WO2007081150A1 - Method defining nal unit type and system of transmission bitstream and redundant slice coding - Google Patents

Method defining nal unit type and system of transmission bitstream and redundant slice coding Download PDF

Info

Publication number
WO2007081150A1
WO2007081150A1 PCT/KR2007/000169 KR2007000169W WO2007081150A1 WO 2007081150 A1 WO2007081150 A1 WO 2007081150A1 KR 2007000169 W KR2007000169 W KR 2007000169W WO 2007081150 A1 WO2007081150 A1 WO 2007081150A1
Authority
WO
WIPO (PCT)
Prior art keywords
nal unit
bitstream
coded picture
header
redundant
Prior art date
Application number
PCT/KR2007/000169
Other languages
French (fr)
Inventor
Hae-Chul Choi
Jae-Gon Kim
Jin-Woo Hong
Hae-Kwang Kim
Jie Jia
Original Assignee
Electronics And Telecommunications Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electronics And Telecommunications Research Institute filed Critical Electronics And Telecommunications Research Institute
Publication of WO2007081150A1 publication Critical patent/WO2007081150A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/65Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • the present invention relates to a method of indicating a network abstraction layer (NAL) unit type and apparatuses for transmitting a bitstream and coding a redundant slice, and more particularly, to a method and apparatus for directly indicating a redundant coded picture in a NAL unit type in order to transmit a bitstream or perform coding using error resilient coding methods such as H.264/AVC, scalable video coding (SVC), and multi-view coding (MVC).
  • NAL network abstraction layer
  • PLRs packet loss rates
  • a bandwidth used to transmit protection data can be used to transmit the error protection data. In this way, the bandwidth can be reasonably assigned between the error protection data and video data.
  • the redundant coded slice can be identified by parsing a slice header.
  • SVC scalable video coding
  • MVC multi-view coding
  • an auxiliary coded picture is indicated by a syntax element aux_format_idc.
  • nal_unit_type 19 is used to indicate that the coded slice in a current NAL Unit is a part of one auxiliary coded picture.
  • the NAL Unit that is the nal_unit_type 19 does not exist in the bitstream.
  • FIG. 1 illustrates a location relationship between a video coding layer (VCL) and a network abstraction layer (NAL) in H/264/AVC according to an embodiment of the present invention
  • FIG. 2 is a block diagram of a network intermediate node for regulating error resilience according to an embodiment of the present invention
  • FIG. 3 is a block diagram of a bitstream transmission device disposed between an encoder and a decoder according to an embodiment of the present invention
  • FIG. 4 is a block diagram of a redundant slice encoding device according to an embodiment of the present invention.
  • FIG. 5 is a table illustrating changes in syntax of nal_unit-type according to an embodiment of the present invention.
  • FIG. 6 is a table illustrating changes in syntax of nal_unit-type according to another embodiment of the present invention.
  • FIG. 7 is a flowchart of a bitstream transmitting method according to an embodiment of the present invention.
  • FIG. 8 is a flowchart of a coding method according to an embodiment of the present invention.
  • FIG. 9 is a flowchart of a coding method based on the status of a network according to an embodiment of the present invention.
  • the present invention provides a method of indicating a current network abstraction layer (NAL) unit as a redundant coded picture using nal-unit-type 19 when an auxiliary coded picture is not used.
  • NAL network abstraction layer
  • the present invention also provides a codec including an encoder and a decoder for performing redundant slice coding using the method.
  • the present invention also provides a system for simply parsing a parsing NAL unit header without parsing a slice header in a network node, selecting a redundant coded picture, resiliently transmitting the redundant coded picture, and adjusting error-resilience using the method. Disclosure of the Invention
  • an encoder for coding a redundant slice comprising: if a predetermined network abstraction layer (NAL) unit of a bitstream is a redundant coded picture, recording a NAL unit type indicating the redundant coded picture on a header of a NAL unit and encoding the bitstream.
  • NAL network abstraction layer
  • a decoder for coding a redundant slice comprising: parsing a header of a predetermined NAL unit of a bitstream, determining if a NAL unit type indicating a redundant coded picture exists in the bitstream, and decoding the bitstream.
  • a bitstream transmitting apparatus comprising: a header parser parsing a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determining if the NAL unit is the redundant coded picture; and a transmission determiner, wherein if the header parser determines that the NAL unit is the redundant coded picture, the transmission determiner determines whether to transmit the NAL unit according to the status of the network.
  • an apparatus for encoding a redundant slice comprising: an encoder, wherein if a predetermined NAL unit of a bitstream is a redundant coded picture, the encoder records a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encodes the bitstream; a header parser parsing the header of the NAL unit of the encoded bitstream and determining if the NAL unit is the redundant coded picture; and a transmission determiner, wherein if the header parser determines that the NAL unit is the redundant coded picture, the transmission determiner determines whether to transmit the NAL unit according to the status of the network.
  • the method of indicating a NAL unit type does not increase bits in the current H.264/AVC, scalable video coding (SVC), and multi-view coding (MVC), and does not reduce coding compression efficiency.
  • a redundant coded slice non-instantaneous decoder refresh (IDR) picture can be indicated by parsing a header of a NAL unit.
  • the redundant coded slice can be simply and easily discarded without parsing a slice header, which reduces the burden on a processor and allows efficient use of network resources (bandwidth).
  • the network abstraction layer (NAL) unit type is used to indicate a redundant coded picture when H.264/AVC does not use a data partition and a NAL unit to be transmitted is the redundant coded picture.
  • the redundant coded picture indicates a NAL unit type 19.
  • An encoder for coding a redundant slice comprising: if a predetermined network abstraction layer (NAL) unit of a bitstream is a redundant coded picture, recording a NAL unit type indicating the redundant coded picture on a header of a NAL unit and encoding the bitstream.
  • NAL network abstraction layer
  • a NAL unit type 19 may be recorded on the header of the NAL unit and the bitstream may be encoded.
  • a decoder for coding a redundant slice comprising: parsing a header of a predetermined NAL unit of a bitstream, determining if a NAL unit type indicating a redundant coded picture exists in the bitstream, and decoding the bitstream.
  • SVC or MVC is applied to the bitstream, it may be determined if a NAL unit type 19 exists in the bitstream and the bitstream may be decoded.
  • the bitstream may be decoded using a primary coded picture, and, if it is determined that the NAL unit type indicating the redundant coded picture exists in the bitstream, the bitstream may be decoded using one of the primary coded picture and the redundant coded picture.
  • a bitstream transmitting apparatus comprising: a header parser parsing a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determining if the NAL unit is the redundant coded picture; and a transmission determiner, wherein if the header parser determines that the NAL unit is the redundant coded picture, the transmission determiner determines whether to transmit the NAL unit according to the status of the network.
  • the header parser when SVC or MVC is applied to the bitstream, may parse the header of the NAL unit of the bitstream, and, if a NAL unit type 19 is included in the bitstream, may determine the NAL unit as the redundant coded picture.
  • the transmission determiner may transmit or drop the NAL unit according to the status of the network.
  • the transmission determiner may determine whether to transmit the NAL unit to the network according to a packet-loss rate (PLR), an error occurrence rate, or a bandwidth of the network.
  • PLR packet-loss rate
  • a codec for performing redundant slice coding comprising: an encoder, wherein if a predetermined NAL unit of a bitstream is a redundant coded picture, the encoder records a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encodes the bitstream; and a decoder parsing a header of a predetermined NAL unit of the bitstream, determining if a NAL unit type indicating the redundant coded picture exists in the bitstream, and decoding the bitstream.
  • the encoder may record a NAL unit type 19 on the header of the NAL unit and encode the bitstream.
  • the decoder may determine if a NAL unit type 19 exists in the bitstream and may decode the bitstream.
  • the decoder may decode the bitstream using a primary coded picture, and, if the NAL unit type exists in the bitstream, decode the bitstream using one of a primary coded picture and the redundant coded picture.
  • An apparatus for encoding a redundant slice comprising: an encoder, wherein if a predetermined NAL unit of a bitstream is a redundant coded picture, the encoder records a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encodes the bitstream; a header parser parsing the header of the NAL unit of the encoded bitstream and determining if the NAL unit is the redundant coded picture; and a transmission determiner, wherein if the header parser determines that the NAL unit is the redundant coded picture, the transmission determiner determines whether to transmit the NAL unit according to the status of the network.
  • the encoder may record a NAL unit type 19 on the header of the NAL unit and encode the bitstream.
  • the apparatus may further comprise: a decoder, if SVC or MVC is applied to the bitstream, determining if a NAL unit type 19 exists in the bitstream and decoding the bitstream.
  • the transmission determiner may determine whether to transmit the NAL unit to the network according to a PLR, an error occurrence rate, or a bandwidth of the network.
  • the decoder may decode the bitstream using a primary coded picture, and, if the NAL unit type exists in the bitstream, decode the bitstream using one of a primary coded picture and the redundant coded picture.
  • a method of encoding a redundant slice wherein, if a predetermined NAL unit of a bitstream is a redundant coded picture, a NAL unit type indicating the redundant coded picture is recorded on a header of the NAL unit and the bitstream is encoded.
  • a method of decoding a redundant slice comprising: parsing a header of a predetermined NAL unit of a bitstream, determining if a NAL unit type indicating a redundant coded picture exists in the bitstream, and decoding the bitstream.
  • a bitstream transmitting method comprising: (a) parsing a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determining if the NAL unit is the redundant coded picture; and (b) if the header parser determines that the NAL unit is the redundant coded picture, determining whether to transmit the NAL unit according to the status of the network.
  • the header of the NAL unit of the bitstream may be parsed, and, if a NAL unit type 19 is include in the bitstream, the NAL unit may be determined as the redundant coded picture.
  • the NAL unit may be transmitted to the network or dropped according to the status of the network.
  • (b) it may be determined whether the NAL unit is transmitted to the network according to a PLR, an error occurrence rate, or a bandwidth of the network.
  • a method of coding a redundant slice wherein, (a) if a predetermined NAL unit of a bitstream is a redundant coded picture, recording a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encoding the bitstream; and (b) parsing a header of a predetermined NAL unit of a bitstream, determining if a NAL unit type indicating a redundant coded picture exists in the bitstream, and decoding the bitstream.
  • bitstream is decoded using a primary coded picture, and, if it is determined that the NAL unit type indicating the redundant coded picture exists in the bitstream, the bitstream is decoded using one of the primary coded picture and the redundant coded picture.
  • a method of coding a redundant slice wherein, (a) if a predetermined NAL unit of a bitstream is a redundant coded picture, recording a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encoding the bitstream; (b) parsing a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determining if the NAL unit is the redundant coded picture; (c) if the header parser determines that the NAL unit is the redundant coded picture, determining whether to transmit the NAL unit according to the status of the network; and (d) decoding the bitstream using a primary coded picture included in the NAL unit of the bitstream or the redundant coded picture included in the transmitted NAL unit.
  • (b) it may be determined whether the NAL unit is transmitted to the network according to a PLR, an error occurrence rate, or a bandwidth of the network.
  • bitstream is decoded using a primary coded picture, and, if it is determined that the NAL unit type indicating the redundant coded picture exists in the bitstream, the bitstream is decoded using one of the primary coded picture and the redundant coded picture.
  • FIG. 1 illustrates a location relationship between a video coding layer (VCL) and a network abstraction layer (NAL) in H.264/AVC according to an embodiment of the present invention.
  • VCL video coding layer
  • NAL network abstraction layer
  • FIG. 1 H.264/AVC is divided into the VCL 1 the NAL, and a system.
  • a primary coded picture is well-known image compression information that influences a decoding process. That is, the primary coded picture is information indispensable to the decoding process.
  • a redundant coded picture can be understood as a duplicate of the primary coded picture, which is used for error-resilience.
  • the image can be restored as the redundant coded picture.
  • the primary coded picture is basically defined in video standards.
  • the video standards describe how to decode the primary coded picture.
  • An auxiliary coded picture is information auxiliary to the primary coded picture.
  • the redundant coded picture is a kind of auxiliary coded picture.
  • the auxiliary coded picture is not indispensable to the decoding process but is additional information used for a predetermined purpose (for example, the redundant coded picture is used in an error prone environment.
  • redundant slice coding is an effective video communication tool resilient to_packet-loss.
  • the redundant slice coding means that slices are made redundant or are coded using different coding parameters. For example, a redundant slice can be coded with higher quantization
  • the H.264/AVC defines the NAL disposed between the VCL that performs video coding and the lower system that transmits coded information and stores the information so that the VCL and the NAL are separated from each other.
  • Parameter sets such as a sequence parameter set (SPS), a picture parameter set (PPS), and supplemental enhancement information (SEI) (additional information for decoding the VCL including timing information on each picture, information on a predetermined access, etc.) that are coding information on a sequence and pictures are separated from fresh information in the VCL.
  • SPS sequence parameter set
  • PPS picture parameter set
  • SEI Supplemental enhancement information
  • mapping of a bitstream of the lower system such as formatting of an H.264/AVC file, a real-time transport protocol (RTP), an MPEG-2 system, etc. are made based on a basic unit of the NAL, [NAL unit].
  • a header of a NAL unit includes nal_refjdc indicating whether another slice referring to the NAL unit exists and nal_unit_type indicating the type of the NAL unit.
  • the ISO/IEC MEGP part 10 AVC/H.264 standards currently designate a NAL type 19 as a coded slice of an auxiliary coded picture without partitioning slice_layer_without_partioining_rbsp().
  • a slice header needs to be parsed in order to determine if a predetermined NAL unit is the redundant coded picture in an H.264/AVC bitstream.
  • the redundant coded picture is inserted into the H.264/AVC bitstream, thereby increasing decoding quality in a decoder.
  • PLR packet-loss rate
  • the insertion of the redundant coded picture increases a total bit rate, which may deteriorate the average quality of the bitstream. Therefore, it is advantageous that the redundant coded picture is not used in a network having an insignificant PLR.
  • FIG. 2 is a block diagram of a network intermediate node for regulating error resilience according to an embodiment of the present invention.
  • a server which can efficiently regulate an error is assigned to the network intermediate node disposed between an encoder and a decoder.
  • a parsing NAL unit header receives a NAL unit from the encoder, parses the header of the NAL unit, and determines if the NAL unit is a primary coded picture or a redundant coded picture.
  • An extraction unit determines whether the NAL unit, which is determined to be the redundant coded picture, is to be transmitted or dropped according to the status or environment of a network which is transmitted to the decoder.
  • the network intermediate node can easily and conveniently drop the NAL unit which is determined to be the redundant coded picture.
  • the redundant coded picture included in a bitstream is transmitted in a network having a high PLR, and dropped in a network having a low PLR, thereby reducing a total bit rate.
  • FIG. 3 is a block diagram of a bitstream transmission device 310 disposed between an encoder 300 and a decoder 320 according to an embodiment of the present invention.
  • the bitstream transmission device 310 includes a header parser 311 and a transmission determiner 312.
  • the header parser 311 parses a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determines if the NAL unit is the redundant coded picture.
  • scalable video coding SVC
  • MVC multi-view coding
  • the transmission determiner 312 determines whether to transmit or drop the NAL unit according to the status of the network.
  • FIG. 4 is a block diagram of a redundant slice encoding device according to an embodiment of the present invention.
  • the redundant slice encoding device includes an encoder 400, a header parser 410, a transmission determiner 420, and a decoder 430.
  • the encoder 400 records a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encodes the bitstream.
  • the header parser 410 parses the header of the NAL unit of the encoded bitstream and determines if the NAL unit is the redundant coded picture.
  • the transmission determiner 420 determines whether to transmit the NAL unit according to the status of the network.
  • the decoder 430 decodes the bitstream using a primary coded picture or the redundant coded picture included in the NAL unit transmitted from the transmission determiner 420.
  • FIG. 5 is a table illustrating changes in syntax of nal_unit-type according to an embodiment of the present invention.
  • a header of the NAL unit is only parsed to determine if the coded slice is a nal_unit_type 19.
  • FIG. 6 is a table illustrating changes in syntax of nal_unit-type according to another embodiment of the present invention.
  • the SVC standards describe that a nal_unit_type 19 indicates that a coded slice of a current NAL unit does not belong to an IDR picture but instead belongs to a redundant coded picture.
  • a redundant coded slice has information on temporaljevel, dependencyjd, and qualityjevel, which is used to give differential significance to the redundant coded slice.
  • the information on temporaljevel, dependencyjd, and qualityjevel of the current NAL unit can be acquired by only parsing a header of the NAL unit.
  • the redundant coded slice can be selectively dropped according to the environment of a network to which the redundant coded slice is transmitted according to the changes in syntax of nal_unit-type.
  • FIG. 7 is a flowchart of a bitstream transmitting method according to an embodiment of the present invention.
  • a header of a NAL unit of an encoded bitstream including the header of the NAL unit on which the NAL unit type indicating a redundant coded picture is recorded is parsed to determine if the NAL unit is the redundant coded picture (Operation 700).
  • the NAL unit is determined to be the redundant coded picture (Operation 710), it is determined whether to transmit the NAL unit according to the status of the network (Operation 720).
  • FIG. 8 is a flowchart of a coding method according to an embodiment of the present invention. Referring to FIG. 8, if a predetermined NAL unit of a bitstream is a redundant coded picture, a NAL unit type indicating the redundant coded picture is recorded on a header of a NAL unit and the bitstream is encoded (Operation 800).
  • the header of the NAL unit of the encoded bitstream is parsed to determine if a NAL unit type indicating the redundant coded picture exists in the bitstream (Operation 810).
  • the bitstream is decoded using a primary coded picture (Operation 830). If it is determined that the NAL unit type indicating the redundant coded picture exists in the bitstream, the bitstream is decoded using the primary coded picture or the redundant coded picture (Operation 820).
  • FIG. 9 is a flowchart of a coding method based on the status of a network according to an embodiment of the present invention. Referring to FIG. 9, if a predetermined NAL unit of a bitstream is a redundant coded picture, a NAL unit type indicating the redundant coded picture is recorded on a header of a NAL unit and the bitstream is encoded (Operation 900).
  • the header of the NAL unit of the encoded bitstream is parsed to determine if the NAL unit is the redundant coded picture (Operation 910).
  • the NAL unit is the redundant coded picture
  • it is determined whether to transmit the NAL unit according to the status of the network (Operation 920).
  • the bitstream is decoded (Operation 940) using one of a primary coded picture and the redundant coded picture, which exist in the transmitted NAL unit (Operation 930).

Abstract

With current H.264/AVC, scalable video coding (SVC), and multi-view coding (MVC), a redundant coded slice can be identified by parsing a slice header. However, the parsing of the slice header aggravates the burden on a processor and increases costs. A NAL unit type is used to indicate a redundant coded picture when H.264/AVC, SVC, or MVC does not use a data partition and a NAL unit to be transmitted is the redundant coded picture. A bitstream transmitting apparatus includes: a header parser parsing a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determining if the NAL unit is the redundant coded picture; and a transmission determiner, if the header parser determines that the NAL unit is the redundant coded picture, determining whether to transmit the NAL unit to a network according to the status of the network, thereby easily and simply transmitting or dropping the redundant coded slice without parsing a slice header when the bitstream is decoded.

Description

METHOD DEFINING NAL UNIT TYPE AND SYSTEM OF TRANSMISSION BITSTREAM AND REDUNDANT SLICE CODING
TECHNICAL FIELD
The present invention relates to a method of indicating a network abstraction layer (NAL) unit type and apparatuses for transmitting a bitstream and coding a redundant slice, and more particularly, to a method and apparatus for directly indicating a redundant coded picture in a NAL unit type in order to transmit a bitstream or perform coding using error resilient coding methods such as H.264/AVC, scalable video coding (SVC), and multi-view coding (MVC).
BACKGROUND ART
Currently, error resilient coding methods provide scalable video stream error- resilience aimed at predefined network condition. However, in reality, one error resilient scalable video stream may be transmitted over networks with different packet loss rates (PLRs).
In this case, when bit streams that are strongly protected against errors are transmitted over networks with a lower PLR, video compression efficiency is decreased due to the strong protection.
However, if error protection data can be flexibly changed according to network conditions, a bandwidth used to transmit protection data can be used to transmit the error protection data. In this way, the bandwidth can be reasonably assigned between the error protection data and video data.
With current H.264/AVC, scalable video coding (SVC), and multi-view coding (MVC), the redundant coded slice can be identified by parsing a slice header. However, the parsing of the slice header aggravates the burden on a processor and increases costs.
Considering the current H.264/AVC, SVC, and MVC, as in the sequence parameter set extension RBSP syntax, an auxiliary coded picture is indicated by a syntax element aux_format_idc.
When the auxiliary coded picture is used, nal_unit_type 19 is used to indicate that the coded slice in a current NAL Unit is a part of one auxiliary coded picture. When the auxiliary coded picture is not used, the NAL Unit that is the nal_unit_type 19 does not exist in the bitstream. BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates a location relationship between a video coding layer (VCL) and a network abstraction layer (NAL) in H/264/AVC according to an embodiment of the present invention;
FIG. 2 is a block diagram of a network intermediate node for regulating error resilience according to an embodiment of the present invention;
FIG. 3 is a block diagram of a bitstream transmission device disposed between an encoder and a decoder according to an embodiment of the present invention;
FIG. 4 is a block diagram of a redundant slice encoding device according to an embodiment of the present invention;
FIG. 5 is a table illustrating changes in syntax of nal_unit-type according to an embodiment of the present invention;
FIG. 6 is a table illustrating changes in syntax of nal_unit-type according to another embodiment of the present invention;
FIG. 7 is a flowchart of a bitstream transmitting method according to an embodiment of the present invention;
FIG. 8 is a flowchart of a coding method according to an embodiment of the present invention; and
FIG. 9 is a flowchart of a coding method based on the status of a network according to an embodiment of the present invention.
DETAILED DESCRIPTION OF THE INVENTION Technical Goal of the Invention
The present invention provides a method of indicating a current network abstraction layer (NAL) unit as a redundant coded picture using nal-unit-type 19 when an auxiliary coded picture is not used.
The present invention also provides a codec including an encoder and a decoder for performing redundant slice coding using the method.
The present invention also provides a system for simply parsing a parsing NAL unit header without parsing a slice header in a network node, selecting a redundant coded picture, resiliently transmitting the redundant coded picture, and adjusting error-resilience using the method. Disclosure of the Invention
According to an aspect of the present invention, there is provided an encoder for coding a redundant slice, comprising: if a predetermined network abstraction layer (NAL) unit of a bitstream is a redundant coded picture, recording a NAL unit type indicating the redundant coded picture on a header of a NAL unit and encoding the bitstream.
According to another aspect of the present invention, there is provided a decoder for coding a redundant slice, comprising: parsing a header of a predetermined NAL unit of a bitstream, determining if a NAL unit type indicating a redundant coded picture exists in the bitstream, and decoding the bitstream.
According to another aspect of the present invention, there is provided a bitstream transmitting apparatus, comprising: a header parser parsing a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determining if the NAL unit is the redundant coded picture; and a transmission determiner, wherein if the header parser determines that the NAL unit is the redundant coded picture, the transmission determiner determines whether to transmit the NAL unit according to the status of the network.
According to another aspect of the present invention, there is provided an apparatus for encoding a redundant slice, comprising: an encoder, wherein if a predetermined NAL unit of a bitstream is a redundant coded picture, the encoder records a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encodes the bitstream; a header parser parsing the header of the NAL unit of the encoded bitstream and determining if the NAL unit is the redundant coded picture; and a transmission determiner, wherein if the header parser determines that the NAL unit is the redundant coded picture, the transmission determiner determines whether to transmit the NAL unit according to the status of the network.
Effect of the Invention
The method of indicating a NAL unit type does not increase bits in the current H.264/AVC, scalable video coding (SVC), and multi-view coding (MVC), and does not reduce coding compression efficiency.
When an auxiliary coded picture or data partition is used, current video coding standards remain unchanged.
When the auxiliary coded picture and data partition is not used, a redundant coded slice non-instantaneous decoder refresh (IDR) picture can be indicated by parsing a header of a NAL unit. In this way, the redundant coded slice can be simply and easily discarded without parsing a slice header, which reduces the burden on a processor and allows efficient use of network resources (bandwidth).
BEST MODE FOR CARRYING OUT THE INVENTION
The network abstraction layer (NAL) unit type is used to indicate a redundant coded picture when H.264/AVC does not use a data partition and a NAL unit to be transmitted is the redundant coded picture.
In scalable video coding or multi-view coding, the redundant coded picture indicates a NAL unit type 19.
An encoder for coding a redundant slice, comprising: if a predetermined network abstraction layer (NAL) unit of a bitstream is a redundant coded picture, recording a NAL unit type indicating the redundant coded picture on a header of a NAL unit and encoding the bitstream.
If scalable video coding (SVC) or multi-view coding (MVC) is applied to the bitstream, a NAL unit type 19 may be recorded on the header of the NAL unit and the bitstream may be encoded.
A decoder for coding a redundant slice, comprising: parsing a header of a predetermined NAL unit of a bitstream, determining if a NAL unit type indicating a redundant coded picture exists in the bitstream, and decoding the bitstream.
If SVC or MVC is applied to the bitstream, it may be determined if a NAL unit type 19 exists in the bitstream and the bitstream may be decoded.
If it is determined that the NAL unit type indicating the redundant coded picture does not exist in the bitstream, the bitstream may be decoded using a primary coded picture, and, if it is determined that the NAL unit type indicating the redundant coded picture exists in the bitstream, the bitstream may be decoded using one of the primary coded picture and the redundant coded picture.
A bitstream transmitting apparatus, comprising: a header parser parsing a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determining if the NAL unit is the redundant coded picture; and a transmission determiner, wherein if the header parser determines that the NAL unit is the redundant coded picture, the transmission determiner determines whether to transmit the NAL unit according to the status of the network. The header parser, when SVC or MVC is applied to the bitstream, may parse the header of the NAL unit of the bitstream, and, if a NAL unit type 19 is included in the bitstream, may determine the NAL unit as the redundant coded picture.
The transmission determiner may transmit or drop the NAL unit according to the status of the network.
The transmission determiner may determine whether to transmit the NAL unit to the network according to a packet-loss rate (PLR), an error occurrence rate, or a bandwidth of the network.
A codec for performing redundant slice coding, comprising: an encoder, wherein if a predetermined NAL unit of a bitstream is a redundant coded picture, the encoder records a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encodes the bitstream; and a decoder parsing a header of a predetermined NAL unit of the bitstream, determining if a NAL unit type indicating the redundant coded picture exists in the bitstream, and decoding the bitstream.
If SVC or MVC is applied to the bitstream, the encoder may record a NAL unit type 19 on the header of the NAL unit and encode the bitstream.
If SVC or MVC is applied to the bitstream, the decoder may determine if a NAL unit type 19 exists in the bitstream and may decode the bitstream.
The decoder, wherein if a NAL unit type indicating the redundant coded picture does not exist in the bitstream, may decode the bitstream using a primary coded picture, and, if the NAL unit type exists in the bitstream, decode the bitstream using one of a primary coded picture and the redundant coded picture.
An apparatus for encoding a redundant slice, comprising: an encoder, wherein if a predetermined NAL unit of a bitstream is a redundant coded picture, the encoder records a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encodes the bitstream; a header parser parsing the header of the NAL unit of the encoded bitstream and determining if the NAL unit is the redundant coded picture; and a transmission determiner, wherein if the header parser determines that the NAL unit is the redundant coded picture, the transmission determiner determines whether to transmit the NAL unit according to the status of the network.
If SVC or MVC is applied to the bitstream, the encoder may record a NAL unit type 19 on the header of the NAL unit and encode the bitstream.
The apparatus may further comprise: a decoder, if SVC or MVC is applied to the bitstream, determining if a NAL unit type 19 exists in the bitstream and decoding the bitstream.
The transmission determiner may determine whether to transmit the NAL unit to the network according to a PLR, an error occurrence rate, or a bandwidth of the network.
The decoder, wherein if a NAL unit type indicating the redundant coded picture does not exist in the bitstream, may decode the bitstream using a primary coded picture, and, if the NAL unit type exists in the bitstream, decode the bitstream using one of a primary coded picture and the redundant coded picture.
A method of encoding a redundant slice, wherein, if a predetermined NAL unit of a bitstream is a redundant coded picture, a NAL unit type indicating the redundant coded picture is recorded on a header of the NAL unit and the bitstream is encoded.
A method of decoding a redundant slice, comprising: parsing a header of a predetermined NAL unit of a bitstream, determining if a NAL unit type indicating a redundant coded picture exists in the bitstream, and decoding the bitstream.
A bitstream transmitting method, comprising: (a) parsing a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determining if the NAL unit is the redundant coded picture; and (b) if the header parser determines that the NAL unit is the redundant coded picture, determining whether to transmit the NAL unit according to the status of the network.
In (a), when SVC or MVC is applied to the bitstream, the header of the NAL unit of the bitstream may be parsed, and, if a NAL unit type 19 is include in the bitstream, the NAL unit may be determined as the redundant coded picture.
In (b), the NAL unit may be transmitted to the network or dropped according to the status of the network.
In (b), it may be determined whether the NAL unit is transmitted to the network according to a PLR, an error occurrence rate, or a bandwidth of the network.
A method of coding a redundant slice, wherein, (a) if a predetermined NAL unit of a bitstream is a redundant coded picture, recording a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encoding the bitstream; and (b) parsing a header of a predetermined NAL unit of a bitstream, determining if a NAL unit type indicating a redundant coded picture exists in the bitstream, and decoding the bitstream.
In (a), if SVC or MVC is applied to the bitstream, a NAL unit type 19 is recorded on the header of the NAL unit and the bitstream is encoded. In (b), if SVC or MVC is applied to the bitstream, determining if a NAL unit type 19 exists in the bitstream and decoding the bitstream.
In (b), if it is determined that the NAL unit type indicating the redundant coded picture does not exist in the bitstream, the bitstream is decoded using a primary coded picture, and, if it is determined that the NAL unit type indicating the redundant coded picture exists in the bitstream, the bitstream is decoded using one of the primary coded picture and the redundant coded picture.
A method of coding a redundant slice, wherein, (a) if a predetermined NAL unit of a bitstream is a redundant coded picture, recording a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encoding the bitstream; (b) parsing a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determining if the NAL unit is the redundant coded picture; (c) if the header parser determines that the NAL unit is the redundant coded picture, determining whether to transmit the NAL unit according to the status of the network; and (d) decoding the bitstream using a primary coded picture included in the NAL unit of the bitstream or the redundant coded picture included in the transmitted NAL unit.
In (a), if SVC or MVC is applied to the bitstream, a NAL unit type 19 is recorded on the header of the NAL unit and the bitstream is encoded.
In (b), if SVC or MVC is applied to the bitstream, determining if a NAL unit type 19 exists in the bitstream and decoding the bitstream.
In (b), it may be determined whether the NAL unit is transmitted to the network according to a PLR, an error occurrence rate, or a bandwidth of the network.
In (d), if it is determined that the NAL unit type indicating the redundant coded picture does not exist in the bitstream, the bitstream is decoded using a primary coded picture, and, if it is determined that the NAL unit type indicating the redundant coded picture exists in the bitstream, the bitstream is decoded using one of the primary coded picture and the redundant coded picture.
EMBODIMENTS
FIG. 1 illustrates a location relationship between a video coding layer (VCL) and a network abstraction layer (NAL) in H.264/AVC according to an embodiment of the present invention. Referring to FIG. 1 , H.264/AVC is divided into the VCL1 the NAL, and a system. A primary coded picture is well-known image compression information that influences a decoding process. That is, the primary coded picture is information indispensable to the decoding process.
A redundant coded picture can be understood as a duplicate of the primary coded picture, which is used for error-resilience.
If the primary coded picture loss occurs in an error-prone environment, the image can be restored as the redundant coded picture.
The primary coded picture is basically defined in video standards. The video standards describe how to decode the primary coded picture.
Therefore, a non-error environment does not need the redundant coded picture but requires the primary coded picture. Thus, the video standards describe that the redundant coded picture is not allowed to influence the decoding process.
An auxiliary coded picture is information auxiliary to the primary coded picture. The redundant coded picture is a kind of auxiliary coded picture. The auxiliary coded picture is not indispensable to the decoding process but is additional information used for a predetermined purpose (for example, the redundant coded picture is used in an error prone environment.
In H.264/AVC error resilience tools, redundant slice coding is an effective video communication tool resilient to_packet-loss. The redundant slice coding means that slices are made redundant or are coded using different coding parameters. For example, a redundant slice can be coded with higher quantization
(QP)-
The H.264/AVC defines the NAL disposed between the VCL that performs video coding and the lower system that transmits coded information and stores the information so that the VCL and the NAL are separated from each other.
Parameter sets such as a sequence parameter set (SPS), a picture parameter set (PPS), and supplemental enhancement information (SEI) (additional information for decoding the VCL including timing information on each picture, information on a predetermined access, etc.) that are coding information on a sequence and pictures are separated from fresh information in the VCL.
In addition, mapping of a bitstream of the lower system such as formatting of an H.264/AVC file, a real-time transport protocol (RTP), an MPEG-2 system, etc. are made based on a basic unit of the NAL, [NAL unit]. A header of a NAL unit includes nal_refjdc indicating whether another slice referring to the NAL unit exists and nal_unit_type indicating the type of the NAL unit. The ISO/IEC MEGP part 10 AVC/H.264 standards currently designate a NAL type 19 as a coded slice of an auxiliary coded picture without partitioning slice_layer_without_partioining_rbsp().
A slice header needs to be parsed in order to determine if a predetermined NAL unit is the redundant coded picture in an H.264/AVC bitstream.
If a network has a high packet-loss rate (PLR) when the H.264/AVC bitstream is transmitted, the redundant coded picture is inserted into the H.264/AVC bitstream, thereby increasing decoding quality in a decoder.
However, the insertion of the redundant coded picture increases a total bit rate, which may deteriorate the average quality of the bitstream. Therefore, it is advantageous that the redundant coded picture is not used in a network having an insignificant PLR.
FIG. 2 is a block diagram of a network intermediate node for regulating error resilience according to an embodiment of the present invention. Referring to FIG. 2, a server which can efficiently regulate an error is assigned to the network intermediate node disposed between an encoder and a decoder. A parsing NAL unit header receives a NAL unit from the encoder, parses the header of the NAL unit, and determines if the NAL unit is a primary coded picture or a redundant coded picture. An extraction unit determines whether the NAL unit, which is determined to be the redundant coded picture, is to be transmitted or dropped according to the status or environment of a network which is transmitted to the decoder.
The network intermediate node can easily and conveniently drop the NAL unit which is determined to be the redundant coded picture. In detail, the redundant coded picture included in a bitstream is transmitted in a network having a high PLR, and dropped in a network having a low PLR, thereby reducing a total bit rate.
FIG. 3 is a block diagram of a bitstream transmission device 310 disposed between an encoder 300 and a decoder 320 according to an embodiment of the present invention. Referring to FIG. 3, the bitstream transmission device 310 includes a header parser 311 and a transmission determiner 312.
The header parser 311 parses a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determines if the NAL unit is the redundant coded picture.
When scalable video coding (SVC) or multi-view coding (MVC) is applied to the bitstream, if it is determined that a NAL unit type 19 exists in the bitstream by parsing the header of the NAL unit of the bitstream, the NAL unit is determined as the redundant coded picture.
If the header parser 311 determines that the NAL unit is the redundant coded picture, the transmission determiner 312 determines whether to transmit or drop the NAL unit according to the status of the network.
FIG. 4 is a block diagram of a redundant slice encoding device according to an embodiment of the present invention. Referring to FIG. 4, the redundant slice encoding device includes an encoder 400, a header parser 410, a transmission determiner 420, and a decoder 430.
If a predetermined NAL unit of a bitstream is a redundant coded picture, the encoder 400 records a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encodes the bitstream.
The header parser 410 parses the header of the NAL unit of the encoded bitstream and determines if the NAL unit is the redundant coded picture.
If the header parser 410 determines that the NAL unit is the redundant coded picture, the transmission determiner 420 determines whether to transmit the NAL unit according to the status of the network.
The decoder 430 decodes the bitstream using a primary coded picture or the redundant coded picture included in the NAL unit transmitted from the transmission determiner 420.
FIG. 5 is a table illustrating changes in syntax of nal_unit-type according to an embodiment of the present invention. Referring to FIG. 5, when it is determined that a coded slice of a NAL unit does not belong to an instantaneous decoder refresh (IDR) picture but instead belongs to a redundant coded picture by the changes in context of nal_unit-type, a header of the NAL unit is only parsed to determine if the coded slice is a nal_unit_type 19.
FIG. 6 is a table illustrating changes in syntax of nal_unit-type according to another embodiment of the present invention. The SVC standards describe that a nal_unit_type 19 indicates that a coded slice of a current NAL unit does not belong to an IDR picture but instead belongs to a redundant coded picture.
In this case, a redundant coded slice has information on temporaljevel, dependencyjd, and qualityjevel, which is used to give differential significance to the redundant coded slice.
The information on temporaljevel, dependencyjd, and qualityjevel of the current NAL unit can be acquired by only parsing a header of the NAL unit. Referring to FIG. 6, the redundant coded slice can be selectively dropped according to the environment of a network to which the redundant coded slice is transmitted according to the changes in syntax of nal_unit-type.
FIG. 7 is a flowchart of a bitstream transmitting method according to an embodiment of the present invention. Referring to FIG. 7, a header of a NAL unit of an encoded bitstream including the header of the NAL unit on which the NAL unit type indicating a redundant coded picture is recorded is parsed to determine if the NAL unit is the redundant coded picture (Operation 700).
If the NAL unit is determined to be the redundant coded picture (Operation 710), it is determined whether to transmit the NAL unit according to the status of the network (Operation 720).
FIG. 8 is a flowchart of a coding method according to an embodiment of the present invention. Referring to FIG. 8, if a predetermined NAL unit of a bitstream is a redundant coded picture, a NAL unit type indicating the redundant coded picture is recorded on a header of a NAL unit and the bitstream is encoded (Operation 800).
The header of the NAL unit of the encoded bitstream is parsed to determine if a NAL unit type indicating the redundant coded picture exists in the bitstream (Operation 810).
If it is determined that the NAL unit type indicating the redundant coded picture does not exist in the bitstream, the bitstream is decoded using a primary coded picture (Operation 830). If it is determined that the NAL unit type indicating the redundant coded picture exists in the bitstream, the bitstream is decoded using the primary coded picture or the redundant coded picture (Operation 820).
FIG. 9 is a flowchart of a coding method based on the status of a network according to an embodiment of the present invention. Referring to FIG. 9, if a predetermined NAL unit of a bitstream is a redundant coded picture, a NAL unit type indicating the redundant coded picture is recorded on a header of a NAL unit and the bitstream is encoded (Operation 900).
The header of the NAL unit of the encoded bitstream is parsed to determine if the NAL unit is the redundant coded picture (Operation 910).
If it is determined that the NAL unit is the redundant coded picture, it is determined whether to transmit the NAL unit according to the status of the network (Operation 920). The bitstream is decoded (Operation 940) using one of a primary coded picture and the redundant coded picture, which exist in the transmitted NAL unit (Operation 930). While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention as defined by the following claims. The preferred embodiments should be considered in a descriptive sense only and not for purposes of limitation. Therefore, the scope of the invention is defined not by the detailed description of the invention but by the appended claims, and all differences within the scope will be construed as being included in the present invention.

Claims

1. An encoder for coding a redundant slice, wherein, if a predetermined network abstraction layer (NAL) unit of a bitstream is a redundant coded picture, a NAL unit type indicating the redundant coded picture is recorded on a header of a NAL unit and the bitstream is encoded.
2. The encoder of claim 1 , wherein, if scalable video coding (SVC) or multi-view coding (MVC) is applied to the bitstream, a NAL unit type 19 is recorded on the header of the NAL unit and the bitstream is encoded.
3. A decoder for coding a redundant slice, comprising: parsing a header of a predetermined NAL unit of a bitstream, determining if a NAL unit type indicating a redundant coded picture exists in the bitstream, and decoding the bitstream.
4. The decoder of claim 3, wherein, if SVC or MVC is applied to the bitstream, it is determined if a NAL unit type 19 exists in the bitstream and the bitstream is decoded.
5. The decoder of claim 3, wherein if it is determined that the NAL unit type indicating the redundant coded picture does not exist in the bitstream, the bitstream is decoded using a primary coded picture, and, if it is determined that the NAL unit type indicating the redundant coded picture exists in the bitstream, the bitstream is decoded using one of the primary coded picture and the redundant coded picture.
6. A bitstream transmitting apparatus, comprising: a header parser parsing a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determining if the NAL unit is the redundant coded picture; and a transmission determiner, wherein if the header parser determines that the NAL unit is the redundant coded picture, the transmission determiner determines whether to transmit the NAL unit according to the status of the network.
7. The apparatus of claim 6, wherein the header parser, when SVC or MVC is applied to the bitstream, parses the header of the NAL unit of the bitstream, and, if a NAL unit type 19 is included in the bitstream, determines the NAL unit as the redundant coded picture.
8. The apparatus of claim 6, wherein the transmission determiner transmits or drops the NAL unit according to the status of the network.
9. The apparatus of claim 6, wherein the transmission determiner determines whether to transmit the NAL unit to the network according to a packet- loss rate (PLR), an error occurrence rate, or a bandwidth of the network.
10. An apparatus for encoding a redundant slice, comprising: an encoder, wherein if a predetermined NAL unit of a bitstream is a redundant coded picture, the encoder records a NAL unit type indicating the redundant coded picture on a header of the NAL unit and encodes the bitstream; a header parser parsing the header of the NAL unit of the encoded bitstream and determining if the NAL unit is the redundant coded picture; and a transmission determiner, wherein if the header parser determines that the NAL unit is the redundant coded picture, the transmission determiner determines whether to transmit the NAL unit according to the status of the network.
11. The apparatus of claim 10, wherein, if SVC or MVC is applied to the bitstream, the encoder records a NAL unit type 19 on the header of the NAL unit and encodes the bitstream.
12. The apparatus of claim 10, wherein the transmission determiner determines whether to transmit the NAL unit to the network according to a PLR, an error occurrence rate, or a bandwidth of the network.
13. The apparatus of claim 10, further comprising: a decoder, wherein if a NAL unit type indicating the redundant coded picture does not exist in the bitstream, the decoder decodes the bitstream using a primary coded picture, and, if the NAL unit type exists in the bitstream, decodes the bitstream 2007/000169 using one of a primary coded picture and the redundant coded picture.
14. A method of encoding a redundant slice, wherein, if a predetermined NAL unit of a bitstream is a redundant coded picture, a NAL unit type indicating the redundant coded picture is recorded on a header of the NAL unit and the bitstream is encoded.
15. The method of claim 14, wherein, if SVC or MVC is applied to the bitstream, a NAL unit type 19 is recorded on the header of the NAL unit and the bitstream is encoded.
16. A method of decoding a redundant slice, comprising: parsing a header of a predetermined NAL unit of a bitstream, determining if a NAL unit type indicating a redundant coded picture exists in the bitstream, and decoding the bitstream.
17. The method of claim 16, wherein, if SVC or MVC is applied to the bitstream, determining if a NAL unit type 19 exists in the bitstream and decoding the bitstream.
18. The method of claim 16, wherein if it is determined that the NAL unit type indicating the redundant coded picture does not exist in the bitstream, the bitstream is decoded using a primary coded picture, and, if it is determined that the NAL unit type indicating the redundant coded picture exists in the bitstream, the bitstream is decoded using one of the primary coded picture and the redundant coded picture.
19. A bitstream transmitting method, comprising:
(a) parsing a header of a NAL unit of a coded bitstream including the header of the NAL unit on which a NAL unit type indicating a redundant coded picture is recorded and determining if the NAL unit is the redundant coded picture; and
(b) if the header parser determines that the NAL unit is the redundant coded picture, determining whether to transmit the NAL unit according to the status of the network.
20. The method of claim 19, wherein in (a), when SVC or MVC is applied to the bitstream, the header of the NAL unit of the bitstream is parsed, and, if a NAL unit type 19 is included in the bitstream, the NAL unit is determined as the redundant coded picture.
21. The method of claim 19, wherein in (b), the NAL unit is transmitted to the network or dropped according to the status of the network.
22. The method of claim 19, wherein in (b), it is determined whether the NAL unit is transmitted to the network according to a PLR, an error occurrence rate, or a bandwidth of the network.
PCT/KR2007/000169 2006-01-09 2007-01-09 Method defining nal unit type and system of transmission bitstream and redundant slice coding WO2007081150A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US75727806P 2006-01-09 2006-01-09
US60/757,278 2006-01-09
KR10-2007-0002637 2007-01-09
KR1020070002637A KR100889745B1 (en) 2006-01-09 2007-01-09 Method defining NAL unit type and system of trasmission bitstream and redundant slice coding

Publications (1)

Publication Number Publication Date
WO2007081150A1 true WO2007081150A1 (en) 2007-07-19

Family

ID=38256512

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2007/000169 WO2007081150A1 (en) 2006-01-09 2007-01-09 Method defining nal unit type and system of transmission bitstream and redundant slice coding

Country Status (2)

Country Link
KR (1) KR100889745B1 (en)
WO (1) WO2007081150A1 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008005124A2 (en) * 2006-07-05 2008-01-10 Thomson Licensing Methods and apparatus for multi-view video encoding and decoding
WO2008085876A2 (en) * 2007-01-04 2008-07-17 Thomson Licensing Method and apparatus for video error concealment using high level syntax reference views in multi-view coded video
WO2008126046A2 (en) * 2007-04-13 2008-10-23 Nokia Corporation System and method for using redundant pictures for inter-layer prediction in scalable video coding
WO2012036839A2 (en) * 2010-09-13 2012-03-22 Intel Corporation Techniques enabling video slice alignment for low-latecy video transmissions over mmwave communications
RU2492585C2 (en) * 2008-07-16 2013-09-10 Нокиа Корпорейшн Method and apparatus for track and track subset grouping
JP2017507535A (en) * 2013-12-31 2017-03-16 華為技術有限公司Huawei Technologies Co.,Ltd. Method and apparatus for encoding and decoding video data
CN106537919A (en) * 2014-06-25 2017-03-22 高通股份有限公司 Multi-layer video coding
JP2017513313A (en) * 2014-03-18 2017-05-25 ホアウェイ・テクノロジーズ・カンパニー・リミテッド Method and apparatus for encoding and decoding video data
US10595026B2 (en) 2012-04-16 2020-03-17 Electronics And Telecommunications Research Institute Decoding method and device for bit stream supporting plurality of layers
WO2020055869A1 (en) * 2018-09-14 2020-03-19 Futurewei Technologies, Inc. Improved attribute layers and signaling in point cloud coding
CN113453026A (en) * 2020-03-26 2021-09-28 阿里巴巴集团控股有限公司 Video data processing method and device, electronic equipment and computer storage medium

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100898769B1 (en) * 2007-09-19 2009-05-20 전자부품연구원 Svc video extraction apparatus for real-time video stream and the method thereof
US10313696B2 (en) 2012-03-16 2019-06-04 Lg Electronics Inc Method for storing image information, method for parsing image information and apparatus using same
WO2013165215A1 (en) * 2012-05-04 2013-11-07 엘지전자 주식회사 Method for storing image data, method for parsing image data, and an apparatus for using the same
WO2020226203A1 (en) * 2019-05-08 2020-11-12 엘지전자 주식회사 Transmission apparatus and reception apparatus for parallel data streams

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020176025A1 (en) * 2001-03-05 2002-11-28 Chang-Su Kim Systems and methods for encoding redundant motion vectors in compressed video bitstreams
US20040218669A1 (en) * 2003-04-30 2004-11-04 Nokia Corporation Picture coding method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100543700B1 (en) * 2003-01-30 2006-01-20 삼성전자주식회사 A method and an apparatus for redundant image encoding and decoding

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020176025A1 (en) * 2001-03-05 2002-11-28 Chang-Su Kim Systems and methods for encoding redundant motion vectors in compressed video bitstreams
US20040218669A1 (en) * 2003-04-30 2004-11-04 Nokia Corporation Picture coding method

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008005124A2 (en) * 2006-07-05 2008-01-10 Thomson Licensing Methods and apparatus for multi-view video encoding and decoding
WO2008005124A3 (en) * 2006-07-05 2008-04-24 Thomson Licensing Methods and apparatus for multi-view video encoding and decoding
WO2008085876A2 (en) * 2007-01-04 2008-07-17 Thomson Licensing Method and apparatus for video error concealment using high level syntax reference views in multi-view coded video
WO2008085876A3 (en) * 2007-01-04 2008-10-09 Thomson Licensing Method and apparatus for video error concealment using high level syntax reference views in multi-view coded video
WO2008126046A2 (en) * 2007-04-13 2008-10-23 Nokia Corporation System and method for using redundant pictures for inter-layer prediction in scalable video coding
WO2008126046A3 (en) * 2007-04-13 2009-02-19 Nokia Corp System and method for using redundant pictures for inter-layer prediction in scalable video coding
RU2492585C2 (en) * 2008-07-16 2013-09-10 Нокиа Корпорейшн Method and apparatus for track and track subset grouping
WO2012036839A2 (en) * 2010-09-13 2012-03-22 Intel Corporation Techniques enabling video slice alignment for low-latecy video transmissions over mmwave communications
WO2012036839A3 (en) * 2010-09-13 2012-05-10 Intel Corporation Techniques enabling video slice alignment for low-latecy video transmissions over mmwave communications
US9049493B2 (en) 2010-09-13 2015-06-02 Intel Corporation Techniques enabling video slice alignment for low-latecy video transmissions over mmWave communications
US10958918B2 (en) 2012-04-16 2021-03-23 Electronics And Telecommunications Research Institute Decoding method and device for bit stream supporting plurality of layers
US11483578B2 (en) 2012-04-16 2022-10-25 Electronics And Telecommunications Research Institute Image information decoding method, image decoding method, and device using same
US11949890B2 (en) 2012-04-16 2024-04-02 Electronics And Telecommunications Research Institute Decoding method and device for bit stream supporting plurality of layers
US10595026B2 (en) 2012-04-16 2020-03-17 Electronics And Telecommunications Research Institute Decoding method and device for bit stream supporting plurality of layers
US11490100B2 (en) 2012-04-16 2022-11-01 Electronics And Telecommunications Research Institute Decoding method and device for bit stream supporting plurality of layers
US10602160B2 (en) 2012-04-16 2020-03-24 Electronics And Telecommunications Research Institute Image information decoding method, image decoding method, and device using same
US10958919B2 (en) 2012-04-16 2021-03-23 Electronics And Telecommunications Resarch Institute Image information decoding method, image decoding method, and device using same
JP2017507535A (en) * 2013-12-31 2017-03-16 華為技術有限公司Huawei Technologies Co.,Ltd. Method and apparatus for encoding and decoding video data
JP2017513313A (en) * 2014-03-18 2017-05-25 ホアウェイ・テクノロジーズ・カンパニー・リミテッド Method and apparatus for encoding and decoding video data
US10313703B2 (en) 2014-03-18 2019-06-04 Huawei Technologies Co., Ltd. Video data encoding and decoding methods and apparatuses
CN106537919B (en) * 2014-06-25 2019-07-05 高通股份有限公司 For decoding the method, apparatus and equipment of multi-layer video data
CN106537919A (en) * 2014-06-25 2017-03-22 高通股份有限公司 Multi-layer video coding
WO2020055869A1 (en) * 2018-09-14 2020-03-19 Futurewei Technologies, Inc. Improved attribute layers and signaling in point cloud coding
CN113453026A (en) * 2020-03-26 2021-09-28 阿里巴巴集团控股有限公司 Video data processing method and device, electronic equipment and computer storage medium

Also Published As

Publication number Publication date
KR20070074503A (en) 2007-07-12
KR100889745B1 (en) 2009-03-24

Similar Documents

Publication Publication Date Title
WO2007081150A1 (en) Method defining nal unit type and system of transmission bitstream and redundant slice coding
CN1934865B (en) Method and device for resizing of buffer in encoder and decoder
US9332254B2 (en) Coding, storage and signalling of scalability information
FI115589B (en) Encoding and decoding redundant images
KR101558116B1 (en) Switching between representations during network streaming of coded multimedia data
US9560367B2 (en) Parameter set and picture header in video coding
US8767818B2 (en) Backward-compatible aggregation of pictures in scalable video coding
CN109257623B (en) Method for decoding picture and electronic device for decoding picture
US20130064284A1 (en) Encoder And Method Thereof For Encoding a Representation of a Picture of a Video Stream
US20040218669A1 (en) Picture coding method
US6215824B1 (en) Transcoding method for digital video networking
JP2006524947A (en) Picture sequence encoding method
EP2754302A1 (en) Network streaming of coded video data
EP1499938A2 (en) Generic adaptation layer for jvt video
JP2006319992A (en) Packet transfer apparatus and method for multimedia streaming service therefor
CN101742289B (en) Method, system and device for compressing video code stream
CA2646870A1 (en) Method for protecting multimedia data using additional network abstraction layers (nal)
US11765444B2 (en) Streaming media data including an addressable resource index track
US20130114743A1 (en) Encoder, decoder and methods thereof for reference picture management
CN106303539B (en) A kind of unequal error transmission protecting based on H.264 video message type
JP2011172153A (en) Media encoding and transmitting apparatus
US20070019725A1 (en) Motion image data converting method, apparatus and program
CN110636387A (en) H.264 network-based video transmission system
Ibrahim et al. Implementation of error resilience technique for Multiview Video Coding
Wang avtcore S. Zhao Internet-Draft S. Wenger Intended status: Standards Track Tencent Expires: May 6, 2021 Y. Sanchez Fraunhofer HHI

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07708466

Country of ref document: EP

Kind code of ref document: A1