US9106915B2 - Video coding and decoding devices and methods and systems thereof - Google Patents

Video coding and decoding devices and methods and systems thereof Download PDF

Info

Publication number
US9106915B2
US9106915B2 US11/754,035 US75403507A US9106915B2 US 9106915 B2 US9106915 B2 US 9106915B2 US 75403507 A US75403507 A US 75403507A US 9106915 B2 US9106915 B2 US 9106915B2
Authority
US
United States
Prior art keywords
redundant
stream
prediction error
macroblocks
macroblock
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US11/754,035
Other versions
US20080037635A1 (en
Inventor
Dong Li
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Assigned to LENOVO (BEIJING) LIMITED reassignment LENOVO (BEIJING) LIMITED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LI, DONG
Publication of US20080037635A1 publication Critical patent/US20080037635A1/en
Application granted granted Critical
Publication of US9106915B2 publication Critical patent/US9106915B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Definitions

  • the present invention relates to a field of video transmission, such as videophone conference system, and more particularly to a video coding device, a video decoding device, a video coding method, a video decoding method and a system thereof, which divide and hierarchically encode various video contents according to predefined criteria and then transmit them so as to ensure QoS for the transmitted video contents.
  • Main Profile in H.264 provides a Redundant Slices technique.
  • This technique applies a same method for adding redundant information to any content information, and thus cannot effectively provide corresponding protections for different video contents. Therefore, QoS for video content cannot be guaranteed in the case of a bad network quality.
  • An object of the present invention is to provide a video coding device, a video decoding device, a video coding method, a video decoding method and a system thereof, which divide and hierarchically encode different video contents according to predefined criteria and then transmit them so as to ensure QoS for the transmitted video contents.
  • a coding device which comprises a video coder for performing video coding on a frame including a plurality of macroblocks by a predefined coding technique so as to output a normal coded stream and for outputting a prediction error value for each of the macroblocks obtained through inter-frame movement prediction, a grading means for grading the macroblocks based on the prediction error values and allocating redundant bits to macroblocks at respective grades, a redundant coder for generating redundant information indicated by corresponding redundant bits for each of the graded macroblock, and a merger means for merging said normal coded stream and said redundant information to generate a resulting coded stream.
  • said grading means dynamically determines the number and method for grading based on at least one of coded bit rate requirement and prediction error value for an actual video frame.
  • said grading means classifies to one and same grade the macroblocks for which the prediction error values are similar to each other, and executes the grading in an increment or decrement order of the prediction error values.
  • the number of redundant bits allocated to a macroblock belonging to a grade of a greater prediction error value by said grading means is greater than that to a macroblock belonging to a grade of a smaller prediction error value.
  • said redundant coder allocates redundant bits to the macroblocks at respective grades based on a predefined bit rate, and the number of the redundant bit can be zero.
  • said redundant information includes at least one of a low-precision original image, a low-precision original image and check code, a low-precision prediction error value as well as a low-precision prediction error value and check code.
  • said predefined coding technique is one of H.264, H.263, MPEG2 and MPEG4.
  • a decoding device which comprises a split means for splitting a coded stream received via a channel into a normal stream and a redundant stream, a video decoder for decoding said normal stream by a predefined decoding technique, a redundant decoder for acquiring a corresponding substitute stream from said redundant stream in the case of an error occurring in the decoded normal stream, and an error masking means for replacing an erroneous portion in the decoded normal stream with said substitute stream.
  • said redundant stream includes redundant code.
  • said redundant stream includes redundant code and check code.
  • said redundant code includes at least one of a low-precision original image and a low-precision prediction error value.
  • said predefined coding technique is one of H.264, H.263, MPEG2 and MPEG4.
  • said error masking means when an error occurs in the stream, if there is redundant information at the same grade as a macroblock, said error masking means substitutes the stream for the corresponding macroblock with decoded redundant information.
  • said error masking means acquires the stream for the corresponding macroblock in a previous frame from a buffer area as said substitute stream.
  • a coding method comprising the steps of performing video coding on a frame including a plurality of macroblocks by a predefined coding technique so as to output a normal coded stream, and simultaneously outputting a prediction error value for each of the macroblocks through inter-frame movement prediction; grading the macroblocks based on the prediction error values, and allocating redundant bits to macroblocks at respective grades; generating redundant information indicated by corresponding redundant bit for the graded macroblocks; and merging said normal coded stream and said redundant information to generate a resulting coded stream.
  • the macroblocks for which the inter-frame prediction error values are similar to each other are classified to one and same grade, the grading is executed in an increment or decrement order of the prediction error values.
  • the number of redundant bits allocated to a macroblock belonging to a grade of a greater prediction error value is greater than that to a macroblock belonging to a grade of a smaller prediction error value.
  • the number and method for grading are dynamically determined based on at least one of coded bit rate requirement and prediction error value for an actual video frame.
  • a decoding method comprising steps of splitting a coded stream received via a channel into a normal stream and a redundant stream; decoding said normal stream by a predefined decoding technique; acquiring a corresponding substitute stream from said redundant stream in the case of an error occurring in the decoded normal stream; and replacing an erroneous portion in the decoded normal stream with said substitute stream.
  • said method when an error occurs in the stream, if there is redundant information at the same grade as a macroblock, said method further comprises a step of substituting the stream for the corresponding macroblock with decoded redundant information.
  • said method when an error occurs in the stream, if there isn't redundant information at the same grade as a macroblock, said method further comprises a step of acquiring the stream for the corresponding macroblock in a previous frame from a buffer area as said substitute stream.
  • bit rate will not be increased significantly with content transmission quality being guaranteed.
  • FIG. 1 shows a schematic diagram for explaining how to grade macroblocks in a video frame based on bit plane
  • FIG. 2 shows a schematic diagram for explaining the process of macroblock grading
  • FIG. 3 shows stream content and transmission mode used in the present invention
  • FIG. 4 is a functional block diagram of a video transmission system according to an embodiment of the present invention.
  • FIG. 5A is a flowchart for a video coding method according to an embodiment of the present invention.
  • FIG. 5B is a flowchart for a video decoding method according to an embodiment of the present invention.
  • FIG. 1 shows a schematic diagram for explaining how to grade macroblocks in a video frame based on bit plane.
  • a current frame is predicted with respect to a previous frame of a picture.
  • video macroblocks are graded in a similar manner to bit plane based on the magnitude of each prediction error value. All the macroblocks with the largest prediction error value are mapped to slice 1 , all the macroblocks with smaller prediction error value are mapped to slice 2 and so on, and the number of slices is determined as required.
  • FIG. 2 shows a schematic diagram for explaining the process of macroblock grading.
  • (A) denotes a frame neighboring to a frame denoted by (B)
  • (C) represents a difference image between a frame predicted with respect to (A) and (B), that is, a prediction difference image.
  • the diagram (D) in FIG. 2 shows slices to which different macroblocks in the prediction difference image are mapped, and and in FIG. 2 represent slice 1 and 2 , respectively.
  • Other macroblocks can be coded in a manner identical to normal coding, for those macroblocks with larger prediction errors, however, redundant information will be allocated to ensure transmission quality of video content.
  • redundant bits are allocated to different slices at coding end, and the redundant information can be but not limited to a low-precision original image plus check code or a low-precision prediction error value plus check code. It is obvious that check code is not necessary here.
  • the number of the redundant bits allocated to slice 1 is the largest, and that allocated to slice 2 is smaller, and in this way, the number decreases one by one. Accordingly, for those video content with larger movement prediction errors, it is allowed to add more redundant bits so that a better error masking processing can be ensured at decoding side if a transmission error occurs. By allocating a smaller number of redundant bits to those video content with less movement prediction errors, it can be ensured that the stream is controllable as a whole, and if a transmission error occurs, since the prediction error is small, even there is no redundant bit for error masking, compensation can be made directly using a reference image without any serious deterioration in quality.
  • redundant code and check code can be transmitted via a same channel or separated from each other so as to transmit the check code via a reliable channel and the normal stream and the redundant code via another channel.
  • the actual number of grades and the used method are determined dynamically based on the actual bit rate requirement and video content.
  • the finer and more the grades are the more redundant bits need to be allocated, and the larger the movement prediction error between video frames is, the more redundant information is needed.
  • a higher bit rate allows more and finer grades to protect more macroblock data, while a lower bit rate allows allocating only fewer grades for protection.
  • a larger overall inter-frame prediction error requires more grades, while a smaller overall inter-frame prediction error can be protected with fewer or even no grade.
  • FIG. 4 is a functional block diagram of a video transmission system according to an embodiment of the present invention.
  • a video transmission system includes a video coder 402 , a grading unit 403 , a redundant coding unit 404 and a merger unit 405 .
  • An original video stream is inputted at the input terminal 401 of the coding device.
  • the input video stream enters the video coder 402 , which generates a coded stream by a normal coding on the original video stream and sends to the grading unit 403 bit rate control information as well as movement prediction value between video frames obtained through movement prediction.
  • the grading unit 403 classifies video macroblocks to different protection grades, i.e. different slices, based on the magnitude of the movement prediction value for each of the video macroblocks, and on the other hand, it determines the number of redundant bits for each grade based on the bit rate control information. For example, with a bit rate of 1 Mbps, 8 bits are allocated to the macroblocks classified to slice 1 , 4 bits to slice 2 and 1 bit to slice 3 ; and with a bit rate of 2 Mbps, 16 bits are allocated to the macroblocks classified to slice 1 , 8 bits to slice 2 and 2 bit to slice 3 .
  • the redundant coder 404 generates different redundant information for macroblocks of different grades based on the input original stream and the grade information and the redundant bit number for each macroblocks generated by the grading unit 403 .
  • the redundant information for each macroblock can be but not limited to its low-precision original image plus check code or its low-precision prediction error value plus check code. Also as described above, the check code is not necessary. Packet check code can be selected if check code is used.
  • the merger unit 405 merges the normal stream produced by the video coder 402 and the redundant information produced by the redundant coder 404 into one same video stream and sends it out via a transmission channel 406 .
  • a decoding device in the video transmission system of the present invention includes a split unit 407 , a video decoder 408 , a redundant decoder 410 and a grade-by-grade error masking unit 409 .
  • the split unit 407 receives a stream transmitted over an IP network or a wireless network via the transmission channel 406 and splits the received stream into a normal stream and a redundant stream.
  • the normal stream is a stream which has no addition of redundant information and is generated through a standard coding process, such as H.264, H.263, MPEG2 or MPEG4, while the redundant stream is a stream of the redundant information added on the basis of the above method and grade.
  • the split unit 407 transfers the split normal stream to the video decoder 408 and on the other hand, transfers the redundant stream to the redundant decoder 410 .
  • the video decoder 408 then generates normal decoded information from the normal stream and sends to the redundant decoder 410 error information, that is, information about a macroblock suffering from an error, if some error or missing occurs in the stream.
  • the redundant decoder 410 first judges whether a redundant code for the error-inflicted macroblock exists in the redundant stream. If there is no redundant code for the macroblock, the stream of a corresponding macroblock in a previous frame is extracted from a buffer area for decoding and used as the last-outputted stream of the macroblock in the current frame.
  • the check code is utilized to check the redundant code for the macroblock so that it can be judged whether the redundant code is proper. If the redundant code is proper, a substitute stream for the error-inflicted macroblock is generated from the redundant code and then outputted to the grade-by-grade error masking unit 409 , in which the stream of the error-inflicted macroblock is replaced with the substitute stream, and then a final decoded video stream is outputted after the error masking.
  • the check code is utilized to recover the redundant code, and then the process is carried out as described above.
  • the decoded video frame is outputted at the output terminal 411 for the decoding device.
  • FIG. 5A is a flowchart for a video coding method according to an embodiment of the present invention.
  • an original video stream S is acquired or inputted from a video source in Step S 501 .
  • Step S 502 a normal coding processing is performed on the input original video stream according to predefined coding technique, such as H.264, H.263, MEPG2 or MPEG4, and a movement prediction value for each video macroblock is obtained through inter-frame movement prediction and then outputted. Thereafter, a prediction error is determined as the difference between the inter-frame movement prediction value for each macroblock and its actual value.
  • predefined coding technique such as H.264, H.263, MEPG2 or MPEG4
  • Step S 503 each of the video frames is divided into different protection grades based on the magnitudes of prediction errors for different macroblocks, with the macroblocks being classified into different protection grades slice 1 , slice 2 , . . . , slice N.
  • Step S 504 the number of redundant bits for each grade is determined on the basis of bit rate control information. For example, with a bit rate of 1 Mbps, 8 bits are allocated to the macroblocks classified to slice 1 , 4 bits to slice 2 and 1 bit to slice 3 ; and with a bit rate of 2 Mbps, 16 bits are allocated to the macroblocks classified to slice 1 , 8 bits to slice 2 and 2 bit to slice 3 .
  • Steps S 505 and S 506 different redundant information is generated for the graded microblocks based on the grading result and the bit allocation scheme.
  • the redundant information for each macroblock can be but not limited to its low-precision original image plus check code or its low-precision prediction error value plus check code.
  • error correction code such as packet check code, can be selected as the check code.
  • the robustness of the system will be enhanced if check code is included in the redundant information.
  • Step S 507 it is judged, for each macroblock at each grade, whether the code and its redundant information have been obtained, and if the answer is negative, the flow returns to Step S 504 and the above action is repeated. If the process of N-grade coding has been completed, the code plus redundancy is transferred sequentially in Step S 408 until the code transmission has been fulfilled for all the protection grades.
  • FIG. 5B is a flowchart for a video decoding method according to an embodiment of the present invention.
  • a stream is received via a transmission channel in Step S 511 .
  • Step S 512 it is judged whether the received stream of a current frame is correct in Step S 512 , and if it is correct, the flow proceeds directly to Step S 516 , and a decoding process is performed on the coded stream of the current frame in an order reverse to that at coding side.
  • Step S 516 If there is no redundant code for the macroblock in the stream, a corresponding macroblock in a previous decoded frame is extracted from a buffer area and used as the decoded result of the above macroblock. The flow then proceeds to Step S 516 and continues the subsequent decoding.
  • Step S 514 If there is redundant code for the macroblock in the stream, it is judged whether the redundant code is proper in Step S 514 . If it is improper, a corresponding check code is acquired in Step S 518 , and thereafter, in Step S 519 , the redundant code is corrected using the check code to obtain a proper redundant code.
  • Step S 515 a substitute stream of the corresponding macroblock is obtained from the proper redundant code, and if the decoding process has been fulfilled for the macroblock at all grades, a decoded stream S′ is outputted for the current frame.
  • the present invention when compared with the existing error masking methods, has the two primary advantages as follows. First, the importance degree of video content has been given sufficient consideration so that error recovery can be priorly guaranteed for important content even if some transmission error occurs, thereby preventing remarkable degradation in video quality. Second, since the bit number for the added redundant information depends on different grades, the overall bit rate can be controlled.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Disclosed are Video coding and decoding devices, methods and system thereof, in which the video coding device comprises a video coder for performing video coding on a frame including a plurality of macroblocks by a predefined coding technique so as to output a normal coded stream and for outputting a prediction error value for each of the macroblocks obtained through inter-frame movement prediction, a grading means for grading the macroblocks based on the prediction error values and allocating redundant bit to macroblocks at respective grades, a redundant coder for generating redundant information indicated by corresponding redundant bit for each of the graded macroblock, and a merger means for merging said normal coded stream and said redundant information to generate a final coded stream. With the configuration of the present invention, bit rate will not be increased significantly with content transmission quality being guaranteed.

Description

BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a field of video transmission, such as videophone conference system, and more particularly to a video coding device, a video decoding device, a video coding method, a video decoding method and a system thereof, which divide and hierarchically encode various video contents according to predefined criteria and then transmit them so as to ensure QoS for the transmitted video contents.
2. Description of Prior Art
In an IP-based network environment, it is difficult to effectively guarantee the video transmission quality for video conference thanks to unreliability of network transmission. Well-known methods generally adopt retransmission mechanism or add redundant information. Retransmission, however, usually increases the load on network, and in the case of adding redundant information, since video itself has a great amount of data, it is required that more redundant information has to be added to achieve more reliable guarantee for transmission quality.
At present, various video coding and decoding algorithms have been proposed, for example, Main Profile in H.264 provides a Redundant Slices technique. This technique, however, applies a same method for adding redundant information to any content information, and thus cannot effectively provide corresponding protections for different video contents. Therefore, QoS for video content cannot be guaranteed in the case of a bad network quality.
SUMMARY OF THE INVENTION
The present invention is made in view of the above problems in the prior art. An object of the present invention is to provide a video coding device, a video decoding device, a video coding method, a video decoding method and a system thereof, which divide and hierarchically encode different video contents according to predefined criteria and then transmit them so as to ensure QoS for the transmitted video contents.
According to a first aspect of the invention, a coding device is provided, which comprises a video coder for performing video coding on a frame including a plurality of macroblocks by a predefined coding technique so as to output a normal coded stream and for outputting a prediction error value for each of the macroblocks obtained through inter-frame movement prediction, a grading means for grading the macroblocks based on the prediction error values and allocating redundant bits to macroblocks at respective grades, a redundant coder for generating redundant information indicated by corresponding redundant bits for each of the graded macroblock, and a merger means for merging said normal coded stream and said redundant information to generate a resulting coded stream.
According to an embodiment of the present invention, said grading means dynamically determines the number and method for grading based on at least one of coded bit rate requirement and prediction error value for an actual video frame.
According to an embodiment of the present invention, said grading means classifies to one and same grade the macroblocks for which the prediction error values are similar to each other, and executes the grading in an increment or decrement order of the prediction error values.
According to an embodiment of the present invention, the number of redundant bits allocated to a macroblock belonging to a grade of a greater prediction error value by said grading means is greater than that to a macroblock belonging to a grade of a smaller prediction error value.
According to an embodiment of the present invention, said redundant coder allocates redundant bits to the macroblocks at respective grades based on a predefined bit rate, and the number of the redundant bit can be zero.
According to an embodiment of the present invention, said redundant information includes at least one of a low-precision original image, a low-precision original image and check code, a low-precision prediction error value as well as a low-precision prediction error value and check code.
According to an embodiment of the present invention, said predefined coding technique is one of H.264, H.263, MPEG2 and MPEG4.
According to another aspect of the present invention, a decoding device is provided, which comprises a split means for splitting a coded stream received via a channel into a normal stream and a redundant stream, a video decoder for decoding said normal stream by a predefined decoding technique, a redundant decoder for acquiring a corresponding substitute stream from said redundant stream in the case of an error occurring in the decoded normal stream, and an error masking means for replacing an erroneous portion in the decoded normal stream with said substitute stream.
According to an embodiment of the present invention, said redundant stream includes redundant code.
According to an embodiment of the present invention, said redundant stream includes redundant code and check code.
According to an embodiment of the present invention, said redundant code includes at least one of a low-precision original image and a low-precision prediction error value.
According to an embodiment of the present invention, said predefined coding technique is one of H.264, H.263, MPEG2 and MPEG4.
According to an embodiment of the present invention, when an error occurs in the stream, if there is redundant information at the same grade as a macroblock, said error masking means substitutes the stream for the corresponding macroblock with decoded redundant information.
According to an embodiment of the present invention, when an error occurs in the stream, if there isn't redundant information at the same grade as a macroblock, said error masking means acquires the stream for the corresponding macroblock in a previous frame from a buffer area as said substitute stream.
According to still another aspect of the present invention, a coding method is provided, which comprise the steps of performing video coding on a frame including a plurality of macroblocks by a predefined coding technique so as to output a normal coded stream, and simultaneously outputting a prediction error value for each of the macroblocks through inter-frame movement prediction; grading the macroblocks based on the prediction error values, and allocating redundant bits to macroblocks at respective grades; generating redundant information indicated by corresponding redundant bit for the graded macroblocks; and merging said normal coded stream and said redundant information to generate a resulting coded stream.
According to an embodiment of the present invention, the macroblocks for which the inter-frame prediction error values are similar to each other are classified to one and same grade, the grading is executed in an increment or decrement order of the prediction error values.
According to an embodiment of the present invention, the number of redundant bits allocated to a macroblock belonging to a grade of a greater prediction error value is greater than that to a macroblock belonging to a grade of a smaller prediction error value.
According to an embodiment of the present invention, the number and method for grading are dynamically determined based on at least one of coded bit rate requirement and prediction error value for an actual video frame.
According to still another aspect of the present invention, a decoding method is provided, which comprise steps of splitting a coded stream received via a channel into a normal stream and a redundant stream; decoding said normal stream by a predefined decoding technique; acquiring a corresponding substitute stream from said redundant stream in the case of an error occurring in the decoded normal stream; and replacing an erroneous portion in the decoded normal stream with said substitute stream.
According to an embodiment of the present invention, when an error occurs in the stream, if there is redundant information at the same grade as a macroblock, said method further comprises a step of substituting the stream for the corresponding macroblock with decoded redundant information.
According to an embodiment of the present invention, when an error occurs in the stream, if there isn't redundant information at the same grade as a macroblock, said method further comprises a step of acquiring the stream for the corresponding macroblock in a previous frame from a buffer area as said substitute stream.
Furthermore, there is provided a system comprising said coding device and said decoding device.
With the configuration of the present invention, bit rate will not be increased significantly with content transmission quality being guaranteed.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 shows a schematic diagram for explaining how to grade macroblocks in a video frame based on bit plane;
FIG. 2 shows a schematic diagram for explaining the process of macroblock grading;
FIG. 3 shows stream content and transmission mode used in the present invention;
FIG. 4 is a functional block diagram of a video transmission system according to an embodiment of the present invention;
FIG. 5A is a flowchart for a video coding method according to an embodiment of the present invention; and
FIG. 5B is a flowchart for a video decoding method according to an embodiment of the present invention.
 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Hereafter, an embodiment of the present invention will be described in detail with reference to the drawings.
FIG. 1 shows a schematic diagram for explaining how to grade macroblocks in a video frame based on bit plane.
As shown in FIG. 1, a current frame is predicted with respect to a previous frame of a picture. Then video macroblocks are graded in a similar manner to bit plane based on the magnitude of each prediction error value. All the macroblocks with the largest prediction error value are mapped to slice 1, all the macroblocks with smaller prediction error value are mapped to slice 2 and so on, and the number of slices is determined as required.
FIG. 2 shows a schematic diagram for explaining the process of macroblock grading. In FIG. 2, (A) denotes a frame neighboring to a frame denoted by (B), and (C) represents a difference image between a frame predicted with respect to (A) and (B), that is, a prediction difference image. The diagram (D) in FIG. 2 shows slices to which different macroblocks in the prediction difference image are mapped, and
Figure US09106915-20150811-P00001
and
Figure US09106915-20150811-P00002
in FIG. 2 represent slice 1 and 2, respectively. Other macroblocks can be coded in a manner identical to normal coding, for those macroblocks with larger prediction errors, however, redundant information will be allocated to ensure transmission quality of video content.
Therefore, in addition to normally-coded bits, redundant bits are allocated to different slices at coding end, and the redundant information can be but not limited to a low-precision original image plus check code or a low-precision prediction error value plus check code. It is obvious that check code is not necessary here.
The number of the redundant bits allocated to slice 1 is the largest, and that allocated to slice 2 is smaller, and in this way, the number decreases one by one. Accordingly, for those video content with larger movement prediction errors, it is allowed to add more redundant bits so that a better error masking processing can be ensured at decoding side if a transmission error occurs. By allocating a smaller number of redundant bits to those video content with less movement prediction errors, it can be ensured that the stream is controllable as a whole, and if a transmission error occurs, since the prediction error is small, even there is no redundant bit for error masking, compensation can be made directly using a reference image without any serious deterioration in quality. In an actual implementation, as shown in FIGS. 3(A) and (B) respectively, redundant code and check code can be transmitted via a same channel or separated from each other so as to transmit the check code via a reliable channel and the normal stream and the redundant code via another channel.
Furthermore, in the above grading process, the actual number of grades and the used method are determined dynamically based on the actual bit rate requirement and video content. Generally speaking, the finer and more the grades are, the more redundant bits need to be allocated, and the larger the movement prediction error between video frames is, the more redundant information is needed. Thus, a higher bit rate allows more and finer grades to protect more macroblock data, while a lower bit rate allows allocating only fewer grades for protection. Similarly, a larger overall inter-frame prediction error requires more grades, while a smaller overall inter-frame prediction error can be protected with fewer or even no grade. This above process is a dynamic equilibrium process.
FIG. 4 is a functional block diagram of a video transmission system according to an embodiment of the present invention.
As shown in FIG. 4, a video transmission system according to an embodiment of the present invention includes a video coder 402, a grading unit 403, a redundant coding unit 404 and a merger unit 405.
An original video stream is inputted at the input terminal 401 of the coding device. The input video stream enters the video coder 402, which generates a coded stream by a normal coding on the original video stream and sends to the grading unit 403 bit rate control information as well as movement prediction value between video frames obtained through movement prediction.
The grading unit 403, on one hand, classifies video macroblocks to different protection grades, i.e. different slices, based on the magnitude of the movement prediction value for each of the video macroblocks, and on the other hand, it determines the number of redundant bits for each grade based on the bit rate control information. For example, with a bit rate of 1 Mbps, 8 bits are allocated to the macroblocks classified to slice 1, 4 bits to slice 2 and 1 bit to slice 3; and with a bit rate of 2 Mbps, 16 bits are allocated to the macroblocks classified to slice 1, 8 bits to slice 2 and 2 bit to slice 3.
The redundant coder 404 generates different redundant information for macroblocks of different grades based on the input original stream and the grade information and the redundant bit number for each macroblocks generated by the grading unit 403. As previously described, the redundant information for each macroblock can be but not limited to its low-precision original image plus check code or its low-precision prediction error value plus check code. Also as described above, the check code is not necessary. Packet check code can be selected if check code is used.
Then, the merger unit 405 merges the normal stream produced by the video coder 402 and the redundant information produced by the redundant coder 404 into one same video stream and sends it out via a transmission channel 406.
As shown in FIG. 4, a decoding device in the video transmission system of the present invention includes a split unit 407, a video decoder 408, a redundant decoder 410 and a grade-by-grade error masking unit 409.
The split unit 407 receives a stream transmitted over an IP network or a wireless network via the transmission channel 406 and splits the received stream into a normal stream and a redundant stream. Here, the normal stream is a stream which has no addition of redundant information and is generated through a standard coding process, such as H.264, H.263, MPEG2 or MPEG4, while the redundant stream is a stream of the redundant information added on the basis of the above method and grade.
The split unit 407 transfers the split normal stream to the video decoder 408 and on the other hand, transfers the redundant stream to the redundant decoder 410. The video decoder 408 then generates normal decoded information from the normal stream and sends to the redundant decoder 410 error information, that is, information about a macroblock suffering from an error, if some error or missing occurs in the stream.
The redundant decoder 410 first judges whether a redundant code for the error-inflicted macroblock exists in the redundant stream. If there is no redundant code for the macroblock, the stream of a corresponding macroblock in a previous frame is extracted from a buffer area for decoding and used as the last-outputted stream of the macroblock in the current frame.
If there is redundant code for the macroblock, the check code is utilized to check the redundant code for the macroblock so that it can be judged whether the redundant code is proper. If the redundant code is proper, a substitute stream for the error-inflicted macroblock is generated from the redundant code and then outputted to the grade-by-grade error masking unit 409, in which the stream of the error-inflicted macroblock is replaced with the substitute stream, and then a final decoded video stream is outputted after the error masking.
If the above redundant code is improper, the check code is utilized to recover the redundant code, and then the process is carried out as described above. The decoded video frame is outputted at the output terminal 411 for the decoding device.
FIG. 5A is a flowchart for a video coding method according to an embodiment of the present invention. As shown in FIG. 5A, an original video stream S is acquired or inputted from a video source in Step S501. Next, in Step S502, a normal coding processing is performed on the input original video stream according to predefined coding technique, such as H.264, H.263, MEPG2 or MPEG4, and a movement prediction value for each video macroblock is obtained through inter-frame movement prediction and then outputted. Thereafter, a prediction error is determined as the difference between the inter-frame movement prediction value for each macroblock and its actual value.
In Step S503, each of the video frames is divided into different protection grades based on the magnitudes of prediction errors for different macroblocks, with the macroblocks being classified into different protection grades slice 1, slice 2, . . . , slice N.
In Step S504, the number of redundant bits for each grade is determined on the basis of bit rate control information. For example, with a bit rate of 1 Mbps, 8 bits are allocated to the macroblocks classified to slice 1, 4 bits to slice 2 and 1 bit to slice 3; and with a bit rate of 2 Mbps, 16 bits are allocated to the macroblocks classified to slice 1, 8 bits to slice 2 and 2 bit to slice 3.
In Steps S505 and S506, different redundant information is generated for the graded microblocks based on the grading result and the bit allocation scheme. For example, the redundant information for each macroblock can be but not limited to its low-precision original image plus check code or its low-precision prediction error value plus check code. Here, error correction code, such as packet check code, can be selected as the check code. As described above, the robustness of the system will be enhanced if check code is included in the redundant information.
In Step S507, it is judged, for each macroblock at each grade, whether the code and its redundant information have been obtained, and if the answer is negative, the flow returns to Step S504 and the above action is repeated. If the process of N-grade coding has been completed, the code plus redundancy is transferred sequentially in Step S408 until the code transmission has been fulfilled for all the protection grades.
FIG. 5B is a flowchart for a video decoding method according to an embodiment of the present invention. As shown in FIG. 5B, a stream is received via a transmission channel in Step S511. Next, it is judged whether the received stream of a current frame is correct in Step S512, and if it is correct, the flow proceeds directly to Step S516, and a decoding process is performed on the coded stream of the current frame in an order reverse to that at coding side.
On the other hand, if some error occurs in part of the stream of the current frame, that is, some decoding error happens to one of the macroblocks, it is judged whether redundant code for the macroblock exists in the stream in Step S513.
If there is no redundant code for the macroblock in the stream, a corresponding macroblock in a previous decoded frame is extracted from a buffer area and used as the decoded result of the above macroblock. The flow then proceeds to Step S516 and continues the subsequent decoding.
If there is redundant code for the macroblock in the stream, it is judged whether the redundant code is proper in Step S514. If it is improper, a corresponding check code is acquired in Step S518, and thereafter, in Step S519, the redundant code is corrected using the check code to obtain a proper redundant code.
Later in Step S515, a substitute stream of the corresponding macroblock is obtained from the proper redundant code, and if the decoding process has been fulfilled for the macroblock at all grades, a decoded stream S′ is outputted for the current frame.
Therefore, when compared with the existing error masking methods, the present invention has the two primary advantages as follows. First, the importance degree of video content has been given sufficient consideration so that error recovery can be priorly guaranteed for important content even if some transmission error occurs, thereby preventing remarkable degradation in video quality. Second, since the bit number for the added redundant information depends on different grades, the overall bit rate can be controlled.
The above description is only the preferred embodiment of the present invention, and the scope of the invention is not limited thereto. In the technological range disclosed in the present invention, any variation or substitution readily conceivable by those skilled in the art should be covered by the scope of the invention, which should be defined by the appended claims.

Claims (28)

What is claimed is:
1. A coding device, comprising:
a video coder configured to perform video coding on a frame including a plurality of macroblocks by a predefined coding technique so as to output a normal coded stream and output a prediction error value for each of said macroblocks obtained through inter-frame movement prediction,
a grading unit configured to grade said macroblocks based on said prediction error values and allocate different number of redundant bits to said macroblocks at respective grades;
a redundant coder configured to generate corresponding redundant information indicated by said redundant bits for each of the graded macroblock; and
a merger unit configured to merge said normal coded stream and said redundant information to generate a resulting coded stream;
said grading unit is further configured to:
classify to one and same grade the macroblocks for which the prediction error values are similar to each other;
execute the grading process in an increment or decrement order of the prediction error values;
dynamically determine the number of redundant bits and method for grading based on at least one of coded bit rate requirement and prediction error value for an actual video frame;
uses the higher bite rate to allow more and finer grades to protect more macroblock data, wherein a larger overall inter-frame prediction error requires more grades; and
uses a lower bit rate to allow allocating only fewer grades for protection, wherein a smaller overall inter-frame prediction error is protected with fewer or even no grade.
2. The coding device of claim 1, wherein the number of redundant bits allocated to a macroblock belonging to a grade of a larger prediction error value by said grading unit is greater than that to a macroblock belonging to a grade of a smaller prediction error value.
3. The coding device of claim 1, wherein said redundant coder is further configured to allocate said redundant bits to said macroblocks at respective grades based on a predefined bit rate, and the number of said redundant bit can be zero.
4. The coding device of claim 1, wherein said redundant information includes at least one of a low-precision original image, a low-precision original image and check code, a low-precision prediction error value as well as a low-precision prediction error value and check code.
5. The coding device of claim 1, wherein said predefined coding technique is one of H.264, H.263, MPEG2 and MPEG4.
6. A decoding device, comprising:
a split unit configured to split a coded stream received via a channel into a normal stream and a redundant stream,
a video decoder configured to decode said normal stream by a predefined decoding technique,
a redundant decoder configured to acquire a corresponding substitute stream from said redundant stream in the case of an error occurring in the decoded normal stream, and
an error masking unit configured to replace an erroneous portion in the decoded normal stream with said substitute stream,
wherein the redundant stream comprises redundant bits for each of the macroblocks which are graded based on prediction error values, the macroblocks at different grades are allocated different number of redundant bits by a grading unit configured to:
classify to one and same grade the macroblocks for which the prediction error values are similar to each other;
execute the grading process in an increment or decrement order of the prediction error values;
dynamically determine the number of redundant bits and method for grading based on at least one of coded bit rate requirement and prediction error value for an actual video frame;
uses the higher bite rate to allow more and finer grades to protect more macroblock data, wherein a larger overall inter-frame prediction error requires more grades; and
uses a lower bit rate to allow allocating only fewer grades for protection, wherein a smaller overall inter-frame prediction error is protected with fewer or even no grade.
7. The decoding device of claim 6, wherein said redundant stream includes redundant code.
8. The decoding device of claim 7, wherein said redundant code includes at least one of a low-precision original image and a low-precision prediction error value.
9. The decoding device of claim 7, wherein said predefined coding technique is one of H.264, H.263, MPEG2 and MPEG4.
10. The decoding device of claim 6, wherein said redundant stream includes redundant code and check code.
11. The decoding device of claim 10, wherein said redundant code includes at least one of a low-precision original image and a low-precision prediction error value.
12. The decoding device of claim 10, wherein said predefined coding technique is one of H.264, H.263, MPEG2 and MPEG4.
13. The decoding device of claim 6, wherein when an error occurs in the stream, if there is redundant information at the same grade as a macroblock, said error masking unit substitutes the stream for the corresponding macroblock with decoded redundant information.
14. The decoding device of claim 6, wherein when an error occurs in the stream, if there isn't redundant information at the same grade as a macroblock, said error masking unit acquires the stream for the corresponding macroblock in a previous frame from a buffer area as said substitute stream.
15. A coding method for a coding device, the coding method comprising the steps of:
performing, by the coding device, video coding on a frame including a plurality of macroblocks by a predefined coding technique so as to output a normal coded stream, and simultaneously outputting a prediction error value for each of said macroblocks obtained through inter-frame movement prediction;
grading, by the coding device, said macroblocks based on said prediction error values, and allocating different number of redundant bits to said macroblocks at respective grades;
generating, by the coding device, redundant information indicated by corresponding redundant bits for the graded macroblocks; and
merging, by the coding device, said normal coded stream and said redundant information to generate a resulting coded stream; and
the method further comprising the grading steps of:
classifying to one and same grade the macroblocks for which the prediction error values are similar to each other;
executing the grading process in an increment or decrement order of the prediction error values;
dynamically determining the number of redundant bits and method for grading based on at least one of coded bit rate requirement and prediction error value for an actual video frame;
using the higher bite rate, allowing more and finer grades to protect more macroblock data, wherein a larger overall inter-frame prediction error requires more grades; and
using a lower bit rate, allowing allocating only fewer grades for protection, wherein a smaller overall inter-frame prediction error is protected with fewer or even no grade.
16. The coding method of claim 15, wherein the number of redundant bits allocated to a macroblock belonging to a grade of a larger prediction error value is greater than that to a macroblock belonging to a grade of a smaller prediction error value.
17. The coding method of claim 15, wherein said redundant information includes at least one of a low-precision original image, a low-precision original image and check code, a low-precision prediction error value as well as a low-precision prediction error value and check code.
18. The coding method of claim 15, wherein said redundant bits are allocated to said macroblocks at respective grades based on a predefined bit rate, and the number of said redundant bits can be zero.
19. The coding method of claim 15, wherein said predefined coding technique is one of H.264, H.263, MPEG2 and MPEG4.
20. A decoding method for a decoding device, the method comprising the steps of:
splitting, by the decoding device, a coded stream received via a channel into a normal stream and a redundant stream;
decoding, by the decoding device, said normal stream by a predefined decoding technique;
acquiring, by the decoding device, a corresponding substitute stream from said redundant stream in the case of an error occurring in the decoded normal stream; and
replacing, by the decoding device, an erroneous portion in the decoded normal stream with said substitute stream;
wherein the redundant stream comprises redundant bits for each of the macroblocks which are graded based on prediction error values, the macroblocks at different grades are allocated different number of redundant bits by performing the grading steps of:
classifying to one and same grade the macroblocks for which the prediction error values are similar to each other;
executing the grading process in an increment or decrement order of the prediction error values;
dynamically determining the number of redundant bits and method for grading based on at least one of coded bit rate requirement and prediction error value for an actual video frame;
using the higher bite rate, allowing more and finer grades to protect more macroblock data, wherein a larger overall inter-frame prediction error requires more grades; and
using a lower bit rate, allowing allocating only fewer grades for protection, wherein a smaller overall inter-frame prediction error is protected with fewer or even no grade.
21. The decoding method of claim 20, wherein said redundant stream includes redundant code.
22. The decoding method of claim 21, wherein said redundant code includes at least one of a low-precision original image and a low-precision prediction error value.
23. The decoding method of claim 21, wherein said predefined coding technique is one of H.264, H.263, MPEG2 and MPEG4.
24. The decoding method of claim 20, wherein said redundant stream includes redundant code and check code.
25. The decoding method of claim 24, wherein said redundant code includes at least one of a low-precision original image and a low-precision prediction error value.
26. The decoding method of claim 24, wherein said predefined coding technique is one of H.264, H.263, MPEG2 and MPEG4.
27. The decoding method of claim 20, wherein when an error occurs in the stream, if there is redundant information at the same grade as a macroblock, said method further comprises a step of substituting the stream for the corresponding macroblock with decoded redundant information.
28. The decoding method of claim 20, wherein when an error occurs in the stream, if there isn't redundant information at the same grade as a macroblock, said method further comprises a step of acquiring the stream for the corresponding macroblock in a previous frame from a buffer area as said substitute stream.
US11/754,035 2006-05-25 2007-05-25 Video coding and decoding devices and methods and systems thereof Active 2033-01-19 US9106915B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN200610011988.7 2006-05-25
CNB2006100119887A CN100548051C (en) 2006-05-25 2006-05-25 Video decoding/encoding device and method and system
CN200610011988 2006-05-25

Publications (2)

Publication Number Publication Date
US20080037635A1 US20080037635A1 (en) 2008-02-14
US9106915B2 true US9106915B2 (en) 2015-08-11

Family

ID=38852140

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/754,035 Active 2033-01-19 US9106915B2 (en) 2006-05-25 2007-05-25 Video coding and decoding devices and methods and systems thereof

Country Status (3)

Country Link
US (1) US9106915B2 (en)
JP (1) JP2007318752A (en)
CN (1) CN100548051C (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8111757B2 (en) * 2007-09-28 2012-02-07 Motorola Mobility, Inc. Method and apparatus for video signal processing
US10424274B2 (en) * 2010-11-24 2019-09-24 Ati Technologies Ulc Method and apparatus for providing temporal image processing using multi-stream field information
CN102624493B (en) * 2012-04-20 2015-07-01 京信通信系统（中国）有限公司 Receiver decoding method and device
CN106162227B (en) * 2015-04-10 2019-01-01 北京大学 The RS coding redundancy packet distribution method and sending device of real-time video transmission
CN111464834B (en) * 2020-04-07 2023-04-07 腾讯科技（深圳）有限公司 Video frame processing method and device, computing equipment and storage medium
CN113259675B (en) * 2021-05-06 2021-10-01 北京中科大洋科技发展股份有限公司 Ultrahigh-definition video image parallel processing method

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05103214A (en) 1991-04-26 1993-04-23 Aikiyatsuto:Kk Picture data communication equipment
US5247363A (en) 1992-03-02 1993-09-21 Rca Thomson Licensing Corporation Error concealment apparatus for hdtv receivers
JPH06225153A (en) 1993-01-27 1994-08-12 Fuji Xerox Co Ltd Picture coder
US5594504A (en) * 1994-07-06 1997-01-14 Lucent Technologies Inc. Predictive video coding using a motion vector updating routine
JPH09116759A (en) 1995-10-20 1997-05-02 Canon Inc Image decoder and image coding decoding system
US5929940A (en) * 1995-10-25 1999-07-27 U.S. Philips Corporation Method and device for estimating motion between images, system for encoding segmented images
US6084908A (en) * 1995-10-25 2000-07-04 Sarnoff Corporation Apparatus and method for quadtree based variable block size motion estimation
JP2001045475A (en) 1999-07-27 2001-02-16 Matsushita Electric Ind Co Ltd Video signal hierarchical coder, video signal hierarchical decoder and program recording medium
US20020176025A1 (en) * 2001-03-05 2002-11-28 Chang-Su Kim Systems and methods for encoding redundant motion vectors in compressed video bitstreams
CN1456016A (en) 2001-01-30 2003-11-12 株式会社欧菲士诺亚 Moving-picture information compressing method and system
CN1665299A (en) 2005-04-07 2005-09-07 西安交通大学 Method for designing architecture of scalable video coder decoder
WO2005088976A1 (en) * 2004-03-12 2005-09-22 Canon Kabushiki Kaisha Moving image coding apparatus, moving image decoding apparatus, control method therefor, computer program, and computer-readable storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5270363A (en) * 1989-05-19 1993-12-14 Milliken Research Corporation Poly(oxyalkylene) modified phthalocyanine colorants

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05103214A (en) 1991-04-26 1993-04-23 Aikiyatsuto:Kk Picture data communication equipment
US5247363A (en) 1992-03-02 1993-09-21 Rca Thomson Licensing Corporation Error concealment apparatus for hdtv receivers
JPH0670306A (en) 1992-03-02 1994-03-11 Rca Thomson Licensing Corp Apparatus for adaptive correction of error
JPH06225153A (en) 1993-01-27 1994-08-12 Fuji Xerox Co Ltd Picture coder
US5594504A (en) * 1994-07-06 1997-01-14 Lucent Technologies Inc. Predictive video coding using a motion vector updating routine
JPH09116759A (en) 1995-10-20 1997-05-02 Canon Inc Image decoder and image coding decoding system
US5929940A (en) * 1995-10-25 1999-07-27 U.S. Philips Corporation Method and device for estimating motion between images, system for encoding segmented images
US6084908A (en) * 1995-10-25 2000-07-04 Sarnoff Corporation Apparatus and method for quadtree based variable block size motion estimation
JP2001045475A (en) 1999-07-27 2001-02-16 Matsushita Electric Ind Co Ltd Video signal hierarchical coder, video signal hierarchical decoder and program recording medium
CN1456016A (en) 2001-01-30 2003-11-12 株式会社欧菲士诺亚 Moving-picture information compressing method and system
US20020176025A1 (en) * 2001-03-05 2002-11-28 Chang-Su Kim Systems and methods for encoding redundant motion vectors in compressed video bitstreams
WO2005088976A1 (en) * 2004-03-12 2005-09-22 Canon Kabushiki Kaisha Moving image coding apparatus, moving image decoding apparatus, control method therefor, computer program, and computer-readable storage medium
JP2005295505A (en) 2004-03-12 2005-10-20 Canon Inc Moving image coding apparatus, moving image decoding apparatus, control method therefor, computer program, and computer-readable storage medium
US20080219571A1 (en) 2004-03-12 2008-09-11 Masaki Suzuki Moving Image Coding Apparatus, Moving Image Decoding Apparatus, Control Method Therefor, Computer Program, and Computer-Readable Storage Medium
US7957604B2 (en) * 2004-03-12 2011-06-07 Canon Kabushiki Kaisha Moving image coding apparatus, moving image decoding apparatus, control method therefor, and computer-readable storage medium
CN1665299A (en) 2005-04-07 2005-09-07 西安交通大学 Method for designing architecture of scalable video coder decoder

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
A Low Complexity Rate-Distortion Source Modeling Framework, IEEE, Chang et al, May 14-19, 2006. *
APIC: Adaptive Perceptual Image Coding Based on Subband Decomposition With Locally Adaptive Perceptual Weighting, IEEE, Hontsch et al, 1997. *

Also Published As

Publication number Publication date
CN100548051C (en) 2009-10-07
US20080037635A1 (en) 2008-02-14
JP2007318752A (en) 2007-12-06
CN101080016A (en) 2007-11-28

Similar Documents

Publication Publication Date Title
JP4360908B2 (en) Video transfer with variable modulation rate
US9106915B2 (en) Video coding and decoding devices and methods and systems thereof
JP5007322B2 (en) Video encoding method
US8060651B2 (en) Systems and methods for adaptively packetizing data partitions for transport over a network
US8804825B2 (en) Bi-pred mode decision in GOP architecture
US20030056168A1 (en) Encoder redundancy selection system and method
EP1315380A2 (en) Object-based bit rate control method and system thereof
JP2013070436A (en) Systems and methods for transmitting data over lossy networks
JPH09121358A (en) Picture coding/decoding device and its method
JP7343915B2 (en) FEC mechanism based on media content
JP4696008B2 (en) IP transmission apparatus and IP transmission method
CN101742289B (en) Method, system and device for compressing video code stream
US20050063473A1 (en) Method and apparatus for transmitting and receiving coded packet and program therefor
KR20080012908A (en) Dpcm coding method of video signals
CN102457728A (en) Method and device for video image encoding
KR100211055B1 (en) Scarable transmitting method for divided image objects based on content
CN111263192A (en) Video processing method and related equipment
US20070116129A1 (en) System and method for transmitting digital video stream using SVC scheme
KR20100019444A (en) Scheduling packet transmission
JP2005192073A (en) Multimedia data communication method and apparatus
US20040258163A1 (en) Video communication system and video coding method
CN111225238A (en) Information processing method and related equipment
US8505060B2 (en) Use of a feedback channel for image broadcasting
CN113747222A (en) Picture synchronous transmission method and system based on edge calculation
EP1555788A1 (en) Method for improving the quality of an encoded video bit stream transmitted over a wireless link, and corresponding receiver

Legal Events

Date Code Title Description
AS Assignment

Owner name: LENOVO (BEIJING) LIMITED, CHINA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LI, DONG;REEL/FRAME:019402/0267

Effective date: 20070521

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8