EP0902592B1 - Kodierungssystem - Google Patents

Kodierungssystem Download PDF

Info

Publication number
EP0902592B1
EP0902592B1 EP19980123717 EP98123717A EP0902592B1 EP 0902592 B1 EP0902592 B1 EP 0902592B1 EP 19980123717 EP19980123717 EP 19980123717 EP 98123717 A EP98123717 A EP 98123717A EP 0902592 B1 EP0902592 B1 EP 0902592B1
Authority
EP
European Patent Office
Prior art keywords
signal
coding
activity
predictive
interframe
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP19980123717
Other languages
English (en)
French (fr)
Other versions
EP0902592A3 (de
EP0902592A2 (de
Inventor
Tokumichi C/O Mitsubishi Denki K. K. Murakami
Yoshiaki c/o Mitsubishi Denki K. K. Kato
Toshiaki c/o Mitsubishi Denki K. K. Shimada
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Publication of EP0902592A2 publication Critical patent/EP0902592A2/de
Publication of EP0902592A3 publication Critical patent/EP0902592A3/de
Application granted granted Critical
Publication of EP0902592B1 publication Critical patent/EP0902592B1/de
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/107Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/112Selection of coding mode or of prediction mode according to a given display mode, e.g. for interlaced or progressive display mode
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/14Coding unit complexity, e.g. amount of activity or edge presence estimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • H04N19/149Data rate or code amount at the encoder output by estimating the code amount by means of a model, e.g. mathematical model or statistical model
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/527Global motion vector estimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output

Definitions

  • This invention relates to a coding system according to the pre-characterising part of claim 1.
  • interframe coding is a coding technique which codes a difference between a newly input uncoded image signal and a previously coded image signal.
  • Fig. 19 is a block diagram of a conventional interframe coding apparatus disclosed in JP-A-63 208 382.
  • the interframe coding apparatus according to the figure has a frame memory 1, a motion-vector detector 2, a subtractor 3, an encoder 4, a local decoder 5, an adder 6, a filter 7 and a filter controller 8.
  • the frame memory 1 stores an image signal of the previous frame.
  • the input image signal 12 is compared with the image signal of the previous frame 11 stored in the frame memory 1 by a block-matching technique in the motion vector detector 2.
  • the motion vector detector 2 detects the quantity and direction of motion of the input image signal 12 and outputs a motion vector signal 13.
  • the frame memory 1 outputs a motion compensation predictive signal 14 based upon the motion vector signal 13.
  • the subtractor 3 subtracts the motion compensation predictive signal 14 from the input image signal 12 to output a predictive error signal 15 or a difference signal.
  • the predictive error signal 15 is coded by quantization at the encoder 4, and a coded error signal 16 is output.
  • the coded error signal 16 is decoded in the local decoder 5, and a local decoded error signal 17 is output.
  • the local decoded error signal 17 is added to the motion compensation predictive signal 14 in the adder 6, and a local decoded signal 18 is output.
  • the local decoded signal 18 is filtered by the filter 7 to eliminate higher frequency components in the signal.
  • the filter smooths the local decoded signal and outputs a smoothed local decoded signal 19. Filtering is controlled by a control signal 20 output by the filter controller 8.
  • the filter control signal 20 controls the filter based upon the motion vector signal 13.
  • the coded error signal 16 and the motion vector signal 13 are transmitted via a transmission line to an external decoding system.
  • Image coding is generally processed by the unit or block of 16x16 or 8x8 pixels of an image signal.
  • the filter 7 can be placed after the frame memory 1 in the local decoding loop instead of after the adder 6 as shown in Fig. 19. Further, filtering can be accomplished by an intra-block filter which processes pixels within a block, and by an inter-block filter which processes pixels involving the pixels in the neighboring blocks. Furthermore, a motion detection can be achieved with a smaller unit of a pixel than a full pixel. This is designed to detect the optimal block of pixels in the previous frame which match a block of pixels in the input image signal 12. These conventional techniques can contribute to eliminate higher frequency components or redundancy in the input image signal based upon the quantity of motion. Thus, they are effective for removing noise in the signal. Consequently, coding efficiency can be improved greatly with these conventional arts.
  • An intraframe coding with a local decoding loop is processed in the following manner according to the conventional coding with reference to Fig 19.
  • the input image signal 12 is directly coded by quantization in the encoder 4, where the coded error signal 16 is output.
  • the coded error signal 16 is decoded in the local decoder 5, where the local decoded error signal 17 is output.
  • the local decoded error signal 17 is stored in the frame memory 1.
  • the coded error signal 16 is transmitted via a transmission line to an external decoding system.
  • the conventional interframe coding generally controls filtering based upon the motion vector, whereby an image signal can be filtered based upon the quantity of motion.
  • a block of pixels representing motion of an image signal, or a motion block is filtered with a low-pass filter (LPF) thereby eliminating the original definition to eliminate noise in the signal.
  • LPF low-pass filter
  • a block of pixels representing no motion or a very small amount of motion is not filtered.
  • the conventional interframe coding system carries a problem of quantization. Coding performance, according to the conventional system, is based upon a limited quantization which is designed optimally for a certain pattern of predictive error signal 15. In other words, the limited quantization can not deal effectively with coding signals of various patterns. When the encoder quantizes the signal with the limited quantization, the predictive error signal 15 is characterized with a poor coding efficiency and results in producing a poor coded error signal.
  • CCITT International consultative Committee for Telephone and Circuit
  • the CCITT H. 261 hybrid video coding algorithm utilises both intraframe and interframe coding schemes.
  • the intraframe mode realises compression in the spatial dimension within a single frame which compression in the temporal mode is disabled.
  • the interframe mode provides compression between consecutive frames in time.
  • the CCITT encoder algorithm requires ad decoder to reconstruct and motion compensate the previous (N-1) frame and utilises this reconstructed image as a prediction for the current frame (N).
  • Ohtsuka et al: “Development of 135 Mbit/s HDTV codec", Signal processing image Communication, vol. 4, no. 4/5, pages 379 - 387, XP 000 293 755 Amsterdam NL, discloses a coding system which includes an encoder for coding an input signal into a coded signal and a frame memory for outputting a predictive signal, which system comprises a coding controller responsive to the input signal and the predictive signal for calculating a characteristic (signal energy) of the input signal and for generating a coding control signal for controlling the encoder based on the characteristic. A comparison is made between characteristics of the interframe signal and the intraframe signal for determining the coding mode, namely interframe or intraframe coding.
  • Bellifemine et al "Image Coding with Block DCT and Motion Compensation. Two Different Approaches", European Transaction on Telecommunications and Related Technologies, vol. 2, no. 3, 1 May 1991, pages 305 - 312, XP 000 236 963, describes two approaches for the purpose of image data compression having the common features: segmentation of picture in 8 x 8 blocks to perform adaptivity; use of temporal prediction and motion compensation to remove temporal correlation; use of two dimensional DCT to remove spatial correlation. According to one approach a selection is made on a block by block basis to make the coding scheme more effective in the energy reduction sense. A differential motion compensated block can be rejected if there is no energy reduction.
  • this rejection occurs if the related block in the previous frame is less correlated to the actual block so that the prediction technique works less effectively.
  • the energy of the compensated block (differential signal) is compared with that of the uncompensated block (original signal), and the block with the lowest energy is chosen for transmission, while the other one is rejected. This means that the best coding mode between inter and intra is chosen for each block according to the local characteristics of the image.
  • the invention therefore, relates to a coding system which includes an encoder for coding an input signal including quantization into a coded signal and a frame memory for outputting a predictive signal, comprising a coding controller responsive to the input signal and the predictive signal, for generating a coding control signal for controlling the encoder, wherein the coding controller includes an activity calculator for calculating an activity value of each of the input signal and a predictive error signal formed by subtracting the input signal from the predictive signal, the activity value becoming smaller when the corresponding signal contains a great amount of lower frequency components, and becoming lager when the corresponding signal contains a great amount of higher frequency components, and an activity comparative selector for comparing the activity values and for generating the coding control signal, which provides a quantization step size, on the basis of said activity values.
  • Fig. 1 shows a configuration of interframe coding system according to an embodiment of the present invention.
  • Fig. 1 comprises a coding controller 41, a coding control signal 42 and a select signal 150.
  • the image signal 11 of the previous frame stored in the frame memory 1 or the local decoded image signal is used as a predictive signal.
  • the subtractor 3 subtracts the input image signal 12 from the predictive signal 11 to output the predictive error signal 15.
  • the coding controller 41 calculates the "Activities" of the input image signal 12 and the predictive error signal 15 to output the coding control signal 42 and the select signal 150, respectively, to the encoder 4.
  • the encoder quantizes the select signal 150 to output the coded error signal 16.
  • the local decoder 5 decodes the coded error signal 16 to output the local decoded error signal 17.
  • the adder 6 combines the local decoded error signal 17 with the image signal 11 to output the local decoded signal 18.
  • the local decoded signal 18 is stored in the frame memory 1.
  • the coded error signal 16 is, on the other hand, also transmitted through a transmission line.
  • the coding controller 41 has an "Activity” calculator 45, an "Activity” comparative selector 46, an "Activity” signal 12a based upon the input image signal 12, an "Activity” signal 15a based upon the predictive error signal 15, the coding control signal 42 and the select signal 150.
  • the "Activity” calculator 45 calculates each "Activity" of the input image signal 12 and the predictive error signal 15 to output their “Activities” to the "Activity” comparative selector 46.
  • the "Activity" of an image signal can be the difference between the maximum and minimum values of luminance intensity of pixels of a signal or the sum of the absolute or squared values of the difference between the mean value and the values of luminance intensity of a block of pixels in an image signal.
  • the “Activity” does not refer to the absolute luminance intensity of each pixel in an image signal. It involves a block of pixels of an image signal. When a block of pixels of an image signal contain a great amount of lower frequency components its "Activity" becomes smaller, while when they contain a great amount of higher frequency components its "Activity" becomes larger.
  • the "Activity” comparative selector 46 the "Activities” 12a and 15a are compared to select an optimal mode signal under a given priority based upon the user's or system's needs.
  • the priority could be:
  • Condition can be limited depending on the purpose or capacity of the system or the user's needs.
  • coding efficiency for instance, a mode signal of the image signal with smaller "Activity” by the comparison is output by the "Activity” comparison selector 46 as stated hereinbefore.
  • picture quality the mode signal of the input image signal 12 is output by the "Activity” comparison selector 46.
  • the "Activity" comparative selector 46 outputs the mode signal of either the input image signal 12 or the predictive error signal 15 based upon the comparison result of their "Activities" under a certain consideration.
  • the "Activity" comparative selector 46 outputs the coding control signal 42 providing coding parameters.
  • the coding parameters include the quantization step size based upon the condition and the "Activities" of the image signals.
  • the "Activity” comparison selector 46 also outputs the image signal selected by the mode signal as the select signal 15o.
  • the "Activity” comparative selector 46 has a weighting circuit 46a, a comparator 46b and a control signal generator 46c.
  • the weighting circuit 46a weights the "Activity” of the input signal 12a and/or the "Activity” of the predictive error signal 15a.
  • the comparator 46b compares the "Activity” of the input image signal 12a with the "Activity” of the predictive error signal 15a output from the weighting circuit 46a.
  • the control signal generator 46c selects either the input image signal 12 or the predictive error signal 15 as the select signal 15o and also outputs the coding control signal 42 by multiplexing the quantization step size, coding coefficients, etc.
  • the weighting circuit 46a will be left to the later discussion for a brief description of the "Activity” comparative selector 46 in this embodiment. Accordingly, the comparator 46b inputs the "Activity” of the input image signal 12a and the “Activity” of the predictive error signal 15a. The comparator 46b compares those "Activities” and outputs a mode signal 46m based upon the comparison result to the control signal generator 46c. The mode signal 46m actuates a switch to input either the input image signal 12 or the predictive error signal 15 in the control signal generator 46c.
  • the mode signal 46m is output as a part of the coding control signal 42 as one of the coding parameters included in the multiplexed signal together with the quantization step size, discrete cosine transform (DCT) coefficients, etc. to the encoder 4.
  • the encoder 4 demultiplexes and checks the multiplexed coding control signal 42, whereby the encoder 4 is informed, for instance with the mode signal, which signal is selected as the select signal 15o of the input image signal 12 and the predictive error signal 15.
  • the encoder 4 performs "intraframe” coding
  • the predictive error signal 15 is selected
  • the encoder 4 performs "interframe” coding. Interframe and intraframe codings are controlled by quantization step sizes and the DCT coefficients.
  • the interframe coding system in accordance with the invention can have a filter controller, an adaptive filter and a motion vector detector as shown in Fig. 4.
  • Fig. 4 comprises Fig. 1, as modified by adding the motion vector detector 2, the motion vector signal 13, the motion compensation predictive signal 14, the filter controller 21, the adaptive filter 22, the filter control signal 23 and the predictive signal 24.
  • the predictive error signal 15 in accordance with the invention can be based partly upon the filtered predictive signal 24 through the filter controller 21 and the adaptive filter 22 as shown in Fig. 4 instead of the image signal of the previous frame 11 unfiltered in Fig. 1.
  • the predictive error signal 15 is the subtracted result of the input image signal 12 by the filtered predictive signal 24 in the subtractor 3. Consequently, the coding controller 41 according to this embodiment compares the "Activity" of the input image signal 12 and the "Activity" of the filtered predictive error signal 15 to output the coding control signal 42.
  • the filter controller 21 calculates the difference between the input image signal 12 and the image signal from the frame memory 1 or the motion compensation predictive signal 14.
  • the filter controller 21 normalizes the difference by the "Activity" of either the input image signal 12 or the motion compensation predictive signal 14. Accordingly, the optimal filtering intensity for the motion compensation predictive signal 14 is decided based upon the normalized result. This can contribute to a desirable elimination of higher frequency components in the image signal leaving no higher frequency components in the prediction error signal, which leads to a high coding efficiency.
  • the coding control signal 42 according to this embodiment can be output by the coding controller 41 based upon the mode signal. The mode signal is to select the image signal having smaller "Activity" of the two: the "Activities" of the input image signal 12a and the "Activity” of the optimally filtered prediction error signal 15a. This also contributes to a high coding efficiency.
  • the "Activity" comparative selector 46 in the coding controller 41 in accordance with the invention can select the mode signal 46m based only upon the input signal resulted in the smallest "Activity” in the "Activity” comparison. Accordingly, the "Activity” comparative selector 46 outputs the mode signal based upon the smallest “Activity” in the comparator and outputs the coding control signal 42 of coding parameter, including the quantization step size, etc. based upon the mode signal and the "Activity".
  • An image signal with smaller "Activity" indicates that the image signal can be coded with higher coding efficiency in the encoder.
  • the "Activity" comparative selector 46 in accordance with the invention can weight “Activities" of the input signals, at least one of them, for comparison.
  • Fig. 5 shows the relation between the "Activities" of input signals and weighting.
  • Fig. 5(a) shows the original “Activity” of the input image signal 12a and the original “Activity” of the predictive error signal with no weight added in the weighting circuit 46a.
  • Fig. 5(b) shows the original “Activity” of the input image signal 12a with no weight added and the "Activity” of the predictive error signal with twice as much weight added as the original "Activity”.
  • the "Activity” comparative selector 46 selects the predictive error signal 15 as the select signal 15o according to Fig. 5(a).
  • the figure shows that the "Activity" of the predictive error signal 15a is constantly smaller than the "Activity" of the input image signal 12a.
  • the "Activity" comparative selector 46 selects either of the signals alternatively of the input image signal 12 or the predictive error signal 15 added a twofold weight on its "Activity” 15b when it has smaller "Activity” than the other as the select signal 15o according to Fig. 5(b).
  • the figure shows that the predictive error signal 15 is selected during the time period T0 through T1 as the select signal 15o.
  • the input image signal 12 is selected during the time period T1 through T2 as the select signal 15o due to the weighting on the predictive error signal.
  • Fig. 6 shows a flowchart of the basic operation in the weighting circuit 46a according to the embodiment in reference to Fig. 3.
  • the weighting circuit 46a inputs the "Activity" of the input image signal 12a and the "Activity” of the predictive error signal (difference signal between the input image signal 12 and the predictive signal from the frame memory) 15a
  • the circuit reads out the previously assigned weighting coefficients W1 and W2, respectively, for the signals.
  • the input "Activities" of the signals 12a and 15a are multiplied by the weighting coefficients W1 and W2, respectively, and a weighted "Activity” of the input image signal 12b and a weighted "Activity” of the predictive error signal 15b is output.
  • the weighting circuit 46a in accordance with the invention can weight only one of the "Activities" of the input signals instead of both of them.
  • the weighting circuit 46a in accordance with the invention can process three or more input signals, instead of two as described in this embodiment.
  • An example of using three input signals in that condition will be described later in reference to Fig. 12.
  • Fig. 7 shows a flowchart of an example of weighting operation in the weighting circuit 46a according to the embodiment in reference to Fig. 5.
  • the "Activity" of the input image signal 12a is not weighted and output as “Activity” 12b after the weighting circuit.
  • the “Activity” of the predictive error signal 15a is doubled by the weight and output as its weighted "Activity” 15b.
  • Fig. 8 shows a flowchart of the basic operation in the comparator 46b according to the embodiment in reference to Fig. 3.
  • the comparator 46b compares the input "Activities" of the input image signal 12b and of the predictive error signal 15b from the weighting circuit 46a to decide a coding mode. When “Activity” 12b is smaller than “Activity” 15b, the comparator 46b selects INTRA mode (for an intraframe coding) while the comparator selects INTER mode (for an interframe coding) when "Activity" 12b is larger than “Activity” 15b. When the comparator selects the mode, it outputs mode signal 46m to the control signal generator 46c.
  • the weighting circuit 46a in accordance with the invention can process three or more input signals, instead of two as described in this embodiment. An example of using three input signals in that situation will be described later in reference to Fig. 12.
  • Fig. 9 shows a flowchart of the basic operation in the control signal generator 46c according to the embodiment in reference to Fig. 3.
  • the control signal generator 46c inputs the input image signal 12, the predictive error signal 15, the weighted "Activity” of the input image signal 12b, the weighted "Activity” of the predictive error signal 15b and the mode signal 46m.
  • the control signal generator 46c outputs the control signal 42 and one of the input signals as the select signal 15o based upon the mode signal 46m.
  • the control signal generator 46c is informed of the selection of either the INTER or INTRA mode with the mode signal 46m.
  • the control signal generator When the INTER mode is selected, the control signal generator outputs the predictive error signal 15 as the select signal 15o.
  • the control signal generator outputs the input image signal 12 as the select signal 15o.
  • the control signal generator 46c reads out the optimal quantization step size (QUANT) and the number of the DCT coefficients in the memory table in Fig. 10 according to the weighted "Activity" of the selected signal 12b or 15b.
  • the readout quantization step size (QUANT) and DCT coefficients as well as the mode signal 46m are multiplexed to be output as the control signal 42.
  • control signal generator 46c in accordance with the invention can input the "Activity" of the input image signal 12a and the "Activity” of the predictive error signal 15a, instead of the weighted "Activities” of those signals 12b and 15b.
  • the threshold values or the contents of the memory table in Fig. 10 have to be altered.
  • the number of threshold value in Fig. 10 in accordance with the invention can be varied according to the assigned QUANT and DCT coefficients.
  • the values of the QUANT and DCT coefficients can be also assigned based upon a given condition or priority, such as the picture quality or coding efficiency.
  • weighting can control the-selection probability of input image signals in the "Activity" comparative selector 46.
  • the select signal 150 can be controlled by weighting technique which is provided with previously set weighting coefficients in the weighting circuit according to the user's or system's needs, or according to the picture quality desired.
  • the coding controller 41 in accordance with the invention can compare the "Activity" of the filtered predictive error signal with the "Activity" of the unfiltered predictive error signal to output the coding control signal 42 based upon the compared result, specifically, the signal with smaller "Activity".
  • Fig. 11 shows a configuration of interframe coding system according to this embodiment providing a predictive signal 24a filtered in the adaptive filter 22 and a predictive signal 24b unfiltered or the motion compensation predictive signal 14.
  • Those predictive signals 24a and 24b are subtracted, respectively, from the input image signal 12 in the subtractors 3a and 3b.
  • the differences resulted from the subtraction are output as the predictive error signals respectively.
  • the predictive error signals are compared in the coding controller 41 to output the coding control signal 42 in the same manner described hereinbefore.
  • the coding controller 41 in accordance with the invention can add weight on either or both of the "Activities" of the predictive error signals, filtered in the adaptive filter 22 or/and unfiltered, for comparison to output the coding control signal 42.
  • the coding control signal 42 in accordance with the invention can be based upon the compared result among the "Activities" of three signals, the filtered predictive error signal and the unfiltered predictive error signal, and the input image signal 12, specifically selecting the mode of the signal with the smallest "Activity".
  • Fig. 12 shows a configuration of interframe coding system according to this embodiment.
  • Fig. 12 comprises Fig. 11, as modified by adding the input image signal 12 input in the coding controller 41.
  • the coding controller 41 uses three input signals of the input image signal 12, the filtered predictive error signal 15x and the unfiltered predictive error signal 15y for the "Activity" comparison to output the coding control signal 42 by selecting the mode of the signal with the smallest "Activity".
  • Fig. 13 shows a block diagram of a configuration of the coding controller 41 according to the embodiment.
  • Fig. 13 comprises Fig. 2, as modified by adding a filtered predictive error signal 15x and an unfiltered predictive error signal 15y, instead of the predictive error signal 15 and also adding an "Activity" of the filtered predictive error signal 15a and an "Activity” of the unfiltered predictive error signal 15c. Therefore the coding controller 41 according to this embodiment inputs three signals, instead of two as described hereinbefore.
  • the "Activity" calculator 45 calculates the "Activities" of the three signals and outputs the calculated result to the "Activity" comparative selector 46.
  • Fig. 14 shows a block diagram of a configuration of the "Activity" comparative selector 46 according to the embodiment.
  • Fig. 14 shows a block diagram of a configuration of the "Activity" comparative selector 46 according to the embodiment.
  • Fig. 3 as modified by adding the filtered predictive error signal 15x, the unfiltered predictive error signal 15y, the "Activity” of the predictive error signal 15c, and a weighted “Activity” of the predictive error signal 15d.
  • the three input “Activities” of the signals in the "Activity” comparative selector 46 are added weight in the weighting circuit 46a.
  • Weighting coefficients W1, W2, and W3 is assigned in the weighting circuit in advance.
  • the weighting circuit adds weight by multiplying the "Activity" of input image signal 12a by a weighting coefficient W1 to output a weighted "Activity” of the input image signal 12b to the comparator 46b.
  • the "Activity” 15a is multiplied by W2 to have a weighted “Activity” 15b and the "Activity” 15c is multiplied by W3 to have a weighted “Activity” 15d.
  • the comparator 46b compares the three weighted "Activities” to generate a mode signal 46m based upon the comparison result.
  • the control signal generator 46c selects one of the three signals as the output select signal 15o, of the input image signal 12, the filtered predictive error signal 15x, and the unfiltered predictive error signal 15y based upon the mode signal 46m.
  • the control signal generator 46c When the input image signal 12 is selected for the select signal 15o, the control signal generator 46c reads out a quantization step size and a DCT coefficient previously stored in the memory table according to the value of the weighted "Activity" of the input image signal 12b. When the filtered predictive error signal 15x is selected for the select signal 15o, the control signal generator 46c reads out a quantization step size and a DCT coefficient in that manner as described hereinbefore based upon the value of the weighted "Activity" of the filtered predictive error signal 15b.
  • control signal generator 46c reads out a quantization step size and a DCT coefficient in that manner as described hereinbefore based upon the value of the weighted "Activity" of the unfiltered predictive error signal 15d.
  • the readout quantization step size and DCT coefficient as well as the mode signal 46m are multiplexed to be output as the control signal 42.
  • the coding controller 41 in accordance with the invention can add weight on at least one of the "Activities" of the three signals, the filtered predictive signal 15a, the unfiltered predictive error signal 15, and the input image signal 12 for the "Activity" comparison to output the coding control signal 42 based upon the signal with the smallest "Activity".
  • the coding control signal 42 in accordance with the invention can be output based upon a mode signal derived from an image signal with smaller "Activity" compared between those of the filtered predictive error signal 15a and the input image signal 12a.
  • the coding controller 41 in accordance with the invention can add weight on either or both of the "Activities" of the filtered predictive error signal through the processing units or/and the input image signal 12 for comparison to output the coding control signal 42.
  • Fig. 15 shows a configuration of interframe coding system according to this embodiment.
  • Fig. 15 comprises Fig. 4, as modified by adding another input of the filter control signal 23 from the filter controller 21 into the coding controller 41.
  • the filter control signal 23 is for a weighting control.
  • the filter control signal informs the coding controller 41 of the condition of the predictive error signal 15 whether it is filtered or not in the adaptive filter 22.
  • the control signal 23 is analyzed in the weighting circuit 46a in the coding controller 41 to inform whether the adaptive filter 22 is ON or OFF.
  • the weighting circuit 46a knows that the predictive error signal 15 is based upon the predictive signal 24 filtered in the adaptive filter 22, for example, it adds weight on the predictive error signal 15.
  • Dynamic weighting control can be realized with a variety of modes or values in the filter control signal 23 providing more than two modes of ON and OFF.
  • the filter control signal 23 in accordance with the invention can be specified by a difference itself between the input image signal 12 and the image signal from the frame memory 1 without the normalization action process in the filter controller 21.
  • the filter control signal 23 in accordance with the invention can be specified based upon a difference between the input image signal 12 and the image signal from the frame memory 1.
  • the filter controller 21 in accordance with the invention can output the filter control signal 23 by normalizing the difference between the input image signal 12 and an image signal from the frame memory 1 by the image signal from the frame memory 13.
  • the adaptive filter 16 in accordance with the invention can be provided after the adder 6 in the local decoding loop as shown in Fig. 16.
  • the adaptive filter 22 filters the local decoded signal 18 based upon the filter control signal 23 from the filter controller 21.
  • either the filtered or unfiltered local decoded signal is stored in the frame memory 1.
  • the filtered, for instance, image signal 14 or predictive signal 24 from the frame memory 1 is subtracted from the input image signal 12 in the subtractor 3 to output the predictive error signal 15 for interframe coding.
  • the frame memory 1 in accordance with the invention can store an image signal by the field instead of the frame.
  • the frame memory can also store a multiple number of time-varying frames or fields instead one frame or one field.
  • Fig. 17 shows a configuration of interframe coding system in accordance with the invention.
  • Fig. 17 comprises Fig. 4, as modified by adding a coding-filtering controller 50 instead of providing separately the filter controller 21 and the coding controller 41.
  • Both of the filter controller and coding controller calculate the "Activity" of an image signal in the same manner to control a signal and therefore it may be desirable to integrate them in terms of the concentration of the similar unit including the same function.
  • the integrated controller of filtering and coding can provide more control efficient coding system and contribute to downsizing or minimization of the overall system.
  • the motion vector detector 2 in accordance with the invention can be removed from the system when the system prioritizes simplification. With this configuration, the quantity of motion of an image signal is always considered zero.
  • coding control system in accordance with the invention can provide a feedback loop based upon the coded data from the encoder 4 or the local error signal 16, adding to the coding controller 41 or the filtering-coding controller 50.
  • Fig. 18 shows a configuration of the interframe coding system according to this embodiment.
  • Fig. 18 comprises Fig. 1, as modified by adding a transmission buffer 100, a transmission signal 160 and a feedback signal 101.
  • the transmission buffer 100 stores coded data from the encoder 4 based upon the coded error signal 16.
  • the transmission signal 160 of the coded error signal 16 is transmitted onto a transmission line from the transmission buffer 100.
  • the feedback signal 101 is fed back to the coding controller 41 from the transmission buffer 100.
  • the coding controller 41 controls coding with the coding control signal 42 by the feedback signal 101.
  • the feedback signal 101 indicates, for instance, occupied ratio of coded error signals 16 in the transmission buffer 100.
  • the coding controller 41 controls coding with the coding control signal 42 to reduce the amount coding in the encoder 4, for instance, when the coded error signal 16 occupies the transmission buffer 100 in larger proportion.
  • the coding controller 41 controls coding to increase the amount of coding in the encoder 4 with the coding control signal 42, for instance, when the coded error signal 16 occupies the transmission buffer 100 in smaller proportion.
  • the "Activity" of an image signal in accordance with the invention can be represented in a variety of manners as a characteristic of the image signal.
  • the foregoing embodiments provide the "Activity", a characteristic, of an image signal by a difference between image signals or by the sum of the absolute or squared difference values of an image signal vs. the mean value.
  • the processing unit of image signal in accordance with the invention can be a block of 16x16, 32x32, or 8x16 pixels for example, instead of a block of 8x8 pixels. Otherwise, the processing unit can possibly be other forms, instead of a block of pixels.
  • a coding signal or coding data in accordance with the invention can be based upon radar signal or sound signal, instead of image signal.
  • the interframe coding system of the present invention has the following advantageous effects.
  • the coding controller outputs the coding control signal based upon the "Activities" of the input image signal and the predictive error signal. This can improve coding efficiency.
  • the coding controller adds weight on the "Activity" of an input image signal.
  • the coding controller can control the output ratio of an image signal as the select signal from the coding controller in accordance with a user's or system's needs or the condition of the processing image signal.
  • filtering control and coding control are designed to deal with any image signals comprehensively including pictures with no or little motion and pictures with motion. Therefore pictures with motion can keep the original definition, ⁇ Awhile pictures with no or little motion can acquire high definition coded image by eliminating higher frequency components in the signal.
  • filtering can produce a highly coding efficient image signal by eliminating higher frequency components in the signal in the event that the predictive signal still contains a large amount of quantization error. Further, the coding controller outputs the coding control signal based upon the signal with the smallest "Activity" among others, so that the coding efficiency can be improved.
  • the coding controller outputs the coding control signal based upon the mode signal by selecting the image signal with the smallest "Activity" among others. This can improve the coding efficiency by providing a highly efficient prediction with less coding loop gain.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Algebra (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Image Processing (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Claims (10)

  1. Codiersystem, welches einen Codierer (4) zum Codieren eines Eingangssignals (12) enthaltend die Quantisierung in ein codiertes Signal (16) und einen Vollbildspeicher (1) zum Ausgeben eines Vorhersagesignals (11) enthält, welches aufweist:
    eine Codiersteuervorrichtung (41), die auf das Eingangssignal (12) und das Vorhersagesignal (11) anspricht, um ein Codiersteuersignal (42) für die Steuerung des Codierers (4) zu erzeugen,
       dadurch gekennzeichnet, daß
    die Codiersteuervorrichtung (41) eine Aktivitätsberechnungsvorrichtung (45) zum Berechnen eines Aktivitätswertes jeweils des Eingangssignals (12) und eines Vorhersagefehlersignals (15), das durch Subtrahieren des Eingangssignals (12) von dem Vorhersagesignal (11) gebildet ist, wobei der Aktivitätswert kleiner wird, wenn das entsprechende Signal eine große Menge von niedrigeren Frequenzkomponenten enthält, und größer wird, wenn das entsprechende Signal eine große Menge von höheren Frequenzkomponenten enthält, und eine Aktivitätsvergleichs-Auswahlvorrichtung (46) für den Vergleich der Aktivitätswerte und für die Erzeugung des Codiersteuersignals (42), das eine Quantisierungsschrittgröße auf der Grundlage der Aktivitätswerte liefert, enthält.
  2. Codiersystem nach Anspruch 1, dadurch gekennzeichnet, daß die Aktivitätsvergleichs-Auswahlvorrichtung (46) auch vorgesehen ist für die Auswahl entweder des Eingangssignals (12) oder des Vorhersagefehlersignals (15) für die Codierung auf der Grundlage des Vergleichsergebnisses.
  3. Codiersystem nach Anspruch 1 oder 2, dadurch gekennzeichnet, daß die Aktivitätsvergleichs-Auswahlvorrichtung (46) Mittel (46a) zum Gewichten zumindest einer von Charakteristiken enthält.
  4. Codiersystem nach einem der Ansprüche 1 bis 3, gekennzeichnet durch
    ein Filter (22) zum Empfang und zum Filtern des Vorhersagesignals (14) und zum Ausgeben eines gefilterten Signals (24); und
    eine Filtersteuervorrichtung (21), die auf das Eingangssignal (12) und das Vorhersagesignal (14) anspricht, um ein Filtersteuersignal (23) zur Steuerung des Filters (22) zu erzeugen.
  5. Codiersystem nach Anspruch 4, dadurch gekennzeichnet, daß die Codiersteuervorrichtung (41) aufweist:
    Mittel zur Inter-Vollbild-Codierung, welche ein erstes Inter-Vollbild-Signal auf der Grundlage des gefilterten Signals und ein zweites Inter-Vollbild-Signal auf der Grundlage des ungefilterten Vorhersagesignals erzeugen;
    Mittel zur Intra-Vollbild-Codierung, welche ein Intra-Vollbild-Signal erzeugen;
    Mittel (45) zum Bestimmen von Charakteristiken des ersten und des zweiten Inter-Vollbild-Signals sowie des Intra-Vollbild-Signals;
    Mittel (56b) zum Vergleichen von jeweils zwei von der Charakteristik des ersten Inter-Vollbild-Signals, der Charakteristik des zweiten Inter-Vollbild-Signals und der Charakteristik des Intra-Vollbild-Signals; und
    Mittel (46c) zum Erzeugen des Codiersteuersignals auf der Grundlage des Vergleichsergebnisses.
  6. Codiersystem nach Anspruch 5, dadurch gekennzeichnet, daß Vergleichsmittel (46a) Mittel zum Gewichten zumindest einer von Charakteristiken enthalten.
  7. Codiersystem nach Anspruch 4, dadurch gekennzeichnet, daß die Codiersteuervorrichtung (41) aufweist:
    Mittel zur Inter-Vollbild-Codierung, welche ein Inter-Vollbild-Signal auf der Grundlage des gefilterten Signals erzeugen;
    Mittel zur Intra-Vollbild-Codierung, welche ein Intra-Vollbild-Signal auf der Grundlage des gefilterten Signals erzeugen;
    Mittel zur Intra-Vollbild-Codierung, welche ein Intra-Vollbild-Signal erzeugen;
    Mittel zur Bestimmung einer Charakteristik des Inter-Vollbild-Signals und einer Charakteristik des Intra-Vollbild-Signals;
    Mittel zum Vergleichen der beiden Charakteristiken; und
    Mittel zum Erzeugen des Codiersteuersignals auf der Grundlage des Vergleichsergebnisses.
  8. Codiersystem nach Anspruch 7, dadurch gekennzeichnet, daß die Vergleichsmittel Mittel zum Gewichten zumindest einer von Charakteristiken enthalten.
  9. Codiersystem nach Anspruch 1, dadurch gekennzeichnet, daß die Codiersteuervorrichtung (41) Mittel zum Erzeugen des Codiersteuersignals auf der Grundlage des codierten Signals enthalten, die eine Rückkopplungsschleife bilden.
  10. Codiersystem nach Anspruch 2, 5 oder 7, dadurch gekennzeichnet, daß die Codiersteuervorrichtung (41) Mittel (45) zum Berechnen der Charakteristik auf der Grundlage einer Differenz zwischen dem Maximal- und dem Minimalwert des Signals, der Summe der absoluten Differenzwerte zwischen den individuellen Differenzwerten zwischen den individuellen Werten und dem Mittelwert der individuellen Werte, oder der Summe der quadrierten Differenzwerte zwischen den individuellen Werten und dem Mittelwert der individuellen Werte enthalten.
EP19980123717 1992-12-25 1993-12-23 Kodierungssystem Expired - Lifetime EP0902592B1 (de)

Applications Claiming Priority (10)

Application Number Priority Date Filing Date Title
JP346552/92 1992-12-25
JP34655292 1992-12-25
JP34655292 1992-12-25
JP36371/93 1993-02-25
JP3637193 1993-02-25
JP3637193 1993-02-25
JP20784293 1993-08-23
JP207842/93 1993-08-23
JP20784293A JP3165296B2 (ja) 1992-12-25 1993-08-23 フレーム間符号化処理方式及びフレーム間符号化処理方法及び符号化制御方式
EP19930120766 EP0603878B1 (de) 1992-12-25 1993-12-23 Kodierungssystem und -verfahren

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
EP19930120766 Division EP0603878B1 (de) 1992-12-25 1993-12-23 Kodierungssystem und -verfahren

Publications (3)

Publication Number Publication Date
EP0902592A2 EP0902592A2 (de) 1999-03-17
EP0902592A3 EP0902592A3 (de) 1999-08-25
EP0902592B1 true EP0902592B1 (de) 2002-05-15

Family

ID=27289070

Family Applications (4)

Application Number Title Priority Date Filing Date
EP19930120766 Expired - Lifetime EP0603878B1 (de) 1992-12-25 1993-12-23 Kodierungssystem und -verfahren
EP19980123716 Expired - Lifetime EP0903945B1 (de) 1992-12-25 1993-12-23 System und Verfahren zur Zwischenbildkodierung
EP19980123717 Expired - Lifetime EP0902592B1 (de) 1992-12-25 1993-12-23 Kodierungssystem
EP20010107231 Withdrawn EP1126723A3 (de) 1992-12-25 1993-12-23 System und Verfahren zur Zwischenbildkodierung

Family Applications Before (2)

Application Number Title Priority Date Filing Date
EP19930120766 Expired - Lifetime EP0603878B1 (de) 1992-12-25 1993-12-23 Kodierungssystem und -verfahren
EP19980123716 Expired - Lifetime EP0903945B1 (de) 1992-12-25 1993-12-23 System und Verfahren zur Zwischenbildkodierung

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP20010107231 Withdrawn EP1126723A3 (de) 1992-12-25 1993-12-23 System und Verfahren zur Zwischenbildkodierung

Country Status (5)

Country Link
US (4) US5579051A (de)
EP (4) EP0603878B1 (de)
JP (1) JP3165296B2 (de)
AU (1) AU656489B2 (de)
DE (3) DE69332180T2 (de)

Families Citing this family (81)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3165296B2 (ja) * 1992-12-25 2001-05-14 三菱電機株式会社 フレーム間符号化処理方式及びフレーム間符号化処理方法及び符号化制御方式
JPH07203428A (ja) * 1993-12-28 1995-08-04 Canon Inc 画像処理方法及び装置
KR100213015B1 (ko) * 1994-03-31 1999-08-02 윤종용 양자화 방법 및 회로
US6026190A (en) * 1994-10-31 2000-02-15 Intel Corporation Image signal encoding with variable low-pass filter
JP2900983B2 (ja) * 1994-12-20 1999-06-02 日本ビクター株式会社 動画像帯域制限方法
EP0721286A3 (de) * 1995-01-09 2000-07-26 Matsushita Electric Industrial Co., Ltd. Einrichtung zur Dekodierung von Videosignalen mit Verminderung von Artefakten
JPH08237669A (ja) * 1995-02-28 1996-09-13 Sony Corp 画像信号処理装置、画像信号処理方法および画像信号復号化装置
US5812197A (en) * 1995-05-08 1998-09-22 Thomson Consumer Electronics, Inc. System using data correlation for predictive encoding of video image data subject to luminance gradients and motion
FR2737931B1 (fr) * 1995-08-17 1998-10-02 Siemens Ag Procede destine au traitement de blocs d'images decodes d'un procede de codage d'images a base de blocs
GB2342525B (en) * 1995-10-30 2000-06-28 Sony Uk Ltd Image quantisation based on image activity
KR100203710B1 (ko) * 1996-04-30 1999-06-15 전주범 비트 발생량 조절기능을 갖는 영상 부호화 시스템
US6101276A (en) * 1996-06-21 2000-08-08 Compaq Computer Corporation Method and apparatus for performing two pass quality video compression through pipelining and buffer management
JP3466032B2 (ja) * 1996-10-24 2003-11-10 富士通株式会社 動画像符号化装置および復号化装置
JP2001507880A (ja) * 1996-12-09 2001-06-12 ソネラ ユルキネン オサケユキチュア ビデオ画像の伝送方法
FI106071B (fi) * 1997-03-13 2000-11-15 Nokia Mobile Phones Ltd Mukautuva suodatin
US6269484B1 (en) * 1997-06-24 2001-07-31 Ati Technologies Method and apparatus for de-interlacing interlaced content using motion vectors in compressed video streams
KR100243225B1 (ko) * 1997-07-16 2000-02-01 윤종용 블록화효과 및 링잉잡음 감소를 위한 신호적응필터링방법 및신호적응필터
JPH11177993A (ja) * 1997-12-12 1999-07-02 Nec Corp 動画像符号化装置
JP3352931B2 (ja) * 1997-12-26 2002-12-03 沖電気工業株式会社 動きベクトル検出装置
US6101278A (en) * 1998-01-30 2000-08-08 Philips Electronics North America Corp. System for extracting coding parameters from video data
EP1065881B1 (de) * 1998-03-05 2008-07-09 Matsushita Electric Industrial Co., Ltd. Verfahren zur bildkodierung, verfahren zur bildkodierung/-dekodierung, bildkodierer, oder vorrichtung zur bildaufzeichnung/-wiedergabe
WO1999059344A1 (en) * 1998-05-12 1999-11-18 Sgs-Thomson Microelectronics Asia Pacific (Pte) Ltd. Conditional masking for video encoder
KR20010032337A (ko) * 1998-09-22 2001-04-16 마츠시타 덴끼 산교 가부시키가이샤 영상신호 부호화방법, 영상신호 부호화장치 및 프로그램기록매체
US6307979B1 (en) 1999-02-12 2001-10-23 Sony Corporation Classified adaptive error recovery method and apparatus
US6519369B1 (en) 1999-02-12 2003-02-11 Sony Corporation Method and apparatus for filter tap expansion
US6621936B1 (en) 1999-02-12 2003-09-16 Sony Corporation Method and apparatus for spatial class reduction
US6418548B1 (en) 1999-02-12 2002-07-09 Sony Corporation Method and apparatus for preprocessing for peripheral erroneous data
US6591398B1 (en) 1999-02-12 2003-07-08 Sony Corporation Multiple processing system
EP1075147A1 (de) * 1999-08-02 2001-02-07 Koninklijke Philips Electronics N.V. Bewegungsschätzung
US6522785B1 (en) 1999-09-24 2003-02-18 Sony Corporation Classified adaptive error recovery method and apparatus
US6351494B1 (en) * 1999-09-24 2002-02-26 Sony Corporation Classified adaptive error recovery method and apparatus
US6754371B1 (en) 1999-12-07 2004-06-22 Sony Corporation Method and apparatus for past and future motion classification
US6931063B2 (en) * 2001-03-26 2005-08-16 Sharp Laboratories Of America, Inc. Method and apparatus for controlling loop filtering or post filtering in block based motion compensationed video coding
EP1404136B1 (de) 2001-06-29 2018-04-04 NTT DoCoMo, Inc. Bildcodierer, bilddecodierer, bildcodierungsverfahren und bilddecodierungsverfahren
EP1515567B1 (de) 2001-09-12 2006-08-23 Matsushita Electric Industrial Co., Ltd. Bildkodierungsverfahren und Bilddekodierungsverfahren
US20040062310A1 (en) 2002-01-17 2004-04-01 Zhong Xue Coding distortion removal method, video encoding method, video decoding method, and apparatus and program for the same
ES2754625T3 (es) 2001-11-29 2020-04-20 Godo Kaisha Ip Bridge 1 Método de extracción de distorsión de codificación
US6996249B2 (en) * 2002-01-11 2006-02-07 Nec Laboratories America, Inc. Applying informed coding, informed embedding and perceptual shaping to design a robust, high-capacity watermark
US20030161407A1 (en) * 2002-02-22 2003-08-28 International Business Machines Corporation Programmable and adaptive temporal filter for video encoding
US6980599B2 (en) * 2002-06-04 2005-12-27 Koninklijke Philips Electronics N.V. Video decoding system and method having post-processing to reduce sharpness prediction drift
BRPI0303901B1 (pt) * 2002-07-11 2018-03-06 Godo Kaisha Ip Bridge 1 “Método de determinação de poder de filtragem para determinar um poder de filtragem para remover uma distorção de codificação entre blocos que constituem uma imagem, método de decodificação de imagem móvel para decodificar os dados de imagem móvel codificados, aparelho de determinação de poder de filtragem, e aparelho de codificação de imagem móvel”
EP1391866A1 (de) * 2002-08-23 2004-02-25 Deutsche Thomson Brandt Adaptive Rauschreduzierung für digitale Bildanzeigevorrichtungen
US8126078B2 (en) * 2003-01-28 2012-02-28 Agere Systems Inc. Method and apparatus for reducing noise in an unbalanced channel using common mode component
US7995849B2 (en) * 2003-03-17 2011-08-09 Qualcomm, Incorporated Method and apparatus for improving video quality of low bit-rate video
JP3997171B2 (ja) * 2003-03-27 2007-10-24 株式会社エヌ・ティ・ティ・ドコモ 動画像符号化装置、動画像符号化方法、動画像符号化プログラム、動画像復号装置、動画像復号方法、及び動画像復号プログラム
FR2857205B1 (fr) * 2003-07-04 2005-09-23 Nextream France Dispositif et procede de codage de donnees video
US7257173B2 (en) * 2004-04-28 2007-08-14 Agilent Technologies, Inc. Bounding box signal detector
US8503530B2 (en) * 2004-05-27 2013-08-06 Zhourong Miao Temporal classified filtering for video compression
JP4189358B2 (ja) * 2004-06-17 2008-12-03 株式会社東芝 画像符号化装置及び方法
KR20060005585A (ko) * 2004-07-13 2006-01-18 삼성전자주식회사 Usb를 이용한 데이터 전송 장치 및 방법
US8218634B2 (en) * 2005-01-13 2012-07-10 Ntt Docomo, Inc. Nonlinear, in-the-loop, denoising filter for quantization noise removal for hybrid video compression
JP4150730B2 (ja) * 2005-02-14 2008-09-17 株式会社東芝 画像符号化装置、および画像符号化方法
EP2234405A3 (de) 2005-04-13 2011-03-16 NTT DoCoMo, Inc. Bildvorhersage auf Basis einer Frequenzbandanalyse des zu vorhersagenden Bildes
US20060285590A1 (en) * 2005-06-21 2006-12-21 Docomo Communications Laboratories Usa, Inc. Nonlinear, prediction filter for hybrid video compression
JP4650173B2 (ja) * 2005-09-05 2011-03-16 ソニー株式会社 符号化装置、符号化方法、符号化方法のプログラム及び符号化方法のプログラムを記録した記録媒体
KR100738075B1 (ko) * 2005-09-09 2007-07-12 삼성전자주식회사 영상 부호화/복호화 장치 및 방법
US7787541B2 (en) * 2005-10-05 2010-08-31 Texas Instruments Incorporated Dynamic pre-filter control with subjective noise detector for video compression
KR100723507B1 (ko) * 2005-10-12 2007-05-30 삼성전자주식회사 I-프레임 움직임 예측을 이용한 동영상 압축 장치의 적응양자화 제어기 및 적응 양자화 제어 방법
KR100728921B1 (ko) * 2005-12-26 2007-06-15 삼성전자주식회사 입력 영상에 적응적인 해상도변환장치 및 그의해상도변환방법
WO2007116551A1 (ja) * 2006-03-30 2007-10-18 Kabushiki Kaisha Toshiba 画像符号化装置及び画像符号化方法並びに画像復号化装置及び画像復号化方法
WO2007114368A1 (ja) * 2006-03-30 2007-10-11 Kabushiki Kaisha Toshiba 画像符号化装置及び方法並びに画像復号化装置及び方法
JP4747975B2 (ja) 2006-07-14 2011-08-17 ソニー株式会社 画像処理装置および方法、プログラム、並びに、記録媒体
US9014280B2 (en) * 2006-10-13 2015-04-21 Qualcomm Incorporated Video coding with adaptive filtering for motion compensated prediction
EP2082585A2 (de) * 2006-10-18 2009-07-29 Thomson Licensing Verfahren und vorrichtung zur videokodierung über präzisierte prognosedaten
JP4901450B2 (ja) * 2006-12-19 2012-03-21 株式会社東芝 動画像符号化装置
JP4518111B2 (ja) * 2007-07-13 2010-08-04 ソニー株式会社 映像処理装置、映像処理方法、及びプログラム
JP2010287916A (ja) * 2007-09-10 2010-12-24 Panasonic Corp 画像符号化方法
US8300987B2 (en) * 2007-09-28 2012-10-30 Ati Technologies Ulc Apparatus and method for generating a detail-enhanced upscaled image
US8964117B2 (en) 2007-09-28 2015-02-24 Ati Technologies Ulc Single-pass motion adaptive deinterlacer and method therefore
US8259228B2 (en) * 2007-12-10 2012-09-04 Ati Technologies Ulc Method and apparatus for high quality video motion adaptive edge-directional deinterlacing
US8396129B2 (en) * 2007-12-28 2013-03-12 Ati Technologies Ulc Apparatus and method for single-pass, gradient-based motion compensated image rate conversion
EP2249572A4 (de) * 2008-03-07 2012-05-23 Toshiba Kk Verfahren und vorrichtung für dynamische bildkodierung/-dekodierung
EP2141927A1 (de) * 2008-07-03 2010-01-06 Panasonic Corporation Filter für die Videocodierung
US8131056B2 (en) * 2008-09-30 2012-03-06 International Business Machines Corporation Constructing variability maps by correlating off-state leakage emission images to layout information
US8611435B2 (en) 2008-12-22 2013-12-17 Qualcomm, Incorporated Combined scheme for interpolation filtering, in-loop filtering and post-loop filtering in video coding
TWI463878B (zh) * 2009-02-19 2014-12-01 Sony Corp Image processing apparatus and method
JP5429582B2 (ja) * 2009-07-01 2014-02-26 ソニー株式会社 画像処理装置および方法
JP5698382B2 (ja) * 2011-01-12 2015-04-08 シーメンス アクチエンゲゼルシヤフトSiemens Aktiengesellschaft ビデオコーダにおける参照イメージの圧縮及び伸長方法
WO2012131895A1 (ja) * 2011-03-29 2012-10-04 株式会社東芝 画像符号化装置、方法及びプログラム、画像復号化装置、方法及びプログラム
US10257498B2 (en) 2015-12-04 2019-04-09 Empire Technology Development Llc Coordination of multiple structured light-based 3D image detectors
CN111327895B (zh) * 2018-12-17 2022-05-24 深圳市中兴微电子技术有限公司 一种数据处理方法及装置

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5244512A (en) * 1975-10-06 1977-04-07 Nippon Telegr & Teleph Corp <Ntt> Between-frame coding equipment
US4703350A (en) * 1985-06-03 1987-10-27 Picturetel Corporation Method and apparatus for efficiently communicating image sequences
US4754492A (en) * 1985-06-03 1988-06-28 Picturetel Corporation Method and system for adapting a digitized signal processing system for block processing with minimal blocking artifacts
FR2599201A1 (fr) * 1986-05-23 1987-11-27 Trt Telecom Radio Electr Dispositif de codage a modulation differentielle par impulsions codees, dispositif de decodage associe et systeme de transmission comportant au moins un tel dispositif de codage ou de decodage
US4706260A (en) * 1986-11-07 1987-11-10 Rca Corporation DPCM system with rate-of-fill control of buffer occupancy
JPH082106B2 (ja) * 1986-11-10 1996-01-10 国際電信電話株式会社 動画像信号のハイブリツド符号化方式
JPH082104B2 (ja) * 1986-11-10 1996-01-10 富士通株式会社 動き補償フレ−ム間符号化方式
US4794455A (en) * 1987-01-07 1988-12-27 Pictel Corporation Method and apparatus employing adaptive filtering for efficiently communicating image sequences
JPS63199589A (ja) * 1987-02-14 1988-08-18 Fujitsu Ltd フレ−ム間符号化方式
JP2743172B2 (ja) * 1987-02-25 1998-04-22 富士通株式会社 ループ内フィルタ処理方式
JPH01503668A (ja) * 1987-06-22 1989-12-07 イーストマン・コダック・カンパニー 適応利得及びかたよりによるブロック適応線形予測符号化
CA1333420C (en) * 1988-02-29 1994-12-06 Tokumichi Murakami Vector quantizer
JPH0813145B2 (ja) * 1988-03-09 1996-02-07 国際電信電話株式会社 領域分割を用いた動画像符号化方式
GB8826463D0 (en) * 1988-11-11 1988-12-14 Rca Licensing Corp Technique for actv side-panel noise reduction
DE3839642A1 (de) * 1988-11-24 1990-05-31 Bosch Gmbh Robert Einrichtung zur codierung von videosignalen
JPH0832047B2 (ja) * 1989-04-28 1996-03-27 日本ビクター株式会社 予測符号化装置
JP3159309B2 (ja) * 1989-09-27 2001-04-23 ソニー株式会社 映像信号符号化方法及び映像信号符号化装置
US5020401A (en) * 1989-10-13 1991-06-04 Jiles Stephen L Universal plastic-pipe tool
US5144426A (en) * 1989-10-13 1992-09-01 Matsushita Electric Industrial Co., Ltd. Motion compensated prediction interframe coding system
JPH03127580A (ja) * 1989-10-13 1991-05-30 Matsushita Electric Ind Co Ltd 動き補償フレーム間符号化装置
JPH03136586A (ja) * 1989-10-23 1991-06-11 Nec Corp 圧縮符号化装置
JPH0714209B2 (ja) * 1989-12-20 1995-02-15 松下電器産業株式会社 動画像符号化装置
DE69119936T2 (de) * 1990-02-28 1996-11-14 Victor Company Of Japan Einrichtung zur Datenkompression
US5150432A (en) * 1990-03-26 1992-09-22 Kabushiki Kaisha Toshiba Apparatus for encoding/decoding video signals to improve quality of a specific region
DE69126585T2 (de) * 1990-09-20 1998-01-02 Nec Corp Verfahren und Gerät zur Kodierung von bewegten Bildsignalen
JPH0813138B2 (ja) * 1990-11-28 1996-02-07 松下電器産業株式会社 画像符号化装置
JP2883449B2 (ja) * 1990-12-27 1999-04-19 株式会社東芝 記録装置
US5212742A (en) * 1991-05-24 1993-05-18 Apple Computer, Inc. Method and apparatus for encoding/decoding image data
DE4118571A1 (de) * 1991-06-06 1992-12-10 Philips Patentverwaltung Vorrichtung zur steuerung des quantisierers eines hybrid-kodierers
DE69225859T2 (de) * 1991-10-02 1998-12-03 Matsushita Electric Ind Co Ltd Orthogonaltransformationskodierer
JP2574572B2 (ja) 1991-10-09 1997-01-22 松下電器産業株式会社 画像符号化方法及び画像符号化装置
JP2586260B2 (ja) * 1991-10-22 1997-02-26 三菱電機株式会社 適応的ブロッキング画像符号化装置
JPH05183888A (ja) * 1991-12-27 1993-07-23 Mitsubishi Electric Corp 情報源符号化装置
JP3165296B2 (ja) * 1992-12-25 2001-05-14 三菱電機株式会社 フレーム間符号化処理方式及びフレーム間符号化処理方法及び符号化制御方式
US5461422A (en) * 1994-05-23 1995-10-24 Industrial Technology Research Institute Quantizer with automatic pre-threshold

Also Published As

Publication number Publication date
US5579051A (en) 1996-11-26
DE69331939T2 (de) 2003-01-02
DE69332180D1 (de) 2002-09-05
EP1126723A3 (de) 2003-07-30
EP0903945A2 (de) 1999-03-24
US5724098A (en) 1998-03-03
AU656489B2 (en) 1995-02-02
DE69331939D1 (de) 2002-06-20
EP0603878B1 (de) 1999-11-10
EP0603878A2 (de) 1994-06-29
JP3165296B2 (ja) 2001-05-14
DE69332180T2 (de) 2003-05-08
EP0902592A3 (de) 1999-08-25
AU5186293A (en) 1994-07-14
DE69326990T2 (de) 2000-05-31
EP0903945B1 (de) 2002-07-31
EP1126723A2 (de) 2001-08-22
US6272177B1 (en) 2001-08-07
DE69326990D1 (de) 1999-12-16
EP0903945A3 (de) 1999-08-25
EP0603878A3 (de) 1996-01-24
EP0902592A2 (de) 1999-03-17
US5543848A (en) 1996-08-06
JPH06311506A (ja) 1994-11-04

Similar Documents

Publication Publication Date Title
EP0902592B1 (de) Kodierungssystem
US5568196A (en) Motion adaptive noise reduction filter and motion compensated interframe coding system using the same
US5438374A (en) System and method for filtering video signals
US5260782A (en) Adaptive DCT/DPCM video signal coding method
EP0537958B1 (de) Bildkodierung und/oder -dekodierung
EP0235803B1 (de) System zur Kodierung und Übertragung von Bewegtbildsignalen
US5757969A (en) Method for removing a blocking effect for use in a video signal decoding apparatus
US5365271A (en) Information source encoding apparatus
JPH04328982A (ja) 高能率符号化装置及び復号化装置
US6512792B1 (en) Moving image encoding apparatus with a quantization step size different from the dequantization step size
JPH01228384A (ja) 領域分割を用いた動画像符号化方式
RU2154917C2 (ru) Улучшенный способ заключительной обработки и устройство для использования в системе декодирования сигнала изображения
JPH0681308B2 (ja) フレ−ム間符号化における量子化雑音抑圧方式
JPH0984024A (ja) 動画像信号の符号化装置
JP2512165B2 (ja) 動画像信号の符号化装置
JP4359273B2 (ja) 符号化モード選択方法
JPH05227513A (ja) 映像信号伝送装置
JP4353928B2 (ja) データ圧縮方法、記録方法、及び伝送方法
JP4359274B2 (ja) 動画像圧縮符号化装置
JPH0759087A (ja) 画像信号受信装置
JPH06296276A (ja) 動き補償予測符号化装置の前処理装置
JPH0787582B2 (ja) 画像符号化伝送装置
JPH0846976A (ja) 予測符号化装置
JP2001186527A (ja) 符号化制御方式
JPH09163374A (ja) 雑音低減装置

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AC Divisional application: reference to earlier application

Ref document number: 603878

Country of ref document: EP

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): DE FR GB NL

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): DE FR GB NL

17P Request for examination filed

Effective date: 19990908

17Q First examination report despatched

Effective date: 20000411

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAG Despatch of communication of intention to grant

Free format text: ORIGINAL CODE: EPIDOS AGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAH Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOS IGRA

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AC Divisional application: reference to earlier application

Ref document number: 603878

Country of ref document: EP

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB NL

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 69331939

Country of ref document: DE

Date of ref document: 20020620

ET Fr: translation filed
PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20030218

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20041208

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20041216

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20041222

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20051215

Year of fee payment: 13

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20051223

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060701

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20051223

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20060831

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20060831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20070701

NLV4 Nl: lapsed or anulled due to non-payment of the annual fee

Effective date: 20070701