Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
  • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
  • H04N19/51—Motion estimation or motion compensation
  • H04N19/573—Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
  • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
  • H04N19/51—Motion estimation or motion compensation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/146—Data rate or code amount at the encoder output
  • H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
  • H04N19/19—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding using optimisation based on Lagrange multipliers
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
  • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
  • H04N19/51—Motion estimation or motion compensation
  • H04N19/56—Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search

Definitions

• the invention relates to a method and an apparatus for coding and decoding a video frame in a telecommunication system, when the video frame is made up of a string of consecutive stationary frames, in which the frames to be transmitted are typically divided into frame blocks or segments, for instance pixel groups, specific for each frame and the data in each frame block typically comprises information indicating the luminance, colour and location of the frame block.
• Various methods have been developed to solve this problem.
• To transfer a frame the frame is usually divided into frame blocks whose size is selected to suit the system.
• Frame block information generally comprises information on the luminance, colour and location of the frame block in the frame itself.
• the frame block data is compressed by each block using a desired coding method. The compression is based on removing the less significant data. Compression methods are divided primarily into three classes: spectral redundancy reduction, spatial redundancy reduction and temporal redundancy reduction. Various combinations of these methods are typically used in compression.
• a YUV colour model for instance, is applied to spectral redundancy reduction.
• the YUV colour model utilises the fact that the human eye is more sensitive to changes in luminance than in chrominance, i.e. colour.
• the YUV model has one luminance component (Y) and two chrominance components (U, V).
• the chrominance components are also sub-sampled.
• a luminance block according to the H.263 video coding standard is 16 x 16 pixels and both chrominance blocks, which cover the same area as the luminance block, are 8 x 8 pixels.
• the combination of one luminance block and two chrominance blocks is in this standard called a macro block.
• a discrete cosine transformation for instance, is used, in which the block to be compressed is preferably 8 x 8 pixels.
• DCT discrete cosine transformation
• the pixel presentation of a frame block is transformed into a space-frequency presentation.
• the signal frequencies which exist in a frame block have high-amplitude coefficients, whereas the coefficients of the signals that do not exist in a frame block are close to zero.
• DCT is also a lossless transformation and interference is caused to the signal in quantizing only.
• Temporal redundancy can be reduced by utilising the fact that consecutive frames usually resemble each other, so instead of compressing each individual frame, motion data of the frame blocks is generated.
• the basic principle is as follows: an as good as possible reference block which has been coded earlier is searched for the frame block to be coded, the motion between the reference block and the frame block to be coded is modelled and the calculated motion vector coefficients are transmitted to the receiver.
• the difference between the block to be coded and the reference block is indicated as a prediction error component or frame.
• the problem is to find a reference block which produces as good a coding efficiency as possible (a sufficiently good picture quality with as small an amount of bits as possible) and a high calculation capacity, and thus also calculation time, required by the comparison.
• the invention is based on using the frame reconstruction data of at least one or more reference frames or reference blocks and of one or more earlier coded neighbouring blocks in coding the frame reconstruction data.
• the frame reconstruction data and motion data coded with the method of the invention or with another known method is selected for use depending on how the desired coding efficiency is obtained with a sufficient picture quality.
• a method of coding video frames in a telecommunication system comprising: forming a video frame of consecutive stationary frames, storing the frame reconstruction data of at least one frame as a reference frame and the motion data of earlier coded neighbouring blocks, defining by means of the motion data of one or more earlier coded neighbouring blocks the motion data of the block to be coded, which neighbouring block is formed by means of the stored reference frame, defining the frame reconstruction data of the frame to be coded, selecting for use the frame reconstruction data and motion data representing the block to be coded, which provide a pre-defined coding efficiency with a predefined picture quality.
• a method of coding video frames in a telecommunication system comprising: forming a video frame of consecutive stationary frames, storing the frame reconstruction data of at least one frame as a reference frame and the motion data of earlier coded neighbouring blocks, defining the motion data of a frame block to be coded using only the neighbouring blocks which have the same reference frame used to code the frame reconstruction data of the block to be coded, selecting for use the frame reconstruction data and motion data, which provide a pre-defined coding efficiency with a pre-defined picture quality.
• the invention also relates to a subscriber terminal comprising: means for forming a video frame of consecutive stationary frames, means for storing the frame reconstruction data of at least one frame as a reference frame and the motion data of earlier coded neighbouring blocks, means for defining by means of the motion data of one or more earlier coded neighbouring blocks the motion data of the block to be coded, which neighbouring block is formed by means of the stored reference frame, means for defining the frame reconstruction data of the frame to be coded, means for selecting for use the frame reconstruction data and motion data representing the block to be coded, which provide a pre-defined coding efficiency with a predefined picture quality.
• the invention also relates to a subscriber terminal comprising: means for forming a video frame of consecutive stationary frames, means for storing the frame reconstruction data of at least one frame as a reference frame and the motion data of earlier coded neighbouring blocks, means for defining the motion data of a frame block to be coded using only the neighbouring blocks which have the same reference frame used to code the frame reconstruction data of the block to be coded, means for selecting for use the frame reconstruction data and motion data, which provide a pre-defined coding efficiency with a pre-defined picture quality.
• the invention also relates to a video coder comprising: means for forming a video frame of consecutive stationary frames, means for storing the frame reconstruction data of at least one frame as a reference frame and the motion data of earlier coded neighbouring blocks, means for defining by means of the motion data of one or more earlier coded neighbouring blocks the motion data of the block to be coded, which neighbouring block is formed by means of the stored reference frame, means for defining the frame reconstruction data of the frame to be coded, means for selecting for use the frame reconstruction data and motion data representing the block to be coded, which provide a pre-defined coding efficiency with a predefined picture quality.
• the invention also relates to a video coder comprising: means for forming a video frame of consecutive stationary frames, means for storing the frame reconstruction data of at least one frame as a reference frame and the motion data of earlier coded neighbouring blocks, means for defining the motion data of a frame block to be coded using only the neighbouring blocks which have the same reference frame used to code the frame reconstruction data of the block to be coded, means for selecting for use the frame reconstruction data and motion data, which provide a pre-defined coding efficiency with a pre-defined picture quality.
• the invention also relates to a computer program which can be read by a computer and which executes the method of coding video frames in a telecommunication system, comprising: forming a video frame of consecutive stationary frames, storing the frame reconstruction data of at least one frame as a reference frame and the motion data of earlier coded neighbouring blocks, defining by means of the motion data of one or more earlier coded neighbouring blocks the motion data of the block to be coded, which neighbouring block is formed by means of the stored reference frame, defining the frame reconstruction data of the frame to be coded, selecting for use the frame reconstruction data and motion data representing the block to be coded, which provide a pre-defined coding efficiency with a predefined picture quality.
• the invention also relates to a computer program which can be read by a computer and which executes the method of coding video frames in a telecommunication system, comprising: forming a video frame of consecutive stationary frames, storing the frame reconstruction data of at least one frame as a reference frame and the motion data of earlier coded neighbouring blocks, defining the motion data of a frame block to be coded using only the neighbouring blocks which have the same reference frame used to code the frame reconstruction data of the block to be coded, selecting for use the frame reconstruction data and motion data, which provide a predefined coding efficiency with a pre-defined picture quality.
• the method and apparatus of the invention provide savings in calculation time and capacity while the picture quality remains adequate.
• Figure 1 illustrates an example of a telecommunication system
• Figures 2a to 2c illustrate one estimation process of vectors using a reference frame
• Figure 3 illustrates one estimation process of a motion vector using neighbouring blocks
• Figure 4 is a flow chart which shows method steps of finding a reference block and predicting a motion vector
• Figure 5 illustrates an example of finding a reference block and predicting a motion vector
• Figure 6 illustrates an example of a coder
• Figure 7 illustrates an example of a decoder
• Figure 8 illustrates an example of a subscriber terminal
• Figure 9 illustrates a second example of finding a reference block and predicting a motion vector.
• Figure 1 illustrates in a simplified manner one digital data transmission system to which the solution of the invention can be applied. It is a part of a cellular radio system comprising a base station 104 which is in radio contact 108 and 110 with subscriber terminals 100 and 102 which can be terminals installed fixedly or in a vehicle or portable terminals. Transceivers in the base station are connected to an antenna unit, with which the radio link to the subscriber terminals is implemented. The base station is further in contact with a base station controller 106 which transmits the connections of the terminals elsewhere in the network. The base station controller controls in a centralised manner several base stations connected to it. A control unit in the base station controller takes care of call control, data traffic control, mobility management, collection of statistics, and signalling.
• the cellular radio system can also have a connection to the public telephone network, in which case a transcoder belonging to the system transforms the different digital coding formats of speech used between the public telephone network and the cellular radio network to suit each other, for instance from the 64 kbit/s format of the fixed network to a cellular radio network format (e.g. 13 kbit s) and vice versa.
• a transcoder belonging to the system transforms the different digital coding formats of speech used between the public telephone network and the cellular radio network to suit each other, for instance from the 64 kbit/s format of the fixed network to a cellular radio network format (e.g. 13 kbit s) and vice versa.
• FIGS. 2a to 2c show in a simplified manner a prior art coding method of motion which is based on predicting the motion vector of a frame block (the term block is also used in the text) using a reference frame stored earlier in memory.
• This type of coding is called inter- coding which means utilising the similarities between the frames in a string of frames in compression coding.
• the reference frame 206 has been divided into blocks or segments and coded earlier.
• Figures 2b to 2c do not show frame blocks.
• the reference frame can be before or after the frame to be coded in the string of frames.
• Figure 2a shows the current frame being coded 204 which is also divided into blocks, of which only one block 200 is shown for clarity's sake.
• the size of the blocks is N x M.
• the current block 200 and the reference block 214 shown in Figure 2c need not be geometrically similar, because in reality, too, the filmed objects change, such as rotate or twist.
• the selection criterion is typically to find a block, by means of which it is possible to minimise the number of bits required for transferring the block being coded in such a manner that the picture quality remains sufficiently good.
• the selection criteria can vary depending on the object of application.
• the search is usually performed in the reference frame 206 in an area which is in a frame location corresponding to the block 200 being coded in the current frame 204 and in a certain area in the immediate proximity, depicted by the search area 210 in Figures 2b and 2c.
• the size of the search area is defined suitable for the object of application, for instance by determining on the basis of the frames of the frame string coded earlier, whether the motion is slow or fast; if the motion is slow, the search area can be limited smaller than if the motion is fast.
• the search is typically conducted in the surroundings of the predicted motion vector.
• the location of the frame block is in the example of Figures 2a to 2c indicated with coordinates (x, y) in the upper left corner of the block.
• the x coordinate indicates the location of the pixel or block in horizontal direction and the y coordinate the location of the pixel or block in vertical direction.
• the coordinates of the block being coded are marked as 202.
• the best possible reference frame block 214 has been found in the search area 210.
• the coordinates (x, y) 208 are those of the location where the block 200 being coded would be if it had not moved and thus the same as the coordinates 202. They are shown for the purpose of illustration.
• the block 212 depicts the block 200 had it not moved and is also shown for the purpose of illustration.
• the motion of the frame block being coded can now be indicated as a change from the coordinates (x+u, y+v) 216 to the coordinates (x, y) 208.
• the coordinates (x, y) are defined as origo, so the motion vector 218 of the block being coded can be indicated as coordinates (u, v).
• the motion vector can also be indicated using definition of motion vector coefficients and motion models.
• Figure 3 shows in a simplified manner prior art motion coding methods which are based on predicting the motion vector coefficients of a frame block being coded using earlier coded neighbouring blocks of the frame being coded.
• the neighbouring blocks of the frame block 304 being coded, which have already been coded earlier and which are used to predict the motion vector coefficients of the frame block being coded are here referred to as prediction candidates.
• the prediction candidates are neighbouring blocks 300, 302, 306.
• the prediction candidates 300, 302, 306 are in the example of Figure 3 marked for identification with certain pixel locations 308, 310, 312.
• the prediction candidate 306 is on the left side of the block being coded and marked with the pixel location 308, the prediction candidate 300 is above the block being coded and marked with the pixel location 310 and the prediction candidate 302 is in the top right corner of the block being coded and marked with the pixel location 312.
• the pixel locations 308, 310, 312 reside in their blocks in close proximity to the block 304 being coded. It should be noted that the number and location of the neighbouring blocks with respect to the block being coded may differ from those shown in Figure 3. In the case shown in Figure 3, all three prediction candidates are used in predicting the motion vector coefficients of the block 304 being coded.
• the required motion vector coefficients can, for instance, be predicted as a median of the motion vector coefficients obtained from these prediction candidates. It is also possible to use only one prediction candidate in predicting the motion vector coefficients of the block 304, in which case the coefficients are obtained from the motion vector coefficients of the prediction block 306, the motion vector coefficients of the prediction block 300 or the motion vector coefficients of the prediction block 302.
• Inter- and intra-coding are typically combined block by block in coding video frames to obtain the best possible result.
• An intra-coded frame can be sent at suitable intervals to prevent the accumulation of possible errors caused by the transmission channel from one frame to another, finally causing the failure of the decoding of the frame.
• the methods shown in Figures 2a to 2c and 3 can be used both in coding and decoding.
• the method used by the coder with the necessary frame data is transmitted to the decoder as a bit stream.
• the blocks can also be segmented. Segmentation is preferable in situations where different parts of the frame move in different ways, for instance the background remains the same while a single object, such as a person, a car or the like, moves.
• a frame block can be segmented by dividing it in segments vertically, as in block 300, horizontally, of which there is no example, or in both directions, as in block 306. By segmentation, it is also possible to reduce the number of bits being transferred by using a suitable part of another already coded frame.
• models for motion estimation are utilised. Different models are suitable for defining different motion, such as presenting vertical and horizontal motion or presenting rotation.
• Such models include the affine motion model in which the motion of a pixel, frame segment or block is indicated by a formula in which ⁇ x and ⁇ y form the motion vector
• a 0 , a ⁇ a 2 , b 0 , b 1 and b 2 are motion vector coefficients and x and y are vector components, of which x indicates the location of a pixel or a block in horizontal direction and y the location of a pixel or a block in vertical direction, or the translational model in which the motion of a pixel, frame segment or block is indicated by a formula in which ⁇ x and ⁇ y form the motion vector
• a 0 and b 0 are motion vector coefficients and x and y are vector components.
• the used motion models are stored in the memory of both the coder and the decoder. If several motion models are used in coding, the coder selects the model according to the motion (e.g. with upward motion, a model indicating upward motion is used in coding) and information on the used model is transmitted to the decoder together with the motion vector coefficients.
• Figure 4 is a flow chart showing method steps for video frame coding.
• a frame block refers, for instance, to a block, segment or macro block according to the YUV model formed by pixels.
• the execution of the method starts in block 400.
• a video frame is formed of consecutive stationary frames.
• the stationary frames are sent preferably at a speed at which the human visual system no longer distinguishes separate frames from each other.
• the coded reconstruction data of frame blocks (e.g. colour and luminance of pixels and the prediction error frame obtained from the calculation of motion vector coefficients) are stored into memory.
• the frame reconstruction data is coded according to the applied standard, for instance H.263 or MPEG.
• the definition of the motion vector coefficients and the prediction error frame is described above.
• One or more reference frames are formed of the frame reconstruction data stored in memory.
• the motion data of the earlier coded neighbouring blocks i.e. the motion vector coefficients and a possibly used motion model, are stored into memory. It is most preferable to use neighbouring blocks in close proximity to the block being coded, but sometimes it is also possible to use earlier coded blocks farther away in the frame.
• the motion data of the block being coded is defined by means of earlier coded neighbouring blocks, preferably using the motion vector coefficients of one or more neighbouring blocks.
• the reconstruction data of the block being coded is defined using a reference frame, for instance.
• the method can be intensified by calculating the motion data of the frame block being coded using only the neighbouring blocks which have the same reference frame that was used to code the frame reconstruction data of the block being coded. Similarities often exist between frames in the same frame string, so it is probable that either a block corresponding to the block being coded is found or a block that is similar enough is found in an earlier coded frame from which a suitable reference block has already been found for an earlier coded neighbouring block. For instance, motion vector coefficients of one or more neighbouring blocks are used and the search area of the reference block of the block being coded is restricted in the reference frame to the environment defined by the motion vector coefficients of the neighbouring block.
• the motion vector of this neighbouring block is selected as one motion vector candidate, another candidate can, for instance, be a median calculated from several neighbouring block motion vectors.
• the block which is used in coding the block, is coded in the same manner (inter) with which the block being coded will be coded, i.e., if the neighbouring block is intra-coded, it has no reference frame. If there is no prediction candidate having a reference frame, prior art intra- coding can be used or all reference frames stored in memory can be checked.
• a reference block is the frame block that the video coder, i.e. coder with which the frame reconstruction data of the frame block is coded, uses in compression coding.
• a frame block which is as matching as possible with the block being coded and which was searched from one or more reference frames that were coded earlier and stored in memory, is selected as the reference block, whereby the prediction error frame remains as small as possible.
• the coding method is selected, with which the frame reconstruction data and motion data of the frame block being coded can be coded most advantageously, i.e. a pre-defined coding efficiency is reached with a pre-defined picture quality.
• a pre-defined coding efficiency is reached with a pre-defined picture quality.
• the aim may, for instance, be to make the number of bits as small as possible while the quality of the picture corresponds to that of a normal video picture or to make the number of bits match that of the used standard, even though a smaller number of bits was enough to achieve a picture quality according to the application object.
• Coding efficiency can be estimated by means of a Lagrangian function, for instance, which defines the most effective segmentation and coding and which is
• R(S k ) is the number of bits required to transfer the frame, and ⁇ is the Lagrangian constant.
• the Lagrangian function depicts the connection between the quality of the frame being transferred and the bandwidth required on the transmission path; in general, the higher quality picture, the bigger the bandwidth.
• the selection of the most advantageous compression coding is always a compromise between the required number of bits and the picture quality.
• Arrow 412 depicts the repeatability of the method block by block until the frame is coded. It should be noted that the method is preferably repeated until all frames in the string of frames are coded. The execution of the method ends in block 414.
• Figure 5 illustrates an example of predicting motion vectors and finding a reference block, when only the neighbouring blocks are used, which have the same reference frame that was used in coding the frame reconstruction data of the block being coded. It should be noted that in coding the block, prior art methods are usually also used. In the end, the coding method is selected for use, which provides the desired coding efficiency with a sufficient picture quality.
• the frame page 500 being coded is divided into blocks, of which only a few are shown for clarity's sake.
• Block 506 is the one being coded.
• Frames 502, 504, 532 and 508 are reference frames stored in memory.
• the reference frame of blocks 510 and 514 of the earlier coded neighbouring blocks, marked as number 1 is the frame 502.
• the block 506 being coded and the reference blocks 510 and 514 have not moved in the frame 500 in comparison with the frame 502.
• the reference frame of the neighbouring block 512, marked as number 2 in the figure, is the frame 504 and the reference frame of the neighbouring block 516, marked as number 4 in the figure, is the frame 508.
• the blocks in the frame 500 have moved in comparison with the frames 504 and 508.
• the frame 532 has not been used in coding any of the neighbouring blocks of the block 506 being coded, i.e. it is not a reference frame of any neighbouring block, so the frame 532 is not used in this example to find a reference block for the block 506 being coded.
• the neighbouring blocks 510 and 514 are used as prediction candidates of the motion vectors of the block 506 being coded. A check is made to see whether the coding type (inter) of the prediction candidates is the same as the one to be used in coding the current block.
• the block 526 is used as a reference block and the motion vector coefficients are obtained by calculating an average or median of the motion vector coefficients which have been obtained by comparing the location of the blocks 510 and 518, from which the motion vector coefficients have been obtained for the neighbouring block 510, and the location of the blocks 514 and 520, from which the motion vector coefficients have been obtained for the neighbouring block 514.
• a prediction error frame is defined by comparing the block 506 being coded with the reference block 526. In the example of Figure 5, the block location in frames 500 and 502 has not changed, so the motion vector coefficients are not defined.
• the coding type of the neighbouring block 512 is checked. If it is the same as the one to be used in the current block 506, a reference block is searched for in frame 504 and the motion vector coefficients obtained from the comparison of the blocks 512 and 522 are used as the motion vector coefficients of the block 506.
• the prediction error frame is then defined by means of the reference block 528.
• the coding type of the neighbouring block 516 is checked. If it is the same as the one to be used in the current block 506, a reference block is searched for in frame 508 and the motion vector coefficients obtained from the comparison of the blocks 516 and 524 are used as the motion vector coefficients of the block 506.
• the prediction error frame is then defined by means of the reference block 530.
• the motion vector coefficients for block 506 can also be defined by calculating a median or average of the motion vector coefficients of the blocks 510, 512 and 514.
• the block 534 is intra-coded, so it does not have a reference frame and is thus not used in coding the block 506, if a preferable coding method is found otherwise.
• Figure 9 illustrates a second example of predicting motion vectors and finding a reference block.
• the block being coded is coded by means of only one neighbouring block, if only one neighbouring block has been inter-coded and this neighbouring block has the same reference frame as the block being coded.
• the frame 900 being coded is divided into blocks, of which only a few are shown for clarity's sake.
• Block 912 is the one being coded.
• Frames 902, 904 and 906 are reference frames stored in memory.
• the reference frame of the earlier coded neighbouring block 914 (marked as 1) is the frame 902 and the reference frame of block 910 (marked as 2) is the frame 904.
• the block 908 is intra-coded, so it does not have a reference frame.
• the example in Figure 9 tests whether for the block 912 being coded suitable reference blocks can be found of all the reference frames stored in memory, i.e. frames 902, 904, 906 in this example.
• the motion vector of the block 914 is used as the motion vector prediction candidate, since the block 914 is the only one of the three neighbouring blocks, whose reference frame is the frame 902.
• the motion vector of the block 910 is used as the motion vector prediction candidate, since the block 910 is the only one of the three neighbouring blocks, whose reference frame is the frame 904.
• the frame 906 is not a reference frame for any of the neighbouring blocks, so in the case described in the example, the motion vector is predicted using a median of the blocks 910, 914 and 908, for instance, in which case the motion vector of the inter-coded block 908 is set to zero.
• Figure 6 shows an example of a coder with which the above- mentioned method of coding video frames can be implemented.
• a design principle of video coders is to minimise the prediction error frame E n (x,y) 600 between the block being coded I n ( ⁇ ,y) 620 and the prediction candidate (the selected reference block) P effet( ⁇ ,y) 612.
• the prediction error frame is defined as a difference between the block being coded 620 and the prediction candidate 612, which is obtained in an adder 632, thus
• the prediction block 612 is obtained by a method according to a preferred embodiment of the invention by using a selected reference frame and motion vectors.
• the coefficients of motion vectors Ax(x,y),Ay(x,y) are formed in the motion vector calculation block 630 as a sum of predicted motion vectors and found difference coefficients.
• the predicted motion vector coefficients are, according to the preferred embodiment of the invention, obtained using the motion vectors of the neighbouring blocks which have the same reference frame as the block being coded. Other methods are also used in predicting motion vectors, one of them is a prior art method in which the block being coded is coded directly by means of a reference frame.
• the group of the motion vectors of all pixels in a frame is called a motion vector field.
• a frame is in practice divided into blocks in video coding and the motion information is transmitted block by block to the receiver decoder shown in Figure 7.
• At least one motion vector selected from the predicted motion vectors or motion vector fields formed of them are coded in a motion vector coding block 628.
• Motion models well known in the art, for instance, of which examples are presented above, are used in the coding.
• the coded motion vectors or motion vector fields formed of them are transmitted to a multiplexer 624.
• a frame is formed of the frame blocks segment by segment or block by block.
• the reference block or prediction candidate is of format
• the prediction error frame E n (x,y) 600 is coded, which typically is presented as a finite 2-dimensional series transformation, for instance by means of a discrete cosine transformation (DCT).
• DCT discrete cosine transformation
• the coder also comprises a decoder block 606 in which the prediction error frame E n (x,y) is decoded.
• This prediction error frame E n (x,y) 608 is added in the adder 634 to the prediction block P n ( ⁇ ,y) 612 and a decoded block 7 n ( ⁇ ,y) is obtained as a result, from which a new reference block is obtained, or by combining the blocks belonging to the same page, the reference frame 614 is obtained and stored in memory 610.
• both the transmitter video coder and the receiver video coder have the same reference frame or block for use.
• the information containing the motion vector information is combined with the prediction error frame and this frame information 616 is transmitted to the decoder ( Figure 7).
• video coder functions described above can be implemented in many ways, for instance by software executed on a processor or by hardware, such as a logic built of separate components or ASIC (application-specific integrated circuit).
• ASIC application-specific integrated circuit
• Figure 7 shows an example of a decoder, by means of which the method described above for reducing temporal redundancy in video frame transfer can be implemented.
• a coded prediction error frame 702 and coded motion vector coefficients or motion vector field coefficients 712 of a received video signal 700 are separated from each other in a demultiplexer 710.
• the memory 716 of the decoder there is at least one earlier coded neighbouring block and/or a reference frame R n k ( ⁇ ,y) 722 divided into blocks.
• the same frame blocks and/or reference frame are stored in the coder and decoder memory.
• a prediction candidate P Treat( ⁇ ,y) 718 is formed in the same manner as in the coder block 618 ( Figure 6).
• a decoded prediction error frame E n (x,y) 706 is formed in block 704.
• x and y are vector components, of which x indicates the location of a pixel or a block in horizontal direction and y the location of a pixel or a block in vertical direction, and Ax and ⁇ y form the motion vector of a pixel, frame segment or block.
• the video coder functions described above can be implemented in many ways, for instance by software executed on a processor or by hardware, such as a logic built of separate components or ASIC (application-specific integrated circuit).
• Figure 8 illustrates one terminal of a radio system, by means of which the method of a preferred embodiment of the invention can be implemented.
• a transmitter of a subscriber terminal 824 and a transmitter of a radio system network element perform partly the same tasks.
• the terminal 824 can, for instance, be a mobile phone or microcomputer including radio parts, without limiting the invention thereto.
• the described terminal comprises an antenna 800 which is used to transmit and receive signals through a duplex filter.
• the terminal can also comprise several antennas or a multi-antenna system.
• the terminal also comprises a transmitter 802 which amplifies and transmits to the antenna a modulated signal, a modulator 804 which modulates according to a selected modulation method the carrier with a data signal containing desired information, a receiver 806 which amplifies the signal coming from the antenna and down-converts it to a desired intermediate frequency or directly to base band, a demodulator 808 which demodulates the received signal so that the data signal can be separated from the carrier.
• a transmitter 802 which amplifies and transmits to the antenna a modulated signal
• a modulator 804 which modulates according to a selected modulation method the carrier with a data signal containing desired information
• a receiver 806 which amplifies the signal coming from the antenna and down-converts it to a desired intermediate frequency or directly to base band
• a demodulator 808 which demodulates the received signal so that the data signal can be separated from the carrier.
• the subscriber terminal also has a control block 816 which controls the operation of the different parts of the terminal, such as a camera 820 and video codec 822, and takes the necessary action to process user speech or data generated by a user, such as digital signal processing (DSP), digital-to- analogue converting and filtering.
• DSP digital signal processing
• WCDMA spread-spectrum systems
• the signal spectrum is spread by means of a pseudo- random spreading code in a transmitter to a broad band and despread in a receiver, thus endeavouring to increase the capacity of the channel.
• the control block also performs both coding and decoding, such as channel and speech coding.
• the control block adapts the signal being transmitted and signalling information to match the air interface standard of the used radio system.
• the subscriber terminal comprises one or more memories of different type which can be parts of other blocks or separate (not shown).
• the control block also contains a program controlling the operation of the terminal.
• the video codec 822 which codes and decodes the reconstruction data of a frame is separate, but it can also be a part of the control block 816.
• the camera 820 When transmitting frames, the camera 820 records a digital picture into the memory block 818.
• the camera 820 can also record the picture directly into the codec 822.
• the codec codes a selected frame by means of one of the above methods or by a combination of several methods.
• the camera 820, codec 822 and memory 818 can reside in the subscriber terminal 824 or belong to a separate camera unit 826, in which case the camera unit 826 is connected to the subscriber terminal 824 with an interface 828.
• a user of the subscriber terminal can when necessary view the frame on a display 814.
• the coded frame reconstruction data is transmitted in the same manner as speech or text data to the telecommunication system and transmitted to another phone, for instance.
• the operational blocks of the terminal described above can be implemented in many ways, for instance by software executed on a processor or by hardware, such as a logic built of separate components or ASIC (application-specific integrated circuit).
• the terminal functions shown in the figure can also be combined into operational blocks in many ways differing from the figure, the codec block 822 can, for instance, be divided in to a coder and decoder.
• the user interface of the terminal comprises a loudspeaker or an ear piece 810, a microphone 812, a display 814 and possibly a keyboard, which all are connected to the control block 816.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Compression Or Coding Systems Of Tv Signals (AREA)
• Compression, Expansion, Code Conversion, And Decoders (AREA)
• Color Television Systems (AREA)

Applications Claiming Priority (1)

Publications (1)

Family

ID=8555876

Family Applications (1)

Country Status (12)

Families Citing this family (6)

Family Cites Families (4)

• 2000
  • 2000-08-11 HU HU0302895A patent/HU228614B1/hu active IP Right Revival
  • 2000-08-11 CN CN200610153497A patent/CN100591131C/zh not_active Expired - Lifetime
  • 2000-08-11 EE EEP200300053A patent/EE05596B1/xx unknown
  • 2000-08-11 CN CNB008199256A patent/CN1284372C/zh not_active Expired - Lifetime
  • 2000-08-11 CA CA002419988A patent/CA2419988C/en not_active Expired - Lifetime
  • 2000-08-11 EP EP00951576A patent/EP1325635A1/de not_active Withdrawn
  • 2000-08-11 BR BRPI0017304A patent/BRPI0017304B1/pt active IP Right Grant
  • 2000-08-11 AU AU2000264472A patent/AU2000264472A1/en not_active Abandoned
  • 2000-08-11 WO PCT/FI2000/000686 patent/WO2002015585A1/en active Application Filing
  • 2000-08-11 JP JP2002520565A patent/JP2004534411A/ja not_active Withdrawn
  • 2000-08-11 KR KR1020037001984A patent/KR100828378B1/ko active IP Right Grant
  • 2000-08-11 MX MXPA03001270A patent/MXPA03001270A/es active IP Right Grant
• 2007
  • 2007-07-24 HK HK07108052.1A patent/HK1100115A1/xx not_active IP Right Cessation

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events