Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
  • H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/146—Data rate or code amount at the encoder output
  • H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
  • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
  • H04N19/51—Motion estimation or motion compensation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
  • H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence

Definitions

• the invention relates to methods for processing and sending, as well as for receiving and processing data. Furthermore, the invention relates to transmitter and receiver for carrying out the method.
• radio communication systems In communication systems, messages are transmitted between sender and receiver.
• a specific example of commu ⁇ nikationssysteme are radio communication systems.
• messages for example, with voice information, image information, video information, SMS (Short Message Service), MMS (Multimedia Messaging Service) or other data using electromagnetic waves over a radio interface between transmitter and receiver.
• the radio stations may be various subscriber-side radio stations, repeaters, or network-side radio devices such as base stations or radio access points.
• at least part of the subscriber-side radio stations are mobile radio stations.
• the radiation of the electromagnetic waves takes place with carrier frequencies which lie in the frequency band provided for the respective system.
• Mobile radio communication systems are often designed as cellular systems, for example according to the standard GSM (Global System for Mobile Communication) or UMTS (Universal Mobile Telecommunications System) with a network infrastructure consisting for example of base stations, facilities for controlling and controlling the base stations and other network-side facilities.
• GSM Global System for Mobile Communication
• UMTS Universal Mobile Telecommunications System
• WLANs wireless local area networks
• Examples of information transmitted in communication systems are images or videos, the latter being sequences of images. Due to the high data rates required for the transmission of image or video data, suitable coding methods for the image or video data are used in particular in radio communication systems.
• the use of scalable information is suitable, whereby the base information is transmitted during the transmission of scalable information, and additionally the basic information contains supplementary information.
• Scalable data thus have the property that they can be in ver ⁇ any reduction quality at the receiver by decoding the receiver only the basic information or the basic information and some of the additional information, and not the basic information and all supplementary information.
• the scalability of the image or video data can relate to several scaling dimensions, such as the spatial resolution of individual images.
• the invention is based on the object, efficient Verfah ⁇ ren for processing and sending or receiving data show. Furthermore, suitable devices for carrying out the method should be presented.
• image data of an image are present on the transmitter side in a first resolution level and in a second resolution level higher than the first resolution level.
• At least one interpolation parameter is determined for determination by interpolation of image data of the second resolution level from image data of the first resolution level.
• an indication of the at least one particular Interpolationspa ⁇ rameters will be sent.
• the processed data is preferably video data, ie a sequence of images.
• An image can be represented by a plurality of image data, which may in particular be the numerical values with which the individual pixels of the image are occupied.
• the transmitter before ⁇ preferably a video or picture encoder are image data in at least two levels of resolution before. The resolution level indicates the number of pixels of the image, a higher one
• Resolution level is characterized by more pixels than a lower resolution level.
• At least one interpolation parameter is determined on the transmitter side.
• Using an interpolation ⁇ parameters can be by interpolating image data of the second resolution level from image data of the first resolution level ⁇ it averages at least.
• the at least one interpolation parameter specifies a rule or a specific design of a provision by which the identifying image data of the second resolution level from image data of the first resolution ⁇ stage can take place.
• further variables flow into the determination of the image data of the second resolution level, ie the image data of the second resolution level determined by interpolation need not be determined exclusively from image data of the first resolution level.
• the at least one interpolation parameter may relate to the entire image of the second resolution level, but it is also possible that the at least one interpolation parameter only serves to determine image data of a region of the image of the second resolution level.
• the image data of the other ranges can be determined, for example, by other interpolation parameters, or even sent without the use of interpolation parameters.
• the transmitter takes into account the at least one fixed interpolation preferably by image data by interpolation application under a certain encryption Interpolationsparame ⁇ ters can be determined of the at least, are not sent.
• the sending of the image data and the indication of at least one certain interpolation parameter occurs vorzugswei ⁇ se by radio, it can, however, other transmission Techno ⁇ technologies are applied. It is advantageous when the image data and the indication of at least sent a certain Interpola ⁇ tion parameters in a common message ⁇ the, alternatively, the use of separate messages for the image data on the one hand and the indication of the other possible at least a certain interpolation parameter.
• the determination of the at least one interpolation parameter comprises a selection from a plurality of interpolation parameters, wherein in the selection a quality of image data of the second resolution level determined using the at least one interpolation parameter is taken into account.
• the choice of min ⁇ least one interpolation parameter can be performed by a algo ⁇ algorithm, for example, according to a rate-distortion optimization.
• At least one interpolation parameter is determined to be determined by interpolation of image data of the image in a second resolution level higher than the first resolution level from image data of the first resolution level.
• the at least one interpolation parameter is determined by ei ⁇ ne indication received a Interpolationspara ⁇ meters is evaluated the at least.
• the at least one interpolation parameter is det ⁇ verwen- for determining image data of the second resolution level from image data of the first resolution level.
• the indication of the at least one interpolation parameter comprises information which relates exclusively to the at least one interpolation parameter.
• image data of an image are present on the transmitter side in a first resolution level and in a second resolution level higher than the first resolution level.
• At least one interpolation parameter is determined for determining by interpolation of image data of a first area of the image in the second resolution level from image data ⁇ the first resolution level.
• the at least one interpolation parameter is determined by evaluating information relating to at least a second region of the image of the second resolution step and / or concerning at least a region of the image of the first resolution step.
• information is evaluated which does not relate to the considered first region of the image of the second resolution step for which the at least one interpolation parameter is determined.
• This information may refer to one or more other areas of the second resolution level image. Additionally or alternatively, the information can hen to one or more areas of the image of the first resolution level Bezie ⁇ , that is, on the first region of the first resolution level and / or at one or more other portions of the first resolution level.
• received image data of an image are present in a first resolution stage on the receiver side.
• At least one interpolation parameter is determined for determining by interpolation of image data of a first loading rich the image at the second resolution level from Schmda ⁇ th of the first resolution level.
• the at least one INTERPO ⁇ lationsparameter is determined by information concerning at least evaluated a second area of the image of the second resolution level and / or on at least a portion of the image of the first resolution level.
• the at least one interpolation parameter is used for determining image data of the first area of the second resolution level from image data of the first resolution level.
• the information concerning the at least one second area of the image of the second resolution level and / or concerning the at least one area of the image of the first resolution level comprises:
• Information concerning the coding and / or decoding of the at least one second region of the second resolution step and / or the at least one region of the first resolution step e.g. a block mode.
• the image is an integral part of video data, and for determining the at least one interpolation parameter in addition to the information relating to at least a second region of the image of the second resolution stage and / or at least a portion of
• Image of the first resolution level also uses information about a temporal correlation between the image and at least one other image.
• the at least one interpolation parameter can in particular a filtering method, characterized for example by filter length and filter weights, and / or size of an image area ⁇ and / or a rule for interpolation on a Schmbe- range limit.
• a rule for interpolation at an image area boundary preferably indicates how to continue the image data for purposes of interpolation at an image area boundary.
• the first invention shown SSE method of processing and sending of data and temporarily the second method of the invention for processing and sending of data is applied temporarily, or in relation to egg NEN or more interpolation, the first method of the invention for processing and Sending data and in relation to one or more other Interpolationspa ⁇ parameters the second inventive method for processing and sending data is applied.
• the inventive method for receiving and editing data is advantageous.
• the transmitters and receivers according to the invention are particularly suitable for carrying out the methods according to the invention, whereby this can also apply to the embodiments and further developments. For this purpose, they can have other suitable means ⁇ .
• the transmitter and receiver according to the invention can be realized by a plurality of interconnected devices.
• FIG. 1 shows a section of a radio communication system
• Figure 3 a division of an image into blocks.
• FIG. 1 shows a section of a radio communication ⁇ system comprising an encoder and a decoder ENCODER DECODER.
• the encoder ENCODER encodes video data VIDEO to then wirelessly send them as scalable video data SCLABLE VIDEO STREAM to the decoder DECODER. While it will be assumed hereafter that the transmission between the encoder ENCODER and the decoder DECODER takes place by radio, the invention is also applicable to other transmission technologies.
• the steps described below are carried out in order to simultaneously transmit several spatial resolution levels of the images of the video data VIDEO by means of the scalable video data SCLABLE VIDEO STREAM, without transmitting information at the various resolution levels several times:
• the original images of the video sequence VIDEO for example, in the size 4CIF (4 times Common Intermediate Format, which corresponds to an image size of 704x576 pixels) in Figure 1, are subsampled and / or low-pass filtered to produce images of lower resolution levels / image sizes, 1 CIF (Common Intermediate Format, this corresponds to a picture size with 352x288 pixels) and QCIF (Quarter Common Intermediate Format, this corresponds to a picture size with 176x144 pixels) to generate.
• 1 CIF Common Intermediate Format
• QCIF Quadrater Common Intermediate Format
• coded e are ELEMENTS, such as motion vectors, pixel values Modusinformatio ⁇ nen such as block modes, a resolution level of the next lowest resolution level predicted. That is, there are co-founded ⁇ elements of resolution level from coded CIF elemene ⁇ QCIF resolution level th calculated and coded elements of resolution level 4CIF coded elements of the CIF resolution level.
• the scalable video data SCLABLE VIDEO STREAM does not contain the entire 4CIF and CIF video sequences generated due to the coding CODING, but a smaller amount of coded 4CIF and CIF data, since the decoder DECODER can detect untransmitted data by prediction.
• the encoder ENCODER thus determines per image and per level of resolution of the picture Interpolationsverfah ⁇ reindeer, and selects the concerning this image and this resolu ⁇ sungsprocess to the decoder DECODER data to be sent from depending on the used interpolation.
• the decoder DECODER can resolution levels of the scalable video data SCLABLE VIDEO STREAM extract and, optionally, unnecessary information hö ⁇ herer resolution levels omit or not decode.
• the pixel positions of the lower resolution level are first supplemented by intermediate pixel positions with the value 0, symbolized in the middle row by zeros in circles.
• the pixel values are multiplied by filter weights, in Figure 2 -1/16, 0, 9/16, 16/16, 9/16, 0 and -1/16, and summed.
• filter weights in Figure 2 -1/16, 0, 9/16, 16/16, 9/16, 0 and -1/16, and summed.
• FIG. 2 shows a 4-tab filtering.
• the number 4 here denotes the number of filter weights which ver ⁇ turns are in the specific example the numbers -1/16, 9/16, 9/16, and -1/16.
• Further examples of filters are a 2-tab filter, for example, with the filter weights ⁇ and ⁇ , and a 6-tab filter, for example, with the filter weights 1/32, -5/32, 20/32, 20/32, -5 / 32 and 1/32.
• the described interpolation can take place over the entire image area. However, it is also possible to divide an image into several areas and to calculate the filtering for each area.
• 3 shows an example of such Auftei ⁇ development of a 16x16 area of an image: this can be divided according to the second illustration from the left in two equal 16x8 blocks, according to the third illustration from the left in two equal 8x16 blocks, and according to the right-hand illustration in an 8x8 block, two 8x4 blocks, two 4x8 blocks and four 4x4 blocks.
• pixels needed to compute the filtering may be outside the image or block.
• One way of resolving this problem, known as constant border extension, is to set off for those outside the area considered
• Pixel the value of the pixel is used at the edge of the picture.
• pixel values are mirrored on the image or block boundary, and diesel
• the pixels generated by the reflection are used to calculate the filtering.
• the encoder ENCODER selects suitable interpolation parameters for each image and for each resolution level of the image. These interpolation parameters are the filter, the block size, and the rules for generating pixel values at the image and / or block boundaries. Examples of specific embodiments of these parameters are listed above, but other configurations can also be used. It is possible that the encoder ENCODER selects other variables that can be used for interpolation in addition to the interpolation parameters mentioned.
• the off ⁇ optionally the interpolation is adaptive, that is, the interpolation parameters are depending on each image to be processed and the image area. In principle, the same interpolation parameters are not used for specific image types. Rather, the interpolation parameters used for the same type of image varies with the flexible konkre ⁇ th image to send.
• a rate-distortion optimization is preferably carried out, ie the encoder ENCODER compares the quality of images which are generated by using different interpolation parameters, and sets this in relation to the spark ⁇ transmission of images using these interpolation parameters required data rate. Those interpolation parameters are used which, given the data rate, are the best image or which need the lowest data rate for a given image quality. Compared to the prior art, in which the interpolation parameters are rigid, thereby a higher quality with the same or lower data rate of the radio transmission and a disproportionately he ⁇ creased quality at increased data rate is achieved.
• the decoder DECODER must be aware of the interpolation parameters used by the encoder ENCODER in order to be able to determine from the received image data of a resolution level image data of the next higher resolution level by interpolation.
• the encoder ENCODER the decoder DECODER explicitly signal the interpolation parameters used by him.
• the interpolation parameters are transmitted to the decoder DECODER as side information. This can be done independently of syntax elements used in the prior art. However, it is advantageous to expand according to the prior art ver ⁇ spent syntax elements, such as through the introduction of new block modes.
• the encoder ENCODER thus sends information elements which serve exclusively to indicate the interpolation parameters to be used.
• the decoder DECODER can extract these information elements explicitly and directly from the interpolation parameters to be used.
• the decoder DECODER can determine to use interpolation from other information: • To determine the interpolation parameters for a specific image area other image areas herangezo ⁇ can be gen: o using the interpolation parameters of other blocks:
• the interpolation parameters for a block of an image may be calculated from interpolation parameters of one or more other blocks of the same image.
• the encoder ENCODER can explicitly use the decoder DECODER via the interpolation parameter.
• the encoder ENCODER notifies the decoder DECODER that decoding results of one or more blocks of an image are to be used to decode another block of the same image. This can be transferred to the interpolation parameters of the different blocks, so that e.g. then, when the intra-coding mode indicates to the decoder DECODER that the decoding result of a first block of an image is to be used to calculate the decoding result of a second block of the same image, the decoder DECODER uses the interpolation parameters of the first block as the interpolation parameter of the second block.
• information about the temporal correlation of different images can be used to determine the interpolation parameters: o the block size for the motion estimation and compensation of the area to be encoded, o the block size for the motion estimation and compensation of an adjacent one already encoded region or other already coded portions of the moving ⁇ chen image o the block size of the transform, that is for the transfer of image points in the frequency range at lower resolution levels of the to the coding region or other regions of the same image, o block modes at lower resolution levels of the adjacent area to be coded, o prediction modes.
• the decoder DECODER uses this information to determine the interpolation parameters. If the interpolation parameters are not explicitly signaled to the decoder DECODER, the encoder ENCODER and the decoder DECODER must use the same determination rule for the determination of the interpolation parameters from the information used for this purpose.
• the encoder ENCODER determines from the transmitted to the decoder DECODER Intrakodiermodus the interpolation, and uses these interpolation parameters in the selection of the decoder DECODER to be sent image data.
• DECODER is the determination of the provision Interpolationspara ⁇ meter known from the Intrakodiermodus, it that the sliding surfaces ⁇ interpolation used as the encoder ENCODER.
• interpolation parameters depend on each other. For example, it is advantageous to use short filters for small areas / block sizes. If a dependency exists between different interpolation parameters, then not all interpolation parameters must be communicated in explicit signaling. It is also possible to fix one or more of the interpolation parameters so that only the design of the other interpolation parameters must be signaled to the decoder DECODER or determined by the decoder DECODER.
• a combination of the two methods presented is advantageous, ie the explicit signaling of the interpolation parameters and the implicit signaling, ie the determination of the interpolation parameters by the decoder DECODER from other information.
• the amount of page information required is reduced that more radio resources are available for the transmission of payload information.
• the interpolation can be explicitly signaled to the quality ⁇ ty in terms of the rate-distortion optimization to increase.

Applications Claiming Priority (2)

Publications (1)

Family

ID=36763188

Family Applications (1)

Country Status (7)

Families Citing this family (8)

Family Cites Families (21)

• 2005
  • 2005-04-12 DE DE102005016827A patent/DE102005016827A1/de not_active Withdrawn
• 2006
  • 2006-03-30 US US11/918,400 patent/US8270489B2/en active Active
  • 2006-03-30 KR KR1020077026262A patent/KR101303222B1/ko active IP Right Grant
  • 2006-03-30 JP JP2008505859A patent/JP5069218B2/ja not_active Expired - Fee Related
  • 2006-03-30 CN CN2006800209364A patent/CN101194514B/zh active Active
  • 2006-03-30 WO PCT/EP2006/061168 patent/WO2006108765A1/de active Application Filing
  • 2006-03-30 EP EP06725424A patent/EP1869889A1/de not_active Withdrawn
• 2011
  • 2011-08-18 JP JP2011179107A patent/JP5404715B2/ja not_active Expired - Fee Related

Non-Patent Citations (4)

Also Published As

Similar Documents

Legal Events