US6272254B1 - Method for encoding and decoding of a digitalized image and arrangement for implemention of the method - Google Patents

Method for encoding and decoding of a digitalized image and arrangement for implemention of the method Download PDF

Info

Publication number
US6272254B1
US6272254B1 US09/171,514 US17151498A US6272254B1 US 6272254 B1 US6272254 B1 US 6272254B1 US 17151498 A US17151498 A US 17151498A US 6272254 B1 US6272254 B1 US 6272254B1
Authority
US
United States
Prior art keywords
image
picture elements
coding information
padding
padded
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US09/171,514
Other languages
English (en)
Inventor
Andre Kaup
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Original Assignee
Siemens AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG filed Critical Siemens AG
Assigned to SIEMENS AKTIENGESELLSCHAFT reassignment SIEMENS AKTIENGESELLSCHAFT ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KAUP, ANDRE
Application granted granted Critical
Publication of US6272254B1 publication Critical patent/US6272254B1/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/537—Motion estimation other than block-based
    • H04N19/543—Motion estimation other than block-based using regions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/563—Motion estimation with padding, i.e. with filling of non-object values in an arbitrarily shaped picture block or region for estimation purposes

Definitions

  • New moving image compression methods are based on a resolution of the image content into what are referred to as image objects with arbitrary edging.
  • the individual image objects are separately encoded in various video object planes (what are referred to as VOPs), and are transmitted and decoded in the receiver and again “combined”.
  • VOPs video object planes
  • Traditional image compression methods are based on a resolution of the entire image into quadratic image blocks. This principle can also be accepted in the object-based methods.
  • problems arise in the encoding of the image blocks that are located at the edge of the respective image object since the object edging usually does not coincide with the block edges. What is referred to as a motion-compensated prediction of these edge blocks is especially critical in this context.
  • Block matching method is usually utilized for block-based image compression methods. It is based thereon that the image block to be encoded is compared with same-sized blocks of a reference image. One of the reference image blocks is located at the same position as the image block to be encoded; the other reference image blocks are topically shifted compared to it. Given a large search area in the horizontal and vertical directions, a great number of search positions thus derive, so that correspondingly, many block comparison (“matchings”) must also be implemented given what is referred to as a complete search (“full search”). The sum of the absolute differences of the encoding information that is respectively allocated to each picture element is usually employed as a criterion for the match quality between the block to be respectively encoded and the reference block.
  • the block-based image encoding method MPEG 2 is known from the publication J. De Lameillieure and R. Schfer, MPEG-2-Bildcod ist für das digitale Congressen, NYCund Kino-Technik, Volume 48, No. 3, pp. 99-107, 1994.
  • the invention is based on the problem of specifying a method for the image encoding, a method for the image decoding, as well as an arrangement for the implementation of the methods with which the image encoding or the image decoding is possible with a computing time requirement that is reduced compared to known methods.
  • the problem is solved by the method for image encoding of a digitalized image having an arbitrary number of picture elements wherein the image is provided with at least one image object that comprises an arbitrary number of picture elements.
  • the image is also provided with image blocks.
  • a motion compensation is implemented for the image blocks.
  • a path is implemented in the motion compensation of an object edge image block that comprises at least one object edge of the image object.
  • the padding is only implemented with respect to picture elements that are located within the image object.
  • At least one image object that comprises an arbitrary number of picture elements is identified in the image.
  • the image is divided into image blocks.
  • a motion estimation is implemented for the image blocks.
  • a padding is implemented in the motion estimation of an object edge image block that comprises at least one object edge of the image block. The padding is only implemented with respect to picture elements that are located within the image object.
  • an apparatus for image encoding of a digitalized image having an arbitrary number of picture elements.
  • a processor unit is configured such that: at least one image object that comprises an arbitrary number of picture elements is identified in the image; the image is divided into image blocks; a motion estimation is implemented for the image blocks; a padding is implemented in a motion estimation of an object edge image block that comprises at least one object edge of the image block; and the padding is only implemented with respect to picture elements that are located within the image object.
  • an apparatus for image decoding of a digitalized image having an arbitrary number of picture elements wherein a processor unit is configured such that: the image comprises at least one image object that comprises an arbitrary number of picture elements; the image comprises image blocks; a motion compensation is implemented for the image block; a padding is implemented in the motion compensation of an object edge image block that has at least one object edge of the image object; and the padding is only implemented with respect to picture elements that are located within the image object.
  • At least one image object is determined in the image given the method for image encoding. Further, the image is demarcated into image blocks and a motion estimation is implemented for the image blocks. A padding is implemented in the motion estimation of an image block that comprises at least one object edge of the image object, whereby the padding is merely implemented with respect to picture elements that are located within the image object.
  • a padding is likewise implemented only with respect to picture elements that are located within the image object for motion compensation of an image block that exhibits at least one object edge of an image object.
  • an image store for storing the digital image data is provided, as is a processor unit for the implementation of the individual methods steps of either the method for image encoding or, too, the method for image decoding.
  • FIG. 1 is a computer arrangement with two computers and a camera
  • FIGS. 2 a and 2 b show an image to be encoded (FIG. 2 b ) and a reference image (FIG. 2 a ) on the basis whereof the principle of the method for image decoding is presented;
  • FIG. 3 shows an object edge image block in an image to be decoded as well as the reference image block in a reference image
  • FIG. 4 shows two images to be encoded as well as a reference image for presenting the method for image encoding
  • FIGS. 5 a and 5 b illustrate two image blocks to be encoded with a respective reference image block from a reference image.
  • FIG. 1 shows a camera with which pictures are taken.
  • the camera K can, for example, by an arbitrary analog camera K that registers images of a scene and either digitizes these images in the camera K or, also, transmits them to a computer R 1 , analog, fashion in which the digitalized images are then either processed or the analog images are converted into digitalized images and the digitalized images are processed.
  • the camera K can also be a digital camera K with which digitalized images are directly registered and supplied to the computer R 1 for further-processing.
  • the computer R which, for example, can also be designed as an independent arrangement that implements the method steps described below, for example as an independent computer card that is installed in a computer.
  • the computer R 1 comprises a processor unit P with which the below-described method steps of motion estimating or motion compensation as well as potentially further method steps, for example for image encoding, are implemented.
  • the processor unit P is coupled via a bus BU to a memory SP in which the image data are stored.
  • the method for motion estimating or motion compensation can be advantageously utilized both for image encoding as well as for image decoding.
  • the further computer R 2 comprises the same structure as the first computer R 1 , i.e. the memory that is coupled via the bus BU to the processor unit P.
  • New moving image compression methods for example the methods according to the future MPEG4 standard, are based on a resolution of the image content of the digitalized image B, which comprises an arbitrary number of picture elements BP, into an arbitrary number of image objects BO.
  • FIG. 2 a shows a reference image that shows an image object BO with an object edge OK and image blocks BB.
  • the reference image RB is already decoded in the image decoding and is present in the decoded condition in the image memory SP of a computer R 1 , R 2 .
  • the image PB to be predicated is now reconstructed in the framework of the image decoding.
  • a motion compensation is implemented wherein a reconstruction of the image PB to be predicated, particularly of the image block PBB to be predicted, occurs proceeding from contour information present in the image region about image objects BO contained in the image or, respectively, image block BB and the motion vector that was allocated to the image block PBB to be predicated.
  • coding information is, for example, luminance information (brightness information) or chrominance information (color information) that is respectively allocated to a picture element.
  • an image block BB that, for example, comprises 8 ⁇ 8. Without limitation of the universal validity, however, it can also be applied without further ado to macro blocks that are usually composed of 4 or, also, of 16 image blocks. Any other desired elementary units of the respectively underlying encoding method can also be taken into consideration in the framework of the method, for example rectangles or triangles, etc., of an arbitrary shape and size. What is thus to be understood by an image block is an elementary unit of arbitrary shape and size into which the image b is divided and for which the respective encoding method occurs.
  • a padding can occur in a great variety of ways, for example according to one of the following procedures:
  • a prescribable value of the coding information is allocated to the picture elements to be padded.
  • a value of the coding information that derives from the coding information of picture elements of the image block for which no padding occurs is allocated to the picture elements to be padded.
  • a value of a coding information that derives from an average of the coding information of picture elements of the image block for which no padding occurs is allocated to the picture elements to be padded.
  • a value of a coding information that derives from a low-pass supplementation of the coding information of the image block for which no padding occurs is allocated to the picture elements to be padded.
  • a value of the coding information that derives from a prescribable conformal imaging of the coding information of picture elements of the image block for which no padding occurs is allocated to the picture elements to be padded.
  • a value of the coding information that derives after what is referred to as a repetitive padding described in the ISO publication is allocated to the picture elements to be padded.
  • the contour information of the image object BO for the image block PBB to be respectively predicted is contained in the motion compensation for the image PBB to be predicted. Which picture elements form the object edge OK, which picture elements BP are located within the image object BO and which picture elements BP are located outside the image object BO are thus known for the image block PBB to be predicted.
  • a motion vector BV is allocated to the respective reference image block RBB with which the topical shift of the reference image block by which the reference image block RBB is shifted in order to yield the image block PBB to be predicated is described.
  • a padding is respectively implemented in the motion compensation, whereby the padding is only applied to those picture elements BP of the image block PBB to be predicated that have an object edge OK that are located within the image object BO of the image block PBB to be predicted. No padding occurs for picture elements BP that are not located within the image object BO in the image block PBB to be predicted.
  • FIG. 3 shows a reference image block RBB, the image block PBB to be predicted as well as the motion vector BV that is allocated to the reference image block RBB.
  • the letter R marks those picture elements for which a padding is implemented.
  • the picture elements to be padded derive, for example, in that the object edge OK in the image block PBB to be predicated is superimposed on the object edge OK of the corresponding reference image block RBB and only those picture elements that
  • a motion-compensated prediction for all picture elements lying within the image object BO can be determined via the motion vector BV by shifting the picture elements along, for example, the motion trajectory. No prediction is determined for the picture elements BP lying outside the image object BO.
  • the shift of the picture elements BP established within the object edge OK of the reference image block RBB is implemented first, and the picture element supplementation up to the object edge OK of the image block PBB to be predicted occurs subsequently.
  • the picture elements BP that are already supplemented are no longer available for a prediction of another object edge image block and would have to be re-determined.
  • FIG. 4 shows a reference image RB and two images CB 1 , CB 2 to be encoded for which a motion estimating is respectively implemented.
  • the reference image object RBO, a first image object BO 1 and a second image object BO 2 are shown.
  • a motion estimating in the framework of the image encoding is implemented for object edge image blocks of the first image object BO 1 and of the second image object BO 2 .
  • FIG. 5 a or FIG. 5 b This principle is respectively shown in FIG. 5 a or FIG. 5 b for a first object edge image block OBB 1 and a second object edge image block OBB 2 . Further, the reference image block RBB with the motion vector BV allocated to the reference image block is also respectively shown in FIGS. 5 a and 5 b.
  • the picture elements for which a padding is implemented are referenced R 1 in the reference image block RBB in the motion estimating for the first object edge image block OBB 1 .
  • R 1 in FIG. 5 b first, respectively shows a picture element from the padding for the the first object edge image block OBB 1 and R 2 respectively references a picture element for which a padding was implemented in the framework of the motion estimating for the second object edge image block OBB 2 .
  • the method it is provided in the framework of the motion estimating to respectively store the values of the padded picture elements after the motion estimating for an object edge image block OBB, and to re-employ them in a further motion estimating for a further object edge image block and to then in fact additionally respectively supplement only the picture elements that still need to be padded.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
US09/171,514 1996-11-26 1997-10-14 Method for encoding and decoding of a digitalized image and arrangement for implemention of the method Expired - Fee Related US6272254B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE19648963 1996-11-26
DE19648963A DE19648963C1 (de) 1996-11-26 1996-11-26 Verfahren zur Bildcodierung eines digitalisierten Bildes, Verfahren zur Bilddecodierung eines digitalisierten Bildes und Anordnung zur Durchführung der Verfahren
PCT/DE1997/002350 WO1998024239A1 (de) 1996-11-26 1997-10-14 Verfahren zur bildcodierung eines digitalisierten bildes

Publications (1)

Publication Number Publication Date
US6272254B1 true US6272254B1 (en) 2001-08-07

Family

ID=7812822

Family Applications (1)

Application Number Title Priority Date Filing Date
US09/171,514 Expired - Fee Related US6272254B1 (en) 1996-11-26 1997-10-14 Method for encoding and decoding of a digitalized image and arrangement for implemention of the method

Country Status (6)

Country Link
US (1) US6272254B1 (ja)
EP (1) EP0941613B1 (ja)
JP (1) JP2001504665A (ja)
CN (1) CN1231800A (ja)
DE (2) DE19648963C1 (ja)
WO (1) WO1998024239A1 (ja)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030016871A1 (en) * 2000-12-20 2003-01-23 Yoshihisa Shinagawa Image-effect method and image-effect apparatus
US6606414B1 (en) * 1997-05-07 2003-08-12 Siemens Aktiegesellschaft Method and device for coding a digitized image
US20040061842A1 (en) * 2001-02-19 2004-04-01 Eiji Kasutani Device for creating image feature from image having any shape
US20060034529A1 (en) * 2004-08-13 2006-02-16 Samsung Electronics Co., Ltd. Method and device for motion estimation and compensation for panorama image
US7283675B1 (en) * 1997-05-07 2007-10-16 Siemens Aktiengesellschaft Method and device for encoding and decoding a digitized image
CN101010960B (zh) * 2004-08-13 2011-01-12 庆熙大学校产学协力团 针对全景图像进行运动估计和补偿的方法和设备

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0892559A1 (en) * 1997-07-18 1999-01-20 Texas Instruments Inc. Padding of object border blocks for motion estimation and transform coding in an object-oriented video coder
DE59904186D1 (de) 1998-09-29 2003-03-06 Siemens Ag Verfahren und anordnung zur bearbeitung eines digitalisierten bildes mit bildpunkten
DE19944300C2 (de) * 1999-09-15 2002-08-29 Siemens Ag Verfahren, Anordnung und Computerprogrammerzeugnis zur Bewegungsschätzung bei der Codierung von einem Bildobjekt in einem Bild
CN103593862A (zh) * 2013-11-21 2014-02-19 广东威创视讯科技股份有限公司 一种图像显示方法及控制单元
CN114531590A (zh) * 2016-10-04 2022-05-24 有限公司B1影像技术研究所 图像数据编码/解码方法、介质和发送比特流的方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4890160A (en) * 1986-03-19 1989-12-26 British Broadcasting Corporation TV picture motion vector measurement by correlation of pictures
EP0525310A2 (en) 1991-06-28 1993-02-03 Nippon Hoso Kyokai Method and apparatus for high speed dynamic region extraction
WO1997013372A2 (en) 1995-10-05 1997-04-10 Microsoft Corporation Feature-based video compression method
US5692063A (en) * 1996-01-19 1997-11-25 Microsoft Corporation Method and system for unrestricted motion estimation for video
US5845012A (en) * 1995-03-20 1998-12-01 Daewoo Electronics Co., Ltd. Apparatus for encoding an image signal having a still object

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4890160A (en) * 1986-03-19 1989-12-26 British Broadcasting Corporation TV picture motion vector measurement by correlation of pictures
EP0525310A2 (en) 1991-06-28 1993-02-03 Nippon Hoso Kyokai Method and apparatus for high speed dynamic region extraction
US5845012A (en) * 1995-03-20 1998-12-01 Daewoo Electronics Co., Ltd. Apparatus for encoding an image signal having a still object
WO1997013372A2 (en) 1995-10-05 1997-04-10 Microsoft Corporation Feature-based video compression method
US5692063A (en) * 1996-01-19 1997-11-25 Microsoft Corporation Method and system for unrestricted motion estimation for video

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
IEEE Transactions On Image Processing, vol. 4, No. 1, Jan. 1995-Wu et al.
IEEE Transactions On Image Processing, vol. 4, No. 1, Jan. 1995—Wu et al.
MPEG4 Video Verification Model MPEG96/N1380 Chicago, Oct. 1996, International Organisation For Standardisation.
Signal Processing V: Theories and Applications-Torres, Publication date Sep. 18, 1990-Yu et al p. 901-904.
Signal Processing V: Theories and Applications—Torres, Publication date Sep. 18, 1990—Yu et al p. 901-904.
Transform Coding of Arbitrarily-Shapd Image Segments-Chang et al XP 000607524.
Transform Coding of Arbitrarily-Shapd Image Segments—Chang et al XP 000607524.

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6606414B1 (en) * 1997-05-07 2003-08-12 Siemens Aktiegesellschaft Method and device for coding a digitized image
US7283675B1 (en) * 1997-05-07 2007-10-16 Siemens Aktiengesellschaft Method and device for encoding and decoding a digitized image
US20030016871A1 (en) * 2000-12-20 2003-01-23 Yoshihisa Shinagawa Image-effect method and image-effect apparatus
US20040061842A1 (en) * 2001-02-19 2004-04-01 Eiji Kasutani Device for creating image feature from image having any shape
EP1365357A4 (en) * 2001-02-19 2009-11-25 Nec Corp DEVICE FOR GENERATING A PICTURE OF AN IMAGE OF ANY PICTURE
US7697753B2 (en) 2001-02-19 2010-04-13 Nec Corporation Device for creating image feature from image having any shape
US20060034529A1 (en) * 2004-08-13 2006-02-16 Samsung Electronics Co., Ltd. Method and device for motion estimation and compensation for panorama image
WO2006016788A1 (en) * 2004-08-13 2006-02-16 Industry Academic Cooperation Foundation Kyunghee University Method and device for motion estimation and compensation for panorama image
AU2005272287B2 (en) * 2004-08-13 2009-05-28 Industry Academic Cooperation Foundation Kyunghee University Method and device for motion estimation and compensation for panorama image
US7623682B2 (en) 2004-08-13 2009-11-24 Samsung Electronics Co., Ltd. Method and device for motion estimation and compensation for panorama image
CN101010960B (zh) * 2004-08-13 2011-01-12 庆熙大学校产学协力团 针对全景图像进行运动估计和补偿的方法和设备

Also Published As

Publication number Publication date
JP2001504665A (ja) 2001-04-03
DE59706633D1 (de) 2002-04-18
WO1998024239A1 (de) 1998-06-04
DE19648963C1 (de) 1998-04-30
EP0941613A1 (de) 1999-09-15
CN1231800A (zh) 1999-10-13
EP0941613B1 (de) 2002-03-13

Similar Documents

Publication Publication Date Title
CN111741289B (zh) 处理立方体面图像的方法和装置
US5748789A (en) Transparent block skipping in object-based video coding systems
US6483874B1 (en) Efficient motion estimation for an arbitrarily-shaped object
US6466622B2 (en) Motion picture coding and decoding apparatus
US6037988A (en) Method for generating sprites for object-based coding sytems using masks and rounding average
US9118929B2 (en) Method for performing hybrid multihypothesis prediction during video coding of a coding unit, and associated apparatus
US5692063A (en) Method and system for unrestricted motion estimation for video
CN107257484B (zh) 解码器、编码器、用于解码的方法和用于编码的方法
US6404814B1 (en) Transcoding method and transcoder for transcoding a predictively-coded object-based picture signal to a predictively-coded block-based picture signal
US20200213570A1 (en) Method for processing projection-based frame that includes at least one projection face and at least one padding region packed in 360-degree virtual reality projection layout
JP5970609B2 (ja) ３ｄビデオ符号化における統一された視差ベクトル導出の方法と装置
US5973743A (en) Mode coding method and apparatus for use in an interlaced shape coder
US6272254B1 (en) Method for encoding and decoding of a digitalized image and arrangement for implemention of the method
KR20210031799A (ko) 분할 코딩을 이용한 효과적인 예측
KR20190120444A (ko) 적응적 분할 코딩
US11323717B2 (en) Frequency adjustment for texture synthesis in video coding
Chen et al. Coding of subregions for content-based scalable video
CN106341622B (zh) 一种多路视频流的编码方法及装置
US10448034B2 (en) Video image encoding device, video image coding method, video image decoding device, video image decoding method, and non-transitory computer-readable storage medium
US7020192B1 (en) Method of retrieving video picture and apparatus therefor
US8208739B2 (en) Methods and devices for the determination and reconstruction of a predicted image area
CN115104318A (zh) 基于子画面的图像编码设备和方法
CN115136607A (zh) 基于滤波的图像编码装置和方法
JP2002523987A (ja) ディジタル画像の符号化方法および符号化装置ならびにディジタル画像の復号方法および復号装置
Zhu et al. A novel fractal monocular and stereo video codec with object-based functionality

Legal Events

Date Code Title Description
AS Assignment

Owner name: SIEMENS AKTIENGESELLSCHAFT, GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KAUP, ANDRE;REEL/FRAME:009728/0708

Effective date: 19971009

CC Certificate of correction
REMI Maintenance fee reminder mailed
LAPS Lapse for failure to pay maintenance fees
STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20050807