EP1034660A2 - Motion vector processing - Google Patents
Motion vector processingInfo
- Publication number
- EP1034660A2 EP1034660A2 EP99960701A EP99960701A EP1034660A2 EP 1034660 A2 EP1034660 A2 EP 1034660A2 EP 99960701 A EP99960701 A EP 99960701A EP 99960701 A EP99960701 A EP 99960701A EP 1034660 A2 EP1034660 A2 EP 1034660A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- motion vector
- motion
- picture part
- selection
- given picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 239000013598 vector Substances 0.000 title claims abstract description 79
- 238000012545 processing Methods 0.000 title claims description 5
- 238000003672 processing method Methods 0.000 claims abstract description 4
- 230000005540 biological transmission Effects 0.000 description 6
- 238000000034 method Methods 0.000 description 5
- 238000011156 evaluation Methods 0.000 description 3
- 239000008186 active pharmaceutical agent Substances 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 102000001690 Factor VIII Human genes 0.000 description 1
- 108010054218 Factor VIII Proteins 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/56—Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search
Definitions
- the invention relates to a motion vector processing to reduce an amount of data required for transmitting or storing motion vectors.
- EP 0,691,789 discloses a method and apparatus for motion field estimation, segmentation and coding.
- the motion estimation technique uses a hierarchical approach in which a motion vector updating routine is performed with respect to multiple levels of smaller and smaller regions of a frame.
- the motion vector updating routine updates the motion vector of a smaller region by assigning to it a best motion vector selected from among an initial motion vector assigned to the smaller region, motion vectors of neighboring regions, and a matched motion vector obtained by performing a block matching technique for the smaller region.
- the best motion vector for each region is selected according to a priority scheme and a predetermined threshold value.
- Adjacent regions having the same motion vector are then merged together, and a region shape representation routine is used to specify contour pixels that will allow the merged regions to be recovered by a decoder.
- a contour coding routine is then used to encode the contour pixels for transmission to the decoder.
- a first aspect of the invention provides a motion vector processing method and device as defined in claims 1 and 2.
- a second aspect of the invention provides an image signal decoder and an image signal display apparatus as defined in claims 3 and 4.
- a motion vector is generated for a given picture part based on a selection of a motion vector out of a predetermined set of motion vectors to obtain a selected motion vector, and the given picture part is supplied together with a selection indication of the selected motion vector.
- motion data are obtained from the selection indication, and an output picture part is generated based on the given picture part and the motion data.
- Fig. 1 shows an embodiment of a transmission scheme
- Fig. 2 shows one possible way to generate candidate motion vectors
- Fig. 3 shows an embodiment of an encoder in accordance with the present invention.
- Fig. 4 shows an embodiment of a display apparatus in accordance with the present invention.
- a video signal Vin is applied to an encoder COD to generate a coded image signal I as well as motion vectors MV.
- the coded image signal I and the motion vectors MV are received by a decoder DEC to generate an output video signal Vout.
- the bits required for transmission of the motion vectors MV form a significant part of that total number of bits.
- the invention is based on the recognition that in a motion vector estimation algorithm in which a motion vector for a given picture part C (e.g. a block of pixels, see Fig. 2) is based on already estimated motion vectors 1, 2 in a present field and/or an already estimated motion vector 3 in a previous field of an image signal, a significant reduction in the number of bits for the motion vector data can be achieved by not transmitting or storing the output motion vectors, but by transmitting or storing an indication of the selected neighboring motion vector.
- a motion vector for a given picture part C e.g. a block of pixels, see Fig. 2
- a significant reduction in the number of bits for the motion vector data can be achieved by not transmitting or storing the output motion vectors, but by transmitting or storing an indication of the selected neighboring motion vector.
- a decoder is used both for receiving standard digitally encoded picture signals (e.g. H.261, H.263, MPEG) and picture signals with motion vectors encoded in accordance with the present invention
- a control signal could indicate use of the present invention.
- the invention can also be used if cyclically small update vectors are added to all or some of the neighboring motion vectors before they are examined as to their usefulness for the given image part. In that case, still just an indication of the neighboring motion vector is transmitted or stored.
- This application presupposes that the decoder DEC not only knows that it will receive selection indications rather than full motion vectors, but also how small update vectors are added to the neighboring motion vectors: both the sequence and its start are known. Again, this is no problem in in-house or proprietary coding-decoding systems.
- the invention is applied in equipment which is also capable of encoding / decoding in accordance with an internationally agreed upon standard (e.g. H.261, H.263, MPEG).
- Fig. 3 shows an embodiment of an encoder in accordance with the present invention.
- the input video signal Vin is applied to a motion vector evaluation circuit MV- EVAL to generate a motion vector MV for the given block C on the basis of a plurality of previously generated motion vectors stored in a motion vector memory MV-MEM.
- motion vectors MV obtained by the motion vector evaluation circuit MV-EVAL are applied to the motion vector memory MV-MEM.
- the motion vector evaluation circuit MV- EVAL further supplies a selection indication signal SI indicating which of the neighboring motion vectors has been selected to an encoder output circuit EOC.
- the input video signal Vin is further applied to a video encoder V-COD to obtain a coded image signal I corresponding to the given block C.
- the encoder output circuit EOC generates a data stream DS from the coded image signal I and the selection indication signal SI.
- Fig. 4 shows an embodiment of a display apparatus in accordance with the present invention.
- the data stream DS is applied to a demultiplexer DEMUX to obtain the image signal I and the selection indication SI.
- the selection indication SI is applied to a motion processor MP to obtain motion data MD.
- the image signal I is applied to a video decoder V-DEC to obtain an output picture part OPP in dependence on the motion data MD.
- the output picture part OPP is processed by an output processor OP to obtain a display signal which is applied to a display device D.
- the predetermined set of motion vectors from which a selection is made comprises motion vectors determined for picture parts spatio-temporally adjacent to the given picture part
- a selection is made from a predetermined set of motion vectors determined on a lower resolution version of the image.
- the given picture part may be supplied in a coded form, such as a motion-compensated discrete cosine transform (DCT) encoded form as known from e.g. the MPEG standard.
- DCT discrete cosine transform
- the selection indication may be supplied in a coded form, such as a variable length coded (VLC) form, to achieve a further reduction in the number of bits required for the motion data.
- VLC variable length coded
- any reference signs placed between parentheses shall not be construed as limiting the claim.
- the word “comprising” does not exclude the presence of other elements or steps than those listed in a claim.
- the word “adjacent” does not necessarily mean “directly adjacent”; as follows from some examples in the above-mentioned thesis, it is e.g. possible that there is a block present between two "adjacent" blocks.
- the invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the device claim enumerating several means, several of these means can be embodied by one and the same item of hardware.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US9814467 | 1998-07-10 | ||
WOPCT/US98/14467 | 1998-07-10 | ||
PCT/IB1999/001194 WO2000003545A2 (en) | 1998-07-10 | 1999-06-24 | Motion vector processing |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1034660A2 true EP1034660A2 (en) | 2000-09-13 |
Family
ID=22267468
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP99960701A Ceased EP1034660A2 (en) | 1998-07-10 | 1999-06-24 | Motion vector processing |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP1034660A2 (ja) |
JP (1) | JP4932987B2 (ja) |
WO (1) | WO2000003545A2 (ja) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6735249B1 (en) * | 1999-08-11 | 2004-05-11 | Nokia Corporation | Apparatus, and associated method, for forming a compressed motion vector field utilizing predictive motion coding |
KR101383540B1 (ko) | 2007-01-03 | 2014-04-09 | 삼성전자주식회사 | 복수의 움직임 벡터 프리딕터들을 사용하여 움직임 벡터를추정하는 방법, 장치, 인코더, 디코더 및 복호화 방법 |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4942466A (en) * | 1985-12-24 | 1990-07-17 | British Broadcasting Corporation | Bandwidth compression for television signals |
EP0294961B1 (en) * | 1987-06-09 | 1994-10-12 | Sony Corporation | Motion vector selection in television images |
DE3850709T2 (de) * | 1987-06-09 | 1994-11-24 | Sony Corp | Reduzierung der Bewegungsvektoren in Fernsehbildern. |
JPH0738722B2 (ja) * | 1988-11-15 | 1995-04-26 | 国際電信電話株式会社 | 動き補償符号化方法 |
US5430487A (en) * | 1992-09-30 | 1995-07-04 | Matsushita Electric Corporation Of America | Method and apparatus for improving temporal video signal processing using motion vectors transmitted with the video signal |
JP3589480B2 (ja) * | 1994-03-31 | 2004-11-17 | 三菱電機株式会社 | 映像信号符号化方式 |
JPH0879767A (ja) * | 1994-07-05 | 1996-03-22 | Ricoh Co Ltd | 動きベクトル符号化および復号化方式 |
US5594504A (en) * | 1994-07-06 | 1997-01-14 | Lucent Technologies Inc. | Predictive video coding using a motion vector updating routine |
JPH09154138A (ja) * | 1995-05-31 | 1997-06-10 | Toshiba Corp | 動画像符号化/復号化装置 |
-
1999
- 1999-06-24 EP EP99960701A patent/EP1034660A2/en not_active Ceased
- 1999-06-24 WO PCT/IB1999/001194 patent/WO2000003545A2/en active Application Filing
- 1999-06-24 JP JP2000559697A patent/JP4932987B2/ja not_active Expired - Lifetime
Non-Patent Citations (2)
Title |
---|
REGUNATHAN: "Motion vector quantization in a rate-distortion framework", XP010253944, 26 October 1997 (1997-10-26), XP010253944 * |
TOSHIBA TOSHIAKI: "Moving image coding/decoding device", JP09154138, 10 June 1997 (1997-06-10) * |
Also Published As
Publication number | Publication date |
---|---|
JP4932987B2 (ja) | 2012-05-16 |
WO2000003545A2 (en) | 2000-01-20 |
WO2000003545A3 (en) | 2000-04-13 |
JP2002520958A (ja) | 2002-07-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1379000B1 (en) | Signal encoding method and apparatus and decoding method and apparatus | |
US5748247A (en) | Refinement of block motion vectors to achieve a dense motion field | |
JP3621152B2 (ja) | 特徴点の特定装置及びその方法 | |
US5251028A (en) | Apparatus for reducing quantization artifacts in an interframe hybrid coding system with motion compensation | |
KR100252342B1 (ko) | 움직임 벡터 부호화 방법 및 그 장치 | |
US6263026B1 (en) | Signal compressing system | |
US5687097A (en) | Method and apparatus for efficiently determining a frame motion vector in a video encoder | |
US6208760B1 (en) | Method and apparatus for motion vector processing | |
US6360014B1 (en) | Image decoding method, image decoding apparatus, and data recording medium | |
EP0771117A3 (en) | Method and apparatus for encoding and decoding a video signal using feature point based motion estimation | |
KR100415494B1 (ko) | 화상인코딩방법및장치,기록장치,비디오신호인코딩장치,처리장치및방법,비디오데이터처리장치및방법 | |
EP0734175A1 (en) | Hierarchical motion vector estimation using multiple block sizes | |
US5699129A (en) | Method and apparatus for motion vector determination range expansion | |
US6249548B1 (en) | Motion vector processing | |
WO2003107648A3 (en) | INTERLACE SCANNING MOTION ESTIMATE | |
US5689312A (en) | Block matching motion estimation method | |
US6909748B2 (en) | Method and system for image compression using block size heuristics | |
KR19990027469A (ko) | 참조 움직임 벡터수에 기초한 움직임 벡터 부호화 방법 및그 장치 | |
KR20060133962A (ko) | 스케일러블 신호 처리를 위한 방법 및 장치 | |
EP1034660A2 (en) | Motion vector processing | |
KR101011894B1 (ko) | 영상의 그룹을 코딩 또는 디코딩하기 위한 방법 | |
WO1997005746A3 (en) | Method and system for coding an image sequence, corresponding coded signal and storage medium, and method and system for decoding such a coded signal | |
US20040013200A1 (en) | Advanced method of coding and decoding motion vector and apparatus therefor | |
KR19990027484A (ko) | 움직임 벡터 부호화 방법 및 그 장치 | |
KR20060088548A (ko) | 오버컴플릿 웨이블렛 비디오 코딩 프레임워크 내의 유효계수들을 클러스터링하기 위해 적응 구성 요소들을 갖는3―d 형태학적 연산들 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): DE FR GB |
|
17P | Request for examination filed |
Effective date: 20001013 |
|
17Q | First examination report despatched |
Effective date: 20061214 |
|
APBN | Date of receipt of notice of appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNNOA2E |
|
APBR | Date of receipt of statement of grounds of appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNNOA3E |
|
APAF | Appeal reference modified |
Free format text: ORIGINAL CODE: EPIDOSCREFNE |
|
APBT | Appeal procedure closed |
Free format text: ORIGINAL CODE: EPIDOSNNOA9E |
|
APAM | Information on closure of appeal procedure modified |
Free format text: ORIGINAL CODE: EPIDOSCNOA9E |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED |
|
18R | Application refused |
Effective date: 20101202 |