WO2002003708A2 - Procede de codage video de mouvement d'epaule, a partir d'une sequence d'images - Google Patents

Procede de codage video de mouvement d'epaule, a partir d'une sequence d'images Download PDF

Info

Publication number
WO2002003708A2
WO2002003708A2 PCT/US2001/020048 US0120048W WO0203708A2 WO 2002003708 A2 WO2002003708 A2 WO 2002003708A2 US 0120048 W US0120048 W US 0120048W WO 0203708 A2 WO0203708 A2 WO 0203708A2
Authority
WO
WIPO (PCT)
Prior art keywords
shoulders
images
sequence
movement
feature points
Prior art date
Application number
PCT/US2001/020048
Other languages
English (en)
Other versions
WO2002003708A3 (fr
Inventor
Somnath Sentupta
Rama Suryanarayana
Original Assignee
Intel Corporation
Indian Institute Of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corporation, Indian Institute Of Technology filed Critical Intel Corporation
Priority to AU2001268699A priority Critical patent/AU2001268699A1/en
Publication of WO2002003708A2 publication Critical patent/WO2002003708A2/fr
Publication of WO2002003708A3 publication Critical patent/WO2002003708A3/fr

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00Image coding
    • G06T9/001Model-based coding, e.g. wire frame
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/537Motion estimation other than block-based
    • H04N19/54Motion estimation other than block-based using feature points or meshes

Definitions

  • the present disclosure is related to the video coding of images and, more
  • One aspect of video coding is to remove redundant images or frames
  • a common object of video coding involves a human head or a
  • FIG. 1 is a schematic diagram illustrating a search window between two
  • FIG. 2 is a schematic diagram illustrating application of a matching criterion to a
  • FIG. 3 is a flowchart illustrating an embodiment in accordance with the present
  • model-based image coding typically, the background
  • a model may be employed to encapsulate
  • One such technique that may be employed is block based motion estimation.
  • bits may be conserved by employing a larger sized block, such as, for example,
  • a matching criterion of size 16 by 16 in a search window, of, for example, size 24 by 24.
  • FIG. 1 illustrates the concept behind this approach.
  • (n-i,n 2 ) in frame K is a determined by considering an N-,*N 2 block centered about that pixel
  • search is usually limited to a search window, which in this particular example, may
  • particular size block or to a particular size search window may vary depending on a
  • MSE mean square error
  • FIG. 2 illustrates a block to which this search procedure has been applied.
  • Finding the desired match involves applying the matching criterion over all possible
  • a subsequent stage is centered about the chosen match for a previous stage.
  • limitations on the block size may result in inferior reconstruction quality.
  • a shoulder region of at least one of the images or frames is coded from a
  • shoulders in other images of the sequence may then be estimated using the 2D
  • the wireframe model used here is the well-known CANDIDE model developed by
  • wireframe model is adapted to the head-and-shoulder region of the frame to be coded.
  • the wireframe model is composed of triangular patches, which are characterized by the
  • wire-mesh is deformable in the sense that each of the vertices in the mesh may undergo
  • matrix R represents the angular
  • T represents the translation vector, having the x- and the y-
  • R the angular velocity
  • V x ⁇ and V YK are components of the
  • H ⁇ F K A
  • H ⁇ -l ⁇
  • A is [rn r 12 r 21 r 22 T X T Y ]
  • F ⁇ is [x k I xk y k I xk x k I yk y k I yk I ⁇
  • the global estimation parameters here, the x-y translations and the rotation angle may
  • FIG. 2 is a flowchart illustrating an embodiment 200 of a method of video coding
  • the estimates may be employed for background image processing.
  • one embodiment may be in hardware, whereas another
  • embodiment may be in software. Likewise, an embodiment may be in firmware, or any combination thereof.
  • one embodiment may comprise an article
  • Such a storage medium such as, for example, a CD-ROM,
  • a hardware embodiment may comprise an imaging system including an imager
  • a computing platform such as one adapted to perform or execute coding in

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Image Analysis (AREA)

Abstract

L'invention concerne notamment, dans l'un de ses modes de réalisation, une technique de codage du mouvement des épaules, à partir d'une séquence d'images. Elle concerne également plusieurs autres techniques.
PCT/US2001/020048 2000-06-30 2001-06-21 Procede de codage video de mouvement d'epaule, a partir d'une sequence d'images WO2002003708A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2001268699A AU2001268699A1 (en) 2000-06-30 2001-06-21 Method of video coding shoulder movement from a sequence of images

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US60772400A 2000-06-30 2000-06-30
US09/607,724 2000-06-30

Publications (2)

Publication Number Publication Date
WO2002003708A2 true WO2002003708A2 (fr) 2002-01-10
WO2002003708A3 WO2002003708A3 (fr) 2002-05-30

Family

ID=24433450

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/020048 WO2002003708A2 (fr) 2000-06-30 2001-06-21 Procede de codage video de mouvement d'epaule, a partir d'une sequence d'images

Country Status (2)

Country Link
AU (1) AU2001268699A1 (fr)
WO (1) WO2002003708A2 (fr)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5978030A (en) * 1995-03-18 1999-11-02 Daewoo Electronics Co., Ltd. Method and apparatus for encoding a video signal using feature point based motion estimation

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5978030A (en) * 1995-03-18 1999-11-02 Daewoo Electronics Co., Ltd. Method and apparatus for encoding a video signal using feature point based motion estimation

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
DUDON M ET AL: "MOTION ESTIMATION AND TRIANGULAR ACTIVE MESH" REVUE HF, XX, XX, no. 4, 1995, pages 47-53, XP002036860 ISSN: 0035-3248 *
SCHRODER K ET AL: "Combined description of shape and motion in an object based coding scheme using curved triangles" PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING. (ICIP). WASHINGTON, OCT. 23 - 26, 1995, LOS ALAMITOS, IEEE COMP. SOC. PRESS, US, vol. 3, 23 October 1995 (1995-10-23), pages 390-393, XP010197107 ISBN: 0-7803-3122-2 *
SHIH-PING LIOU: "Model based motion estimation using constrained weighted least squares" PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) AUSTIN, NOV. 13 - 16, 1994, LOS ALAMITOS, IEEE COMP. SOC. PRESS, US, vol. 3 CONF. 1, 13 November 1994 (1994-11-13), pages 810-814, XP010146283 ISBN: 0-8186-6952-7 *
TSUHAN CHEN ET AL: "A new frame interpolation scheme for talking head sequences" PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING. (ICIP). WASHINGTON, OCT. 23 - 26, 1995, LOS ALAMITOS, IEEE COMP. SOC. PRESS, US, vol. 3, 23 October 1995 (1995-10-23), pages 591-594, XP010197038 ISBN: 0-7803-3122-2 *

Also Published As

Publication number Publication date
AU2001268699A1 (en) 2002-01-14
WO2002003708A3 (fr) 2002-05-30

Similar Documents

Publication Publication Date Title
Szeliski et al. Spline-based image registration
Herling et al. High-quality real-time video inpaintingwith PixMix
US8942422B2 (en) Nonlinear self-calibration for structure from motion (SFM) techniques
Bartoli et al. Coarse-to-fine low-rank structure-from-motion
Simoncelli et al. Probability distributions of optical flow.
US5936671A (en) Object-based video processing using forward-tracking 2-D mesh layers
Azarbayejani et al. Recursive estimation of structure and motion using relative orientation constraints
EP1364535B1 (fr) Procede servant a comprimer des informations video
US20190026943A1 (en) Dense visual slam with probabilistic surfel map
Sandström et al. Point-slam: Dense neural point cloud-based slam
US9613420B2 (en) Method for locating a camera and for 3D reconstruction in a partially known environment
KR20080108430A (ko) 2d 영상들로부터 3d 안면 재구성
Moustakas et al. Stereoscopic video generation based on efficient layered structure and motion estimation from a monoscopic image sequence
CN108776989A (zh) 基于稀疏slam框架的低纹理平面场景重建方法
Kundu et al. Realtime motion segmentation based multibody visual slam
Rawat et al. Efficient video stabilization technique for hand held mobile videos
Kurata et al. A fast and robust approach to recovering structure and motion from live video frames
Morikawa et al. 3D structure extraction coding of image sequences
Kuschk et al. Real-time variational stereo reconstruction with applications to large-scale dense SLAM
US7046728B1 (en) Method of video coding the movement of a human face from a sequence of images
WO2002003708A2 (fr) Procede de codage video de mouvement d'epaule, a partir d'une sequence d'images
Kang et al. A parallel feature tracker for extended image sequences
CA2466247A1 (fr) Traitement de trames a base de reseau maille et applications
Lee et al. Globally consistent video depth and pose estimation with efficient test-time training
Sale et al. Super-resolution enhancement of night vision image sequences

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase in:

Ref country code: JP