WO2004047030A2 - Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object - Google Patents
Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object Download PDFInfo
- Publication number
- WO2004047030A2 WO2004047030A2 PCT/IB2003/005168 IB0305168W WO2004047030A2 WO 2004047030 A2 WO2004047030 A2 WO 2004047030A2 IB 0305168 W IB0305168 W IB 0305168W WO 2004047030 A2 WO2004047030 A2 WO 2004047030A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- model
- image
- resolution
- confidence
- feature
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/12—Edge-based segmentation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/149—Segmentation; Edge detection involving deformable models, e.g. active contour models
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10116—X-ray image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
Definitions
- an object of the invention proposes an image processing system having image data processing means for automatic adaptation of the mapping of a 3-D Mesh Model onto a three dimensional surface of an object represented in a gray level image; and having viewing means for displaying quantified and visual indications of the confidence of such a Mesh Model adaptation onto said object surface, in a coded manner, preferably in a color coded manner.
- the system processing means uses the system processing means, the three-dimensional surface of the three dimensional object of interest is registered in a three dimensional gray level image.
- the three dimensional Simplex Mesh Model is fitted onto the three dimensional surface according to a mesh model technique for fitting at best said surface.
- FIG. IB represents an object of interest (an organ) with a Mesh Model (a sphere) for segmenting this object using a Mesh Model deformation technique and the adaptation technique of the invention
- the complex surface OBJ poses a problem when the segmentation method described above is applied.
- the present invention is able to solve this problem.
- the surface denoted by OBJ, represented in FIG.IA and IB, has been chosen in order to demonstrate that the method of the invention may be applied to a great number of different and complex surfaces.
- the image segmentation method is based on utilization of discrete deformable models, like 2-Simplex Meshes Model described as prior art [Delingette].
- a three dimensional digital Simplex Mesh Model is generated as illustrated by FIG.1 A or FIG. IB.
- This refinement consists in introducing an algorithm for automatically increasing the Mesh resolution at parts of high curvature and at parts whose distance to the image data is higher than a threshold. Hence, at each iteration, the area of the spherical cells decreases. So, according to the known technique, since when the distance to the image data is large, as shown in FIG.IA, the surface of the cells decreases and the number of cells increases, the refinement algorithm would be unable to improve the result in said parts P'l, P'2.
- the automated technique of estimation of the adaptation comprises sub-steps of: 4.1) Constructing a Color Coding Table wherein predetermined colors are associated with given feature confidence for model adaptation represented by the confidence parameter.
- the present invention provides a visualization of the cells that are color coded in function of the confidence parameter. This visualization with different colors allows to supervise the deformation process and to locally assess its final quality.
- a predetermined color may be associated to one confidence parameter value; colors maybe classified in classes of colors, each class of colors corresponding to a range of confidence parameter values; each class of color may further be sub-divided according to a scale of hues for sub-dividing the range of confidence parameter values;
- FIG.3 shows a diagram of an image processing system 150 according to the invention for carrying out all the steps of the above-described method.
- the system has means 151 for acquiring digital image data of a sequence of images, and is coupled to computer means 153 for processing these data according to the processing steps of the method cited above.
- the medical viewing system can be used in the intervention room or near the intervention room for processing real time images. Steps of the present method can be applied on stored medical images, for example for estimating medical parameters.
- the medical viewing system provides the image data by connection 157 to the system 153.
- the system provides processed image data to display means and/or storage means.
- the display means 154 may be a screen.
- the storage means may be a memory of the system 153. Said storage means may be alternately external storage means.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Software Systems (AREA)
- Computer Graphics (AREA)
- Quality & Reliability (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Geometry (AREA)
- Image Processing (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Image Analysis (AREA)
- Processing Or Creating Images (AREA)
- Heating, Cooling, Or Curing Plastics Or The Like In General (AREA)
- Coating With Molten Metal (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Image Generation (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2004553008A JP2006506164A (ja) | 2002-11-20 | 2003-11-14 | 3次元メッシュモデルをオブジェクトの3次元表面に自動的に適応させる画像処理システム |
| AU2003278538A AU2003278538A1 (en) | 2002-11-20 | 2003-11-14 | Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object |
| DE60311865T DE60311865T2 (de) | 2002-11-20 | 2003-11-14 | Bildverarbeitungssystem zur automatischen anpassung eines 3d-maschenmodels auf eine 3d-objektfläche |
| US10/535,466 US8437579B2 (en) | 2002-11-20 | 2003-11-14 | Image processing system for automatic adaptation of a 3-D mesh model onto a 3-D surface of an object |
| EP03769837A EP1565880B1 (en) | 2002-11-20 | 2003-11-14 | Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP02292884.0 | 2002-11-20 | ||
| EP02292884 | 2002-11-20 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2004047030A2 true WO2004047030A2 (en) | 2004-06-03 |
| WO2004047030A3 WO2004047030A3 (en) | 2004-10-07 |
Family
ID=32319683
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/IB2003/005168 Ceased WO2004047030A2 (en) | 2002-11-20 | 2003-11-14 | Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US8437579B2 (enExample) |
| EP (1) | EP1565880B1 (enExample) |
| JP (1) | JP2006506164A (enExample) |
| AT (1) | ATE354140T1 (enExample) |
| AU (1) | AU2003278538A1 (enExample) |
| DE (1) | DE60311865T2 (enExample) |
| WO (1) | WO2004047030A2 (enExample) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2460411A (en) * | 2008-05-27 | 2009-12-02 | Simpleware Ltd | Variable mesh resolution in medical image generation |
| WO2010046819A1 (en) * | 2008-10-22 | 2010-04-29 | Koninklijke Philips Electronics N.V. | 3-d ultrasound imaging |
| US8526697B2 (en) | 2008-02-15 | 2013-09-03 | Koninklijke Philips N.V. | Apparatus for segmenting an object comprising sub-objects |
| GB2539963A (en) * | 2015-07-03 | 2017-01-04 | Williams Justin | Thermographic imaging system |
| WO2017001476A1 (en) | 2015-06-29 | 2017-01-05 | Koninklijke Philips N.V. | Interactive mesh editing |
| US10346708B2 (en) | 2013-06-25 | 2019-07-09 | Synopsys, Inc. | Image processing method |
| US12211147B2 (en) | 2019-12-19 | 2025-01-28 | Koninklijke Philips N.V. | Mesh correction depending on mesh normal direction |
Families Citing this family (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9953040B2 (en) * | 2007-08-01 | 2018-04-24 | Koninklijke Philips N.V. | Accessing medical image databases using medically relevant terms |
| RU2505860C2 (ru) * | 2008-04-04 | 2014-01-27 | Конинклейке Филипс Электроникс Н.В. | Одновременная основанная на модели сегментация объектов, удовлетворяющих заранее заданным пространственным соотношениям |
| EP2279489B1 (en) * | 2008-04-07 | 2019-06-12 | Koninklijke Philips N.V. | Mesh collision avoidance |
| US8265363B2 (en) * | 2009-02-04 | 2012-09-11 | General Electric Company | Method and apparatus for automatically identifying image views in a 3D dataset |
| EP2617010B1 (en) * | 2010-09-17 | 2017-07-26 | Koninklijke Philips Electronics N.V. | Choosing anatomical variant model for image segmentation |
| US8903088B2 (en) | 2011-12-02 | 2014-12-02 | Adobe Systems Incorporated | Binding of protected video content to video player with encryption key |
| US8879731B2 (en) | 2011-12-02 | 2014-11-04 | Adobe Systems Incorporated | Binding of protected video content to video player with block cipher hash |
| US9064318B2 (en) | 2012-10-25 | 2015-06-23 | Adobe Systems Incorporated | Image matting and alpha value techniques |
| US10638221B2 (en) | 2012-11-13 | 2020-04-28 | Adobe Inc. | Time interval sound alignment |
| US9201580B2 (en) | 2012-11-13 | 2015-12-01 | Adobe Systems Incorporated | Sound alignment user interface |
| US9355649B2 (en) | 2012-11-13 | 2016-05-31 | Adobe Systems Incorporated | Sound alignment using timing information |
| KR101339552B1 (ko) * | 2012-11-15 | 2013-12-10 | 이화여자대학교 산학협력단 | 사용자 기반의 오브젝트 근사 방법 및 오브젝트 근사 시스템 |
| US9076205B2 (en) | 2012-11-19 | 2015-07-07 | Adobe Systems Incorporated | Edge direction and curve based image de-blurring |
| US10249321B2 (en) | 2012-11-20 | 2019-04-02 | Adobe Inc. | Sound rate modification |
| US9451304B2 (en) | 2012-11-29 | 2016-09-20 | Adobe Systems Incorporated | Sound feature priority alignment |
| US9135710B2 (en) * | 2012-11-30 | 2015-09-15 | Adobe Systems Incorporated | Depth map stereo correspondence techniques |
| US10455219B2 (en) | 2012-11-30 | 2019-10-22 | Adobe Inc. | Stereo correspondence and depth sensors |
| US10249052B2 (en) | 2012-12-19 | 2019-04-02 | Adobe Systems Incorporated | Stereo correspondence model fitting |
| US9208547B2 (en) | 2012-12-19 | 2015-12-08 | Adobe Systems Incorporated | Stereo correspondence smoothness tool |
| US9214026B2 (en) | 2012-12-20 | 2015-12-15 | Adobe Systems Incorporated | Belief propagation and affinity measures |
| EP3251096B1 (en) | 2015-01-28 | 2024-07-10 | Koninklijke Philips N.V. | Finite element modeling of anatomical structure |
| US10915680B2 (en) * | 2018-12-21 | 2021-02-09 | Dassault Systemes Simulia Corp. | Local control of design patterns on surfaces for enhanced physical properties |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE69331719T2 (de) * | 1992-06-19 | 2002-10-24 | Agfa-Gevaert, Mortsel | Verfahren und Vorrichtung zur Geräuschunterdrückung |
| AU6108396A (en) | 1995-06-07 | 1996-12-30 | David M. Geshwind | Systems using motion detection, interpolation, and cross-dis solving for improving picture quality |
| AU2454397A (en) * | 1996-04-24 | 1997-11-12 | Shriners Hospital For Children | Method and apparatus for recording three-dimensional topographies |
| US6404920B1 (en) | 1996-09-09 | 2002-06-11 | Hsu Shin-Yi | System for generalizing objects and features in an image |
| US5886702A (en) * | 1996-10-16 | 1999-03-23 | Real-Time Geometry Corporation | System and method for computer modeling of 3D objects or surfaces by mesh constructions having optimal quality characteristics and dynamic resolution capabilities |
| GB9626676D0 (en) | 1996-12-23 | 1997-02-12 | Smith & Nephew Res | Imaging method |
| US6351262B1 (en) | 1998-06-30 | 2002-02-26 | Lucent Technologies, Inc. | Display techniques for three-dimensional virtual reality |
| JP2000175052A (ja) | 1998-12-07 | 2000-06-23 | Xerox Corp | ピクセルマップ表現の処理方法及び装置 |
| US6968299B1 (en) * | 2000-04-14 | 2005-11-22 | International Business Machines Corporation | Method and apparatus for reconstructing a surface using a ball-pivoting algorithm |
| EP1371013B1 (en) * | 2001-03-09 | 2017-04-12 | Koninklijke Philips N.V. | Image segmentation |
-
2003
- 2003-11-14 JP JP2004553008A patent/JP2006506164A/ja not_active Withdrawn
- 2003-11-14 AT AT03769837T patent/ATE354140T1/de not_active IP Right Cessation
- 2003-11-14 WO PCT/IB2003/005168 patent/WO2004047030A2/en not_active Ceased
- 2003-11-14 DE DE60311865T patent/DE60311865T2/de not_active Expired - Lifetime
- 2003-11-14 AU AU2003278538A patent/AU2003278538A1/en not_active Abandoned
- 2003-11-14 US US10/535,466 patent/US8437579B2/en active Active
- 2003-11-14 EP EP03769837A patent/EP1565880B1/en not_active Expired - Lifetime
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8526697B2 (en) | 2008-02-15 | 2013-09-03 | Koninklijke Philips N.V. | Apparatus for segmenting an object comprising sub-objects |
| GB2460411A (en) * | 2008-05-27 | 2009-12-02 | Simpleware Ltd | Variable mesh resolution in medical image generation |
| GB2460411B (en) * | 2008-05-27 | 2012-08-08 | Simpleware Ltd | Image processing method |
| US8384716B2 (en) | 2008-05-27 | 2013-02-26 | Simpleware Limited | Image processing method |
| WO2010046819A1 (en) * | 2008-10-22 | 2010-04-29 | Koninklijke Philips Electronics N.V. | 3-d ultrasound imaging |
| US10346708B2 (en) | 2013-06-25 | 2019-07-09 | Synopsys, Inc. | Image processing method |
| WO2017001476A1 (en) | 2015-06-29 | 2017-01-05 | Koninklijke Philips N.V. | Interactive mesh editing |
| GB2539963A (en) * | 2015-07-03 | 2017-01-04 | Williams Justin | Thermographic imaging system |
| US12211147B2 (en) | 2019-12-19 | 2025-01-28 | Koninklijke Philips N.V. | Mesh correction depending on mesh normal direction |
Also Published As
| Publication number | Publication date |
|---|---|
| DE60311865D1 (de) | 2007-03-29 |
| ATE354140T1 (de) | 2007-03-15 |
| EP1565880A2 (en) | 2005-08-24 |
| DE60311865T2 (de) | 2007-10-31 |
| AU2003278538A1 (en) | 2004-06-15 |
| US20060078194A1 (en) | 2006-04-13 |
| WO2004047030A3 (en) | 2004-10-07 |
| AU2003278538A8 (en) | 2004-06-15 |
| US8437579B2 (en) | 2013-05-07 |
| JP2006506164A (ja) | 2006-02-23 |
| EP1565880B1 (en) | 2007-02-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8437579B2 (en) | Image processing system for automatic adaptation of a 3-D mesh model onto a 3-D surface of an object | |
| US7043062B2 (en) | Image processing method for displaying an image sequence of a deformable 3-D object with indications of the object wall motion | |
| EP1685534B1 (en) | Three-dimensional segmentation using deformable surfaces | |
| Park et al. | A non-self-intersecting adaptive deformable surface for complex boundary extraction from volumetric images | |
| JP3712234B2 (ja) | 関心領域抽出方法及び画像処理サーバ | |
| WO2003005298A2 (en) | Image processing method for interacting with a 3-d surface represented in a 3-d image | |
| JP4170096B2 (ja) | 対象の3次元表面上にマップされた3次元メッシュモデルの適合性評価のための画像処理装置 | |
| JP7456928B2 (ja) | 胸部x線画像の異常表示制御方法、異常表示制御プログラム、異常表示制御装置、及びサーバ装置 | |
| US6434260B1 (en) | Facial imaging in utero | |
| WO2005078666A1 (en) | Real time user interaction with deformable surfaces of segmentation | |
| CA2617227C (en) | Deformable model for segmenting patient contours versus support structures in medical images | |
| EP2074591B1 (en) | Methods, system and computer program product for detecting a protrusion | |
| EP1141894B1 (en) | Method and apparatus for processing images with regions representing target objects | |
| Akkasaligar et al. | Analysis of polycystic kidney disease in medical ultrasound images | |
| WO2011127940A1 (en) | Method for segmentation of objects from a three dimensional image data set with a deformable model | |
| EP4521355A1 (en) | Correcting topological defects on a surface mesh representing an organ | |
| Jackowski et al. | A computer-aided design system for segmentation of volumetric images | |
| WO2007096453A1 (en) | Method and system for reconstructing a model of an object | |
| Bertolotti | Automatic segmentation of pelvic floor ring on 3D ultrasound | |
| Bankhele et al. | Detection of Protrusion on Curved Folded Surface In Colon Capsule Endoscopy |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| WWE | Wipo information: entry into national phase |
Ref document number: 2003769837 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 2006078194 Country of ref document: US Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 10535466 Country of ref document: US |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2004553008 Country of ref document: JP |
|
| WWP | Wipo information: published in national office |
Ref document number: 2003769837 Country of ref document: EP |
|
| WWP | Wipo information: published in national office |
Ref document number: 10535466 Country of ref document: US |
|
| WWG | Wipo information: grant in national office |
Ref document number: 2003769837 Country of ref document: EP |