WO2007069141A1 - Procédé d'édition de contour - Google Patents

Procédé d'édition de contour Download PDF

Info

Publication number
WO2007069141A1
WO2007069141A1 PCT/IB2006/054630 IB2006054630W WO2007069141A1 WO 2007069141 A1 WO2007069141 A1 WO 2007069141A1 IB 2006054630 W IB2006054630 W IB 2006054630W WO 2007069141 A1 WO2007069141 A1 WO 2007069141A1
Authority
WO
WIPO (PCT)
Prior art keywords
contour
editing
original
edited
function
Prior art date
Application number
PCT/IB2006/054630
Other languages
English (en)
Inventor
Raymond J. E. Habets
Rutger Nijlunsing
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Publication of WO2007069141A1 publication Critical patent/WO2007069141A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text

Definitions

  • This invention pertains in general to the field of Image Analysis. More particularly the invention relates to drawing and editing of models for anatomical structures, and models for the measurement of geometrical properties of such structures from 2D or 3D patient data like X-ray, CT, MR and US images.
  • Contours can be active or passive, open or closed, smooth, e.g. using Bezier interpolation, or composed out of line segments. Contours are for instance used for modeling, segmentation and measuring tasks.
  • contours There are basically two ways to draw a contour, point-by-point or freehand.
  • a freehand contour the contour is often sub-sampled and transformed into a smooth contour after the user finished the drawing.
  • Both the point-by-point and freehand drawing methods create a contour consisting of a number of control points. Contour editing techniques are based on manipulating these control points. After drawing the contour can be transformed to an active contour that optimizes its shape relative to the image.
  • a series of contours can be used. More precisely, one contour is used in each slice of a 3D data set, e.g. acquired by CT scanning. These contours are then combined to form the actual 3D model. Active contours have been used to find the location of the contour in the next slice in a 3D data set or in the next image in a time series, e.g. for motion tracking, automatically.
  • a set of arbitrary two-dimensional (2D) cuts through the volume to draw the contours that are combined to a 3D model. Moving an individual control point will alter the shape of the contour. It is also possible to add or remove control points at any location.
  • Fig. Ia describes a previously known method of region based contour editing in 2D. The method is disclosed in a thesis by J.F. Waterhouse titled “A Comparison of 2D and 3D Interfaces For Editing Surfaces Reconstructed from Contours", Ontario, Canada, 1996. All points within a selected region are moved according to a certain function and accordingly when the selected point (star) is moved; all points in the selected region (black dots) are also moved and the non-selected control points (open dots) stay in place.
  • Fig. Ib illustrates the previously known region based contour editing method, for a 3D slice case.
  • the selected point in slice A is moved; the selected points one slice from the selected point (B) and two slices from the selected point (C) are also moved.
  • a region of interest containing a number of control points i.e. a multiple selection of control points is made. If the user then picks up a control point, for example in the middle of this region, all points in the region will be moved according to a contour editing function.
  • a freehand contour can be edited by drawing part of the contour again. The new part must overlap the old one in two places. The part of the old contour between the two intersection points will be replaced by the newly drawn part. In this way it is possible to expand a contour, or cut away part of a contour.
  • Fig. 2 illustrates the freehand method of contour editing. A freehand contour (white solid line), in Fig. 2a, can be edited by drawing part of the contour again.
  • an improved contour editing method would be advantageous and in particular an improved contour editing method allowing for increased flexibility, and/or user- friendliness would be advantageous.
  • the present invention preferably seeks to mitigate, alleviate or eliminate one or more of the above-identified deficiencies in the art and disadvantages singly or in any combination and solves at least the above mentioned problems by providing a method, a computer-readable medium comprising a computer program, and a medical workstation according to the appended patent claims.
  • a contour editing method comprises selecting at least a part of an original contour in order to modify the original contour into an edited contour, concealing any existing control points used for selecting the part of the original contour, and creating an edited contour by modifying the selected part of the original contour with a contour editing function.
  • a computer-readable medium having embodied thereon a computer program for editing a contour and for processing by a computer.
  • the computer program comprises a first code segment for selecting a location of an original contour in order to modify the original contour into an edited contour, a second code segment for concealing any existing control points used for selecting the location of the original contour, and a third code segment for creating an edited contour by modifying the selected location of the original contour with a contour editing function.
  • an apparatus for performing a contour editing method is provided.
  • the apparatus comprises means for selecting a location of an original contour in order to modify the original contour into an edited contour, means for concealing any existing control points used for selecting the location of the original contour, and means for creating an edited contour by modifying the selected location of the original contour with a contour editing function.
  • the apparatus is a medical workstation configured to edit a contour on a medical image.
  • Some embodiments of the present invention allow for more user- friendly and flexible contour editing. They make it possible to interact with high-resolution contours, sets of 2D contours and 3D contours in a more direct and easy way.
  • Using a simple User Interface allows for the use of a single click and mouse interaction to edit the contour shapes.
  • the actual resolution of the contour i.e. the number of control points, is hidden to the user. No control point are shown, which contributes to the user- friendliness. No selection of control points or a range of control points, respectively, is needed for the interaction, which provides an easy user interaction of the editing process.
  • Fig. 1 is a schematic illustration of a control-point based contour editing method
  • Figs. 2a-d are exemplary images illustrating a freehand contour editing method
  • Figs. 3a-b are schematic illustrations of two styles of mouse interaction, wherein Fig. 3a illustrates movement with respect to the contour direction in the selected point, and Fig. 3b illustrates movement with respect to the screen, i.e. direct mouse manipulation
  • Fig. 4 is a schematic illustration of mouse interaction during an implementation a first embodiment of the invention comprising reshaping a contour part with a gauss-shaped displacement function, wherein the mouse mode is tangent and perpendicular to the contour line at the location of the picked point (first style);
  • Fig. 5 is a schematic illustration of mouse interaction during an implementation a second embodiment of the invention, comprising reshaping a contour part with an elliptical-shaped displacement function, wherein the mouse mode is tangent and perpendicular to the contour line at the location of the picked point (first style);
  • Fig. 6 is a schematic illustration of three examples of two-dimensional displacement functions: gauss (solid line), elliptical (dashed line) and linear (dotted line), wherein the vertical axis is the displacement relative to the selected border point and the horizontal axis gives the distance to the selected point along the border;
  • Fig. 7 is a schematic illustration of mouse interaction during an implementation a third embodiment of the invention comprising reshaping a contour part with a gauss-shaped displacement function, wherein the mouse mode is horizontal and vertical (second style);
  • Fig. 8 is a schematic illustration of mouse interaction during an implementation a fourth embodiment of the invention comprising smoothing of a contour part(second style);
  • Fig. 9 is a schematic illustration of mouse interaction during an implementation a fifth embodiment of the invention comprising activating a contour part.
  • the method of the present invention provides new ways of editing contours, in which the contour editing is not based on the concept of control points like in the prior art. Throughout the embodiments of the method of the present invention the contour editing may be utilized by mapping mouse movements.
  • Figs. 3a and 3b illustrate these two alternative ways of mouse interaction.
  • the mouse mapping is related to the contour direction in the selected point.
  • the mouse mapping may for instance be tangential and/or perpendicular to the contour.
  • the mouse movement corresponds to some other reference, i.e. direct mouse manipulation not related to the contour direction in the selected point, such as movement with respect to the viewing screen.
  • the mouse mapping may be related to any other contour editing geometrically oriented mouse movement, or the mouse mapping may be completely detached from the orientation of the contour.
  • the mouse movements may be just horizontal and vertical displacements similar to the direct mouse manipulation modes that control zoom, pan, roll, contrast and brightness, see Fig. 3b.
  • the first embodiment of the inventive method describes reshaping a part of a contour (border) using a displacement function with two degrees of freedom.
  • These functions map mouse movement to parameters such as the primary displacement (size and direction) and the size and shape of the region to be modified.
  • the second embodiment of the inventive method describes how part of the contour can be smoothened. Again the mouse interaction may be used to steer two parameters of the smoothening process and the affected region.
  • the third and fourth embodiments of the inventive method relate to the field of active contours.
  • Part of a 'normal' contour may be activated to follow image details.
  • the mouse is mapped to the affected region size and properties of the active contour.
  • Part of an active contour may be deactivated.
  • the mouse mappings may be used to alter part of the contour as described in the first two embodiments.
  • a first embodiment of the method of the invention describes reshaping part of a contour border 41 using a displacement function 42 with two degrees of freedom.
  • the two degrees of freedom With a tangent-perpendicular motion or a horizontal- vertical motion. Moving the mouse perpendicular to the border will resultantly move the selected point inwards or outwards.
  • Fig. 4 describes reshaping of a contour 41 with a gauss-shaped displacement function. After the gauss-shaped deformation has been done the resulting contour is contour 42. First, the user picks up the contour at any location (and lets call this point 43), i.e.
  • an elliptical displacement function 52 is used to modify the original contour 51.
  • the mouse movement 54 controls the size of the axes A, B of the ellipse.
  • the mouse movement (in similarity to Fig. 3a and Fig. 4) is tangential and perpendicular to the contour function 52 at the location of the selected point 53.
  • Fig. 6 describes three examples of two dimensional displacement functions.
  • Function 61 describes a gauss function (solid line).
  • Function 62 describes an elliptical function (dashed line) and function 63 describes a linear function (dotted line).
  • the vertical axis is the displacement relative to the selected contour point.
  • the horizontal axis relates to the distance of the selected point along the contour.
  • Fig. 7 describes reshaping the contour 71 with a gauss-shaped displacement function 72 using direct mouse manipulation, meaning that the mouse movement is disengaged from the direction of the contour at the location of the selected point 73 according to some other reference, such as the screen.
  • moving the mouse vertically will control the amplitude A of the movement (in a direction perpendicular to the original contour in point 73).
  • Moving the mouse in the horizontal direction will control the size B of the region that is moved as well as the shape of the displacement function.
  • the horizontal motion in the 3D slices case the horizontal motion also extent the effect to other slices (the displacement function could then e.g. be a gauss shaped bell).
  • a second embodiment of the method of the invention relates to smoothing a part of a contour or surface according to Fig. 8.
  • the user selects a point 83 of the contour 81 at any location and by moving the mouse in perpendicular or vertical (direct mouse manipulation) direction will set the smoothing strength A for the selected part of the contour.
  • Mouse movement in the tangent or horizontal (direct mouse manipulation) direction is used to determine the size B of the region that is smoothened.
  • the smoothing of a part of a contour can be extended to 3D regions.
  • a third embodiment of the method of the invention is based on 'activating' a part of a contour for allowing said part to follow certain image details.
  • activating means that part of the contour will be transformed into an active contour.
  • the user can select a point of the contour 91 at any location and by moving the mouse in vertical direction an external force A will be added allowing the image to attract the contour in a certain direction (such as perpendicular to the border).
  • Mouse movement in the horizontal direction is used to determine the size B of the region which is 'activated'.
  • a fourth embodiment of the method of the invention describes deactivating a part of an already active contour.
  • the fourth embodiment may be utilized on an already active contour for instance to enable editing the contour via the first and/or second embodiments of the invention.
  • the functionality of the fourth embodiment can help to edit a part of an active contour to a feature close to the originally found feature.
  • All embodiments of the present invention may be for both two-dimensional contours as well as three-dimensional surfaces.
  • the horizontal- vertical movement of the mouse (Fig. 3b) relies on a direct mouse manipulation technique that decouples the direction the mouse is moved in, from the direction that the selected point is moved to. If this feature is unwanted the control over the size of the region and the shape of the displacement function can be placed under a separate control for example the scroll-wheel on the mouse.
  • contours consist of control points is hidden or concealed for the user.
  • the user may pick any location on the contour or surface and start editing.
  • direct manipulation e.g. by using an input device such as a mouse
  • the user may control parameters of the displacement function, for example two parameters with regards to the primary displacement, i.e. size and direction of the displacement, and the size and shape of the region the displacement works on).
  • the direct mouse manipulation the user can simultaneously control the strength of the action and the region it works on.
  • the first two methods use parameterized reshaping, i.e. they are always starting from the original contour, it is easy to reverse these edit actions, e.g. by an undo action of the mouse-drag functionality.
  • the undo functionality for the third embodiment which activates a part of the contour needs some extra attention, as the adaptation of an active contour may not be rolled back without precautionary measures.
  • a possibility is to store several intermediate states of the active contour and to revert to one of these intermediate states when rolling back is desired.
  • contour editing is a basic function of many applications the description of the embodiments itself may act as implementation examples. In the following section some situations, in which the embodiments of the invention, advantageously may be utilized are explained.
  • the region based editing of contours can be used for single contours or sets of contours in multiple slices or time series.
  • An example of multiple slices is the creation of a surface model of a vessel from a set of slices.
  • Second embodiment If a contour is drawn freehand or when a contour is the result of a high resolution active object the contour may be rather rough. With the technique described in the second embodiment of the invention the user can smoothly selected parts of the contour.
  • an active contour can easily 'jump' between the two features. Deactivating part of the contour and dragging it to the correct location (with the region based technique of the first embodiment of the invention) or straightening part of the contour (using the region based smoothening of the second embodiment of the invention) so that it is above the correct feature allows the user to quickly edit part of the contour before reactivating it.
  • the invention may be implemented in any suitable form including hardware, software, firmware or any combination of these.
  • the elements and components of embodiments of the invention may be physically, functionally and logically implemented in any suitable way. Indeed, the functionality may be implemented in a single unit, in a plurality of units or as part of other functional units. As such, the invention may be implemented in a single unit, or may be physically and functionally distributed between different units and processors.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

L'invention concerne un procédé d'édition de contour. Le procédé comprend les étapes consistant à sélectionner au moins une partie d'un contour original afin de modifier le contour original en un contour édité, à dissimuler tout point de contrôle existant utilisé pour sélectionner la partie du contour original, et à créer un contour édité en modifiant la partie sélectionnée du contour original avec une fonction d'édition de contour, ce qui permet une édition de contour conviviale et flexible grâce à une interaction facile de l'utilisateur sur le processus d'édition.
PCT/IB2006/054630 2005-12-14 2006-12-06 Procédé d'édition de contour WO2007069141A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP05112146 2005-12-14
EP05112146.5 2005-12-14

Publications (1)

Publication Number Publication Date
WO2007069141A1 true WO2007069141A1 (fr) 2007-06-21

Family

ID=37945827

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2006/054630 WO2007069141A1 (fr) 2005-12-14 2006-12-06 Procédé d'édition de contour

Country Status (1)

Country Link
WO (1) WO2007069141A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160035071A1 (en) * 2014-07-31 2016-02-04 Fujifilm Corporation Curved line correction apparatus, method, and medium

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
BARTELS R H ET AL: "A TECHNIQUE FOR THE DIRECT MANIPULATION OF SPLINE CURVES", PROCEEDINGS/COMPTE RENDU GRAPHICS INTERFACE, 19 June 1989 (1989-06-19), pages 33 - 39, XP000562311 *
FOWLER B ET AL: "Constraint-based curve manipulation", IEEE COMPUTER GRAPHICS AND APPLICATIONS USA, vol. 13, no. 5, September 1993 (1993-09-01), pages 43 - 49, XP002430944 *
HSU W M ET AL: "DIRECT MANIPULATION OF FREE-FORM DEFORMATIONS", COMPUTER GRAPHICS, NEW YORK, NY, US, vol. 26, no. 2, July 1992 (1992-07-01), pages 177 - 184, XP008011515, ISSN: 0097-8930 *
J.F. WATERHOUSE: "A COMPARISON OF 2D AND 3D INTERFACES FOR EDITING SURFACES RECONSTRUCTED FROM CONTOURS", 1996, UNIVERITY OF WATERLOO, WATERLOO, ONTARIO, CANADA, XP002430949 *
R. PARENT: "A SYSTEM FOR SCULPTING 3D DATA", COMPUTER GRAPHICS, vol. 11, no. 2, August 1977 (1977-08-01), pages 138 - 147, XP002430945 *
S. BAIN: "CORELDRAW 12 THE OFFICIAL GUIDE", 2004, MCGRAW HILL, EMERYVILLE, CALIFORNIA 94608, USA, XP002430948 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160035071A1 (en) * 2014-07-31 2016-02-04 Fujifilm Corporation Curved line correction apparatus, method, and medium
CN105321194A (zh) * 2014-07-31 2016-02-10 富士胶片株式会社 曲线修正装置及方法
US10262402B2 (en) 2014-07-31 2019-04-16 Fujifilm Corporation Curved line correction apparatus, method, and medium
CN105321194B (zh) * 2014-07-31 2020-03-03 富士胶片株式会社 曲线修正装置及方法、存储介质

Similar Documents

Publication Publication Date Title
JP4584575B2 (ja) ３ｄ画像に表示される３ｄサーフェイスとインタラクトする画像処理方法
JP4510817B2 (ja) ３次元ボリューム空間クロップのユーザ制御
US11163158B2 (en) Skin-based approach to virtual modeling
US20070279435A1 (en) Method and system for selective visualization and interaction with 3D image data
CN101959452B (zh) 用于交互式肝叶分割的系统和方法
US20070279436A1 (en) Method and system for selective visualization and interaction with 3D image data, in a tunnel viewer
US7561725B2 (en) Image segmentation in a three-dimensional environment
US8958611B2 (en) Interactive CSG subtraction
US20070116334A1 (en) Method and apparatus for three-dimensional interactive tools for semi-automatic segmentation and editing of image objects
JP2004534584A5 (fr)
EP1999717B1 (fr) Systèmes et procédés pour définition interactive de régions et de volumes d'intérêt
US20130328874A1 (en) Clip Surface for Volume Rendering in Three-Dimensional Medical Imaging
JP4758353B2 (ja) 変形可能表面を使った三次元セグメント化
US9730671B2 (en) System and method of voice activated image segmentation
EP2071518A2 (fr) Procédé, appareil, système et support lisible par ordinateur pour une manipulation de forme interactive
CN106716500B (zh) 一种信息处理装置及深度定义方法
WO2007069141A1 (fr) Procédé d'édition de contour
Krapichler et al. Physicians in virtual environments—multimodal human–computer interaction
JP2007144056A (ja) モデリング装置、領域抽出装置、モデリング方法及びプログラム
Krapichler et al. A human-machine interface for medical image analysis and visualization in virtual environments
Arbabtafti et al. Haptic and visual rendering of virtual bone surgery: A physically realistic voxel-based approach
US20170270708A1 (en) Virtual interactive definition of volumetric shapes
CN106843694B (zh) 三维图像处理系统
WO2023031151A1 (fr) Traitement interactif d'images 3d
KR101586895B1 (ko) 3차원의 볼륨 영역 선택 방법 및 장치, 그리고 이를 이용하는 3차원 의료 영상 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06832115

Country of ref document: EP

Kind code of ref document: A1