US20070081725A1 - System and Method For Shape Regulation of Segmented Target Objects - Google Patents

System and Method For Shape Regulation of Segmented Target Objects Download PDF

Info

Publication number
US20070081725A1
US20070081725A1 US11/537,671 US53767106A US2007081725A1 US 20070081725 A1 US20070081725 A1 US 20070081725A1 US 53767106 A US53767106 A US 53767106A US 2007081725 A1 US2007081725 A1 US 2007081725A1
Authority
US
United States
Prior art keywords
shape
constraint
segmentation result
calculating
boundary
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/537,671
Inventor
Lin Hong
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens Corporate Research Inc
Original Assignee
Siemens Corporate Research Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Corporate Research Inc filed Critical Siemens Corporate Research Inc
Priority to US11/537,671 priority Critical patent/US20070081725A1/en
Priority to DE102006047372A priority patent/DE102006047372A1/en
Assigned to SIEMENS CORPORATE RESEARCH, INC. reassignment SIEMENS CORPORATE RESEARCH, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HONG, LIN
Publication of US20070081725A1 publication Critical patent/US20070081725A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/64Analysis of geometric attributes of convexity or concavity
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/12Edge-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/181Segmentation; Edge detection involving edge growing; involving edge linking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10081Computed x-ray tomography [CT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30096Tumor; Lesion

Definitions

  • the present disclosure relates to object segmentation and, more particularly, to methods and systems for regulating an object segmentation result.
  • intensity distribution itself does not provide sufficient cues to differentiate the target objects from the typically rich backgrounds. Additional mechanisms need to be used to help a vision algorithm produce an acceptable result. Shape constraint techniques which regulate the segmented object using shape cues may be used.
  • a liver tumor is typically a simple shaped object.
  • CT computed tomography
  • a discriminating function may produce a segmentation result that includes a significant amount of misclassified voxels.
  • FIGS. 1A and 1B show examples of simple shaped target objects and neighboring objects with an intensity distribution similar to that of the target objects.
  • FIG. 1A is the raw image slice.
  • FIG. 1B shows the corresponding likelihood field.
  • a constraint may be imposed on the configuration of the segmented target object to avoid including the misclassified non-target voxels in the segmentation.
  • additional information needs to be used. In general, it is not desirable to request the user to provide additional interactive inputs.
  • Shape feature is a cue that can be used in regulating the segmentation result.
  • a shape property that characterizes target objects in the liver tumor segmentation scenario, for example, is that the target objects are simple shaped objects which may exhibit significant variations.
  • FIGS. 2A through 2H show examples of the two-dimensional boundaries of three target objects, which were marked by physicians. As shown in FIGS. 2A through 2H , the target object is next to anatomical structures with an intensity distribution similar to that of the target object.
  • Active shape model establishes statistical models from a batch of variations of target shapes, which can then be used to guide the target object segmentation. This technique performs reasonably well when there are no significant variations in target objects. It can handle complex objects with some internal structures and missing parts and occlusion, but is not suitable for scenarios where target objects of simple shape exhibit significant variations.
  • Level set based techniques may provide elegant approaches to embed shape constraint in the level set function, but do not address the shape constraint itself. Smoothness constraints such as integration of derivatives do not provide much help in differentiating the target objects from backgrounds. Other shape measures such as shape factors do not enable a valid mechanism to be established to regulate the segmented shape. A need exists for an effective shape constraint measure on simple target objects which is capable of handling significant object variations.
  • a method for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape.
  • the method includes: calculating a set of shape-constraint measures at each point on a boundary of an object segmentation result; searching for one or more matched point pairs on the boundary of the object segmentation result; and replacing a boundary segment between a selected matched point pair with a smooth curve.
  • a system for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape comprises: a memory device for storing a program; a processor in communication with the memory device, the processor operative with the program to: calculate a set of a shape-constraint measures at each point on a boundary of an object segmentation result; search for one or more matched point pairs on the boundary of the object segmentation result; and replace a boundary segment between a selected matched point pair with a smooth curve.
  • a method for regulating a shape of an object segmentation result.
  • the method includes: defining a set of shape-constraint measures to regulate segmented target objects; searching for a pair of matched points on a boundary of an object segmentation result; and interpolating between the matched points using local shape properties.
  • FIGS. 1A and 1B show examples of simple shaped target objects and neighboring objects with an intensity distribution similar to that of the target objects.
  • FIGS. 2A through 2H show examples of the 2D boundaries of three target objects, which were marked by physicians.
  • FIG. 3 is a flowchart showing a method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape, according to an exemplary embodiment of the present invention.
  • FIGS. 4A through 4D show examples of the estimated likelihood fields of target objects, according to an exemplary embodiment of the present invention.
  • FIG. 5 illustrates a computer system for implementing a method of reducing noise in an image sequence, according to an exemplary embodiment of the present invention.
  • FIG. 6 is a flowchart showing a method of regulating the shape of an object segmentation result, according to an exemplary embodiment of the present invention.
  • a shape constraint technique referred to herein as “a-convex shape constraint technique” imposes constraints on target object segmentation to ensure that the boundary of the segmentation result conforms to a simple object boundary configuration.
  • This technique defines a shape constrain measure, referred to herein as “a-convex measure”, which is an extension of the mathematic convex concept.
  • the a-convex measure may be derived from a center point of a target object to regulate target object boundary based on the a-convex definition, which will be described later in this disclosure.
  • the a-convex shape constraint technique regulates target object segmentation using the a-convex measure which conforms the shape of a segmentation result to an a-convex configuration.
  • the technique can be implemented for two-dimensional (2-D) objects as well as three-dimensional (3-D) objects.
  • regulating a target object directly in 3-D space is typically difficult to be implemented.
  • the object segmentation result is decomposed to a sequence of 2-D cross sections.
  • a-convex shape constraint technique in the cross sections and then combining the results in these cross sections may be a more efficient approach than to impose an a-convex constraint directly in 3-D space.
  • various embodiments of the a-convex shape constraint technique may be applied to 2-D images, 3-D images, and/or higher-dimensional images. Hereinafter, the description will be focused on the regulating process in 2-D.
  • the anchor of a target object, (x c , y c ) to be a position in the target object that may be initially provided by user interaction or by other methods.
  • (x c , y c ) may be located at the center region of a target object.
  • the regulating process assumes that only one connected component exists when regulating a 2-D object.
  • a 3-D target object may produce more than one 2-D connected components and, in which case, each 2D object can be regulated separately.
  • ⁇ (t) denotes a directional angle between a tangent and a directional line to an object center at each curve point, which can be expressed as Equation 1.
  • ⁇ ( t ) ⁇ (( ⁇ x ( t )/ ⁇ t, ⁇ x ( t )/ ⁇ t ) ⁇ circle around ( ⁇ ) ⁇ ( x c ⁇ x ( t ), y c ⁇ y ( t ))), (1)
  • ⁇ circle around ( ⁇ ) ⁇ represents vector product and ⁇ represents the directional angle between ( ⁇ x(t)/ ⁇ t, ⁇ x(t)/ ⁇ t) and (x c ⁇ x(t),y c ⁇ y(t))).
  • is a value larger than 90 degrees and less than 180 degrees.
  • ⁇ (t) may be a small constant size, which can accommodate small local variations.
  • the interval ⁇ (t) is of a size between about 1% to about 50% of a curve length
  • FIGS. 4A through 4D show examples of the estimated likelihood fields of target objects, according to an exemplary embodiment of the present invention Examples of shapes that satisfy the a-convex constraint are shown in FIGS. 4A through 4D .
  • a-convex constraint can be used to constrain segmentation results
  • a simple approach is to define a cost function on the a-convex equation and to plug it in a PDE-based algorithm. Such an approach may not effectively handle boundary leakages.
  • two steps which may be iteratively performed, are used to regulate the segmentation result: (i) search for the most-significant pair of matched points that are non-a-convex on the boundary b(t), and (ii) interpolate between the matched non-a-convex points using local shape properties.
  • a pair of non-a-convex points may be said to be matched if the a-convex arc segments next to the non-a-convex points are consistent such that a smooth circular curve may be formed between them.
  • the significance measurement of a non-a-convex refers to boundary curvature at the point.
  • FIG. 3 is a flowchart showing a method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape, according to an exemplary embodiment of the present invention.
  • step 310 a set of shape-constraint measures are calculated at each point on a boundary of an object segmentation result.
  • the set of shape-constraint measures may define a measurement criterion that characterizes a family of two-dimensional shapes.
  • the family of two-dimensional shapes may comprise compact, pseudo-round types of shapes.
  • the shape-constraint measures may be defined based on a single object center.
  • the shape-constraint measures may be defined based on a middle axis segment.
  • Calculating the set of shape-constraint measures may comprise calculating a directional angle between a tangent and a directional line to an object center at each curve point, calculating a local average of a directional angle in an interval, and checking that substantially all points between a curve point and an object center are inside the object.
  • step 320 search for one or more matched point pairs on the boundary of the object segmentation result.
  • a pair of points on the boundary of the segmentation object are matched point pairs if, at both points, the calculated values of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition and arc segments adjacent to the points are pointed towards each other such that a smooth curve may be formed between them.
  • step 330 a boundary segment between a selected matched point pair is replaced with a smooth curve.
  • the calculating step 310 , searching step 320 and replacing step 330 may be repeated until no matched pairs can be found for which a calculated value of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition.
  • the present invention may be implemented in various forms of hardware, software, firmware, special purpose processors, or a combination thereof.
  • the present invention may be implemented in software as an application program tangibly embodied on a program storage device.
  • the application program may be uploaded to, and executed by, a machine comprising any suitable architecture.
  • a computer system 101 for implementing a method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape can comprise, inter alia, a central processing unit (CPU) 109 , a memory 103 and an input/output (I/O) interface 104 .
  • the computer system 101 is generally coupled through the I/O interface 104 to a display 105 and various input devices 106 such as a mouse and keyboard.
  • the support circuits can include circuits such as cache, power supplies, clock circuits, and a communications bus.
  • the memory 103 can include random access memory (RAM), read only memory (ROM), disk drive, tape drive, etc., or a combination thereof.
  • the present invention can be implemented as a routine 107 that is stored in memory 103 and executed by the CPU 109 to process the signal from the signal source 108 ,
  • the computer system 101 is a general purpose computer system that becomes a specific purpose computer system when executing the routine 107 of the present invention.
  • the computer platform 101 also includes an operating system and micro instruction code.
  • the various processes and functions described herein may either be part of the micro instruction code or part of the application program (or a combination thereof) which is executed via the operating system.
  • various other peripheral devices may be connected to the computer platform such as an additional data storage device and a printing device.
  • a system for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape comprises a memory device 103 for storing a program, and a processor 109 in communication with the memory device 103 .
  • the processor 109 is operative with the program to calculate a set of shape-constraint measures at each point on a boundary of an object segmentation result; search for one or more matched point pairs on the boundary of the object segmentation result; and replace a boundary segment between a selected matched point pair with a smooth curve.
  • Calculating the set of shape-constraint measures may comprise calculating a directional angle between a tangent and a directional line to an object center at each curve point, calculating a local average of a directional angle in an interval, and checking that substantially all points between a curve point and an object center are inside the object.
  • the processor 109 is further operative with the program to repeat the calculating, searching and replacing steps until no matched pairs can be found for which a calculated value of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition.
  • is a value larger than 90 degrees and less than 180 degrees.
  • the interval ⁇ (t) may be of a size between about 1% to about 50% of a curve length.
  • FIG. 6 is a flowchart showing a method of regulating the shape of an object segmentation result, according to an exemplary embodiment of the present invention.
  • a set of shape-constraint measures is defined to regulate segmented target objects.
  • the set of shape-constraint measures may define a measurement criterion that characterizes a family of two-dimensional shapes.
  • the family of two-dimensional shapes may comprise compact, pseudo-round types of shapes.
  • the shape-constraint measures may be defined based on a single object center.
  • the shape-constraint measures may be defined based on a middle axis segment.
  • step 620 search for a pair of matched points on a boundary of an object segmentation result.
  • a pair of points on the boundary of the segmentation object may be matched point pairs if, at both points, the calculated values of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition and arc segments adjacent to the points are pointed towards each other such that a smooth curve may be formed between them.
  • step 630 interpolate between the matched points using local shape properties.
  • a shape constraint technique uses the a-convex measure to regulate the shape of the segmented target objects.
  • the segmented target objects are simple shaped target objects that may exhibit significant shape variations.
  • the a-convex measure may be defined based on a single anchor point In an exemplary embodiment of the present invention, the a-convex measure is defined based on a middle axis segment and may significantly improve the flexibility and the expression capability of the shape constraint technique.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • Image Analysis (AREA)

Abstract

A method for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape includes: calculating a set of shape-constraint measures at each point on a boundary of an object segmentation result; searching for one or more matched point pairs on the boundary of the object segmentation result; and replacing a boundary segment between a selected matched point pair with a smooth curve.

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • This application claims the benefit of U.S. Provisional Application Ser. No. 60/724,532 (Attorney Docket No. 2005P18276US), filed Oct. 7, 2005 and entitled “A Method for Shape Regulation Using a-Convex-Shape-Constraint”, the content of which is herein incorporated by reference in its entirety.
  • BACKGROUND OF THE INVENTION
  • 1. Technical Field
  • The present disclosure relates to object segmentation and, more particularly, to methods and systems for regulating an object segmentation result.
  • 2. Discussion of Related Art
  • In object segmentation application scenarios such as lesion or anatomical structure segmentation in two- or three-dimensional medical images, intensity distribution itself does not provide sufficient cues to differentiate the target objects from the typically rich backgrounds. Additional mechanisms need to be used to help a vision algorithm produce an acceptable result. Shape constraint techniques which regulate the segmented object using shape cues may be used.
  • For example, in the liver tumor segmentation scenario, a liver tumor is typically a simple shaped object. To segment a liver tumor from a computed tomography (CT) image, generally it is necessary to establish a discriminating function of the liver tumor based on intensity distribution. However, such a discriminating function may produce a segmentation result that includes a significant amount of misclassified voxels. FIGS. 1A and 1B show examples of simple shaped target objects and neighboring objects with an intensity distribution similar to that of the target objects. FIG. 1A is the raw image slice. FIG. 1B shows the corresponding likelihood field.
  • A constraint may be imposed on the configuration of the segmented target object to avoid including the misclassified non-target voxels in the segmentation. To impose a constraint on the segmentation result, additional information needs to be used. In general, it is not desirable to request the user to provide additional interactive inputs.
  • Shape feature is a cue that can be used in regulating the segmentation result. A shape property that characterizes target objects in the liver tumor segmentation scenario, for example, is that the target objects are simple shaped objects which may exhibit significant variations. FIGS. 2A through 2H show examples of the two-dimensional boundaries of three target objects, which were marked by physicians. As shown in FIGS. 2A through 2H, the target object is next to anatomical structures with an intensity distribution similar to that of the target object.
  • Traditional shape constraint techniques, including active shape model, smoothness constraint measures such as integration of derivatives, and shape factor, are all ineffective to constrain the configuration of target objects with simple shapes but exhibiting significant variations.
  • Active shape model establishes statistical models from a batch of variations of target shapes, which can then be used to guide the target object segmentation. This technique performs reasonably well when there are no significant variations in target objects. It can handle complex objects with some internal structures and missing parts and occlusion, but is not suitable for scenarios where target objects of simple shape exhibit significant variations.
  • Learning based techniques which capture statistical shape properties as shape prior knowledge are not able to provide sufficient cues to regulate the target object segmentation. Level set based techniques may provide elegant approaches to embed shape constraint in the level set function, but do not address the shape constraint itself. Smoothness constraints such as integration of derivatives do not provide much help in differentiating the target objects from backgrounds. Other shape measures such as shape factors do not enable a valid mechanism to be established to regulate the segmented shape. A need exists for an effective shape constraint measure on simple target objects which is capable of handling significant object variations.
  • SUMMARY OF THE INVENTION
  • According to an exemplary embodiment of the present invention, a method is provided for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape. The method includes: calculating a set of shape-constraint measures at each point on a boundary of an object segmentation result; searching for one or more matched point pairs on the boundary of the object segmentation result; and replacing a boundary segment between a selected matched point pair with a smooth curve.
  • According to an exemplary embodiment of the present invention, a system for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape comprises: a memory device for storing a program; a processor in communication with the memory device, the processor operative with the program to: calculate a set of a shape-constraint measures at each point on a boundary of an object segmentation result; search for one or more matched point pairs on the boundary of the object segmentation result; and replace a boundary segment between a selected matched point pair with a smooth curve.
  • According to an exemplary embodiment of the present invention, a method is provided for regulating a shape of an object segmentation result. The method includes: defining a set of shape-constraint measures to regulate segmented target objects; searching for a pair of matched points on a boundary of an object segmentation result; and interpolating between the matched points using local shape properties.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The present invention will become more apparent to those of ordinary skill in the art when descriptions of exemplary embodiments thereof are read with reference to the accompanying drawings.
  • FIGS. 1A and 1B show examples of simple shaped target objects and neighboring objects with an intensity distribution similar to that of the target objects.
  • FIGS. 2A through 2H show examples of the 2D boundaries of three target objects, which were marked by physicians.
  • FIG. 3 is a flowchart showing a method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape, according to an exemplary embodiment of the present invention.
  • FIGS. 4A through 4D show examples of the estimated likelihood fields of target objects, according to an exemplary embodiment of the present invention.
  • FIG. 5 illustrates a computer system for implementing a method of reducing noise in an image sequence, according to an exemplary embodiment of the present invention.
  • FIG. 6 is a flowchart showing a method of regulating the shape of an object segmentation result, according to an exemplary embodiment of the present invention.
  • DESCRIPTION OF EXEMPLARY EMBODIMENTS
  • Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.
  • According to an exemplary embodiment of the present invention, a shape constraint technique, referred to herein as “a-convex shape constraint technique” imposes constraints on target object segmentation to ensure that the boundary of the segmentation result conforms to a simple object boundary configuration. This technique defines a shape constrain measure, referred to herein as “a-convex measure”, which is an extension of the mathematic convex concept. For example, the a-convex measure may be derived from a center point of a target object to regulate target object boundary based on the a-convex definition, which will be described later in this disclosure.
  • The a-convex shape constraint technique regulates target object segmentation using the a-convex measure which conforms the shape of a segmentation result to an a-convex configuration. The technique can be implemented for two-dimensional (2-D) objects as well as three-dimensional (3-D) objects. However, regulating a target object directly in 3-D space is typically difficult to be implemented. In an exemplary embodiment of the present invention, when the object is a 3-D object, the object segmentation result is decomposed to a sequence of 2-D cross sections. Applying the a-convex shape constraint technique, according to exemplary embodiments of the present invention, in the cross sections and then combining the results in these cross sections may be a more efficient approach than to impose an a-convex constraint directly in 3-D space. It is to be understood that various embodiments of the a-convex shape constraint technique may be applied to 2-D images, 3-D images, and/or higher-dimensional images. Hereinafter, the description will be focused on the regulating process in 2-D.
  • Let b(t)=(x(t), y(t)) be the 2D boundary of a target object, O, where t parameterizes the arc length of the boundary. Define the anchor of a target object, (xc, yc), to be a position in the target object that may be initially provided by user interaction or by other methods. For example, (xc, yc) may be located at the center region of a target object. The regulating process assumes that only one connected component exists when regulating a 2-D object. A 3-D target object may produce more than one 2-D connected components and, in which case, each 2D object can be regulated separately.
  • According to an exemplary embodiment of the present invention, α(t) denotes a directional angle between a tangent and a directional line to an object center at each curve point, which can be expressed as Equation 1.
    α(t)=Φ((∂x(t)/∂t,∂x(t)/∂t){circle around (×)}(x c −x(t),y c −y(t))),   (1)
    where {circle around (×)} represents vector product and Φ represents the directional angle between (∂x(t)/∂t, ∂x(t)/∂t) and (xc−x(t),yc−y(t))). As shown in Equation 2, b(t) is characterized as a-convex if { α ( t ) > 0 and α ( t ) θ and ( x , y ) O , if ( x - x ( t ) ) ( y - y c ) = ( x - x c ) ( y - y ( t ) ) and ( x , y ) [ ( x c , y c ) , ( x ( t ) , y ( t ) ] ( 2 )
    where α(t) represents a local average of the directional angle in an interval, ε(t), starting from t, and where θ has a value larger than 90 degrees. In an exemplary embodiment of the present invention, θ is a value larger than 90 degrees and less than 180 degrees. ε(t) may be a small constant size, which can accommodate small local variations. In an exemplary embodiment of the present invention the interval ε(t) is of a size between about 1% to about 50% of a curve length For a given value of θ, a-convex may be a measurement criterion that characterizes a family of 2-D shapes that are simple compact shapes with some limit variation in local boundary properties. For example, a circle is a-convex (θ=90°). It is to be understood that the a-convex shape constraint technique can be extended to handle target objects of more complex shape.
  • FIGS. 4A through 4D show examples of the estimated likelihood fields of target objects, according to an exemplary embodiment of the present invention Examples of shapes that satisfy the a-convex constraint are shown in FIGS. 4A through 4D.
  • There are various approaches by which the a-convex constraint can be used to constrain segmentation results, For example, a simple approach is to define a cost function on the a-convex equation and to plug it in a PDE-based algorithm. Such an approach may not effectively handle boundary leakages.
  • In an exemplary embodiment of the present invention, two steps, which may be iteratively performed, are used to regulate the segmentation result: (i) search for the most-significant pair of matched points that are non-a-convex on the boundary b(t), and (ii) interpolate between the matched non-a-convex points using local shape properties. A pair of non-a-convex points may be said to be matched if the a-convex arc segments next to the non-a-convex points are consistent such that a smooth circular curve may be formed between them. The significance measurement of a non-a-convex refers to boundary curvature at the point.
  • FIG. 3 is a flowchart showing a method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape, according to an exemplary embodiment of the present invention. Referring to FIG. 3, in step 310, a set of shape-constraint measures are calculated at each point on a boundary of an object segmentation result.
  • The set of shape-constraint measures may define a measurement criterion that characterizes a family of two-dimensional shapes. For example, the family of two-dimensional shapes may comprise compact, pseudo-round types of shapes. The shape-constraint measures may be defined based on a single object center. The shape-constraint measures may be defined based on a middle axis segment.
  • Calculating the set of shape-constraint measures may comprise calculating a directional angle between a tangent and a directional line to an object center at each curve point, calculating a local average of a directional angle in an interval, and checking that substantially all points between a curve point and an object center are inside the object.
  • With reference to Equation 1, above, calculating the set of shape-constraint measures may comprise calculating α(t) and α(t), where α(t) represents a local average of a first directional angle in an interval ε(t) centered from t, and where α(t)=Φ((∂x(t)/∂t, ∂x(t)/∂t){circle around (×)}(xc−x(t), yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t),yc−y(t)). Calculating the set of shape-constraint measures may further comprise calculating (x,y)∈O, if (x−x(t))(y−yc)=(x−xc)(y−y(t)) and (x,y) is between (x(t),y(t)) and (yc,xc), where (x(t),y(t)) is a two-dimensional boundary of a target object O, where t parameterizes an arc length of the boundary of the object segmentation result.
  • In step 320, search for one or more matched point pairs on the boundary of the object segmentation result. In an exemplary embodiment of the present invention, a pair of points on the boundary of the segmentation object are matched point pairs if, at both points, the calculated values of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition and arc segments adjacent to the points are pointed towards each other such that a smooth curve may be formed between them.
  • In step 330, a boundary segment between a selected matched point pair is replaced with a smooth curve.
  • The calculating step 310, searching step 320 and replacing step 330 may be repeated until no matched pairs can be found for which a calculated value of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition.
  • It is to be understood that the present invention may be implemented in various forms of hardware, software, firmware, special purpose processors, or a combination thereof. In one embodiment, the present invention may be implemented in software as an application program tangibly embodied on a program storage device. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture.
  • Referring to FIG. 5, according to an embodiment of the present disclosure, a computer system 101 for implementing a method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape can comprise, inter alia, a central processing unit (CPU) 109, a memory 103 and an input/output (I/O) interface 104. The computer system 101 is generally coupled through the I/O interface 104 to a display 105 and various input devices 106 such as a mouse and keyboard. The support circuits can include circuits such as cache, power supplies, clock circuits, and a communications bus. The memory 103 can include random access memory (RAM), read only memory (ROM), disk drive, tape drive, etc., or a combination thereof. The present invention can be implemented as a routine 107 that is stored in memory 103 and executed by the CPU 109 to process the signal from the signal source 108, As such, the computer system 101 is a general purpose computer system that becomes a specific purpose computer system when executing the routine 107 of the present invention.
  • The computer platform 101 also includes an operating system and micro instruction code. The various processes and functions described herein may either be part of the micro instruction code or part of the application program (or a combination thereof) which is executed via the operating system. In addition, various other peripheral devices may be connected to the computer platform such as an additional data storage device and a printing device.
  • In an exemplary embodiment of the present invention, a system for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape comprises a memory device 103 for storing a program, and a processor 109 in communication with the memory device 103. The processor 109 is operative with the program to calculate a set of shape-constraint measures at each point on a boundary of an object segmentation result; search for one or more matched point pairs on the boundary of the object segmentation result; and replace a boundary segment between a selected matched point pair with a smooth curve.
  • Calculating the set of shape-constraint measures may comprise calculating a directional angle between a tangent and a directional line to an object center at each curve point, calculating a local average of a directional angle in an interval, and checking that substantially all points between a curve point and an object center are inside the object. Calculating the set of shape-constraint measures may comprise calculating α(t) and α(t), where α(t) represents a local average of a first directional angle in an interval ε(t) centered from t, and where α(t)=Φ((∂x(t)/∂t,∂x(t)/∂t){circle around (×)}(xc−x(t), yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t),yc−y(t)).
  • In an exemplary embodiment of the present invention, the processor 109 is further operative with the program to repeat the calculating, searching and replacing steps until no matched pairs can be found for which a calculated value of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition. For example, the shape-constraint measure conditions may comprise α(t)>0 and α(t)≦θ, where α(t) represents a local average of a first directional angle in an interval ε(t) starting from t, and where α(t)=Φ((∂x(t)/∂t,∂x(t)/∂t){circle around (×)}(xc−x(t),yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t),yc−y(t)). In an exemplary embodiment of the present invention, θ is a value larger than 90 degrees and less than 180 degrees. The interval ε(t) may be of a size between about 1% to about 50% of a curve length.
  • It is to be further understood that, because some of the constituent system components and method steps depicted in the accompanying figures may be implemented in software, the actual connections between the system components (or the process steps) may differ depending upon the manner in which the present invention is programmed. Given the teachings of the present invention provided herein, one of ordinary skill in the related art will be able to contemplate these and similar implementations or configurations of the present invention.
  • FIG. 6 is a flowchart showing a method of regulating the shape of an object segmentation result, according to an exemplary embodiment of the present invention. Referring to FIG. 6, in step 610, a set of shape-constraint measures is defined to regulate segmented target objects. The set of shape-constraint measures may define a measurement criterion that characterizes a family of two-dimensional shapes. For example, the family of two-dimensional shapes may comprise compact, pseudo-round types of shapes. The shape-constraint measures may be defined based on a single object center. The shape-constraint measures may be defined based on a middle axis segment.
  • In step 620, search for a pair of matched points on a boundary of an object segmentation result. For example, a pair of points on the boundary of the segmentation object may be matched point pairs if, at both points, the calculated values of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition and arc segments adjacent to the points are pointed towards each other such that a smooth curve may be formed between them.
  • In step 630, interpolate between the matched points using local shape properties.
  • According to an exemplary embodiment of the present invention, a shape constraint technique uses the a-convex measure to regulate the shape of the segmented target objects. In an exemplary embodiment of the present invention, the segmented target objects are simple shaped target objects that may exhibit significant shape variations. The a-convex measure may be defined based on a single anchor point In an exemplary embodiment of the present invention, the a-convex measure is defined based on a middle axis segment and may significantly improve the flexibility and the expression capability of the shape constraint technique.
  • Although exemplary embodiments of the present invention have been described in detail with reference to the accompanying drawings for the purpose of illustration, it is to be understood that the inventive processes and apparatus are not to be construed as limited thereby. It will be readily apparent to those of reasonable skill in the art that various modifications to the foregoing exemplary embodiments may be made without departing from the scope of the invention as defined by the appended claims.

Claims (24)

1. A method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape, comprising:
calculating a set of shape-constraint measures at each point on a boundary of an object segmentation result;
searching for one or more matched point pairs on the boundary of the object segmentation result; and
replacing a boundary segment between a selected matched point pair with a smooth curve.
2. The method of claim 1 wherein calculating the set of shape-constraint measures comprises calculating a directional angle between a tangent and a directional line to an object center at each curve point, calculating a local average of a directional angle in an interval, and checking that substantially all points between a curve point and an object center are inside the object.
3. The method of claim 1 wherein calculating the set of shape-constraint measures comprises calculating α(t) and α(t), where α(t) represents a local average of a first directional angle in an interval ε(t) centered from t, and where α(t)=Φ((∂x(t)/∂t,∂x(t)/∂t){circle around (×)}(xc−x(t),yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t),yc−y(t)).
4. The method of claim 3, further comprising calculating (x,y)∈O, if (x−x(t))(y−yc)=(x−xc)(y−y(t)) and (x,y) is between (x(t),y(t)) and (yc,xc), where (x(t),y(t)) is a two-dimensional boundary of a target object O, where t parameterizes an arc length of the boundary of the object segmentation result.
5. The method of claim 1, wherein the set of shape-constraint measures define a measurement criterion that characterizes a family of two-dimensional shapes
6. The method of claim 5, wherein the family of two-dimensional shapes comprises compact, pseudo-round types of shapes.
7. The method of claim 1, wherein the shape-constraint measures are defined based on a single object center.
8. The method of claim 1, wherein the shape-constraint measures are defined based on a middle axis segment.
9. The method of claim 1l wherein a pair of points on the boundary of the segmentation object are matched point pairs if, at both points, the calculated values of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition and arc segments adjacent to the points are pointed towards each other such that a smooth curve may be formed between them.
10. The method of claim 1, further comprising repeating the calculating, searching and replacing steps until no matched pairs can be found for which a calculated value of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition.
11. The method of claim 10, wherein the shape-constraint measure conditions comprise α(t)>0 and α(t)≦θ, where α(t) represents a local average of a first directional angle in an interval ε(t) starting from t, and where α(t)=Φ((∂x(t)/∂t,∂x(t)/∂t){circle around (×)}(xc−x(t),yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t), yc−y(t)).
12. The method of claim 11, wherein θ is a value larger than 90 degrees and less than 180 degrees.
13. The method of claim 11, wherein the interval ε(t) is of a size between about 1% to about 50% of a curve length.
14. The method of claim 1, wherein when the object is a three-dimensional object, the object segmentation result is decomposed to a sequence of two-dimensional cross sections, and wherein the calculating, searching and replacing steps are repeated for the two-dimensional cross sections.
15. A system for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape, comprising:
a memory device for storing a program;
a processor in communication with the memory device, the processor operative with the program to:
calculate a set of shape-constraint measures at each point on a boundary of an object segmentation result;
search for one or more matched point pairs on the boundary of the object segmentation result; and
replace a boundary segment between a selected matched point pair with a smooth curve.
16. The system of claim 15, wherein calculating the set of shape-constraint measures comprises calculating a directional angle between a tangent and a directional line to an object center at each curve point, calculating a local average of a directional angle in an interval, and checking that substantially all points between a curve point and an object center are inside the object.
17. The system of claim 15, wherein calculating the set of shape-constraint measures comprises calculating α(t) and α(t), where α(t) represents a local average of a first directional angle in an interval ε(t) centered from t, and where α(t)=Φ((∂x(t)/∂t, ∂x(t)/∂t){circle around (×)}(xc−x(t),yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t),yc−y(t)).
18. The system of claim 15, wherein the processor is further operative with the program to repeat the calculating, searching and replacing steps until no matched pairs can be found for which a calculated value of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition.
19. The system of claim 18, wherein the shape-constraint measure conditions comprise α(t)>0 and α(t)≦θ, where α(t) represents a local average of a first directional angle in an interval ε(t) starting from t, and where α(t)=Φ((∂x(t)/∂t,∂x(t)/∂t){circle around (×)}(xc−x(t),yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t),yc−y(t)).
20. The system of claim 19, wherein θ is a value larger than 90 degrees and less than 180 degrees.
21. A method of regulating the shape of an object segmentation result, comprising:
defining a set of shape-constraint measures to regulate segmented target objects;
searching for a pair of matched points on a boundary of an object segmentation result; and
interpolating between the matched points using local shape properties.
22. The method of claim 20, wherein the set of shape-constraint measures define a measurement criterion that characterizes a family of two-dimensional shapes.
23. The method of claim 21, wherein the family of two-dimensional shapes comprises compact, pseudo-round types of shapes.
24. The method of claim 21, wherein a pair of points on the boundary of the segmentation object are matched point pairs if, at both points, the calculated values of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition.
US11/537,671 2005-10-07 2006-10-02 System and Method For Shape Regulation of Segmented Target Objects Abandoned US20070081725A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US11/537,671 US20070081725A1 (en) 2005-10-07 2006-10-02 System and Method For Shape Regulation of Segmented Target Objects
DE102006047372A DE102006047372A1 (en) 2005-10-07 2006-10-06 System and method for shape regulation of segmented target objects

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US72453205P 2005-10-07 2005-10-07
US11/537,671 US20070081725A1 (en) 2005-10-07 2006-10-02 System and Method For Shape Regulation of Segmented Target Objects

Publications (1)

Publication Number Publication Date
US20070081725A1 true US20070081725A1 (en) 2007-04-12

Family

ID=37911118

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/537,671 Abandoned US20070081725A1 (en) 2005-10-07 2006-10-02 System and Method For Shape Regulation of Segmented Target Objects

Country Status (2)

Country Link
US (1) US20070081725A1 (en)
DE (1) DE102006047372A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060044310A1 (en) * 2004-08-31 2006-03-02 Lin Hong Candidate generation for lung nodule detection
US20150286785A1 (en) * 2012-11-21 2015-10-08 The Trustees Of Columbia University In The City Of New York Systems, methods, and devices for image reconstruction using combined pde-constrained and simplified spherical harmonics algorithm
CN106056596A (en) * 2015-11-30 2016-10-26 浙江德尚韵兴图像科技有限公司 Fully-automatic three-dimensional liver segmentation method based on local apriori information and convex optimization

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7016532B2 (en) * 2000-11-06 2006-03-21 Evryx Technologies Image capture and identification system and process

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7016532B2 (en) * 2000-11-06 2006-03-21 Evryx Technologies Image capture and identification system and process
US7403652B2 (en) * 2000-11-06 2008-07-22 Evryx Technologies, Inc. Image capture and identification system and process

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060044310A1 (en) * 2004-08-31 2006-03-02 Lin Hong Candidate generation for lung nodule detection
US7471815B2 (en) * 2004-08-31 2008-12-30 Siemens Medical Solutions Usa, Inc. Candidate generation for lung nodule detection
US20150286785A1 (en) * 2012-11-21 2015-10-08 The Trustees Of Columbia University In The City Of New York Systems, methods, and devices for image reconstruction using combined pde-constrained and simplified spherical harmonics algorithm
US9495516B2 (en) * 2012-11-21 2016-11-15 The Trustees Of Columbia University In The City Of New York Systems, methods, and devices for image reconstruction using combined PDE-constrained and simplified spherical harmonics algorithm
CN106056596A (en) * 2015-11-30 2016-10-26 浙江德尚韵兴图像科技有限公司 Fully-automatic three-dimensional liver segmentation method based on local apriori information and convex optimization

Also Published As

Publication number Publication date
DE102006047372A1 (en) 2007-05-24

Similar Documents

Publication Publication Date Title
US7724936B2 (en) Image generation apparatus and image generation method for detecting abnormalities
US11915514B2 (en) Method and apparatus for detecting facial key points, computer device, and storage medium
Qazi et al. Auto‐segmentation of normal and target structures in head and neck CT images: a feature‐driven model‐based approach
EP2517174B1 (en) Bone suppression in x-ray radiograms
US9053553B2 (en) Methods and apparatus for manipulating images and objects within images
US7430321B2 (en) System and method for volumetric tumor segmentation using joint space-intensity likelihood ratio test
US7015907B2 (en) Segmentation of 3D medical structures using robust ray propagation
US11030747B1 (en) System and method for automatic thoracic organ segmentation from CT using a deep learning framework
US20150043799A1 (en) Localization of Anatomical Structures Using Learning-Based Regression and Efficient Searching or Deformation Strategy
US20140003719A1 (en) Adaptive Trimap Propagation for Video Matting
US20090092300A1 (en) System and Method for Lesion Detection Using Locally Adjustable Priors
US10929981B1 (en) Gross tumor volume segmentation method and computer device
US20150317788A1 (en) Method for Registering Deformable Images Using Random Markov Fields
US20050196027A1 (en) System and method for a semi-automatic quantification of delayed enchancement images
US7200269B2 (en) Non-rigid image registration using distance functions
Shariaty et al. Texture appearance model, a new model-based segmentation paradigm, application on the segmentation of lung nodule in the CT scan of the chest
Foi et al. Difference of Gaussians revolved along elliptical paths for ultrasound fetal head segmentation
US10262428B2 (en) System and method for adaptive range 3D scanning
US9317928B2 (en) Detecting and tracking point features with primary colors
Wang et al. Adaptive mesh expansion model (AMEM) for liver segmentation from CT image
US20070081725A1 (en) System and Method For Shape Regulation of Segmented Target Objects
CN113888566A (en) Target contour curve determining method and device, electronic equipment and storage medium
Nugroho et al. Combinatorial active contour bilateral filter for ultrasound image segmentation
Wang et al. DMCT-Net: dual modules convolution transformer network for head and neck tumor segmentation in PET/CT
Cosío et al. Use of simplex search in active shape models for improved boundary segmentation

Legal Events

Date Code Title Description
AS Assignment

Owner name: SIEMENS CORPORATE RESEARCH, INC., NEW JERSEY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HONG, LIN;REEL/FRAME:018640/0156

Effective date: 20061212

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION