US20070081725A1 - System and Method For Shape Regulation of Segmented Target Objects - Google Patents
System and Method For Shape Regulation of Segmented Target Objects Download PDFInfo
- Publication number
- US20070081725A1 US20070081725A1 US11/537,671 US53767106A US2007081725A1 US 20070081725 A1 US20070081725 A1 US 20070081725A1 US 53767106 A US53767106 A US 53767106A US 2007081725 A1 US2007081725 A1 US 2007081725A1
- Authority
- US
- United States
- Prior art keywords
- shape
- constraint
- segmentation result
- calculating
- boundary
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/64—Analysis of geometric attributes of convexity or concavity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/12—Edge-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/181—Segmentation; Edge detection involving edge growing; involving edge linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10081—Computed x-ray tomography [CT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30096—Tumor; Lesion
Definitions
- the present disclosure relates to object segmentation and, more particularly, to methods and systems for regulating an object segmentation result.
- intensity distribution itself does not provide sufficient cues to differentiate the target objects from the typically rich backgrounds. Additional mechanisms need to be used to help a vision algorithm produce an acceptable result. Shape constraint techniques which regulate the segmented object using shape cues may be used.
- a liver tumor is typically a simple shaped object.
- CT computed tomography
- a discriminating function may produce a segmentation result that includes a significant amount of misclassified voxels.
- FIGS. 1A and 1B show examples of simple shaped target objects and neighboring objects with an intensity distribution similar to that of the target objects.
- FIG. 1A is the raw image slice.
- FIG. 1B shows the corresponding likelihood field.
- a constraint may be imposed on the configuration of the segmented target object to avoid including the misclassified non-target voxels in the segmentation.
- additional information needs to be used. In general, it is not desirable to request the user to provide additional interactive inputs.
- Shape feature is a cue that can be used in regulating the segmentation result.
- a shape property that characterizes target objects in the liver tumor segmentation scenario, for example, is that the target objects are simple shaped objects which may exhibit significant variations.
- FIGS. 2A through 2H show examples of the two-dimensional boundaries of three target objects, which were marked by physicians. As shown in FIGS. 2A through 2H , the target object is next to anatomical structures with an intensity distribution similar to that of the target object.
- Active shape model establishes statistical models from a batch of variations of target shapes, which can then be used to guide the target object segmentation. This technique performs reasonably well when there are no significant variations in target objects. It can handle complex objects with some internal structures and missing parts and occlusion, but is not suitable for scenarios where target objects of simple shape exhibit significant variations.
- Level set based techniques may provide elegant approaches to embed shape constraint in the level set function, but do not address the shape constraint itself. Smoothness constraints such as integration of derivatives do not provide much help in differentiating the target objects from backgrounds. Other shape measures such as shape factors do not enable a valid mechanism to be established to regulate the segmented shape. A need exists for an effective shape constraint measure on simple target objects which is capable of handling significant object variations.
- a method for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape.
- the method includes: calculating a set of shape-constraint measures at each point on a boundary of an object segmentation result; searching for one or more matched point pairs on the boundary of the object segmentation result; and replacing a boundary segment between a selected matched point pair with a smooth curve.
- a system for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape comprises: a memory device for storing a program; a processor in communication with the memory device, the processor operative with the program to: calculate a set of a shape-constraint measures at each point on a boundary of an object segmentation result; search for one or more matched point pairs on the boundary of the object segmentation result; and replace a boundary segment between a selected matched point pair with a smooth curve.
- a method for regulating a shape of an object segmentation result.
- the method includes: defining a set of shape-constraint measures to regulate segmented target objects; searching for a pair of matched points on a boundary of an object segmentation result; and interpolating between the matched points using local shape properties.
- FIGS. 1A and 1B show examples of simple shaped target objects and neighboring objects with an intensity distribution similar to that of the target objects.
- FIGS. 2A through 2H show examples of the 2D boundaries of three target objects, which were marked by physicians.
- FIG. 3 is a flowchart showing a method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape, according to an exemplary embodiment of the present invention.
- FIGS. 4A through 4D show examples of the estimated likelihood fields of target objects, according to an exemplary embodiment of the present invention.
- FIG. 5 illustrates a computer system for implementing a method of reducing noise in an image sequence, according to an exemplary embodiment of the present invention.
- FIG. 6 is a flowchart showing a method of regulating the shape of an object segmentation result, according to an exemplary embodiment of the present invention.
- a shape constraint technique referred to herein as “a-convex shape constraint technique” imposes constraints on target object segmentation to ensure that the boundary of the segmentation result conforms to a simple object boundary configuration.
- This technique defines a shape constrain measure, referred to herein as “a-convex measure”, which is an extension of the mathematic convex concept.
- the a-convex measure may be derived from a center point of a target object to regulate target object boundary based on the a-convex definition, which will be described later in this disclosure.
- the a-convex shape constraint technique regulates target object segmentation using the a-convex measure which conforms the shape of a segmentation result to an a-convex configuration.
- the technique can be implemented for two-dimensional (2-D) objects as well as three-dimensional (3-D) objects.
- regulating a target object directly in 3-D space is typically difficult to be implemented.
- the object segmentation result is decomposed to a sequence of 2-D cross sections.
- a-convex shape constraint technique in the cross sections and then combining the results in these cross sections may be a more efficient approach than to impose an a-convex constraint directly in 3-D space.
- various embodiments of the a-convex shape constraint technique may be applied to 2-D images, 3-D images, and/or higher-dimensional images. Hereinafter, the description will be focused on the regulating process in 2-D.
- the anchor of a target object, (x c , y c ) to be a position in the target object that may be initially provided by user interaction or by other methods.
- (x c , y c ) may be located at the center region of a target object.
- the regulating process assumes that only one connected component exists when regulating a 2-D object.
- a 3-D target object may produce more than one 2-D connected components and, in which case, each 2D object can be regulated separately.
- ⁇ (t) denotes a directional angle between a tangent and a directional line to an object center at each curve point, which can be expressed as Equation 1.
- ⁇ ( t ) ⁇ (( ⁇ x ( t )/ ⁇ t, ⁇ x ( t )/ ⁇ t ) ⁇ circle around ( ⁇ ) ⁇ ( x c ⁇ x ( t ), y c ⁇ y ( t ))), (1)
- ⁇ circle around ( ⁇ ) ⁇ represents vector product and ⁇ represents the directional angle between ( ⁇ x(t)/ ⁇ t, ⁇ x(t)/ ⁇ t) and (x c ⁇ x(t),y c ⁇ y(t))).
- ⁇ is a value larger than 90 degrees and less than 180 degrees.
- ⁇ (t) may be a small constant size, which can accommodate small local variations.
- the interval ⁇ (t) is of a size between about 1% to about 50% of a curve length
- FIGS. 4A through 4D show examples of the estimated likelihood fields of target objects, according to an exemplary embodiment of the present invention Examples of shapes that satisfy the a-convex constraint are shown in FIGS. 4A through 4D .
- a-convex constraint can be used to constrain segmentation results
- a simple approach is to define a cost function on the a-convex equation and to plug it in a PDE-based algorithm. Such an approach may not effectively handle boundary leakages.
- two steps which may be iteratively performed, are used to regulate the segmentation result: (i) search for the most-significant pair of matched points that are non-a-convex on the boundary b(t), and (ii) interpolate between the matched non-a-convex points using local shape properties.
- a pair of non-a-convex points may be said to be matched if the a-convex arc segments next to the non-a-convex points are consistent such that a smooth circular curve may be formed between them.
- the significance measurement of a non-a-convex refers to boundary curvature at the point.
- FIG. 3 is a flowchart showing a method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape, according to an exemplary embodiment of the present invention.
- step 310 a set of shape-constraint measures are calculated at each point on a boundary of an object segmentation result.
- the set of shape-constraint measures may define a measurement criterion that characterizes a family of two-dimensional shapes.
- the family of two-dimensional shapes may comprise compact, pseudo-round types of shapes.
- the shape-constraint measures may be defined based on a single object center.
- the shape-constraint measures may be defined based on a middle axis segment.
- Calculating the set of shape-constraint measures may comprise calculating a directional angle between a tangent and a directional line to an object center at each curve point, calculating a local average of a directional angle in an interval, and checking that substantially all points between a curve point and an object center are inside the object.
- step 320 search for one or more matched point pairs on the boundary of the object segmentation result.
- a pair of points on the boundary of the segmentation object are matched point pairs if, at both points, the calculated values of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition and arc segments adjacent to the points are pointed towards each other such that a smooth curve may be formed between them.
- step 330 a boundary segment between a selected matched point pair is replaced with a smooth curve.
- the calculating step 310 , searching step 320 and replacing step 330 may be repeated until no matched pairs can be found for which a calculated value of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition.
- the present invention may be implemented in various forms of hardware, software, firmware, special purpose processors, or a combination thereof.
- the present invention may be implemented in software as an application program tangibly embodied on a program storage device.
- the application program may be uploaded to, and executed by, a machine comprising any suitable architecture.
- a computer system 101 for implementing a method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape can comprise, inter alia, a central processing unit (CPU) 109 , a memory 103 and an input/output (I/O) interface 104 .
- the computer system 101 is generally coupled through the I/O interface 104 to a display 105 and various input devices 106 such as a mouse and keyboard.
- the support circuits can include circuits such as cache, power supplies, clock circuits, and a communications bus.
- the memory 103 can include random access memory (RAM), read only memory (ROM), disk drive, tape drive, etc., or a combination thereof.
- the present invention can be implemented as a routine 107 that is stored in memory 103 and executed by the CPU 109 to process the signal from the signal source 108 ,
- the computer system 101 is a general purpose computer system that becomes a specific purpose computer system when executing the routine 107 of the present invention.
- the computer platform 101 also includes an operating system and micro instruction code.
- the various processes and functions described herein may either be part of the micro instruction code or part of the application program (or a combination thereof) which is executed via the operating system.
- various other peripheral devices may be connected to the computer platform such as an additional data storage device and a printing device.
- a system for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape comprises a memory device 103 for storing a program, and a processor 109 in communication with the memory device 103 .
- the processor 109 is operative with the program to calculate a set of shape-constraint measures at each point on a boundary of an object segmentation result; search for one or more matched point pairs on the boundary of the object segmentation result; and replace a boundary segment between a selected matched point pair with a smooth curve.
- Calculating the set of shape-constraint measures may comprise calculating a directional angle between a tangent and a directional line to an object center at each curve point, calculating a local average of a directional angle in an interval, and checking that substantially all points between a curve point and an object center are inside the object.
- the processor 109 is further operative with the program to repeat the calculating, searching and replacing steps until no matched pairs can be found for which a calculated value of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition.
- ⁇ is a value larger than 90 degrees and less than 180 degrees.
- the interval ⁇ (t) may be of a size between about 1% to about 50% of a curve length.
- FIG. 6 is a flowchart showing a method of regulating the shape of an object segmentation result, according to an exemplary embodiment of the present invention.
- a set of shape-constraint measures is defined to regulate segmented target objects.
- the set of shape-constraint measures may define a measurement criterion that characterizes a family of two-dimensional shapes.
- the family of two-dimensional shapes may comprise compact, pseudo-round types of shapes.
- the shape-constraint measures may be defined based on a single object center.
- the shape-constraint measures may be defined based on a middle axis segment.
- step 620 search for a pair of matched points on a boundary of an object segmentation result.
- a pair of points on the boundary of the segmentation object may be matched point pairs if, at both points, the calculated values of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition and arc segments adjacent to the points are pointed towards each other such that a smooth curve may be formed between them.
- step 630 interpolate between the matched points using local shape properties.
- a shape constraint technique uses the a-convex measure to regulate the shape of the segmented target objects.
- the segmented target objects are simple shaped target objects that may exhibit significant shape variations.
- the a-convex measure may be defined based on a single anchor point In an exemplary embodiment of the present invention, the a-convex measure is defined based on a middle axis segment and may significantly improve the flexibility and the expression capability of the shape constraint technique.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Geometry (AREA)
- Image Analysis (AREA)
Abstract
A method for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape includes: calculating a set of shape-constraint measures at each point on a boundary of an object segmentation result; searching for one or more matched point pairs on the boundary of the object segmentation result; and replacing a boundary segment between a selected matched point pair with a smooth curve.
Description
- This application claims the benefit of U.S. Provisional Application Ser. No. 60/724,532 (Attorney Docket No. 2005P18276US), filed Oct. 7, 2005 and entitled “A Method for Shape Regulation Using a-Convex-Shape-Constraint”, the content of which is herein incorporated by reference in its entirety.
- 1. Technical Field
- The present disclosure relates to object segmentation and, more particularly, to methods and systems for regulating an object segmentation result.
- 2. Discussion of Related Art
- In object segmentation application scenarios such as lesion or anatomical structure segmentation in two- or three-dimensional medical images, intensity distribution itself does not provide sufficient cues to differentiate the target objects from the typically rich backgrounds. Additional mechanisms need to be used to help a vision algorithm produce an acceptable result. Shape constraint techniques which regulate the segmented object using shape cues may be used.
- For example, in the liver tumor segmentation scenario, a liver tumor is typically a simple shaped object. To segment a liver tumor from a computed tomography (CT) image, generally it is necessary to establish a discriminating function of the liver tumor based on intensity distribution. However, such a discriminating function may produce a segmentation result that includes a significant amount of misclassified voxels.
FIGS. 1A and 1B show examples of simple shaped target objects and neighboring objects with an intensity distribution similar to that of the target objects.FIG. 1A is the raw image slice.FIG. 1B shows the corresponding likelihood field. - A constraint may be imposed on the configuration of the segmented target object to avoid including the misclassified non-target voxels in the segmentation. To impose a constraint on the segmentation result, additional information needs to be used. In general, it is not desirable to request the user to provide additional interactive inputs.
- Shape feature is a cue that can be used in regulating the segmentation result. A shape property that characterizes target objects in the liver tumor segmentation scenario, for example, is that the target objects are simple shaped objects which may exhibit significant variations.
FIGS. 2A through 2H show examples of the two-dimensional boundaries of three target objects, which were marked by physicians. As shown inFIGS. 2A through 2H , the target object is next to anatomical structures with an intensity distribution similar to that of the target object. - Traditional shape constraint techniques, including active shape model, smoothness constraint measures such as integration of derivatives, and shape factor, are all ineffective to constrain the configuration of target objects with simple shapes but exhibiting significant variations.
- Active shape model establishes statistical models from a batch of variations of target shapes, which can then be used to guide the target object segmentation. This technique performs reasonably well when there are no significant variations in target objects. It can handle complex objects with some internal structures and missing parts and occlusion, but is not suitable for scenarios where target objects of simple shape exhibit significant variations.
- Learning based techniques which capture statistical shape properties as shape prior knowledge are not able to provide sufficient cues to regulate the target object segmentation. Level set based techniques may provide elegant approaches to embed shape constraint in the level set function, but do not address the shape constraint itself. Smoothness constraints such as integration of derivatives do not provide much help in differentiating the target objects from backgrounds. Other shape measures such as shape factors do not enable a valid mechanism to be established to regulate the segmented shape. A need exists for an effective shape constraint measure on simple target objects which is capable of handling significant object variations.
- According to an exemplary embodiment of the present invention, a method is provided for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape. The method includes: calculating a set of shape-constraint measures at each point on a boundary of an object segmentation result; searching for one or more matched point pairs on the boundary of the object segmentation result; and replacing a boundary segment between a selected matched point pair with a smooth curve.
- According to an exemplary embodiment of the present invention, a system for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape comprises: a memory device for storing a program; a processor in communication with the memory device, the processor operative with the program to: calculate a set of a shape-constraint measures at each point on a boundary of an object segmentation result; search for one or more matched point pairs on the boundary of the object segmentation result; and replace a boundary segment between a selected matched point pair with a smooth curve.
- According to an exemplary embodiment of the present invention, a method is provided for regulating a shape of an object segmentation result. The method includes: defining a set of shape-constraint measures to regulate segmented target objects; searching for a pair of matched points on a boundary of an object segmentation result; and interpolating between the matched points using local shape properties.
- The present invention will become more apparent to those of ordinary skill in the art when descriptions of exemplary embodiments thereof are read with reference to the accompanying drawings.
-
FIGS. 1A and 1B show examples of simple shaped target objects and neighboring objects with an intensity distribution similar to that of the target objects. -
FIGS. 2A through 2H show examples of the 2D boundaries of three target objects, which were marked by physicians. -
FIG. 3 is a flowchart showing a method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape, according to an exemplary embodiment of the present invention. -
FIGS. 4A through 4D show examples of the estimated likelihood fields of target objects, according to an exemplary embodiment of the present invention. -
FIG. 5 illustrates a computer system for implementing a method of reducing noise in an image sequence, according to an exemplary embodiment of the present invention. -
FIG. 6 is a flowchart showing a method of regulating the shape of an object segmentation result, according to an exemplary embodiment of the present invention. - Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.
- According to an exemplary embodiment of the present invention, a shape constraint technique, referred to herein as “a-convex shape constraint technique” imposes constraints on target object segmentation to ensure that the boundary of the segmentation result conforms to a simple object boundary configuration. This technique defines a shape constrain measure, referred to herein as “a-convex measure”, which is an extension of the mathematic convex concept. For example, the a-convex measure may be derived from a center point of a target object to regulate target object boundary based on the a-convex definition, which will be described later in this disclosure.
- The a-convex shape constraint technique regulates target object segmentation using the a-convex measure which conforms the shape of a segmentation result to an a-convex configuration. The technique can be implemented for two-dimensional (2-D) objects as well as three-dimensional (3-D) objects. However, regulating a target object directly in 3-D space is typically difficult to be implemented. In an exemplary embodiment of the present invention, when the object is a 3-D object, the object segmentation result is decomposed to a sequence of 2-D cross sections. Applying the a-convex shape constraint technique, according to exemplary embodiments of the present invention, in the cross sections and then combining the results in these cross sections may be a more efficient approach than to impose an a-convex constraint directly in 3-D space. It is to be understood that various embodiments of the a-convex shape constraint technique may be applied to 2-D images, 3-D images, and/or higher-dimensional images. Hereinafter, the description will be focused on the regulating process in 2-D.
- Let b(t)=(x(t), y(t)) be the 2D boundary of a target object, O, where t parameterizes the arc length of the boundary. Define the anchor of a target object, (xc, yc), to be a position in the target object that may be initially provided by user interaction or by other methods. For example, (xc, yc) may be located at the center region of a target object. The regulating process assumes that only one connected component exists when regulating a 2-D object. A 3-D target object may produce more than one 2-D connected components and, in which case, each 2D object can be regulated separately.
- According to an exemplary embodiment of the present invention, α(t) denotes a directional angle between a tangent and a directional line to an object center at each curve point, which can be expressed as Equation 1.
α(t)=Φ((∂x(t)/∂t,∂x(t)/∂t){circle around (×)}(x c −x(t),y c −y(t))), (1)
where {circle around (×)} represents vector product and Φ represents the directional angle between (∂x(t)/∂t, ∂x(t)/∂t) and (xc−x(t),yc−y(t))). As shown in Equation 2, b(t) is characterized as a-convex if
whereα(t) represents a local average of the directional angle in an interval, ε(t), starting from t, and where θ has a value larger than 90 degrees. In an exemplary embodiment of the present invention, θ is a value larger than 90 degrees and less than 180 degrees. ε(t) may be a small constant size, which can accommodate small local variations. In an exemplary embodiment of the present invention the interval ε(t) is of a size between about 1% to about 50% of a curve length For a given value of θ, a-convex may be a measurement criterion that characterizes a family of 2-D shapes that are simple compact shapes with some limit variation in local boundary properties. For example, a circle is a-convex (θ=90°). It is to be understood that the a-convex shape constraint technique can be extended to handle target objects of more complex shape. -
FIGS. 4A through 4D show examples of the estimated likelihood fields of target objects, according to an exemplary embodiment of the present invention Examples of shapes that satisfy the a-convex constraint are shown inFIGS. 4A through 4D . - There are various approaches by which the a-convex constraint can be used to constrain segmentation results, For example, a simple approach is to define a cost function on the a-convex equation and to plug it in a PDE-based algorithm. Such an approach may not effectively handle boundary leakages.
- In an exemplary embodiment of the present invention, two steps, which may be iteratively performed, are used to regulate the segmentation result: (i) search for the most-significant pair of matched points that are non-a-convex on the boundary b(t), and (ii) interpolate between the matched non-a-convex points using local shape properties. A pair of non-a-convex points may be said to be matched if the a-convex arc segments next to the non-a-convex points are consistent such that a smooth circular curve may be formed between them. The significance measurement of a non-a-convex refers to boundary curvature at the point.
-
FIG. 3 is a flowchart showing a method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape, according to an exemplary embodiment of the present invention. Referring toFIG. 3 , instep 310, a set of shape-constraint measures are calculated at each point on a boundary of an object segmentation result. - The set of shape-constraint measures may define a measurement criterion that characterizes a family of two-dimensional shapes. For example, the family of two-dimensional shapes may comprise compact, pseudo-round types of shapes. The shape-constraint measures may be defined based on a single object center. The shape-constraint measures may be defined based on a middle axis segment.
- Calculating the set of shape-constraint measures may comprise calculating a directional angle between a tangent and a directional line to an object center at each curve point, calculating a local average of a directional angle in an interval, and checking that substantially all points between a curve point and an object center are inside the object.
- With reference to Equation 1, above, calculating the set of shape-constraint measures may comprise calculating α(t) and
α(t) , whereα(t) represents a local average of a first directional angle in an interval ε(t) centered from t, and where α(t)=Φ((∂x(t)/∂t, ∂x(t)/∂t){circle around (×)}(xc−x(t), yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t),yc−y(t)). Calculating the set of shape-constraint measures may further comprise calculating (x,y)∈O, if (x−x(t))(y−yc)=(x−xc)(y−y(t)) and (x,y) is between (x(t),y(t)) and (yc,xc), where (x(t),y(t)) is a two-dimensional boundary of a target object O, where t parameterizes an arc length of the boundary of the object segmentation result. - In
step 320, search for one or more matched point pairs on the boundary of the object segmentation result. In an exemplary embodiment of the present invention, a pair of points on the boundary of the segmentation object are matched point pairs if, at both points, the calculated values of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition and arc segments adjacent to the points are pointed towards each other such that a smooth curve may be formed between them. - In
step 330, a boundary segment between a selected matched point pair is replaced with a smooth curve. - The calculating
step 310, searchingstep 320 and replacingstep 330 may be repeated until no matched pairs can be found for which a calculated value of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition. - It is to be understood that the present invention may be implemented in various forms of hardware, software, firmware, special purpose processors, or a combination thereof. In one embodiment, the present invention may be implemented in software as an application program tangibly embodied on a program storage device. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture.
- Referring to
FIG. 5 , according to an embodiment of the present disclosure, acomputer system 101 for implementing a method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape can comprise, inter alia, a central processing unit (CPU) 109, amemory 103 and an input/output (I/O)interface 104. Thecomputer system 101 is generally coupled through the I/O interface 104 to adisplay 105 andvarious input devices 106 such as a mouse and keyboard. The support circuits can include circuits such as cache, power supplies, clock circuits, and a communications bus. Thememory 103 can include random access memory (RAM), read only memory (ROM), disk drive, tape drive, etc., or a combination thereof. The present invention can be implemented as a routine 107 that is stored inmemory 103 and executed by theCPU 109 to process the signal from thesignal source 108, As such, thecomputer system 101 is a general purpose computer system that becomes a specific purpose computer system when executing the routine 107 of the present invention. - The
computer platform 101 also includes an operating system and micro instruction code. The various processes and functions described herein may either be part of the micro instruction code or part of the application program (or a combination thereof) which is executed via the operating system. In addition, various other peripheral devices may be connected to the computer platform such as an additional data storage device and a printing device. - In an exemplary embodiment of the present invention, a system for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape comprises a
memory device 103 for storing a program, and aprocessor 109 in communication with thememory device 103. Theprocessor 109 is operative with the program to calculate a set of shape-constraint measures at each point on a boundary of an object segmentation result; search for one or more matched point pairs on the boundary of the object segmentation result; and replace a boundary segment between a selected matched point pair with a smooth curve. - Calculating the set of shape-constraint measures may comprise calculating a directional angle between a tangent and a directional line to an object center at each curve point, calculating a local average of a directional angle in an interval, and checking that substantially all points between a curve point and an object center are inside the object. Calculating the set of shape-constraint measures may comprise calculating α(t) and
α(t) , whereα(t) represents a local average of a first directional angle in an interval ε(t) centered from t, and where α(t)=Φ((∂x(t)/∂t,∂x(t)/∂t){circle around (×)}(xc−x(t), yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t),yc−y(t)). - In an exemplary embodiment of the present invention, the
processor 109 is further operative with the program to repeat the calculating, searching and replacing steps until no matched pairs can be found for which a calculated value of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition. For example, the shape-constraint measure conditions may comprise α(t)>0 andα(t) ≦θ, whereα(t) represents a local average of a first directional angle in an interval ε(t) starting from t, and where α(t)=Φ((∂x(t)/∂t,∂x(t)/∂t){circle around (×)}(xc−x(t),yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t),yc−y(t)). In an exemplary embodiment of the present invention, θ is a value larger than 90 degrees and less than 180 degrees. The interval ε(t) may be of a size between about 1% to about 50% of a curve length. - It is to be further understood that, because some of the constituent system components and method steps depicted in the accompanying figures may be implemented in software, the actual connections between the system components (or the process steps) may differ depending upon the manner in which the present invention is programmed. Given the teachings of the present invention provided herein, one of ordinary skill in the related art will be able to contemplate these and similar implementations or configurations of the present invention.
-
FIG. 6 is a flowchart showing a method of regulating the shape of an object segmentation result, according to an exemplary embodiment of the present invention. Referring toFIG. 6 , instep 610, a set of shape-constraint measures is defined to regulate segmented target objects. The set of shape-constraint measures may define a measurement criterion that characterizes a family of two-dimensional shapes. For example, the family of two-dimensional shapes may comprise compact, pseudo-round types of shapes. The shape-constraint measures may be defined based on a single object center. The shape-constraint measures may be defined based on a middle axis segment. - In
step 620, search for a pair of matched points on a boundary of an object segmentation result. For example, a pair of points on the boundary of the segmentation object may be matched point pairs if, at both points, the calculated values of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition and arc segments adjacent to the points are pointed towards each other such that a smooth curve may be formed between them. - In
step 630, interpolate between the matched points using local shape properties. - According to an exemplary embodiment of the present invention, a shape constraint technique uses the a-convex measure to regulate the shape of the segmented target objects. In an exemplary embodiment of the present invention, the segmented target objects are simple shaped target objects that may exhibit significant shape variations. The a-convex measure may be defined based on a single anchor point In an exemplary embodiment of the present invention, the a-convex measure is defined based on a middle axis segment and may significantly improve the flexibility and the expression capability of the shape constraint technique.
- Although exemplary embodiments of the present invention have been described in detail with reference to the accompanying drawings for the purpose of illustration, it is to be understood that the inventive processes and apparatus are not to be construed as limited thereby. It will be readily apparent to those of reasonable skill in the art that various modifications to the foregoing exemplary embodiments may be made without departing from the scope of the invention as defined by the appended claims.
Claims (24)
1. A method of regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape, comprising:
calculating a set of shape-constraint measures at each point on a boundary of an object segmentation result;
searching for one or more matched point pairs on the boundary of the object segmentation result; and
replacing a boundary segment between a selected matched point pair with a smooth curve.
2. The method of claim 1 wherein calculating the set of shape-constraint measures comprises calculating a directional angle between a tangent and a directional line to an object center at each curve point, calculating a local average of a directional angle in an interval, and checking that substantially all points between a curve point and an object center are inside the object.
3. The method of claim 1 wherein calculating the set of shape-constraint measures comprises calculating α(t) and α(t) , where α(t) represents a local average of a first directional angle in an interval ε(t) centered from t, and where α(t)=Φ((∂x(t)/∂t,∂x(t)/∂t){circle around (×)}(xc−x(t),yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t),yc−y(t)).
4. The method of claim 3 , further comprising calculating (x,y)∈O, if (x−x(t))(y−yc)=(x−xc)(y−y(t)) and (x,y) is between (x(t),y(t)) and (yc,xc), where (x(t),y(t)) is a two-dimensional boundary of a target object O, where t parameterizes an arc length of the boundary of the object segmentation result.
5. The method of claim 1 , wherein the set of shape-constraint measures define a measurement criterion that characterizes a family of two-dimensional shapes
6. The method of claim 5 , wherein the family of two-dimensional shapes comprises compact, pseudo-round types of shapes.
7. The method of claim 1 , wherein the shape-constraint measures are defined based on a single object center.
8. The method of claim 1 , wherein the shape-constraint measures are defined based on a middle axis segment.
9. The method of claim 1l wherein a pair of points on the boundary of the segmentation object are matched point pairs if, at both points, the calculated values of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition and arc segments adjacent to the points are pointed towards each other such that a smooth curve may be formed between them.
10. The method of claim 1 , further comprising repeating the calculating, searching and replacing steps until no matched pairs can be found for which a calculated value of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition.
11. The method of claim 10 , wherein the shape-constraint measure conditions comprise α(t)>0 and α(t) ≦θ, where α(t) represents a local average of a first directional angle in an interval ε(t) starting from t, and where α(t)=Φ((∂x(t)/∂t,∂x(t)/∂t){circle around (×)}(xc−x(t),yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t), yc−y(t)).
12. The method of claim 11 , wherein θ is a value larger than 90 degrees and less than 180 degrees.
13. The method of claim 11 , wherein the interval ε(t) is of a size between about 1% to about 50% of a curve length.
14. The method of claim 1 , wherein when the object is a three-dimensional object, the object segmentation result is decomposed to a sequence of two-dimensional cross sections, and wherein the calculating, searching and replacing steps are repeated for the two-dimensional cross sections.
15. A system for regulating an object segmentation result to conform a shape of the object segmentation result to a pseudo-round type of shape, comprising:
a memory device for storing a program;
a processor in communication with the memory device, the processor operative with the program to:
calculate a set of shape-constraint measures at each point on a boundary of an object segmentation result;
search for one or more matched point pairs on the boundary of the object segmentation result; and
replace a boundary segment between a selected matched point pair with a smooth curve.
16. The system of claim 15 , wherein calculating the set of shape-constraint measures comprises calculating a directional angle between a tangent and a directional line to an object center at each curve point, calculating a local average of a directional angle in an interval, and checking that substantially all points between a curve point and an object center are inside the object.
17. The system of claim 15 , wherein calculating the set of shape-constraint measures comprises calculating α(t) and α(t) , where α(t) represents a local average of a first directional angle in an interval ε(t) centered from t, and where α(t)=Φ((∂x(t)/∂t, ∂x(t)/∂t){circle around (×)}(xc−x(t),yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t),yc−y(t)).
18. The system of claim 15 , wherein the processor is further operative with the program to repeat the calculating, searching and replacing steps until no matched pairs can be found for which a calculated value of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition.
19. The system of claim 18 , wherein the shape-constraint measure conditions comprise α(t)>0 and α(t) ≦θ, where α(t) represents a local average of a first directional angle in an interval ε(t) starting from t, and where α(t)=Φ((∂x(t)/∂t,∂x(t)/∂t){circle around (×)}(xc−x(t),yc−y(t))), where {circle around (×)} represents vector product and Φ represents a second directional angle between (∂x(t)/∂t,∂x(t)/∂t) and (xc−x(t),yc−y(t)).
20. The system of claim 19 , wherein θ is a value larger than 90 degrees and less than 180 degrees.
21. A method of regulating the shape of an object segmentation result, comprising:
defining a set of shape-constraint measures to regulate segmented target objects;
searching for a pair of matched points on a boundary of an object segmentation result; and
interpolating between the matched points using local shape properties.
22. The method of claim 20 , wherein the set of shape-constraint measures define a measurement criterion that characterizes a family of two-dimensional shapes.
23. The method of claim 21 , wherein the family of two-dimensional shapes comprises compact, pseudo-round types of shapes.
24. The method of claim 21 , wherein a pair of points on the boundary of the segmentation object are matched point pairs if, at both points, the calculated values of at least one shape-constraint measure of the set of shape-constraint measures does not satisfy a shape-constraint measure condition.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/537,671 US20070081725A1 (en) | 2005-10-07 | 2006-10-02 | System and Method For Shape Regulation of Segmented Target Objects |
DE102006047372A DE102006047372A1 (en) | 2005-10-07 | 2006-10-06 | System and method for shape regulation of segmented target objects |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US72453205P | 2005-10-07 | 2005-10-07 | |
US11/537,671 US20070081725A1 (en) | 2005-10-07 | 2006-10-02 | System and Method For Shape Regulation of Segmented Target Objects |
Publications (1)
Publication Number | Publication Date |
---|---|
US20070081725A1 true US20070081725A1 (en) | 2007-04-12 |
Family
ID=37911118
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/537,671 Abandoned US20070081725A1 (en) | 2005-10-07 | 2006-10-02 | System and Method For Shape Regulation of Segmented Target Objects |
Country Status (2)
Country | Link |
---|---|
US (1) | US20070081725A1 (en) |
DE (1) | DE102006047372A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060044310A1 (en) * | 2004-08-31 | 2006-03-02 | Lin Hong | Candidate generation for lung nodule detection |
US20150286785A1 (en) * | 2012-11-21 | 2015-10-08 | The Trustees Of Columbia University In The City Of New York | Systems, methods, and devices for image reconstruction using combined pde-constrained and simplified spherical harmonics algorithm |
CN106056596A (en) * | 2015-11-30 | 2016-10-26 | 浙江德尚韵兴图像科技有限公司 | Fully-automatic three-dimensional liver segmentation method based on local apriori information and convex optimization |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7016532B2 (en) * | 2000-11-06 | 2006-03-21 | Evryx Technologies | Image capture and identification system and process |
-
2006
- 2006-10-02 US US11/537,671 patent/US20070081725A1/en not_active Abandoned
- 2006-10-06 DE DE102006047372A patent/DE102006047372A1/en not_active Ceased
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7016532B2 (en) * | 2000-11-06 | 2006-03-21 | Evryx Technologies | Image capture and identification system and process |
US7403652B2 (en) * | 2000-11-06 | 2008-07-22 | Evryx Technologies, Inc. | Image capture and identification system and process |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060044310A1 (en) * | 2004-08-31 | 2006-03-02 | Lin Hong | Candidate generation for lung nodule detection |
US7471815B2 (en) * | 2004-08-31 | 2008-12-30 | Siemens Medical Solutions Usa, Inc. | Candidate generation for lung nodule detection |
US20150286785A1 (en) * | 2012-11-21 | 2015-10-08 | The Trustees Of Columbia University In The City Of New York | Systems, methods, and devices for image reconstruction using combined pde-constrained and simplified spherical harmonics algorithm |
US9495516B2 (en) * | 2012-11-21 | 2016-11-15 | The Trustees Of Columbia University In The City Of New York | Systems, methods, and devices for image reconstruction using combined PDE-constrained and simplified spherical harmonics algorithm |
CN106056596A (en) * | 2015-11-30 | 2016-10-26 | 浙江德尚韵兴图像科技有限公司 | Fully-automatic three-dimensional liver segmentation method based on local apriori information and convex optimization |
Also Published As
Publication number | Publication date |
---|---|
DE102006047372A1 (en) | 2007-05-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7724936B2 (en) | Image generation apparatus and image generation method for detecting abnormalities | |
US11915514B2 (en) | Method and apparatus for detecting facial key points, computer device, and storage medium | |
Qazi et al. | Auto‐segmentation of normal and target structures in head and neck CT images: a feature‐driven model‐based approach | |
EP2517174B1 (en) | Bone suppression in x-ray radiograms | |
US9053553B2 (en) | Methods and apparatus for manipulating images and objects within images | |
US7430321B2 (en) | System and method for volumetric tumor segmentation using joint space-intensity likelihood ratio test | |
US7015907B2 (en) | Segmentation of 3D medical structures using robust ray propagation | |
US11030747B1 (en) | System and method for automatic thoracic organ segmentation from CT using a deep learning framework | |
US20150043799A1 (en) | Localization of Anatomical Structures Using Learning-Based Regression and Efficient Searching or Deformation Strategy | |
US20140003719A1 (en) | Adaptive Trimap Propagation for Video Matting | |
US20090092300A1 (en) | System and Method for Lesion Detection Using Locally Adjustable Priors | |
US10929981B1 (en) | Gross tumor volume segmentation method and computer device | |
US20150317788A1 (en) | Method for Registering Deformable Images Using Random Markov Fields | |
US20050196027A1 (en) | System and method for a semi-automatic quantification of delayed enchancement images | |
US7200269B2 (en) | Non-rigid image registration using distance functions | |
Shariaty et al. | Texture appearance model, a new model-based segmentation paradigm, application on the segmentation of lung nodule in the CT scan of the chest | |
Foi et al. | Difference of Gaussians revolved along elliptical paths for ultrasound fetal head segmentation | |
US10262428B2 (en) | System and method for adaptive range 3D scanning | |
US9317928B2 (en) | Detecting and tracking point features with primary colors | |
Wang et al. | Adaptive mesh expansion model (AMEM) for liver segmentation from CT image | |
US20070081725A1 (en) | System and Method For Shape Regulation of Segmented Target Objects | |
CN113888566A (en) | Target contour curve determining method and device, electronic equipment and storage medium | |
Nugroho et al. | Combinatorial active contour bilateral filter for ultrasound image segmentation | |
Wang et al. | DMCT-Net: dual modules convolution transformer network for head and neck tumor segmentation in PET/CT | |
Cosío et al. | Use of simplex search in active shape models for improved boundary segmentation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SIEMENS CORPORATE RESEARCH, INC., NEW JERSEY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HONG, LIN;REEL/FRAME:018640/0156 Effective date: 20061212 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |