CN103079467B - The mechanism generated for higher structure and edit - Google Patents

Abstract

Embodiment of the present invention are for method and the mechanism for handling the image generated by the X-ray therapy machine for radiodiagnosis and treatment use.In one embodiment, there is provided a kind of for by following steps (such as, the registration) that connect between image and image data set intelligence automatically propagate the method that profile is described manually or automatically: obtain one or more images of one or more image data set；Determine described image relative to the dependency between the structure identified；And generation deformation map, described deformation map establishes the correspondence of each point in source images and the point in target image.Subsequently, this deformation map is applied independently to each structure of described source images and by the structure-borne of deformation to described target image by described intelligence mechanism of transmission.

Description

The mechanism generated for higher structure and edit

Related application

This application claims in the U.S. utility application number 12/821 that on June 23rd, 2010 submits to and title is " MechanismforAdvancedStructureGenerationandEditing ", 985 and be also submit to and the priority of U.S. utility application number 12/821,977 that title is " MechanismforDynamicallyPropagatingReal-timeAlterationsof MedicalImages " on June 23rd, 2010.

Technical field

Present invention relates in general to X-ray therapy, and it particularly relates to a kind of for handling by the mechanism of the image generated for the X-ray therapy machine in radiodiagnosis and treatment use.

Background of invention

It is known that use medical imaging apparatus that various internal diseases are diagnosed and planned treatment.Generally, imaging device such as X-ray apparatus, computer tomography (CT) or nuclear magnetic resonance (MR) device is used to generate one or more preliminary sweeps or the image of interest region.Can by make a branch of lonizing radiation focus to target zones and gather in imager by restraint obtain these preliminary sweeps.The bundle that imager collects is used to generate the display (i.e. one or more images) of target zones, and display can be used to diagnosis or monitor affected areas (such as, tumor or focus or peripheral region).

Typically, once get image, it is necessary for positively identifying the key structure (such as position or organ) being in targeting regions, in order to treatment can by optimal orientation.General medical imaging technique includes the technology for automatically identifying (" segmentation ") organ and big structure.These technology generally include is classified to these structures by obtained radiodensity description adjacent structure and relative position and the obtained density with given value according to these structures.But, even if there being the automatic segmentation to anatomical structure, identify that these positions generally also include following the trail of the contour line (" profile ") of these or other structure.Such as, the radiation of a part for targeting certain organs or organ is likely to need to carry out specific identification and/or boundary to by (multiple) part connecing subject organ.Similarly, tumor can also be drawn profile and identified for treatment clearly.For some treatment plan, it may be preferred to indicate these parts identified by drawing the profile of the girth in region clearly.

Traditionally, manually perform this profile and describe and on diagnosis planning CT, this process performed at least one times, and the structure generated is subsequently used in predicted treatment plan.Newer technology and advanced techniques allow by using cone beam computerized tomography system (CBCT) to improve image acquisition.In conventional computerized tomography system, rebuild one or more 2D section from the One Dimensional Projection of patient, and these sections can be bonded to form three-dimensional (3D) image of patient.Except being obtained the image of whole volume by ROTATING SOURCE and imager and from except multiple 2D backprojection reconstruction 3D renderings completely, cone beam computerized tomography system is analogous to conventional computer tomograph system.Unfortunately, then the profile that hand drawn is independent on the continuum of 2D section is bonded to obtain each image of whole data set and is probably extremely consuming time and effort.Time and labor increases more along with quantity and the respective size of the quantity of image slice and the anatomical structure (such as, organ, tumor etc.) in the specific region paid close attention to.

Additionally, concrete anatomic construction over time and/or due in treatment plan process, accept radiotherapy and it may happen that change (changing is intensely sometimes).Exactly, depending on the curative effect of disease and treatment plan, the size of target zones is likely to expand or reduce.Thus, the treatment plan being centered around the diagnostic image design of generation in initial CT scan process is probably invalid, poor efficiency or or even treatment patient is adventurous.For guaranteeing best targeting and location, sometimes obtain the image of the renewal by area for treatment termly by generating other image over the course for the treatment of, in order to guarantee the suitable location of radiotherapy bundle and determine the effectiveness of therapeutic scheme.The treatment machine being recently developed allows by generally in the change adopting senior imaging acquisition technology such as cone-beam computed tomography (CBCT) to detect on anatomic construction in the site for the treatment of machine immediately before or after patient therapeuticallv.

The generation of more new images and treatment sequential can according to particular patient and/or treatment plan different time, some treatment plans include being monitored by obtaining monitoring image every day.Unfortunately, the dependence (particularly when data are used to planned regulation) of more new images also can be increased the workload that profile is described, because in the generation process of additional images and by applying conventional cutting techniques automatically, any extra profile description that typically not preservation manually performs.Due to the sensitive natur of more new images, for therapeutic purposes to anatomical structure and carry out manual contours in anatomical structure and describe to be probably very consuming time.Thus, manually replicate the profile about great amount of images and be probably extremely intensive and poor efficiency process.

Brief summary of the invention

This general introduction is provided to introduce the concept of the many reduced forms being hereafter further described below in detailed description.This general introduction is not intended to identify key feature or the basic feature of required theme, is also not intended to the scope being used to the required theme of restriction.

In X-ray therapy is planned, manual contours is described to be still process consuming time.Typically, this process is performed once by diagnosis planning CT and the structure generated is subsequently used in predicted treatment plan.But, along with the raising of the availability of the imaging modalities in therapeutic process (the daily conical beam CT at such as treatment machine place) process, improve effective contour tracer or regulate original contour/structure to adapt to the requirement of the complex concept of new anatomy.Embodiment of the present invention are for the method for the feature of automatic spread contoured between the multiple image data sets that generate of X-ray therapy machine for using in radiodiagnosis and treatment use and mechanism.

According to embodiment of the present invention, being likely to by automatic spread to another 3D rendering data set (CBCT such as got in treatment machine) in the anatomical structure of an image (3DCT such as used in the planning stage) upper definition, premise is that two data sets are by pre-registration each other.In one embodiment, it is provided that a kind of in (such as registration) that the connect method that between image and image data set, intelligence automatic spread profile manually or automatically is described.As provided, method includes: obtain one or more images of one or more image data set, determine image relative to the dependency between the structure identified, generate the deformation map of each point and the correspondence of a point in target image established in source images.Subsequently, this deformation map is applied independently to each structure of source images and by the structure-borne after deformation to target image by intelligence mechanism of transmission.When because being likely to be present in the content variation between image due to time and/or treatment, this allows the profile that generates of automatic spread and allows partial structurtes to change over a data-oriented to concentrate or structure between multiple differing data collection.

It is functional that the advantage provided by performing this method includes achieving structure replication, the functional merging of structure replication from the message of deformation map to provide and the mating more accurately of the actual anatomic construction in target image.The correction feature while that the design same tool for correcting the deformation field from image registration may be utilized on two or more registered imageses, to realize carrying out profile description on multiple collection of registration data simultaneously.Furthermore it is possible to realize editing the effectiveness of multiple structure simultaneously.

Accompanying drawing is sketched

The accompanying drawing of the part being incorporated herein in file and forming application documents illustrates embodiment of the present invention, and is used for together with the description explaining principles of the invention:

Fig. 1 describes the flow chart of the method for automatically propagating defined structure between multiple associated data set according to embodiment of the present invention.

Fig. 2 describes the flow chart of the method describing data for the profile more propagating renewal between new images concentrated at individual data according to embodiment of the present invention.

Fig. 3 is the diagram of the exemplary propagation between the associated picture that data according to embodiment of the present invention are concentrated.

Fig. 4 describes the flow chart of the method for automatically editing the structure in multiple associated picture according to embodiment of the present invention.

Fig. 5 is the diagram of the example arrangement editor in single image according to embodiment of the present invention.

Fig. 6 is the diagram according to the example arrangement editor in multiple, the associated picture of embodiment of the present invention and propagation.

Fig. 7 describes the exemplary computing environments according to embodiment of the present invention.

Detailed description of the invention

Some embodiments will be carried out now referring in detail to.Although theme will be described in conjunction with alternate embodiment, but it is to be understood that these alternate embodiment are not intended required theme is limited to these embodiments.On the contrary, required theme is intended to contain replacement scheme, amendment and the equivalent that can include in the spirit and scope of the theme required by such as claims define.

Additionally, in the following detailed description, for providing, thoroughly understanding of required theme is elaborated many details.But, it will be appreciated by persons skilled in the art that can practice embodiments when not having these details or having its equivalent.In other cases, it is not described in detail well-known method, program and parts, in order to avoid unnecessarily obscuring aspect and the feature of theme.

Just a kind of method provides and discusses part following detailed description of.Although step and its sequence disclosed in the accompanying drawing (such as Fig. 1, Fig. 2) of operation describing this method herein, but these steps and sequence are illustrative of.Embodiment is very suitable for performing the variant of step cited in the flow chart of other steps various or accompanying drawing herein and is different from sequence depicted and described herein performs with a kind of.

Can use under general context in medium such as program module, by one or more computers or the computer executable instructions of other calculation element execution being present in some form of computer, the embodiments described herein is described.Generally, program module includes performing particular task or implementing the routine of particular abstract data type, program, object, parts, data structure etc..The functional of program module can combine according to the needs in each embodiment or be distributed.

For example and and unrestricted, computer can use medium can include computer-readable storage medium and communication media.Computer-readable storage medium include in any method or technology implementation for storage information such as computer-readable instruction, data structure, program module or other data volatile and nonvolatile, removable and nonremovable medium.Computer-readable storage medium includes but not limited to random access memory (RAM), read-only memory (ROM), electrically erasable ROM (EEPROM), flash memory or other memory techniques, high density compact disc ROM (CD-ROM), digital versatile disc (DVD) or other optical memory, cartridge, tape, disk memory or other magnetic memory device, or can be used other medium any of the required information of storage.

Communication media can be embodied as the computer-readable instruction in modulated message signal such as carrier wave or other transfer mechanism, data structure, program module or other data, and includes any information delivery media.Term " modulated message signal " refers to a signal, and one or more features that signal has are set or change the information in signal to be encoded.For example and and unrestricted, communication media includes wire medium (such as cable network or direct wired connection) and wireless medium (such as acoustics, radio frequency (RF), infrared ray and other wireless medium).The combination of any of the above person should also be as including in the scope of computer-readable medium.

In embodiments below, describe the technology of the effect automatically propagating manual contours between a kind of multiple data sets in imaging systems.Embodiment includes a kind of for automatically propagating, from source images to the target image of association, the method that the effect of manual contours adjusts the difference between referenced image simultaneously.

Contoured structure is to the automatic spread of associated data set

Fig. 1 be according to an embodiment for flow process Figure 100 of the method for the structure of automatic spread contoured manually or automatically between multiple images.Step 101 to step 107 is described to include the illustrative steps in the process described in flow process Figure 100 according to various embodiments described herein.In one embodiment, flow process Figure 100 is implemented as and is stored in computer-readable medium and by performing the computer executable instructions that performs for the calculation element of the process of automatic spread manual contours effect between data set.

In step 101, accessing the first image, the first image includes more than first structure and one or more silhouette effect manually or automatically.First image can include such as, medical imaging apparatus the first data scanning of the CT data set generated.First image can also be made up of the display of the data got in initial diagnosis CT scan process.According to some embodiments, the data for whole data set can by pre-imaging and store in the data repository (such as internal memory) that access in a step 101.In some cases, the first image self can include multiple anatomical features or structure.These features can include but not limited to organ, tumor, focus etc..These features some or all of can carry out automatic Ground Split according to the various identifications implemented as software program and cutting techniques.In further embodiment, image can show the feature of the part of position or the structure that can include multiple silhouette effect such as general outline.

In step 103, access includes the second image of more than second structure.Such as, the second image can include (multiple) same anatomical position and the display of the patient about identical (or even not same).Second image can include such as, medical imaging apparatus the second data scanning of the data set generated.Medical imaging apparatus can include and generate the imaging device identical for the imaging device of the data of the first data set.In some embodiments, the second image can have the data set identical with the first image.As an alternative, other imaging device can also be used to generate the second data set.Such as, in some cases, X-ray therapy machine can equipped with CBCT or other imaging equipment.Imaging can also be carried out to meeting subject patient from X-ray therapy machine by imaging equipment.Other device such as MR imaging apparatus or other similar medical imaging apparatus can also be used to obtain view data.

In one embodiment, perform step 103 calculation element can be communicably connected to treatment and/or imaging equipment, thus allow the data including the second image once be acquired just immediately by perform calculation element access.As an alternative, can equally by pre-imaging and store in the data repository that access in a step 101 for the data of an image or whole data set.

Second image the same with the first image can include multiple anatomical features.These features can include but not limited to all or part structure shown in the first image.In some embodiments, the second image can be made up of the display being equal to or being generally equal to the general region of anatomy being shown in having equivalent or being generally similarly oriented in the first image, axis, size, scope.As an alternative, second image can include the display of different multiple anatomical features, the part being shown in the first image wherein only having anatomic construction is visible, and display can be different from the display of the feature in the first image with in condition in orientation or other visible configuration.According to some embodiments, the second image can with the first image pre-association.Pre-association can include at an intrasystem registration.

In step 105, identify any parallax in the first image of step 101 access content of clearly identifying common with the second image in step 103 access, and map the relation between parallax point." deformation map " that can pass through two images of generation performs to map the dissimilarity of common characteristic.In one embodiment, it is possible to generate deformation map by establishing each pixel of apokoinou construction in the first image or " source " image or the region of anatomy with the correspondence being equal to pixel in the second image or " target " image.The position of compared pixels and it is then determined that the relative displacement between a pair respective pixel is to draw the relative property between pixel.In one embodiment, respective pixel is to identify by comparing the respective image pixel intensities of the remainder relative to image.This correspondence may be implemented as such as trivector field.As an alternative, it is also possible to implement correspondence by expressing multiple mathematical functions of the relative property between two respective point.

In step 107, according to the deformation map generated in step 105, the silhouette effect manually or automatically identified in the first image accessed in step 101 is automatically propagated to the second image accessed in step 103.In some embodiments, it is possible to automatically propagate silhouette effect to each image of the first image registration each data set of the data set registration of the first image (or with).

Can such as by deformation map is applied to silhouette effect application and the output of gained is copied to the second image performs propagate silhouette effect.That is, it it is not the direct 1:1 propagation of identical silhouette effect, and any silhouette effect manually or automatically originating from the first image while the mapping parallax being adjusted to accommodate between the first image and the second image, will be transmitted to the second image.Such as, if after the treatment, the size of tumor, position and/or shape are modified, then drawing profile and will also correspondingly be modified to ideally carry out optimal treatment targeting for the region of specific targeting around tumor.Under propagating affected situation one to one, any profile of target is described to be likely to, by deformation inadequately (such as having size or the particularity of deficiency), be in the position of non-corresponding or incongruent and nonideal shape.By to the propagation application deformation map of silhouette effect, it is possible to perform definitely and accurate propagate.

Contoured structure is to the propagation of the more new images of data set

Fig. 2 describes the flow chart that the profile for propagating more new construction between multiple data sets according to embodiment of the present invention describes the method for data.Step 201 to step 213 describes the illustrative steps of the process including describing in flow process Figure 200 according to various embodiments described herein.In one embodiment, flow process Figure 200 is implemented as and is stored in computer-readable medium and is described, by the profile performed for automatically updating structure between multiple data sets, the computer executable instructions that the calculation element of data performs.

In step 201, obtained the original data of Target subjects by imaging device.In one embodiment, view data includes the display of a part for the anatomic construction of Target subjects.The acquisition of original data can be performed by the data set in imaging device such as X ray, MRI or other medical imaging apparatus generates the view data of multiple image.According to various embodiments, original data can obtain in diagnotor process or in the process facilitate diagnotor.Once get, then original data can be stored for further reference to.In one embodiment, original data can be stored by proprietary software application, accesses from proprietary software application and handle proprietary software application.The user's input received by the graphic user interface of software application can instruct (multiple) file to including view data to store, access and handle.

The original data got by imaging device in step 201 can include multiple anatomical structure (such as organ, tumor, focus etc.).These structures some or all of can carry out automatic Ground Split according to the various identifications and cutting techniques being embodied as software program.In some embodiments, for such as treating the purpose of planning, can receive in step 203 and input corresponding other profile description with user.

Can manually add profile by the user's input received in the graphic user interface such as performed on the computer systems to describe.As an alternative, it is possible to automatically describe algorithm from profile and show that profile is described.The example that profile is described can include all or part of clear and definite profile diagram in the structure of effect such as one or more parts.In one embodiment, it is possible to by showing the image corresponding with view data and obtaining user's input via cursor and the reception user's input of other user input apparatus, input indicates required manual contours to describe over the display.

In step 205, obtain (such as, in chronological order subsequently) view data of the renewal of Target subjects.The view data updated can be made up of the display of the targeting regions of the acquisition original data in time point same subject subsequently.Such as can obtain the view data of renewal after diagnosis process and in treatment process process.For example, it is possible to by obtaining view data equipped with the therapy equipment of CT or CBCT imaging device.The view data updated can also obtain at the section of time subsequently of the same diagnostic process obtaining original data, and is generated by the imaging device identical with the imaging device generating original data.

In one embodiment, the identical or generally many table structure being depicted in image according to original data can also be depicted in the view data of renewal.Such as, the view data of renewal can represent the identical of Target subjects's (part for the anatomic construction of such as patient or patient) or the display of generally equivalent (multiple) region of anatomy.Alternate embodiment can include small amount or the structure of larger amount of structure or similar quantity, has orientation in various degree, position simultaneously and axially disposes, in order at least one structure is total between the view data and the original data that update.

In step 207, establish the relation between view data and the original data updated.In one embodiment, it is possible to perform to establish the relation between the view data and the original data that update by the corresponding data in registering images software application.Can pass through to receive to be manually entered from user's (by such as user interface) to perform registration, be manually entered and make the file including the view data of renewal be associated with the file including original data in picture editting or observation application program.In an alternate embodiment, it is possible to predefined relation before obtaining the view data updated.Such as, once get view data, then the image identified for particular subject or patient can automatically be contacted (such as registration) in application program.According to some embodiments, it is possible to the multiple image of registration simultaneously all together.For example, it is possible to automatically registration includes the data set of multiple image.As an alternative, it is possible to by whole data set communication with one another, in order to manually make each image of each data set be associated with each other image of each data set in application program.

Original data can be edited to, in step 209, the profile included step 203 receives and describe.Can by such as adding original data to carry out executive editor's original data by describing corresponding data with profile.In further embodiment, the original data edited can be stored for further reference to.In step 211, generate mapping mechanism and catalogue for any content variation determined between original data and the view data of renewal.In one embodiment, mapping mechanism may be implemented as deformation map, deformation map is drawn by following: compare view data and the original data of renewal, and determines that the deviation of the total characteristics of image between feature and the feature identified of the total targeting of two images exists.In some embodiments, it is possible to be each image generation deformation map of a centering, wherein can map the deviation of common characteristic in mapping program and non-shared feature can be ignored.As an alternative, it is possible to each common characteristic for view data centering generates unique deformation map.

According to some aspects, it is possible to by the pixel data of the pixel data of pixel of the one or more common characteristics included in original data with the common characteristic in the view data of renewal being compared to detection content variation.For example, it is possible to the relative pixel intensity of pixel of the common characteristic included in original data is compared with the image pixel intensities of the pixel of the same characteristic features in the view data including renewal.With such pattern, it can be deduced that for the correspondence between the pixel of the same characteristic features on different images, and deformation map (or other such mechanism) can be generated.This correspondence can be represented as trivector field and/or the multiple mathematical functions by the relative property between two respective point of definition are expressed.

In step 213, according to the mapping mechanism generated in step 211 (such as, deformation map), manual (or the automatically) silhouette effect identified in the original data that step 203 receives is automatically propagated to the view data of the renewal got in step 205.In some embodiments, it is possible to automatically propagate silhouette effect to each image of initial pictures registration each data set of the data set registration of initial pictures (or with).According to some embodiment, the deformation map generated is reversible, and therefore, once generate deformation map, then the silhouette effect of the view data for updating received can be transmitted to original data according to identical process.

Can perform to propagate silhouette effect according to above by reference to the step 107 described by Fig. 1.It may be thus possible, for example, to any silhouette effect (or vice versa) is propagated in the output by the silhouette effect being applied in initial pictures by deformation map (or in other mapping mechanism that step 211 gets) and to the data interpolation gained of the image updated.Therefore, it it is not the clear and definite 1:1 propagation of identical silhouette effect, and any silhouette effect originating from initial pictures will while being automatically adjusted the mapping parallax adapting between initial pictures and the image of renewal, it is transmitted to the image of renewal, therefore causes for and be suitable for the propagation of the relatively silhouette effect of new image data.Equally, the silhouette effect of the image carrying out self refresh will create, to the propagation of initial pictures, the corresponding silhouette effect being suitable for initial pictures on initial pictures.

The exemplary automatic spread of contoured structure

Fig. 3 is the diagram of the exemplary propagation between the associated picture that data are concentrated.According to some embodiments, the first image 301 can represent the image of a part for the experimenter's anatomic construction generated by medical image system with the second image 317 associated, for instance as CT image or CBCT image.These images can include such as the structure of organ or blood vessel or other anatomical elements.In some embodiments, it is possible to manually (such as pass through user interface) or automatically (such as pass through software program) describe or identify these structures.

According to an aspect, first image includes the part from experimenter's anatomic construction and generates " source " image earlier of (and being represented graphically a part for experimenter's anatomic construction), and the second image can include " target " image after a while in time of same or like part of experimenter's anatomic construction.Such as, source images can generate from experimenter during diagnosis earlier, and target image can generate from identical experimenter the period after a while after application for the treatment of or routine.As an alternative, target image can also generate from different experimenters (such as patient), but includes the identical of anatomic construction or the display of generally similar part.

Typically diagnosing and treating in process, medical imaging apparatus the view data generated can manually or automatically be described to strengthen by profile.Profile describes can be used to such as to describe, emphasize or the specific part of targeting image.As Fig. 3 present, first or silhouette effect manually or automatically in " source " image 301 can pass through to perform to be automatically propagated to second above by reference to Fig. 1 and Fig. 2 method described, " target " image 317 of association.

In some cases, the association between the first image and the second image (respectively image 301 and image 317) can be predefined in an application program such as manipulated image and/or image display application program.According to other configuration, it is possible to be manually entered definitely by what (such as by the user interface on screen from user) received and establish association clearly.In other configuration, once meet some prerequisite (the such as identical experimenter identified, the identical storage position etc. identified), it is possible to automatically establish association.

As depicted in fig. 3, the image in data set may further include one or more layer.Such as, the first image 301 has been rendered as multiple layer (such as layer 303,305).According to some embodiments, the feature identified can be grouped between one or more layers and/or arrange.Such as, for the embodiment of the wherein anatomic construction of graphical representation experimenter, organ can be presented on one layer, and cardiovascular system can be presented on the second layer, and skeletal system can be present in third layer etc..In still another embodiment, silhouette effect can separate with further feature and be disposed in exclusive layer.

Layer including the first image 301 can be corresponding with the layer of the second image 317.It is therefoie, for example, the contour layer 319 of the second image 317 is corresponding with the contour layer 303 of the first image 301, and the characteristic layer 321 of the second image 317 is corresponding with the characteristic layer 305 of the first image 301.According to these embodiments, the similar identification layer between associated images can be automatically associated with in an application program or platform.As an alternative, it is also possible to create user-defined association.

As Fig. 3 present, image 303 includes characteristic layer 305, and characteristic layer includes feature (such as feature 307).Feature can such as represent the anatomical organs in target anatomical structure or other position.Equally, identical anatomical organs or position can also be indicated in the characteristic layer 321 of the second image 317 as feature 325.As it is shown on figure 3, feature 325 looks less than feature 307.According to some embodiments, the specific pixel parallax between two features or unit in a pair (or more) image can be mapped by deformation mechanism (such as deformation map 311).As Fig. 3 present, it is possible to the correspondence being determined by including in the pixel of one or more feature (such as feature 309 and feature 325) performs mapping.

As depicted in fig. 3, it is possible to by mapping correspondence for the mapping of each image generation pixel.Can specifically generate each pixel-map (such as deformation map) for each image, and mark and draw the space relative property including between the feature (via pixel) of the image in deformation map.The correspondence between the deformation map of the first image 301 and the deformation map of the second image 317 can be mapped: the relative displacement between related pixel in determining the correspondence (such as identity property) between the pixel in the relative pixel intensity of the pixel of the feature included on each image, the pixel determined based on image pixel intensities in the first image 301 and the second image 317 and determining the respective deformation map of image by such as following steps.

It is therefoie, for example, any pixel in structure 309 can be determined relative to the image pixel intensities of adjacent pixels and is associated with the pixel in structure 325 with identical or generally equivalent relative pixel intensity.It can be each pixel man-to-man mapping of generation of (multiple) structure including image 301,317.It is associated once include the pixel of each feature with the equivalent pixel in associated picture, it is possible to determine and relative displacement between each pixel and the pixel being equal to each pixel in target image 317 of map source image 301.

This relative displacement may be implemented as the registration of the relative property mapped between the multiple deformation map representing each respective image (301,317) and maps (such as, 311).It is therefoie, for example, the certain variations between each pixel in deformation map 313 (corresponding with image 301) and deformation map 315 (and image 317 is corresponding) can be determined that the vector with the set relative property including vector field.Therefore, other point of data (such as pixel) in image 301 can be revised similarly for image 317 by applying equivalent or generally equivalent vector.In an alternate embodiment, as the replacement generating vector field, it is possible to use the algebraic equation expressing the vector including vector field below determines deformation (displacement).

Once generate mapping mechanism 311, the silhouette effect in an image just can be transmitted to another associated images.As depicted, the contoured structure 307 in contour layer 303 can be transmitted in the contour layer 319 of image 317.But, different from the conventional method being merely able to directly duplication, print effect can be modified in order to more accurately embody experimenter's anatomic construction according to deformation mechanism 311.It is therefoie, for example, if the relative property between feature 309 and feature 325 includes a change (changes of the aspects such as such as size, shape, axis, orientation), then silhouette effect is once be transmitted it is possible to stand an equivalent change.As depicted in fig. 3, example feature 325 includes the gross area less than feature 309.Equally, silhouette effect 307 is once be deformed mechanism 311 and regulating, it is possible to be embodied as the less area in the second image as silhouette effect 323, thus providing automatic spread, automatic spread provides the adaptability in response to any change in time to export.

Exemplary partial structurtes editor

Fig. 4 describes the flow chart of the method for editing the partial structurtes in one or more data set according to embodiment of the present invention.Step 401 to step 409 describes the illustrative steps of the process including being depicted in flow chart 400 according to various embodiments described herein.In one embodiment, flow chart 400 is implemented as the computer executable instructions being stored in computer-readable medium and being performed by the calculation element performing the process for edit structure data automatic between one or more data sets.

In step 401, access the first image by such as performing the calculation element of image manipulation software application.In one embodiment, the figure such as a part for the anatomic construction of the pictorial data representation Target subjects of data obtained according to diagnotor (such as X ray, MRI etc.) shows.Specifically, anatomical structure (such as organ, blood vessel, system unit) can be depicted in figure shows.In further embodiment, image can have the corresponding deformation mechanism of the relative property maintained between image and the image of other registration.In one embodiment, deformation mechanism may be implemented such that and includes identical mapping and registration mapping.According to this kind of embodiment, identical mapping can be used to map the relative position of the anatomical structure in identical image.

Identical mapping may be implemented as and such as represents two-dimentional or three-dimensional coordinate axiom, and plurality of structure occupies the space in grid.The ad-hoc location of any point in such space can be expressed as a class value or coordinate, and the set that each structure is multiple point.The point that therefore, it can be mapped to adjacent structure by the relative position of the specified point by including each structure implements identical mapping.In one embodiment, view data can be handled software application storage by identical image and handle software application access from identical image.The user's input received by the graphic user interface of software application can instruct storage, access and the manipulation of (multiple) file including view data in the calculation element of the calculation element or other communication connection that perform application program.

Registration maps and may be implemented as a series of identical mappings corresponding with pre-association image.The apokoinou construction shared between identical mapping and the identical mapping corresponding with another associated images of one image can be mapped in registration mapping together.

According to some embodiments, it is possible to step 403 receive with one or more structures (partial structurtes) of the first image manually adjust or edit corresponding input.Structure, " locally " (for instance on image) of image of namely observed or editor, it is possible to such as adjust to reach accurately by correcting artifact, or illustrate one or more generated structure.In other embodiments, input the previous manual contours of execution according to user to describe to be corrected or adjust.Structure editing can be received by the graphic user interface generated by software application.In one embodiment, it is possible to by showing the image corresponding with view data and obtaining user's input via one or more cursors and the reception user's input of other user input apparatus, input indicates required structure over the display.For example, it is possible to so edit contour line or the shape of a structure.

In step 405, with reference to the deformation mechanism corresponding with the first image.Can such as by the data execution software application in the internal memory being stored in computing system be realized with reference to deformation mechanism.In step 407, edit and input corresponding structure by editing the identical mapping of the first image in deformation mechanism according to user's input with the user received in step 403.It is thus possible, for instance, it is possible in identical mapping, adjust the multiple pixels including structure to be edited, in order to meet and represent the structure edited as considered the user received in step 403 to input.In certain embodiments, another identical mapping can be created for edit structure, and is mapped to the original identical mapping corresponding with the first image.Non-edit structure can be replicated in new identical mapping and be modified to structure before meeting the editor being mapped in original identical mapping and the identical relative property between edit structure in newly created identical mapping.Amendment structure can be performed by the value that the one or more points revising in structure such as revised with include in identical mapping are corresponding.

In step 407, according to the identical mapping corresponding with the first image, the Manual structure editor carried out as the first image that user's input is received in step 403 is automatically propagated to other structure of the first image.In other embodiments, as described by referring to Fig. 6, it is possible to the effect with each other image of the first image registration each data set of the data set registration of the first image (or with) automatically transmission structure editor.

Transmission structure editor can be performed: deformation mechanism (such as identical mapping and/or registration map) is applied to the first image, and adjusts remaining structure so that the effect of edit structure to be described according to identical mapping by following steps.Therefore, it is not that the direct 1:1 of the effect of identical editor propagates, but the structure in the first image will keep their relative size and position (such as orientation, proportionality).Therefore, cause for and the effect of initiating structure editor of applicable raw image data to the propagation of other partial structurtes.

Fig. 5 is the diagram edited while the multiple structures in image 501.According to some embodiments, image 501 includes multiple layer (such as contour layer 503 and structure sheaf 505), and layer each has one or more effect (such as respectively outline effect 507 and structure 509).According to an embodiment, image 501 can be above by reference to Fig. 3 image 301 described.In a typical embodiment, for instance, the data for image 501 can be get and as the stored pregenerated image of computer-readable medium at relatively early time point.As it is shown in figure 5, when the structure placed when the one or more local including image 501 is edited, other the remaining structure including image 501 can be modified to account edit structure equally, so allow to be automatically obtained editor specific, simultaneously.

In one embodiment, image 501 can be accessed (such as via manipulated image or image viewing application program) and show that (such as passing through graphic user interface) is to user.One or more structures (including silhouette effect) of image 501 can be edited after reference picture.Structure can be edited such as adds, revises, improves or removes profile description or other structure.Can be handled by identical image or user interface for observing the image viewing application program of application program carrys out executive editor.According to an embodiment, when the structure in image 501 being modified in carrying out editing process, create the identical mapping 513 made new advances, and registration maps 527 identical mappings 511 that the identical mapping 513 of the image of renewal maps to original image.

Once registration maps the 527 respective identical mappings of image that have mapped original image and renewal, then the non-edit structure in original image (such as image 501) can be modified to embody and/or edit structure is described.Amendment can be realized: adjust the relative property to consider structure to what edit structure was carried out by the application of each non-edit structure by such as following steps, edit structure is that the mapping relations mapped between the identical mapping (such as identical mapping 1511 and identical mapping 2513) in 527 according to registration are revised, therefore realize including the structure of an image respective automatically and editor, so specific for each structural generation and adaptability output simultaneously.There is the gained image (such as image 517) revising structure (such as 523,525) and the layer (such as contour layer 519, structure sheaf 521) of respective numbers can be included as the first image (such as image 501).It addition, when the time subsequently carries out reference, gained image 517 can be stored together with original image (such as image 501), or as an alternative, gained image can replace original image.According to some embodiment, deformation mechanism may be implemented as vector field.

The exemplary automatic spread of edit structure

Other embodiment according to claimed subject matter, can be extended to, above by reference to Fig. 3 automatic spread characteristic described, the structure including manual editing, as described above with the structure of Fig. 4 manual editing described.Fig. 6 is the self-propagating diagram of the multiple edit structures in image 601.Therefore, Fig. 6 is depicted as the assemblage characteristic of the process (such as above by reference to Fig. 4 and Fig. 5 process described) from editor's partial structurtes and the process (such as above by reference to Fig. 1 to Fig. 3 process described) for revising to associated images automatic spread.

As Fig. 6 present, image 601 is provided and includes multiple layer (such as contour layer 603 and structure sheaf 605), and layer each has one or more structure (such as respectively outline effect 607 and structure 609).According to an embodiment, image 601 can be above by reference to Fig. 3 and/or Fig. 5 image 301 described.In a typical embodiment, for instance, the data for image 601 can be get and as the stored pregenerated image of computer-readable medium at relatively early time point.As shown in Figure 6, when the one or more structures including image 601 are edited, other the remaining partial structurtes including image 601 can be modified to account edit structure equally, so allows to automatically realize editor specific, simultaneously.It addition, the structure of associated images (such as image 635) can also be edited to just meet edit structure, the distinctiveness ratio being pre-stored in is described simultaneously.Such as, those structure delineation can be thoroughly different size, shape or orientation by the image of the identical structure (such as anatomic construction) representing progress (or recovery) obtained within a period of time.This can be particularly well-suited to targeting for radiocurable region.Therefore, in an image (image such as obtained during treatment planning or diagnostic phases), edit structure is likely to not produce completely suitable and/or accurate result and carrys out application directly equivalent editor in image after a while.

As depicted in figure 6, the partial structurtes editing the first image (such as image 601) can perform as described by figure 5 above.Impact can be similarly subjected to according to some embodiment, different pieces of information collection or even corresponding with different images standard image.For example, it is possible to generate image 601 from computer tomography (CT) image device.Equally, identical or generally similar portions the image being shown in the structure of the target anatomical in image 601 can be generated by the image device of independent standard or method equally.Such as, cone-beam computed tomography (CBCT) image device can be used to generate identical or generally similar portions the CBCT image of target anatomical structure.

According to some embodiment, Manual structure editor can be propagated to the image between various criterion.Therefore, it is associated with CT image (such as image 601) and shows that the CBCT image (such as image 623) of apokoinou construction (such as structure 625 and 627) automatically can also be revised according to the identical relative property (such as map in 611 at registration and capture) between the structure of the identical mapping 2615 of the identical mapping 1613 and image 623 that are mapped in the first image 601, thus producing the CBCT image of the amendment (such as image 629) with edit structure (such as structure 631 and 633).

Therefore, when mapping the identical mapping 613 of structure of the first image 601 and being modified (such as by editing one or more structures of the first image 601), it is possible to identical mapping 613 is compared with from the identical mapping 619 one or more structures of the first image 601 modified and generate.Edit structure can be then mapped to the corresponding construction (such as mapping in 617) of the first identical mapping 613 at registration.Non-edit structure from the first identical mapping 613 while being adjusted according to the identical relative property between the structure and the homologue of the manual editing in the identical mapping 619 generated that are mapped in the first identical mapping 613, can be replicated in new identical mapping 619.

It is therefoie, for example, the structure as having been edited into tumor or the block with the size reduced can cause the structure of association, as having the manual contours target zones of the proportional size reduced.These amendments that identical mapping 613 is carried out can change shown (such as showing in a display device) image to editor user.As present, the amendment of identical mapping 613 can be shown with the gained image 635 of the structure (such as corresponding with structure 607 structure 637, and the structure 639 corresponding with structure 609) of corresponding editor.Therefore, the particular propagation of the structure of silhouette effect and manual editing can be automatically propagated to other partial structurtes and attached image.

Example calculation machine

As Fig. 7 present, example system (embodiment of the present invention can be implemented in example system) includes general computing system environment such as computing system 700.In the configuration that computing system 700 is most basic, computing system typically comprises at least one processing unit 701 and internal memory, and for passing on the address/data bus 709 (or other interface) of information.Depending on accurately configuration and the type of computing system environment, internal memory can be volatile (such as RAM702), non-volatile (such as ROM703, flash memory etc.) or some combinations of the two.

Computer system 700 could be included for presenting the optional graphics subsystem 705 of information to computer user, for instance by showing information on the attachment display device 710 connected by vision cable 711.According to required embodiment of the present invention, graphics subsystem 705 can pass through vision cable 711 and be connected directly to display device 710.The graphic user interface of the image viewing software application performed in computer system 700 can be created in such as graphics subsystem 705 and in display device 710 and display to the user that.In an alternate embodiment, display device 710 can be integrated in computing system (such as notebook computer or net book display floater) and will not need vision cable 711.In one embodiment, it is possible to perform flow process 100,200 and 300 by graphics subsystem 705 in whole or in part together with processor 701 and internal memory 702, and the output of any gained is shown in the display device 710 of attachment.

It addition, computing system 700 can also have other features/functionality.Such as, computing system 700 can also include other memorizer (removable and/or non-removable), and other memorizer includes but not limited to disk or CD or tape.This other memorizer is shown by data storage device 707 in the figure 7.That computer-readable storage medium includes being implemented in any method or technology for the volatile and nonvolatile of storage information such as computer-readable instruction, data structure, program module or other data, can remove and not removable medium.RAM702, ROM703 and data storage device 707 are all the examples of computer-readable storage medium.

Computer system 700 also includes optional alphanumeric input device 706, the control of optional cursor or guide 707 and one or more signal communication interface (input/output device, for instance NIC) 708.Information and command selection can be communicated to central processing unit 701 by optional alphanumeric input device 706.Optional cursor controls or guide 707 is connected to bus 709 and is communicated to central processing unit 701 for by user's input information and command selection.The signal communication interface (input/output device) 708 being also connected to bus 709 can be serial port.Communication interface 709 can also include wireless communication mechanism.Using communication interface 709, computer system 700 can be passed through communication network such as the Internet or Intranet (such as LAN) and be communicatively connected to other computer system, or is able to receive that data (such as digital television signal).

Although theme being described with the language for architectural feature and/or methodology behavior, but it is to be understood that in claims, the theme of definition is not necessarily limited to specific feature described above or behavior.But, specific feature described above and behavior are to be disclosed as the exemplary form implementing claim.

Claims (36)

1. the method for automatically propagating defined structure between data set, comprising:

Accessing the first image, described first image includes more than first structure and multiple silhouette effect；

Accessing the second image, described second image includes more than second structure corresponding with described more than first structure；

By more than first pixel-map including described first image is generated deformation map to more than second pixel including described second image, described deformation map definition relative property between described more than first structure being placed on respectively on described first image and described second image and described more than second structure；And

Based on described deformation map, the plurality of silhouette effect being included within described first image is automatically propagated to described second image,

More than first pixel-map including described first image wherein includes determining more than first image pixel intensities of the pixel including the common characteristic included in described more than first pixel and the relative property of more than second image pixel intensities of the pixel including the described common characteristic included in described more than second pixel to described more than second pixel.

2. method according to claim 1, wherein said more than first structure includes more than first anatomical structure.

3. method according to claim 1, wherein said more than second structure includes more than second anatomical structure.

4. method according to claim 1, the view data that wherein said first image includes including multiple image is concentrated.

5. method according to claim 4, the same view data that wherein said second image includes including described first image is concentrated.

6. method according to claim 4, wherein said second image includes in the different images data set including described first image.

7. method according to claim 1, the plurality of silhouette effect of wherein said propagation includes:

Described deformation map is applied to the plurality of silhouette effect；And

The described output that described deformation is applied to the plurality of silhouette effect is copied on described second image.

8. method according to claim 1, wherein said first image and at least one in described second image include computer tomography (CT) scanogram.

9. method according to claim 1, wherein said first image and at least one in described second image include cone-beam computed tomography (CBCT) scanogram.

10. method according to claim 1, wherein said deformation map includes vector field.

11. method according to claim 1, wherein said mapping includes:

Described more than first pixel and described more than second pixel are compared；And

Determine any pixel displacement relative to the position of the corresponding pixel of described first image of described second image.

12. method according to claim 11, wherein said determine that relative property includes:

Determine more than first image pixel intensities of described more than first pixel；

Determine more than second image pixel intensities of described more than second pixel；And

Relatively described more than first image pixel intensities and described more than second image pixel intensities.

13. for propagating the method that the structure outline updated describes data between multiple data sets, described method includes:

Obtain the original data of multiple anatomical structure；

Receive and describe user's input that data are corresponding with the profile of the plurality of anatomical structure in described original data；

The plurality of anatomical structure in original data described in data edition is described according to profile；

Obtain the view data updated of the plurality of anatomical structure that the view data updated is concentrated；

Relation between the view data and the described original data that have updated described in establishment；

Generate deformation map, described deformation map is by comparing more than second pixel of the view data updated described in including more than first pixel of described original data and including, to determine that based on the relative property between described more than first pixel and more than second pixel the deviation between described original data and the described view data updated exists, define the deviation between the view data of described original data and described renewal；And

Based on described deformation map, the outline data being included within described original data propagates the view data of described renewal,

Wherein based on the relative property between described more than first pixel and described more than second pixel include the pixel including the common characteristic included in described more than first pixel multiple first image pixel intensities and to include the described common characteristic included in described more than second pixel pixel more than second image pixel intensities between relative property.

14. a radiotherapy device, comprising:

Multiple radioactive sources；

Multiple imagers, it is for receiving lonizing radiation from the plurality of radioactive source and being configured to generate the data representing the target image including multiple anatomical structure；And

Calculation element, it is configured to access and represents that the source images including profile description and mapping include the data of the deformation map of the relative property between more than first pixel of described source images and more than second pixel including described data image, wherein said profile is depicted in be considered while described deformation map by automatic spread

Relative property between wherein said more than first pixel and described more than second pixel include include the pixel including the common characteristic in described more than first pixel multiple first image pixel intensities and include the described common characteristic included in described more than second pixel pixel more than second image pixel intensities between relative property.

15. device according to claim 14, wherein said calculation element is further configured to generate the deformation map of the correspondence mapped between described source images and described target image.

16. device according to claim 15, wherein said profile is described to be by described deformation map being applied to described source images and describing to copy to be automatically propagated to described target image on described target image by described profile adjusting described deformation map while.

17. for the method editing pregenerated image, described method includes:

Access includes the first image of more than first structure；

Receive the input corresponding with the adjustment of the first structure of described more than first structure；

With reference to the first deformation mechanism, described first deformation mechanism includes:

By described more than first structure mapping to the first identical mapping each other；And

The registration mapping described first identical mapping and multiple identical mappings of registration maps；

It is modified described first structure that described first identical mapping is edited in described first deformation mechanism according to described input；And

According to described first deformation mechanism, automatically update described first identical mapping in response to the described adjustment to described first structure,

Wherein said image includes the image generated by medical imaging apparatus.

18. method according to claim 17, wherein receive input and include receiving user's input from graphic user interface.

19. method according to claim 17, wherein said image includes the image of the anatomic construction of experimenter.

20. method according to claim 17, wherein said more than first structure includes multiple anatomical structure.

21. method according to claim 17, wherein the described adjustment of described first structure is included the change in size, shape or orientation of described first structure.

22. method according to claim 17, wherein said first deformation mechanism includes deformation map.

23. method according to claim 17, wherein said first deformation mechanism includes vector field.

24. method according to claim 17, it farther includes:

In response to automatically adjusting described more than first structure, automatically accessing the second image, described second image includes more than second structure corresponding with described more than first structure and has corresponding second identical mapping of the relative position mapping described more than second structure；

Generate the second deformation mechanism of the relative property mapped between described first identical mapping and described second identical mapping；And

Automatically adjusting described more than second structure according to the second deformation mechanism, described second deformation mechanism maps the relative property between described more than first structure and the corresponding structure of described more than second structure.

25. method according to claim 24, wherein said second image includes and the image of described first image pre-association.

26. method according to claim 24, wherein said second image includes in the same data set including described first image.

27. method according to claim 24, the data that wherein said second image includes not being the data set including described first image are concentrated.

28. method according to claim 24, wherein said generation deformation map mechanism includes:

Determine the relative property included between more than first pixel of described first identical mapping and more than second pixel, described more than second pixel list under including in one: described the first identical mapping updated or described second identical mapping.

29. method according to claim 28, wherein said determine that relative property includes:

Determine multiple image pixel intensities of described more than first pixel；

Determine multiple image pixel intensities of described more than second pixel；And

Determine the relative property between described more than first image pixel intensities and described more than second image pixel intensities.

30. for the method propagating the structural image data updated between multiple data sets simultaneously, described method includes:

Receiving the input corresponding with the figured change of the first anatomical structure, described first anatomical structure is include in multiple anatomical structures of the first image；

Changing the identical mapping corresponding with described first image according to described input, the relative position of described first anatomical structure is mapped to other anatomical structure in the plurality of anatomical structure including described first image by described identical mapping；

The deformation map updated is applied to the plurality of anatomical structure including the first image,

Edit the described mapping of the plurality of structure in described deformation map, to consider the described mapping changing described first anatomical structure；

The figure updating described image by the deformation map updated is applied to the plurality of anatomical structure including described first image represents, the deformation map that the described deformation map updated includes the described mapping in response to the plurality of structure of described change and revises；

Changing the multiple figured described mapping corresponding with described first anatomical structure, the plurality of figure represents and includes in multiple images；

Change the plurality of figured mapping corresponding with described first anatomical structure in deformation map；And

Represent that the figure updating the plurality of image represents by the deformation map updated being applied to the plurality of figure of the described anatomical structure including the plurality of image, the deformation map that the deformation map of described renewal includes the described mapping in response to the plurality of structure of described change and revises.

31. for the system editing edit structure in medical image system, described system includes:

Medical image system, described medical image system includes:

Multiple radioactive sources；

Multiple imagers, it is for receiving lonizing radiation from the plurality of radioactive source and being configured to generate the data representing the multiple images including multiple anatomical structure；And

Calculation element, it is configured to access and represents the described data of the plurality of image,

Wherein, in response to the adjustment receiving the first structure to the plurality of anatomical structure included in the first image of the plurality of image, automatically adjusting other anatomical structure in multiple anatomical structure by applying the deformation mechanism of the relative position of the described anatomical structure mapping described first image, wherein said deformation mechanism includes: multiple anatomical structures are mapped to the first identical mapping each other；And the registration mapping described first identical mapping and multiple identical mappings of registration maps.

32. for the self-propagating equipment realizing edit structure, described equipment includes:

For accessing the device of the first image including more than first structure, described first image has corresponding first identical mapping of the relative position mapping described more than first structure；

For revising the device of the first structure in described more than first structure according to received input, described input is corresponding with the adjustment of described first structure；

For creating the device of the first identical mapping of the renewal of the position of the renewal mapping described more than first structure；

For generating the device of the first deformation mechanism, described first deformation mechanism maps the relative property between described first identical mapping and the first identical mapping of described renewal, and includes described more than first structure mapping to the first identical mapping each other；And the registration mapping described first identical mapping and multiple identical mappings of registration maps；And

For automatically adjusting the device of described more than first structure in response to the described adjustment to described first structure according to described first deformation mechanism.

33. equipment according to claim 32, wherein said equipment farther includes:

For automatically accessing the device of the second image in response to adjusting described more than first structure, described second image includes more than second structure corresponding with described more than first structure and has corresponding second identical mapping of the relative position mapping described more than second structure；

For generating the device of the second deformation mechanism of the relative property mapped between described first identical mapping and described second identical mapping；And

For automatically adjusting the device of described more than second structure according to the second deformation mechanism, described second deformation mechanism maps the relative property between described more than first structure and the corresponding structure of described more than second structure.

34. equipment according to claim 33, the wherein said device for generating deformation mechanism farther includes:

For determining the device of the relative property included between more than first pixel of described first identical mapping and more than second pixel including described second identical mapping.

35. equipment according to claim 32, the wherein said device for generating deformation mechanism farther includes:

For determine more than first pixel including described first identical mapping and include described renewal the first identical mapping more than second pixel between the device of relative property.

36. the equipment according to claim 34 or 35, the wherein said device for determining relative property includes:

For determining the device of multiple image pixel intensities of described more than first pixel；

For determining the device of multiple image pixel intensities of described more than second pixel；And

For determining the device of the relative property between described more than first image pixel intensities and described more than second image pixel intensities.