JP5100041B2 - Image processing apparatus and image processing program - Google Patents

Description

  The present invention relates to an image processing apparatus and an image processing program that can suitably execute alignment between volume data acquired by the same or different modalities.

  An image processing apparatus used in the medical image field in recent years is used in combination with medical imaging equipment such as an ultrasonic diagnostic apparatus, an X-ray CT scan, and a magnetic resonance imaging apparatus, and is widely used in many hospitals and examination institutions. It's being used. This image processing apparatus is capable of providing various images useful as clinical information as the speed of image processing increases and the resolution is improved. For example, in a simulation before surgery, blood vessel running, gastrointestinal tumor, plaque (spots) ), And imaging of the digestive tract cavity when examining the cause of stenosis, etc.

In image diagnosis using such an image processing apparatus, image groups (consisting of a plurality of two-dimensional image data, also referred to as volume data) collected at different timings (time periods) and different modalities are compared. In some cases, the time course of the affected area is observed. In such a case, it is necessary to perform association (for example, alignment) between the image groups. Conventionally, for example, a local area obtained by performing a difference process between a diagnostic area that is a part of one specific image (digital image) and a local image of a corresponding area that is a part of another image corresponding to the diagnostic area. By creating a difference image, an interpreter can interpret images while confirming a temporal change in the diagnosis area or a difference from normal (for example, see Patent Document 1), a first image set having a different imaging time, a second image set, and the like. There is an image processing apparatus that realizes an apparatus that performs MPR processing on each of the image sets and performs alignment using MPR images (see, for example, Patent Document 2).
JP-A-7-37074 JP 2004-96417 A

  However, in the conventional image processing apparatus, in principle, alignment of each image is required. Therefore, if image groups composed of a plurality of image data, particularly volume data, are associated with each other by the conventional method, in principle, all the images constituting the volume data are confirmed and aligned. This is necessary and puts a great burden on the operator.

  In addition, when the image sets composed of a plurality of images are associated with each other using the MPR image, the MPR image indicates an arbitrary cut end, and thus a characteristic part that does not exist in the cut end is an MPR target range. If it exists outside, it may not be sufficient in accuracy.

  In addition, as a well-known document relevant to this application, there exist the following, for example.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an image processing apparatus and an image processing program capable of executing association between image groups more easily and preferably than in the past. .

  In order to achieve the above object, the present invention takes the following measures.

An image processing apparatus according to an embodiment includes a storage unit that stores first volume data and second volume data, and a first unit for each of the first volume data and the second volume data . a first image generation unit for generating a first superimposed image is a two-dimensional image obtained by superposing information included in the volume data along the reference direction, using said respective first superimposed image, wherein the An association unit that generates a deformation pattern for approximating one volume data and the second volume data; and the second volume data corresponding to the first area set in the first volume data a second region of the upper, determined using the modified pattern, corresponding to the second area using the second volume data image A second image generation unit for generating a display unit for displaying the generated image, and comprising a.
An image processing program according to an embodiment is a two-dimensional image obtained by superimposing information included in volume data along a first reference direction for each of first volume data and second volume data on a computer. A first image generation function for generating a first superimposed image, and a modification for approximating the first volume data and the second volume data using the first superimposed images. A matching function for generating a pattern, and a second area on the second volume data corresponding to the first area set in the first volume data is determined using the deformation pattern, and A second image generation function for generating an image corresponding to the second area using the second volume data; and displaying the generated image. It is used for realizing a display function.

  As described above, according to the present invention, it is possible to realize an image processing apparatus and an image processing program capable of executing association between image groups more easily and preferably than in the past.

  Hereinafter, first and second embodiments of the present invention will be described with reference to the drawings. In the following description, components having substantially the same function and configuration are denoted by the same reference numerals, and redundant description will be given only when necessary.

  In the present embodiment, an image processing apparatus will be described as an example of a single apparatus connected to a medical image device or an image server via a network. However, regardless of this, the technical idea of the present invention is a medical imaging apparatus (for example, X-ray computed tomography) that incorporates the image processing apparatus (or that realizes the same function as the image processing apparatus). Apparatus, magnetic resonance imaging apparatus, ultrasonic diagnostic apparatus, X-ray diagnostic apparatus, nuclear medicine diagnostic apparatus, etc.). It can also be realized by installing a program for executing the same function as that of the image processing apparatus in a computer such as a medical workstation and developing these on a memory. At this time, a program capable of causing the computer to execute the technique is stored in a recording medium such as a magnetic disk (floppy (registered trademark) disk, hard disk, etc.), an optical disk (CD-ROM, DVD, etc.), or a semiconductor memory. It can also be distributed.

(First embodiment)
FIG. 1 is a block diagram showing the configuration of the image processing apparatus 1 according to the first embodiment. As shown in FIG. 1, the image processing apparatus 1 includes an operation unit 2, a display unit 3, a transmission / reception unit 4, a control unit 5, an image data storage unit 6, and an image processing unit 7.

  The operation unit 2 includes a trackball, various switches, a mouse, a keyboard, and the like for incorporating various instructions, conditions, and the like from the operator into the apparatus 1.

  The display unit 3 displays an image, an input screen for performing a predetermined operation, and the like in a predetermined form.

  The transmission / reception unit 4 transmits / receives information including image data to / from other devices via a network.

  The control unit 5 dynamically or statically controls each unit constituting the image processing apparatus 1. In particular, the control unit 5 controls the image data storage unit 6, the image processing unit 7, the operation unit 2, the display unit 3, and the like in an image data association process described later. In addition, the control unit 5 generates a composite image or the like for displaying a plurality of images in parallel, superimposed display, and fusion image according to a predetermined program.

  The image data storage unit 6 stores a plurality of volume data acquired by the transmission / reception unit 4 via the network. The plurality of volume data is acquired by the same or different medical image devices (which may be the same modality, the same type modality, or the different type modality). In addition, each volume data is not necessarily related to the same subject, and may be related to different subjects.

  The image processing unit 7 executes various image processing, particularly image data association processing described later, and includes a superimposed image generation unit 71 and an association processing unit 72.

  The superimposed image generation unit 71 generates a superimposed image using the volume data for each volume data.

  The association processing unit 72 performs spatial association (positioning) between different volume data using the superimposed image for each volume data generated by the superimposed image generation unit 71.

(Image data association function)
Next, the image data association function of the image processing apparatus 1 will be described. This function generates a superimposed image, which is a two-dimensional image in which information of each volume data to be matched is superimposed along a predetermined direction, and uses this to spatially associate different volume data Is to do.

  2A, 2B, 3A, and 3B are diagrams for explaining the concept of the image data association function of the image processing apparatus 1. FIG. 2A shows volume data A acquired by imaging the subject A with the medical imaging device A, and FIG. 2B shows volume data B acquired by imaging the subject B with the medical imaging device B. Each is shown schematically. Note that there is no particular limitation as long as volume data A and volume data B are physically different image data. Therefore, for example, the subject A and the subject B may be the same person or different persons, and the medical image device A and the medical image device B may be the same, the same type, or different types. Furthermore, it is not restricted by the presence or absence of the use of a contrast medium in imaging.

  In the present image data association function, first, a superimposed image is generated by superimposing information held by the volume data A and B along the reference direction. Here, the reference direction used to generate the superimposed image is selected to be perpendicular to the slice direction of an image (diagnostic image) that is finally used in diagnosis. For example, when the diagnostic image is an axial image, the slice direction is the body axis (z-axis) direction, so the reference direction is a direction perpendicular to the body axis (that is, the x-axis direction or the y-direction).

  In the present embodiment, for the sake of specific explanation, it is assumed that the diagnostic image is an axial image and the reference direction is the y-axis direction. Therefore, a superimposed image generated by superimposing information included in the volume data A and B along the y-axis direction (reference direction) is a coronal image. However, without being limited to this, for example, a superimposed image as a sagittal image may be generated with the reference direction as the x-axis direction.

  As a method for generating a superimposed image related to the reference direction, for example, maximum value MIP processing, minimum value MIP processing, average value calculation regarding voxel data, and the like can be employed. Further, when generating a superimposed image, it is not always necessary to use all of the voxel data. For example, a configuration using a part of volume data (slab) cut out with the reference direction as the thickness direction may be used.

  Next, alignment between the volume data is performed using the superimposed images related to the volume data A and B. 3A schematically shows a superimposed image a1 related to the volume data A, and FIG. 3B schematically shows a superimposed image b1 related to the volume data B. As shown in the figure, the positions of the superimposed image a1 and the superimposed image b1 do not correspond to each other, and therefore the positions of the volume data A and the volume data B do not correspond. Therefore, alignment between the volume data A and the volume data B is realized based on the positional relationship between the superimposed image a1 and the superimposed image b1.

  That is, the superimposed image a1 and the superimposed image b1 are compared, and, for example, at least one characteristic part included in each volume data is detected in each superimposed image, and the movements corresponding to these positions are detected. A quantity or conversion formula is calculated. By using this to move or convert at least one of the volume data A and the volume data B, a spatial association between the two can be realized.

  For example, the top of the head, the tip of the shoulder, the tip of the lung, the lower end of the lung, the upper end of the heart, or the like can be adopted as the characteristic part used when calculating the movement amount or the conversion formula. There is no limitation on the number of characteristic parts to be used as a reference. By using as many parts as possible as a reference, it is possible to perform more accurate alignment and fine adjustment. Further, the association between the volume data based on the feature amount may be realized by a manual operation executed via the operation unit 2 in addition to the automatic processing in the association processing unit 72. Moreover, the structure which combines the matching by the automatic process of the matching process part 72 and the matching by manual operation may be sufficient. In such a case, for example, after the association by the automatic processing, the degree of freedom of work in the association between the volume data can be expanded by performing fine adjustment manually.

  When spatial association is executed by this function, an image at a position corresponding to an image selected in one volume data can be automatically selected from the other volume data. For example, it is assumed that a desired image (selected image) is selected from the two-dimensional images constituting the volume data A by a predetermined operation from the operation unit 2 after spatial association. In response to this selection operation, the control unit 5 automatically selects, from the two-dimensional images constituting the volume B, an image (corresponding image) corresponding to the selected image and its position. The selected image and the corresponding image are displayed on the display unit 3 in a predetermined form.

  FIG. 4 is a diagram showing parallel display as an example in which the selected image and the corresponding image are displayed in parallel. The display form of the selected image and the corresponding image is not limited to the parallel display example of FIG. For example, the selected image and the corresponding image are superimposed and displayed in correspondence with each other, the image on the near side of the screen in the superimposed display is made translucent, the difference image generated from the selected image and the corresponding image is displayed, Various display forms such as one that displays only one image (that is, a selected image or a selected image) within a region of interest designated in the superimposed display can be adopted. In the image processing apparatus 1, an I / F for instructing one of the display forms is provided in the operation unit 2. The operator can employ any display method by operating a desired I / F.

  Note that two directions other than the direction perpendicular to the superimposed images a1 and b1 (that is, the reference direction) are obtained by spatial correspondence between the volumes using the positional relationship between the superimposed image a1 and the superimposed image b1. As for (in the example of FIG. 2, the x direction and the z direction), the volume data A and the volume data B can be spatially accurately associated. However, with respect to the reference direction, the spatial correspondence between the volume data A and B may not be sufficient. This is because the superimposed images a1 and b1 are obtained by projecting information about the reference direction onto one image. In such a case, for example, the association with respect to the reference direction can be performed by the following two methods.

  The first method generates a superimposed image having a reference direction different from the reference direction and slice direction of the superimposed images a1 and b1, and uses this to generate a reference direction between the volume data A and the volume data B. To perform spatial mapping for. That is, the superimposed images a1 and b1 (coronal images) have the y-axis direction as the reference direction. Therefore, as shown in FIG. 5, superimposed images (sagittal images) a2 and b2 having a reference direction in the x-axis direction different from the y-axis direction and the slice direction (z-axis direction) are generated and used. Further, volume data A and volume data B are spatially associated with each other. As a result, the volume data A and the volume data B can be accurately associated in all directions of the x, y, and z axes.

  The second method is to execute spatial association for the reference direction individually between the associated two-dimensional images. For example, it is assumed that there is a deviation in the vertical direction between the selected image displayed in parallel (see FIG. 4) and the corresponding image. This vertical deviation corresponds to the deviation in the reference direction. In such a case, the spatial association in the reference direction between the selected image and the corresponding image is executed by a manual operation via the operation unit 2 or automatically. Note that, when the spatial association with respect to the reference direction is automatically performed, the above-described method (see FIG. 3) used for the alignment between the superimposed image a1 and the superimposed image b1 may be used. it can.

(Operation)
Next, an operation in processing (image data association processing) using the image data association function of the image processing apparatus 1 will be described.

  FIG. 6 is a flowchart showing the flow of each process executed in the image data association process of the image processing apparatus 1 according to the first embodiment. As shown in the figure, first, the transmission / reception unit 4 acquires different volume data A and volume data B from the same or different medical image devices via a network. Alternatively, in response to the selection operation from the operation unit 2, the volume data A and the volume data B are read from the image data storage unit 6 (step S1).

  Next, the superimposed image generation unit 71 generates superimposed images a1 and B relating to the respective volume data A and B (step S2), and the association processing unit 72 determines whether the superimposed image a1 and the superimposed image b1 are the same. The volume data A and the volume data B are aligned by, for example, parallel movement such as affine transformation so that the positions of the characteristic portions coincide with each other (step S3).

  Next, the control unit 5 generates two two-dimensional images (axial images) corresponding to the same position between the volume data A and the volume data B in a predetermined form, for example, in accordance with an operator instruction from the operation unit 2. Display (for example, parallel display, superimposed display, fusion image display, etc.) (step S4). Further, as necessary, the control unit 5 generates a difference image from two two-dimensional images corresponding to the same position between the volume data A and the volume data B, and displays this.

  According to the configuration described above, the following effects can be obtained.

  According to this image processing apparatus, alignment between volume data is performed using a superimposed image. Since the superimposed image includes all the features of the volume data used in the superimposed image, the alignment between the superimposed image and the volume data used is indirect using all the positional information of the volume data. It can be said that this is equivalent to proper alignment. Therefore, more accurate alignment between volume data can be realized as compared with the conventional method using only one cross section (not a superimposed image).

  Further, according to the present image processing apparatus, it is possible to perform alignment of different volume data by performing alignment using a superimposed image. Therefore, it is not necessary to perform alignment for each of the two-dimensional images constituting the volume data, and alignment between the volume data can be realized by a simple operation.

  Further, by using the image data association function of the image processing apparatus, for example, volume data relating to a predetermined part of a predetermined patient currently acquired is associated with volume data relating to the same affected part of the same patient acquired in the past. By displaying images corresponding to positions between volume data simultaneously or in a predetermined form, the time course of the affected area can be visually recognized with high accuracy. Therefore, an observer such as a doctor can easily observe the temporal change of the affected area by observing the images displayed at the same time.

  In general, when different volume data are compared, the slice widths of the tomographic images constituting each of them do not always match. Therefore, in the above embodiments, for example, the slice width of the tomographic image constituting the volume data A may differ from the slice width of the tomographic image constituting the volume data B. However, even in such a case, the position of the characteristic part can be specified regardless of the slice width of each volume data. Therefore, according to this method, it is possible to always associate image data without depending on the slice width of the tomographic image constituting each volume data.

(Second Embodiment)
Next, a second embodiment of the present invention will be described. In the present embodiment, a deformation pattern is generated based on the superimposed image, and a tomographic image at a predetermined position or region of one volume data is used as a tomographic image at a corresponding position or region of the other volume data. It approximates as much as possible.

  FIG. 7 is a block diagram showing the configuration of the image processing apparatus 1 according to the second embodiment. When the image processing apparatus 1 shown in the figure is compared with the image processing apparatus 1 shown in FIG. 1, the difference is that the image processing unit 7 further includes a deformation pattern calculation unit 73 and an approximate image generation unit 74.

  For example, the deformation pattern calculation unit 73 compares the superimposed images associated by the image data association processing according to the first embodiment, and sets one volume data (data to be used as a reference in the approximate image generation described later). Is calculated as close as possible to the other volume data (data subjected to deformation processing for generating an approximate image). This deformation pattern is generated, for example, by dividing each superimposed image into small regions of the same pattern and calculating a linear transformation equation or a nonlinear transformation equation for making the corresponding small regions correspond to each other. It can also be realized by, for example, generating a movement map for each pixel (model of movement pattern) for approximating one superimposed image to the other superimposed image using a technique such as pattern matching. Can do.

  In the present embodiment, for the sake of specific description, the data used as a reference in the approximate image generation is referred to as volume data A, and the data subjected to the deformation process for generating the approximate image is referred to as volume data B. Therefore, the deformation pattern in this case is acquired by conversion formula calculation for approximating the superimposed image b1 to the superimposed image a1 or by generating a template of the movement pattern.

  The approximate image generation unit 74 generates an approximate image using the deformation pattern calculated by the deformation pattern calculation unit 73 and an image related to a predetermined position or predetermined area of the volume data.

(Approximate image generation function)
Next, the approximate image generation function of the image processing apparatus 1 will be described.

  FIG. 8 is a diagram for explaining the concept of the approximate image generation function of the image processing apparatus 1 according to the second embodiment. As shown in the figure, a deformation pattern C for approximating the superimposed image b1 to the superimposed image a1 as much as possible is generated by conversion equation calculation or the like. For example, when a diagnostic image is designated on the volume data A and the superimposed image a1, the generated deformation pattern C is a position corresponding to the diagnostic image on the superimposed image b1 and the volume data B (curve b in FIG. 8). Is specified using the deformation pattern C. Further, the approximate image is generated using data of the corresponding position specified in the volume data B.

  In some cases, the position data on the superimposed image b1 corresponding to the axial image specified on the volume data A and created from the volume data B is a curve (not a straight line) like the curve b. In such a case, the approximate image is created as a Curved MPR image.

  FIG. 9 is a flowchart for explaining the flow of processing using this approximate image generation function (approximate image generation processing). In the figure, first, in response to an input from the operation unit 2, the display unit 2 displays a predetermined tomographic image (for example, an axial image A) using the volume data A (step S11). It is assumed that volume data A and volume data B have been subjected to space association processing.

  Next, the association processing unit 72 determines a position (for example, a straight line a) corresponding to the axial image A on the superimposed image a1 (coronal image) obtained by superimposing the volume data A (step S12), and further The curve b corresponding to the straight line a on the superimposed image b1 is determined using information defined in the cross section D corresponding to the straight line a on the deformation pattern C (for example, conversion formula for each small region, conversion table, etc.). (Step S13).

  Next, the approximate image generation unit 74 extracts data along the curve b from the volume data B superimposed on the superimposed image b1, and uses this to generate an approximate image (step S14).

  In the approximate image generation process, the corresponding position on the volume data B is automatically specified and collected by the approximate image generation unit 74 for the data corresponding to the curve b. However, the identification of the corresponding position on the volume data B may be realized by manual operation executed via the operation unit 2 in addition to automatic processing. Moreover, the structure which combines the matching by the automatic process of the matching process part 72 and the matching by manual operation may be sufficient. In such a case, for example, after the association by the automatic processing, the degree of freedom of work in the association between the volume data can be expanded by performing fine adjustment manually.

(Operation)
Next, an operation in processing (approximate image generation processing) using the approximate image generation function of the image processing apparatus 1 will be described.

  FIG. 10 is a flowchart showing the flow of each process executed in the approximate image generation process of the image processing apparatus 1 according to the second embodiment. In the figure, Steps S1 to S4 are substantially the same as the contents shown in FIG.

  Next, the deformation pattern calculation unit 73 generates a deformation pattern based on the superimposed image a1 and the superimposed image b1 (step S5).

  The approximate image generation unit 74 generates an approximate image that approximates a tomographic image relating to a predetermined position of the volume data A designated through the operation unit 2 using the deformation pattern and the volume data B (step S6). The specific process in this step is as shown in steps S11 to S14 in FIG.

  Next, the control unit 5 displays the axial image A related to a predetermined position of the volume data A and the approximate image related thereto in a predetermined form (for example, parallel display, superimposition) in accordance with an operator instruction from the operation unit 2, for example. Display, fusion image display, etc.) (step S7). Moreover, the control part 5 produces | generates a difference image from the axial image A and the approximate image regarding this, and displays this as needed.

  According to the configuration described above, the approximate image generation function of the image processing apparatus is used to generate a tomographic image at a predetermined position of one volume data and an approximate image from the tomographic image at a corresponding position of the other volume data. be able to. Therefore, for example, simultaneously displaying a tomographic image at a predetermined position or region of a predetermined patient currently acquired and an approximate image using a tomographic image at a corresponding position or region of volume data of the same patient acquired in the past, etc. Thus, the time course of the affected area can be visually recognized with high accuracy. Therefore, an observer such as a doctor can more easily and clearly observe the temporal change of the affected area using the approximate image.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Specific examples of modifications are as follows.

  (1) Before the spatial association process described in each of the above embodiments, a size association process for associating pixel sizes and pixel pitches between volumes may be performed. For example, the volume data A acquired by the X-ray computed tomography apparatus is configured by the pixel pitch L1 by the two-dimensional image data of 512 pixels × 512 pixels, while the volume data acquired by the magnetic resonance imaging apparatus. It is assumed that B is constituted by a pixel pitch L2 by two-dimensional image data of 256 pixels × 256 pixels. In this case, for example, the association processing unit 72 performs a predetermined calculation process such as affine transformation on the volume data B, so that the pixel size and the pixel pitch can be made the same as those of the volume data A. By performing such size association processing between volume data, more accurate spatial association can be performed.

  (2) In the above embodiments, the spatial association between the volume data A and the volume data B has been described as an example. However, the number of volume data to be associated is not limited to two, and the spatial association process may be performed between a larger number of volume data.

  Further, when there are a plurality of volume data, it is possible to directly or indirectly perform each process. For example, a case is assumed in which spatial association is performed between a total of four volume data, ie, volume data E1, E2, F1, and F2. Here, the volume data E1 is composed of T1-weighted images acquired by the magnetic resonance imaging apparatus E, and the volume data E2 is acquired by fMRI (functional MRI) imaging using the modality E. The volume data F1 is composed of T1-weighted images acquired by the modality F, and the volume data F2 is acquired by fMRI imaging using the magnetic resonance imaging apparatus E.

  In such a case, the volume data E1 and the volume data E2 (or the volume data F1 and the volume data F2) are acquired by the same device, and thus spatial correspondence is made between them. Therefore, for example, by executing spatial association between the volume data E1 and the volume data F1, the spatial association between the volume data E1, E2, F1, and F2 is performed directly or indirectly. Can do.

  (3) Spatial association processing described in the first embodiment, approximate image generation processing described in the second embodiment, and size correspondence described in (1) above between two or more volume data When performing attachment processing, etc., one of the volume data may be used as reference volume data, and conversion or the like may be executed only for other volume data (volume data other than the reference volume data) so as to match the reference volume data. . In such a case, the control unit 5 determines the reference volume data by the following method, for example.

  The first method is to determine reference volume data based on a time axis. In such a method, for example, the latest (or oldest) volume data in time is set as the reference volume data, and various processes are executed on the other volume data so as to match this.

  The second method determines reference volume data based on the type of image. In such a method, for example, when performing alignment processing between volume data related to a T1-weighted image and volume data acquired by fMRI imaging, the pixel size and pixel pitch of the volume data related to the T1-weighted image are matched. , Pre-processing is performed on the volume data acquired by fMRI imaging.

  The third method uses volume data relating to a standard image (for example, a schematic image standardized from an anatomical viewpoint) as a reference volume. In such a method, various processes are executed so that the volume data acquired by photographing matches the volume data related to the standard image.

  (4) In each of the above-described embodiments, an example is described in which an axial image at the same position is cut out from each spatially correlated volume data and image diagnosis is performed using this. However, the usage form of each volume data associated spatially is not limited to this. For example, an MPR image, a volume rendering image, and the like may be generated and observed using each volume data.

  (5) In each of the above embodiments, the example in which the slice direction of the diagnostic image is perpendicular to the reference direction used for the image data association processing has been described. However, the technical idea of the present invention is applicable even when the slice direction of the diagnostic image and the reference direction are not perpendicular to each other without being bound by this.

  In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  As described above, according to the present invention, it is possible to realize an image processing apparatus and an image processing program capable of executing association between image groups more easily and preferably than in the past.

FIG. 1 is a block diagram showing the configuration of the image processing apparatus 1 according to the first embodiment. FIG. 2A is a diagram for explaining the concept of the image data association function of the image processing apparatus 1 according to the first embodiment. FIG. 2B is a diagram for explaining the concept of the image data association function of the image processing apparatus 1 according to the first embodiment. 3A and 3B are diagrams for explaining the concept of the image data association function of the image processing apparatus 1 according to the first embodiment. FIG. 3B is a diagram for explaining the concept of the image data association function of the image processing apparatus 1 according to the first embodiment. FIG. 4 is a diagram illustrating an example of a display form of images associated by the image data association function. FIG. 5 is a diagram illustrating an example of image data association using superimposed images in other directions. FIG. 6 is a flowchart showing the flow of each process executed in the image data association process of the image processing apparatus 1 according to the first embodiment. FIG. 7 is a block diagram showing the configuration of the image processing apparatus 1 according to the second embodiment. FIG. 8 is a diagram for explaining the concept of the approximate image generation function of the image processing apparatus 1 according to the second embodiment. FIG. 9 is a flowchart for explaining the flow of processing using this approximate image generation function (approximate image generation processing). FIG. 10 is a flowchart showing the flow of each process executed in the approximate image generation process of the image processing apparatus 1 according to the second embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Image processing apparatus, 2 ... Operation part, 3 ... Display part, 4 ... Transmission / reception part, 5 ... Control part, 6 ... Image data storage part, 7 ... Image processing part, 71 ... Superimposed image generation part, 72 ... Correspondence Attaching processing unit, 73 ... deformation pattern calculating unit, 74 ... approximate image generating unit

Claims (17)

A storage unit for storing the first volume data and the second volume data ;
For each of the first volume data and the second volume data, a first superimposed image that is a two-dimensional image in which information of the volume data is superimposed along a first reference direction is generated. One image generation unit;
An association unit that generates a deformation pattern for approximating the first volume data and the second volume data using each of the first superimposed images ;
A second area on the second volume data corresponding to the first area set in the first volume data is determined using the deformation pattern, and the second volume data is used to determine the second area. A second image generation unit for generating an image corresponding to the second region ;
A display unit for displaying the generated image;
An image processing apparatus comprising:   The image processing apparatus according to claim 1, wherein the association unit performs spatial association between the at least two volume data using the first superimposed images.   The said matching unit divides | segments each said 1st superimposed image into a small area | region, and determines the conversion for every said small area | region, The said deformation | transformation pattern is produced | generated, It is characterized by the above-mentioned. Image processing apparatus.   The first image generation unit includes:
  Further generating a second superimposed image, which is a two-dimensional image obtained by superimposing information contained in volume data along a second reference direction different from the first reference direction and the slice direction;
  The association unit performs spatial association between the at least two volume data using the first superimposed image and the second superimposed image;
  The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.   The position adjustment unit which performs position adjustment regarding the 2nd reference direction different from the said 1st reference direction and the said slice direction with respect to the displayed said image is further comprised, The further characterized by the above-mentioned. The image processing apparatus as described in any one of them.   The first superimposed image is any one of a maximum brightness projection image, a minimum brightness projection image, and an average image using an average value of voxels constituting the volume data. The image processing apparatus according to claim 5.   5. The second superimposed image is any one of a maximum value luminance projection image, a minimum value luminance projection image, and an average value image using an average value of voxels constituting the volume data. Image processing apparatus.   The second image generation unit generates a fusion image, a superimposed image, and a difference image based on the plurality of images corresponding to the same position or the same region between different volume data. The image processing apparatus according to claim 1.   The image processing apparatus according to claim 1, wherein the first superimposed image is created from a part of the volume data.   The image processing apparatus according to claim 4, wherein the second superimposed image is created from a part of the volume data.   The image processing apparatus according to claim 1, wherein the slice direction is a direction perpendicular to the first reference direction.   The image processing apparatus according to claim 4, wherein the slice direction, the first reference direction, and the second reference direction are orthogonal to each other.   The association unit is
  Performing a size association process for associating a pixel pitch and a pixel size between the at least two volume data;
  Generating the first superimposed image using the volume data subjected to the size association processing;
  The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.   The association unit is
  Selecting reference volume data from the plurality of volume data based on the time information about the time when the volume data was acquired, or the type of image constituting the volume data;
  Performing the size association processing on other volume data so as to correspond to the pixel size and pixel pitch of the reference volume data;
  The image processing apparatus according to claim 13.   The association unit is
  Selecting reference volume data from the plurality of volume data based on the time information about the time when the volume data was acquired, or the type of image constituting the volume data;
  Performing parallel movement processing on other volume data so as to spatially correspond to the reference volume data;
  The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.   The storage unit stores volume data relating to a standard image,
  The first image generation unit generates a third superimposed image that is a two-dimensional image in which information included in volume data related to a standard image is superimposed;
  The association unit performs spatial association between the volume data using the first superimposed image and the third superimposed image;
  The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.   On the computer,
  For each of the first volume data and the second volume data, a first superimposed image that is a two-dimensional image in which the information of the volume data is superimposed along the first reference direction is generated. Image generation function,
  An association function for generating a deformation pattern for approximating the first volume data and the second volume data using each first superimposed image;
  A second area on the second volume data corresponding to the first area set in the first volume data is determined using the deformation pattern, and the second volume data is used to determine the second area. A second image generation function for generating an image corresponding to the second region;
  A display function for displaying the generated image;
  An image processing program characterized by realizing the above.

Images