JP2006026396A - Image processing system and method, control program, and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To efficiently process a difference in image processing, during follow-up. <P>SOLUTION: A plurality of images produced by an image generation section 1 is stored in an image storage section 2 while corresponding to photograph information on time and date. At least one criteria image and comparison image are specified respectively from images stored by an image specification part 5. Information on time and date of the specified criteria image and comparison image is compared by an image comparator 3. The difference is processed with calculation decided on the basis of a comparative result by a difference processing section 4 and displayed in an image display section 7 on the basis of control of a display control section 6. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing apparatus and method, and more particularly to an image processing apparatus and method, a control program, and a storage medium for processing a plurality of medical images.

  In recent years, the use of digital images has progressed in the field of medical image diagnosis. For example, an apparatus for taking an X-ray image using a semiconductor sensor records an image over a very wide radiation exposure area as compared with a conventional radiographic system using a silver salt photograph, and further in image storage and transmission. It has the advantage that it is easy to construct an efficient system.

  In addition, by digitizing medical images, there is a possibility of a diagnostic form that was difficult with conventional silver halide photography. That is, conventionally, when comparing X-ray images taken at different time points during patient follow-up, etc., it has been common practice to carry out comparative interpretation by placing a film on a Schaukasten.

  On the other hand, if digital image data is used, a difference image is generated and output by aligning two digital images taken at different times so that the normal anatomical structures match and performing a difference process, By comparing and interpreting the difference image with a pair of images based on the difference image, it becomes possible to grasp the change between the images more accurately.

  FIG. 15 is a block diagram showing a configuration of a conventional differential image generation / display apparatus. The reference image and the comparison image are medical image data of specific parts taken at different times. The two image data are corrected by the density correction unit 401 so that the density value distributions of the two image signals are substantially equal, the positional relationship of the anatomical structure is obtained by the alignment unit 402, and one of the image data is obtained by the deformation unit 403. Each pixel of the comparison image, here the comparison image, is transformed so as to overlap the corresponding pixel in the reference image, and the difference calculation unit 404 performs difference processing between the corresponding pixels to generate a difference image. The difference image is displayed together with the reference image and the comparison image on the display unit 7 (for example, Patent Document 1).

  Here, in the difference processing described above, the calculation order of the two images is set in advance so that when one is a past image and the other is a current image, the order is past-present or current-past. .

Japanese Patent Laid-Open No. 10-155746

  The difference image is used to depict a change occurring in a subject in an image taken at a predetermined period, such as a regular checkup, and in such an application, as described above, a set of images is used. The difference processing may be performed in a predetermined order.

  However, in the follow-up of a specific patient, it is necessary to take a plurality of times in a relatively short period of time, observe the results of some treatment action sequentially, and grasp the history going back to the past history. Conventionally, there has been no method for efficiently generating a temporal difference image in such an application.

  In view of such circumstances, an object of the present invention is to provide an image processing apparatus and method, a program, and a storage medium that can execute efficient difference processing in follow-up observation.

  The image processing apparatus according to the present invention includes a storage unit that stores an image, an image specifying unit that specifies a reference image and a comparison image from the images stored in the storage unit, and the specified reference image and the comparison image. When acquiring the time-dependent difference image based on the comparison result by the comparison means, the comparison means for acquiring the shooting date / time information of the reference image and comparing the shooting date / time information of the reference image and the shooting date / time information of the comparison image And a difference image generation means for generating the temporal difference image from the reference image and the comparison image using the calculation determined by the determination means.

  In one aspect of the image processing apparatus of the present invention, the difference image generation means determines whether to subtract either the reference image or the comparison image from the other based on the comparison result by the comparison means.

  In one aspect of the image processing apparatus of the present invention, the difference image generation unit deforms the comparison image using the reference image designated by the image designation unit as a reference, and the reference image is transformed from the reference image transformed. The temporal difference image is generated.

  In one aspect of the image processing apparatus of the present invention, the image designating unit can display a list of images stored in the storage unit, and the reference image and the comparison image can be displayed from the displayed list of images. select.

  In one aspect of the image processing apparatus of the present invention, the image designating unit is capable of displaying a reduced image obtained by reducing and displaying the image stored in the storage unit, and is based on an instruction input for the displayed reduced image. The reference image and the comparison image are selected.

  In one aspect of the image processing apparatus of the present invention, the image designating unit can display the images stored in the storage unit in a predetermined order based on the shooting date and time information, and can input an instruction to the displayed image. Based on this, the reference image and the comparison image are selected.

  In one aspect of the image processing apparatus of the present invention, the difference image generating means subtracts an image with more recent shooting date / time information from an image with more recent shooting date / time information based on a comparison result by the comparing means. Determine the operation.

  The image processing method of the present invention includes a step of designating a reference image and a comparison image from among images stored in a storage means, and acquisition of shooting date / time information of the designated reference image and comparison image, Using the step of comparing the shooting date / time information of the reference image and the shooting date / time information of the comparison image, the step of determining the calculation when generating the temporal difference image based on the comparison result, and the determined calculation Generating the temporal difference image from the reference image and the comparison image.

  In one aspect of the image processing method of the present invention, in the step of generating the difference image, it is determined whether to subtract either the reference image or the comparison image from the other based on the comparison result.

  In one aspect of the image processing method of the present invention, in the step of generating the difference image, the comparison image is deformed using the designated reference image as a reference, and the reference image and the comparison image that has been deformed are used to change the temporal image. A difference image is generated.

  In one aspect of the image processing method of the present invention, in the step of designating the reference image and the comparison image, a list of stored images is displayed, and the reference image and the comparison image are displayed from the displayed list of images. select.

  In one aspect of the image processing method of the present invention, in the step of designating the reference image and the comparison image, a reduced image obtained by reducing the stored image can be displayed, and an instruction is input to the displayed reduced image. The reference image and the comparison image are selected based on the above.

  In one aspect of the image processing method of the present invention, in the step of designating the reference image and the comparison image, the stored images can be displayed in a predetermined order based on the shooting date and time information, and the displayed image The reference image and the comparison image are selected based on an instruction input.

  In one aspect of the image processing method of the present invention, in the difference image generation step, based on the comparison result in the comparison step, an image with more recent shooting date / time information is subtracted from an image with more shooting date / time information. Determine the operation.

  The control program of the present invention is for causing a computer to execute the image processing method.

  The storage medium of the present invention is a computer-readable medium on which the control program is recorded.

  According to the present invention, it is possible to realize image processing capable of performing efficient difference processing in follow-up observation even when the combination method of images to be compared and interpreted is changed when a temporal difference image is generated. it can.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments to which the present invention is applied will be described in detail with reference to the drawings.

[First Embodiment]
-Configuration of image processing device-
FIG. 1 is a block diagram illustrating a functional configuration of the image processing apparatus according to the first embodiment. First, the overall operation outline will be described with reference to FIG.

  The image processing apparatus according to the present embodiment includes at least one reference image from an image generation unit 1 that generates an image, an image storage unit 2 that stores and stores images, and an image that is stored and stored in the image storage unit 2. And an image designating unit 5 for designating a comparison image, an image comparison unit 3 for acquiring the shooting time of the designated reference image and comparative image, and specifying the front-rear relationship thereof, and a result of identification by the image comparison unit 3, The difference processing unit 4 that generates a temporal difference image from the reference image and the comparison image, the display control unit 6 that performs display control of the difference image, and the display control unit 6 control the reference image, the comparison image, and the difference image. And an image display unit 7 to be displayed.

  In FIG. 1, medical images generated by the image generation unit 1 are accumulated and stored in an image storage unit 2. The stored image is read as a pair or a plurality of pairs as necessary, the difference processing unit 4 performs the difference process, and the resulting difference image is displayed via the display control unit 6 as an image display unit. 7 and used for diagnosis.

  On the other hand, the original image used for generating the difference image is also displayed on the image display unit 7 together with the difference image or alone via the display control unit 6 and used for diagnosis.

  In the above operation, the image comparison unit 3 compares images to be subjected to difference processing by a method described later, and controls the processing in the difference processing unit 4. On the other hand, the image designation unit 5 designates an image to be subjected to difference processing by a method described later, and determines an image to be output from the image storage unit 2 to the difference processing unit 4 based on the instruction.

  In order to implement the above functions, for example, a configuration of an image generation apparatus 200 and a file server 300 connected to a computer (PC) 100 via a network 400 as shown in FIG. 2 can be used. In the figure, a computer 100 has a central processing unit (CPU) 101 and various peripheral devices connected via a bus 107. A hard disk 104, a mouse 120, a keyboard 130, a printer 140, and a display device 150 are connected to the PC 100 as external peripheral devices, and a RAM 102, a ROM 103, an accelerator 105, and a hard disk 104 are provided inside the PC. Furthermore, image data can be transmitted / received to / from the external image generation device 200 and the file server 300 via the network 400 connected by an interface (not shown).

  In the above configuration, the image generation unit 1 in FIG. 1 can be associated with the image generation apparatus 200. The image generation device 200 generates and outputs a digital image signal representing a subject (not shown). As such an apparatus, any apparatus that generates and outputs a medical image may be used. For example, an X-ray imaging apparatus such as an FOD (Flat Panel Detector) apparatus, a CR (Computed Radiography) apparatus, or a CT (Computed Tomography) apparatus, or an MRI. (Magnetic Resonance Imaging) apparatus, US (Ultra Sonic) echo apparatus, etc. may be used. In addition, the image generation unit 1 is not necessarily limited to the above-described imaging apparatus, and may be a file server 300 that stores an image generated by an imaging apparatus (not shown in FIG. 2).

  Next, the file server 300 connected via the hard disk 104 of the computer 100 or the network 400 in FIG. Further, the present invention is not limited to this, and a storage device such as a hard disk HD built in the image generation device 200 may be used.

-Image processing method-
Next, the overall operation flow of the image processing method according to the present invention will be described together with details of the operation of each unit using the flowchart shown in FIG. In the following, description will be made on the assumption that the CPU 101 in FIG. 2 controls the overall processing operation and the CPU 101 executes and realizes a program module for each unit to perform a necessary operation, but the present invention is not limited to this. Without being done, it can take various forms as described above.

Step S100:
In response to the user input, the display control unit 6 reads out patient information attached to the patient image to be interpreted, which is generated by the image generation unit 1 and stored in the image storage unit 2, and displays the patient information on the image display unit 7. In the present embodiment, as shown in FIG. 4, patient information displays a list of the date and time when a specific patient was imaged and the imaging type (part, line-of-sight direction). Here, the patient information may accompany the image data stored in the image storage unit 2 or may be read from a database or the like managed separately from the image data. In FIG. 4, C is a mouse cursor, B1 and B2 are displayed on the screen for designating at least one set of images necessary for time-difference image generation, and the mouse cursor C is overlapped and pressed (clicked). It is an operable button.

Step S110:
The user first presses the reference image button B1, selects a mode for selecting a reference image, and selects a row corresponding to the image to be the reference image from the list displayed above the button B1. In order to select, the mouse cursor C may be moved and clicked on the line to be selected. At this time, the image designating unit 5 designates the selected image as a reference image. FIG. 4A illustrates the state at this time, and shows a state where the lowermost row in the displayed list, that is, the latest image is selected as the reference image. At the left end, a mark “S” indicating that the image has been selected as the reference image is displayed. Here, two or more reference images cannot be selected at the same time from the displayed list, and if the second row is selected, the previously selected row is automatically selected. Is not selected.

Step S120:
Next, the user presses the comparison image button B2, selects a comparison image selection mode, and selects one or more comparison images by the same operation as that of the reference image. At this time, the image designating unit 5 designates the selected image as a comparative image. At the left end of the row corresponding to the image selected as the comparison image, a mark “R” indicating that it has been selected as the comparison image is displayed. Although only one reference image can be selected, a plurality of comparison images can be selected. In FIG. 4B, three images corresponding to the second to fourth lines are used as comparison images. Is selected.

Step S130:
The image comparison unit 3 compares the shooting date and time of each combination of the selected reference image and comparison image, determines the order of differences in difference processing described later, and outputs the difference order to the difference processing unit 4. The acquisition of the shooting date and time may be based on information attached to the selected image data, or may be based on information in a database stored separately from the image data as described above.

The order of the difference determined here is based on the shooting date and time of a pair of images to be subtracted from the image with the latest shooting date and time, or conversely the shooting date and time is more recent. Whether or not to subtract an image with a more recent shooting date and time is stored in the image comparison unit 3.
In the present embodiment, it is assumed that the shooting date / time is set to subtract an image having a more recent shooting date / time from an image having a more recent shooting date / time, but the present invention is not limited to this and may be vice versa.

As in this embodiment, when the shooting date / time of the reference image and the shooting date / time of the comparison image are compared, and the shooting date / time of the reference image is more recent, the order of the differences determined by the image comparison unit 3 is As shown in FIG. That is, when the reference image is S and the comparative images are R1 to R3, the generated difference images TS1 to TS3 are:
TS1 = R1-S (Formula 1)
TS2 = R2-S (Formula 2)
TS3 = R3-S (Formula 3)
The difference processing unit 4 operates so that

Step S140:
The difference processing unit 4 reads a pair of reference images and comparison images from the image storage unit 2, and generates and outputs a difference image through the processing shown in FIG. Here, alignment processing for deforming the comparison image so as to match the positions of the reference image and the comparison image is executed. At this time, the reference image is deformed without deforming the reference image. Then, a difference calculation process is performed between the reference image and the deformed comparison image. As for the order of the difference calculation, the reference image is subtracted from each of the deformed comparison images as shown in Equations 1 to 3 and FIG. That is, the difference image is generated by subtracting the new image with the latest shooting date from the image with the old shooting date.

Step S150:
Since the difference processing is performed for each pair of images, as shown in FIG. 4, when there are three comparison images, a check is performed as to whether or not the last pair is obtained each time one processing is completed. If it is determined, the process returns to the next step; otherwise, the process returns to the previous step, here step S130, and the process is repeated.

Step S160:
The three difference images generated as described above are output to the image display unit 7 by the display control unit 6 and diagnosed.

(Modification 1)
As described above, in the first embodiment, the case where the shooting date / time of the reference image is more recent than the shooting date / time of the comparison image has been described. On the contrary, the shooting date / time of the reference image is more than the shooting date / time of the comparison image. A case where the image was taken in the past will be described in Modification 1 below. In the first modification, a description will be given using the flowchart shown in FIG. 3 as in the first embodiment.

Step S110:
FIG. 5A illustrates a state in which the reference image is selected, and shows a state in which the uppermost row in the displayed list, that is, the past image is selected as the reference image. A mark “S” indicating that the image is selected as the reference image is displayed at the left end of the line.

Step S120:
As in the previous example, the user selects a comparison image by operating the mouse. At the left end of the row corresponding to the image selected as the comparison image, a mark “R” indicating that it has been selected as the comparison image is displayed. In FIG. 5B, three images corresponding to the 3rd to 5th rows are selected as comparative images, but all of them are taken after the reference image in terms of time.

Step S130:
The image comparison unit 3 compares the shooting date and time of each combination of the selected reference image and comparison image, determines the order of differences in difference processing described later, and outputs the difference order to the difference processing unit 4.

In this example, the comparison image is newly taken with respect to the reference image, and the order of differences determined by the image comparison unit 3 is as shown in FIG. That is, when the reference image is S and the comparative images are R1 to R3, the generated difference images TS1 to TS3 are:
TS1 = S-R1 (Formula 4)
TS2 = S−R2 (Formula 5)
TS3 = S−R3 (Formula 6)
The difference processing unit 4 operates so that

Step S140:
The difference processing unit 4 generates and outputs a difference image in the same manner as described above. In the alignment process, the reference image is not deformed, but the comparison image is deformed so as to coincide with the reference image. As shown in Expressions 4 to 6 and FIG. 6B, the difference calculation is performed by subtracting each comparison image deformed from the reference image to generate a difference image.
Since the subsequent steps are the same as in the previous example, description thereof will be omitted.

  By performing the above processing, even when there are a plurality of combinations of images to be compared, a difference image is efficiently generated, and always the signal in the difference image and the actual change between the images It is possible to keep the correspondence unique.

FIG. 7 is a schematic diagram illustrating a change example of an image and a temporal difference as one-dimensional pixel value data in the first embodiment and the modification described above.
First, the four plots shown above (a) in FIG. 6 represent pixel values in the vicinity of the lesion shadow in each image. These are diagrams corresponding to FIG. 4 and FIG. 6A, and show that the lesion shadow gradually decreases over the comparative images R1 to R3, and the shadow disappears completely in the most recently taken reference image S. ing. Here, when the difference images TS1, TS2, and TS3 are generated as shown in FIG. 6A and Equations 1 to 3, the state of the shadow change is lower than the background portion where no change occurs on the difference image. It is rendered as a differential signal with The magnitude of this difference signal becomes smaller as the lesion shadow becomes smaller, and the difference between the comparative image R3 and the reference image S where the shadow has almost disappeared has almost the same value as the background portion.

  On the other hand, for the example shown in FIGS. 5 and 6B, a differential signal is obtained as shown in FIG. 7B. In either case, the focus shadow gradually decreases, and the corresponding difference signal has a low value relative to the background where no change has occurred. When displaying such a difference signal, for example, the signal value corresponding to the background portion is made to correspond to the median value of the luminance level that can be displayed on a display device such as a CRT monitor, and displayed as, for example, a gray region Is done.

  For example, when the display is performed in gray scale, the difference signals in FIGS. 7A and 7B are both black areas when the shading decreases as shown in FIG. 8A, and the shading increases. Are drawn as white areas, the same correspondence can be maintained even when the temporal relationship between the standard image and the comparison image is different. The association between the increase / decrease of the shadow and the expression on the difference image is not limited to this, and for example, the display gradation characteristics may be reversed and displayed as shown in FIG. .

(Modification 2)
As described above, in the first embodiment, when the shooting date / time of the reference image is more recent than the shooting date / time of the comparison image, in Modification 1, the shooting date / time of the reference image was shot in the past than the shooting date / time of the comparison image. Although the case has been described, a case in which a comparative image is shot both before and after the shooting date and time of the reference image will be described in Modification 2 below. This modified example 2 will also be described using the flowchart shown in FIG. 3 as in the first embodiment.

Step S110:
FIG. 9A illustrates a state in which the reference image is selected, and shows a state in which the middle in the displayed list is selected as the reference image, and the reference image is displayed at the left end of the selected row. A mark “S” indicating that it has been selected is displayed.

Step S120:
As in the previous example, the user selects a comparison image by operating the mouse. At the left end of the row corresponding to the image selected as the comparison image, a mark “R” indicating that it has been selected as the comparison image is displayed. In FIG. 9B, four images corresponding to the first to second lines and the fourth to fifth lines are selected as comparative images, and are taken before the reference image in time. Some of them were shot later.

Step S130:
The image comparison unit 3 compares the shooting date and time of each combination of the selected reference image and comparison image, determines the order of differences in difference processing described later, and outputs the difference order to the difference processing unit 4.

The difference order combining the first embodiment and the above modification is as shown in FIG. That is, when the reference image is S and the comparative images are R1 to R4, the generated difference images TS1 to TS4 are:
TS1 = R1-S (Formula 7)
TS2 = R2-S (Formula 8)
TS3 = S−R3 (Formula 9)
TS4 = S-R4 (Formula 10)
The difference processing unit 4 operates so that

In the above treatment method, it seems that there is no problem when the focus shadow decreases uniformly or increases uniformly, but when chemotherapy is actually used and the shadow decreases or increases There are many. In such a case, it is easier to understand that the past image is drawn from the reference image regardless of the temporal relationship between the reference image and the comparison image. In other words, if the shooting date / time of the reference image was taken in the past than the shooting date / time of the comparison image, the shooting is performed in the same direction as in the above modification, but the shooting date / time of the reference image is later than the shooting date / time of the comparison image. When the image is taken in step 1, a difference process in the opposite direction to that of the first embodiment is performed. In this example, the order of differences determined by the image comparison unit 3 is as shown in FIG. That is, when the reference image is S and the comparative images are R1 to R4, the generated difference images TS1 to TS4 are
TS1 = S-R1 (Formula 11)
TS2 = S−R2 (Formula 12)
TS3 = S−R3 (Formula 13)
TS4 = S−R3 (Formula 14)
The difference processing unit 4 operates so that

Step S140:
The difference processing unit 4 generates and outputs a difference image in the same manner as described above. In the alignment process, the reference image is not deformed, but the comparison image is deformed so as to coincide with the reference image. As shown in Expressions 11 to 14 and FIG. 10B, the difference calculation is performed by subtracting each comparison image deformed from the reference image to generate a difference image.
Since the subsequent steps are the same as in the previous example, description thereof will be omitted.

  By performing the above processing, even when there are a plurality of combinations of images to be compared, a difference image is efficiently generated, and always the signal in the difference image and the actual change between the images It is possible to keep the correspondence unique.

FIG. 11 is a schematic diagram illustrating a change example of an image and a time-dependent difference as one-dimensional pixel value data in the second modification described above.
First, the five plots illustrated above (a) in FIG. 6 represent pixel values in the vicinity of the lesion shadow in each image. These are diagrams corresponding to FIG. 9 and FIG. 10 (a), showing that the lesion shadow gradually decreases over the comparative images R1 to R4, and that the shadow has completely disappeared in the most recently taken reference image S. ing. Here, when the difference images TS1 to TS4 are generated as shown in FIG. 10A and Expressions 7 to 10, the magnitude of the difference signal decreases as it approaches the size of the lesion shadow of the reference image. The state of the change is depicted as a difference signal having a low pixel value for all the background portions where no change has occurred on the difference image.

  On the other hand, for the example shown in FIGS. 9 and 10B, a differential signal is obtained as shown in FIG. 11B. That is, for a comparative image whose lesion shadow is smaller than the reference image, the corresponding difference signal has a low value relative to the background without change, but for a comparative image whose lesion shadow is larger than the reference image. The corresponding difference signal has a high value relative to the background where no change has occurred. When displaying such a difference signal, for example, the signal value corresponding to the background portion is made to correspond to the median value of the luminance level that can be displayed on a display device such as a CRT monitor, and displayed as, for example, a gray region Is done.

  Therefore, the difference images generated by Expressions 4 to 14 in Modifications 1 and 2 described above can be displayed only by performing black and white reversal processing on the difference images generated by Expressions 1 to 3. Therefore, it is possible to generate a difference image in the same direction for all and perform the black and white reversal process depending on the date and time relationship between the reference image and the comparison image.

  Furthermore, in the present invention, in the difference processing process, the comparison image is always deformed and aligned regardless of the temporal relationship. Therefore, when a difference image is generated from a series of comparison images and interpretation is performed. In addition, it is possible to always generate a difference image based on the posture of the subject in one reference image, and to facilitate interpretation.

FIG. 12 shows an example of this state, in which FIG. 12 (a) corresponds to FIG. 4 and FIG. 12 (b) corresponds to FIG.
FIG. 12 illustrates the above-described differential image processing in more detail, and deformed images R1w to R3w in which the comparison images R1 to R3 are aligned with the reference image S are generated. These deformed images are temporarily generated inside the difference processing unit 4 and directly used for difference processing.

In FIG. 12, each deformed image is registered with respect to the reference image S. Therefore, even when the posture of the subject is different in each captured image, the posture of the subject in the deformed image matches the reference image S. Will be.
That is, in (a), since the comparison images R1 to R3 are aligned with the reference image S, the posture of the subject in the difference image is the same as that in the reference image S. On the other hand, as shown in (b), even when the reference image S is taken most recently, the posture of the subject in each difference image is the same as that in the reference image S. Thereby, when comparing a plurality of difference images, it is possible to obtain an effect that it is easy to take a correspondence between the portions of interest and to make a diagnosis more easily.

[Second Embodiment]
In the first embodiment, the reference image and the comparison image are displayed in a list on the screen and selected, but the image itself may be displayed and selectable.

FIG. 13 is a schematic diagram illustrating an example in which an image is displayed in a reduced size, and a reference image or a comparison image is selected by selecting the reduced image with a mouse.
In the figure, information such as the inspection date and time is displayed next to the reduced image, and the image is set as a reference image by clicking the image.

  Moreover, the arrangement | positioning method of a reduced image is not limited to this, Various methods can be taken. For example, as disclosed in Patent Document 1, a series of time-series images may be arranged vertically and horizontally so that they can be selected.

  Furthermore, as described above, in selecting the reference image and the comparison image, it is possible to select an image to be selected by a plurality of buttons attached to the mouse without providing the selection buttons B1 and B2. Further, when selecting a plurality of comparison images, a combination of a mouse and a keyboard operation may be used. For example, a plurality of images may be selected by clicking a mouse while pressing a specific key.

[Third Embodiment]
In the above-described embodiment, a screen for selecting an image is individually provided, and a reference image and a comparison image are selected using the screen. However, the present invention is not limited to this, and the screen for performing image diagnosis is used. Can also be done.

FIG. 14 shows an image display example at the time of diagnosis in the image display unit 7.
In FIG. 5A, there are four image display areas in the window W, and images of the same patient are displayed from the upper left to the lower right in the order of imaging time. Here, by clicking the display area and highlighting the frame as the reference image area, the other area may be used as the comparison image, and the image may be selected according to the display position on the screen.

  That is, as shown in FIG. 6A, when the newest image is used as a reference image and the previous three images are used as comparative images, the upper left area is used as a reference image as shown in FIG. What is necessary is just to select as an area | region. On the other hand, as shown in FIG. 6B, when the past image is used as the reference image, the display area of the past image is selected from the displayed images as shown in FIG. 14B. As a result, the image displayed in this area can be selected as the reference image.

  As described above, according to the embodiment of the present invention, when a temporal difference image is generated in a plurality of combinations, it is always possible to extract a shadow change even if the combination method of images to be compared is compared. It is possible to efficiently generate differential images that are consistent and maintain the same posture of the subject, and to realize image processing that can execute efficient differential processing in follow-up observation.

[Another embodiment to which the present invention is applied]
The image comparison unit 3, the difference processing unit 4, the image designation unit 5 and the display control unit 6, which are the main components of the image processing apparatus according to the above-described embodiments, and each step of the image processing method (for example, steps S <b> 110 to S <b> 160 in FIG. ) Can be realized by operating a program stored in a RAM or ROM of a computer. This program and a computer-readable storage medium storing the program are included in the present invention.

  The program is recorded on a storage medium such as a CD-ROM or provided to a computer via various transmission media. As a storage medium for recording the program, a flexible disk, a hard disk, a magnetic tape, a magneto-optical disk, a nonvolatile memory card, and the like can be used in addition to the CD-ROM. On the other hand, as the transmission medium of the program, a communication medium (wired line such as an optical fiber, etc.) in a computer network (LAN, WAN such as the Internet, wireless communication network, etc.) system for propagating and supplying program information as a carrier wave A wireless line or the like.

  In addition, the functions of the above-described embodiments are realized by executing a program supplied by a computer, and the program is used in cooperation with an OS (operating system) or other application software running on the computer. When the functions of the above-described embodiment are realized, or when all or part of the processing of the supplied program is performed by a function expansion board or a function expansion unit of the computer, the functions of the above-described embodiment are realized. Such a program is included in the present invention.

  In the main configuration of the image processing apparatus, each unit can be implemented as a logical component in one program or as an individual library. For example, as shown in FIG. 2, this program is stored in the hard disk HD, read out by a user input (not shown) or other instruction input, expanded in the RAM, and sequentially executed by the CPU. Function is realized. Alternatively, a file server FS connected via the ROM or the network N may be used as a program storage destination.

  Furthermore, some or all of these elements can be realized as hardware. The accelerator ACC in FIG. 2 is an example thereof, and is connected to the bus BUS as hardware including the difference processing unit 4 or other functions, for example, and the CPU can control the overall operation.

1 is an overall configuration diagram of an image processing apparatus according to the present invention. 1 is a configuration diagram of a system for implementing an image processing apparatus according to the present invention. 3 is a basic flowchart of an image processing method according to the present invention. It is a schematic diagram which shows the example of an image selection screen in 1st Embodiment. It is a schematic diagram which shows the example of an image selection screen in 1st Embodiment. It is explanatory drawing of the combination of the image which produces | generates a difference image. It is explanatory drawing showing the relationship between a shadow change and a difference signal. It is a schematic diagram which shows the example of the shadow drawing in a difference image. It is a schematic diagram which shows the example of an image selection screen in 1st Embodiment. It is explanatory drawing of the combination of the image which produces | generates a difference image. It is explanatory drawing showing the relationship between a shadow change and a difference signal. It is explanatory drawing of the position alignment of the image by this invention. It is a schematic diagram which shows the example of an image selection screen in 2nd Embodiment. It is a schematic diagram which shows the example of an image selection screen in 3rd Embodiment. It is a schematic diagram which shows the basic composition of the conventional difference process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image generation part 2 Image storage part 3 Image comparison part 4 Difference processing part 5 Image designation part 6 Display control part 7 Image display part

Claims (16)

Storage means for storing a plurality of images;
Image designation means for designating a reference image and a comparison image from a plurality of images stored in the storage means;
Comparison means for obtaining shooting date / time information of the designated reference image and the comparison image, and comparing shooting date / time information of the reference image with shooting date / time information of the comparison image;
Determining means for determining a calculation when generating a temporal difference image based on a comparison result by the comparing means;
An image processing apparatus comprising: difference image generation means for generating the temporal difference image from the reference image and the comparison image using the operation determined by the determination means.   The image processing apparatus according to claim 1, wherein the difference image generation unit determines whether to subtract either the reference image or the comparison image from the other based on a comparison result by the comparison unit. .   The difference image generation unit deforms the comparison image with the reference image designated by the image designation unit as a reference, and generates the temporal difference image from the reference image and the modified comparison image. The image processing apparatus according to claim 1.   The image designating unit is capable of displaying a list of images stored in the storage unit, and selects the reference image and the comparison image from the displayed list of images. The image processing apparatus described.   The image designating unit can display a reduced image obtained by reducing the image stored in the storage unit, and selects the reference image and the comparison image based on an instruction input for the displayed reduced image. The image processing apparatus according to claim 1.   The image designating unit can display the images stored in the storage unit in a predetermined order based on the shooting date and time information, and selects the reference image and the comparison image based on an instruction input for the displayed image The image processing apparatus according to claim 1, wherein:   The difference image generation means determines an operation based on a comparison result by the comparison means so as to subtract an image with more recent shooting date / time information from an image with earlier shooting date / time information. The image processing apparatus according to 1. Designating a reference image and a comparison image from images stored in the storage means;
Obtaining the shooting date / time information of the specified reference image and the comparison image, and comparing the shooting date / time information of the reference image with the shooting date / time information of the comparison image;
Determining an operation in generating the temporal difference image based on the comparison result;
And a step of generating the temporal difference image from the reference image and the comparative image using the determined calculation.   9. The image processing method according to claim 8, wherein, in the step of generating the difference image, whether to subtract one of the reference image or the comparison image from the other is determined based on the comparison result. The step of generating the difference image includes deforming the comparison image using the designated reference image as a reference, and generating the temporal difference image from the reference image and the modified comparison image. Item 9. The image processing method according to Item 8.   9. The step of designating the reference image and the comparison image includes displaying a list of stored images, and selecting the reference image and the comparison image from the displayed list of images. The image processing method as described.   In the step of designating the reference image and the comparison image, a reduced image obtained by reducing and displaying the stored image can be displayed, and the reference image and the comparison image can be displayed based on an instruction input for the displayed reduced image. The image processing method according to claim 8, wherein: is selected.   In the step of designating the reference image and the comparison image, the stored images can be displayed in a predetermined order based on the shooting date and time information, and the reference image and the comparison are based on an instruction input for the displayed image. The image processing method according to claim 8, wherein an image is selected.   The calculation of the difference image generation step is based on a comparison result obtained in the comparison step so as to subtract an image with more recent shooting date / time information from an image with more shooting date / time information. 9. The image processing method according to 8.   The control program for making a computer perform the image processing method of any one of Claims 8 thru | or 14.   15. A computer-readable storage medium storing a control program for causing a computer to execute the image processing method according to claim 8.

Images