JP3931792B2 - Time-series processed image display device and display method - Google Patents

Time-series processed image display device and display method Download PDF

Info

Publication number
JP3931792B2
JP3931792B2 JP2002324837A JP2002324837A JP3931792B2 JP 3931792 B2 JP3931792 B2 JP 3931792B2 JP 2002324837 A JP2002324837 A JP 2002324837A JP 2002324837 A JP2002324837 A JP 2002324837A JP 3931792 B2 JP3931792 B2 JP 3931792B2
Authority
JP
Japan
Prior art keywords
image
time
processing
difference
series
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2002324837A
Other languages
Japanese (ja)
Other versions
JP2003224775A (en
Inventor
仁 吉村
亜紀子 柳田
久 米川
Original Assignee
コニカミノルタホールディングス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by コニカミノルタホールディングス株式会社 filed Critical コニカミノルタホールディングス株式会社
Priority to JP2002324837A priority Critical patent/JP3931792B2/en
Publication of JP2003224775A publication Critical patent/JP2003224775A/en
Application granted granted Critical
Publication of JP3931792B2 publication Critical patent/JP3931792B2/en
Application status is Expired - Fee Related legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Description

[0001]
BACKGROUND OF THE INVENTION
  The present invention relates to a display device for time-series processed images.And display methodSpecifically, the present invention relates to a technique for easily presenting a temporally changing portion of a subject based on a time-series processed image obtained by performing image processing using a plurality of time-series images.
[0002]
[Prior art]
Radiation images such as X-ray images are often used for disease diagnosis, etc. In order to obtain this X-ray image, X-rays transmitted through the subject are irradiated onto a phosphor layer (phosphor screen), thereby So-called radiographs in which visible light is generated and developed by irradiating a film using a silver salt in the same manner as ordinary photographs have been used (see Patent Documents 1 and 2).
[0003]
In the diagnosis based on the observation of the radiograph, for example, a plurality of films (for example, chest X-ray film obtained by regular examination) obtained at different times for the same subject, In some cases, doctors use these images for diagnosis by comparing the time-series images with each other and recognizing the time-varying portion based on their own experience knowledge.
[0004]
As described above, the method of comparing and referring to time-series images is important for finding a newly generated lesion and knowing the progress or improvement of a known lesion.
[0005]
[Patent Document 1]
JP 55-012144 A
[Patent Document 2]
U.S. Pat. No. 3,895,527
[0006]
[Problems to be solved by the invention]
However, even when time-series comparative image interpretation is performed as described above, an important part that has changed over time may be overlooked.
[0007]
For example, in a chest radiographic image, normal structures such as bones, blood vessels, and bronchi are intricately intertwined, and the shadow of a lesion is sometimes camouflaged by the shadow of these normal structures, and may be difficult to find.
[0008]
In addition, the two radiographs often have a considerably different density and gradation due to variations in the amount of X-ray exposure at the time of radiographing, and such variations in the finish between time-series images. It could be an obstacle to accurate comparison.
[0009]
Further, in the comparative image interpretation of the film image as described above, there is a problem in that it is necessary to select the target film from the film storage etc. and carry it to the image interpretation room each time and hang it on the Saucusten, which is inefficient.
[0010]
Further, conventionally, even when a temporally changing portion is detected by comparative interpretation between time-series images, in order to recognize the exact position, range, or degree of change, a plurality of films corresponding to each other are used. Since the selection must be made based on observation and knowledge, and the judgment must be made by comparing the different areas, there is a problem that the diagnosis efficiency is poor.
[0011]
The present invention has been made in view of the above problems, and shows the positional relationship between a time-series change portion of a subject based on a time-series image and a structure portion that is easy to see and has not changed over time. It is intended to improve diagnostic accuracy and diagnostic efficiency, particularly in medical radiographic images, by presenting it to the radiographer in a clearly shown form.
[0012]
[Means for Solving the Problems]
  Therefore, the display device for time-series processed images according to the invention of claim 1 performs difference processing between the time-series original images.Of the lesionDifference image generation means for generating a difference image, and pixels of the difference image,Depending on the direction of image data changeColor operation means for coloring different colors, image processing means for performing predetermined image processing on the original image corresponding to the difference image, and the original image processed by the image processing means differ from the color operation means Image adding means for adding the difference images colored in color, and image display means for displaying the added image obtained by the image adding means in a stationary state.
[0013]
  A display device for time-series processed images according to the invention of claim 2 comprises:The predetermined image processing is configured to adjust contrast with respect to the original image.
[0014]
  A time-series processed image display device according to the invention of claim 3 is provided.The predetermined image processing is configured to perform unsharpening processing on the original image.
[0015]
  A display device for time-series processed images according to the invention of claim 4The predetermined image processing is configured to perform contour extraction processing of the original image.
[0016]
  A time-series processed image display device according to the invention of claim 5 is provided.The predetermined image processing is to perform contour extraction processing of the original image, and further includes graphic generation means for generating a graphic that represents a contour of the original image extracted by the contour extraction processing, The adding means is configured to add the graphic generated by the graphic generating means and the difference image colored with the different color.
[0017]
  In the time-series processed image display device according to the invention of claim 6, the color operation means includesChange the color density based on the pixel value of the difference imageThe configuration.
[0020]
  Claim 7In the time-series processed image display device according to the invention, the image display means switches between a state in which the addition image is displayed and a state in which the image before the addition processing is performed in the image addition means. The display switching means is provided.
[0022]
  Claim8In the time-series processed image display device according to the invention, after the difference image generating means performs alignment processing for aligning the relative positional deviation of the subject portion between the original images based on the alignment information. The difference processing is performed.
[0023]
  Claim9In the time-series processed image display device according to the invention, the alignment processing in the difference image generation unit is obtained by linear approximation after obtaining the positional deviation of the mutually corresponding portions between the original images. Based on the amount of misalignment, a non-linear misalignment correction function between original images is obtained.
[0024]
  Claim10In the time-series processed image display device according to the invention, the alignment processing in the difference image generation means roughly positions the positional deviations of the mutually corresponding portions between the original images based on parameters input from the outside. After the adjustment, the amount of deviation is calculated by the cross-correlation method for each corresponding region to correct the distortion.
[0025]
  In the time-series processed image display device according to the invention of claim 11, the alignment processing in the difference image generating means includes parallel movement amount, combination of parallel movement amount and rotation amount, polynomial order, and X for all pixels. The combination of the movement amount in the direction and the movement amount in the Y direction, or the combination of the movement amount in the X direction and the movement amount in the Y direction with respect to the representative pixel is adopted.
  In the time-series processed image display method according to the twelfth aspect of the present invention, the difference image generation means performs difference processing between the time-series original images.Of the lesionGenerate a difference image, and for the pixels of the difference image,Depending on the direction of image data changeDifferent colors are colored by the color operation means, the image processing means is subjected to predetermined image processing on the original image corresponding to the difference image, and the original image processed by the image processing means is different from the color operation means. The added image obtained by adding the difference image colored is displayed on the image display means in a stationary state.
  In the time-series processed image display method according to the thirteenth aspect of the present invention, the predetermined image processing adjusts contrast with respect to the original image.
  In the time-series processed image display method according to the fourteenth aspect of the present invention, the predetermined image processing performs unsharpening processing on the original image.
  In the time-series processed image display method according to the invention of claim 15, the predetermined image processing is to perform contour extraction processing of the original image.
  In the time-series processed image display method according to the invention of claim 16, the predetermined image processing is to perform contour extraction processing of the original image, and the contour of the original image extracted by the contour extraction processing is drawn as a line drawing. A figure to be expressed is generated, and the figure expressed as a line drawing and the difference image colored with the different colors are added.
  In the time-series processed image display method according to the invention of claim 17, the color operation means changes the color density based on a pixel value of the difference image.
  In the time-series processed image display method according to the invention of claim 18, the image display means switches between a state in which the addition image is displayed and a state in which the image before the addition processing is displayed. Is.
  In the time-series processed image display method according to the nineteenth aspect of the present invention, the difference image generation means performs alignment processing for aligning the relative positional deviation of the subject portion between the original images based on the alignment information. After that, difference processing is performed.
  In the time-series processed image display method according to the invention of claim 20, the alignment processing in the difference image generating means obtains the positional deviation of the mutually corresponding portions between the original images by linear approximation, and then performs the linear approximation. This is performed by obtaining a non-linear misalignment correction function between original images based on the misalignment amount obtained by the above.
  In the time-series processed image display method according to the twenty-first aspect of the present invention, the registration processing in the difference image generation means is performed by performing positional shifts of mutually corresponding portions between original images based on parameters input from the outside. After roughly aligning, the amount of deviation is calculated by the cross-correlation method for each corresponding region, and distortion correction is performed.
  In the time-series processed image display method according to the invention of claim 22, the alignment processing in the difference image generation means includes parallel movement amount, combination of parallel movement amount and rotation amount, degree of polynomial, X for all pixels. One of the combination of the movement amount in the direction and the movement amount in the Y direction, and the combination of the movement amount in the X direction and the movement amount in the Y direction with respect to the representative pixel.
[0026]
【The invention's effect】
  As described above, according to the inventions according to claims 1 and 12, the difference processing is performed between the time-series original images.Of the lesionDifference imageButFor the pixel of this generated difference image,Depending on the direction of image data changeDifferent colors are colored. This colored difference image is added to the image-processed original image and displayed on the image display means in a stationary state. Therefore, the color of the difference image on the screen is seen to determine the change over time of the lesion at the diagnostic site. it can.
  At this time, by changing the color between the time-varying portion and the invariant structure, the time-changing portion and the unbiased structure can be expressed simultaneously with higher visibility.
  In addition, by expressing the nature of the temporal change with color, it is possible to present the temporally changed portion with high visibility and to provide clinically important information for medical diagnosis.
[0027]
  Claim 2 and13According to the invention, since the contrast of the time-series image is reduced and then added to the difference image, the time-varying portion emphasized by the difference image is easily seen and superimposed on the structure image that does not change with time. It is possible to display, and by observing the addition image, it is possible to easily detect the temporally changing portion after clarifying the positional relationship with the structure that has not changed with time.
[0028]
  Claim 3 and14According to the invention according to the present invention, it is avoided by the unsharpening process on the time-series image that the time-varying portion emphasized in the difference image is buried in a portion that does not change with time in the added image, and the time-varying portion is accurately detected. It is possible to detect a correct position and region.
[0029]
  Claim 4 and15According to the invention according to the above, by performing the contour extraction of the time-series image, it is possible to avoid the time-varying portion emphasized by the difference image from being camouflaged by the low-frequency shadow of the structure in the added image and difficult to find.
[0030]
  Claim 5 and16According to the invention related to the above, since the structure is extracted and made into a figure, the visibility of the positional relationship of the temporally changing portion with respect to the structure can be enhanced.
[0031]
  Claim 6 and17According to the invention according to the present invention, the pixel of the difference image is obtained by the color operation means.Change color density based on valueTherefore, the degree of deterioration or improvement of the lesion is estimated from the color densityDobe able to.
[0034]
  Claim 7 and18According to the invention according to the present invention, it is possible to switch between the state in which the addition image is displayed and the state in which the image before the addition processing is displayed as necessary, so that the addition image suitable for recognizing the positional relationship and size of the temporally changing portion. And display suitable for detailed observation of the shadow of the part that changes with time can be obtained by switching between them.
[0036]
  Claim8-11as well as19-22According to the invention according to the above, after performing the alignment process for aligning the relative position shift of the object portion between the images due to the positioning of the object at the time of photographing or the difference in the X-ray incident direction, the difference process is performed. By doing so, there is an effect that the time-change portion can be detected with high accuracy.
[0037]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below.
FIG. 1 shows a system configuration in an embodiment of a time-series processed image display device according to the present invention.
[0038]
In FIG. 1, an image storage unit 1 (storage device) stores a plurality of digital image data of radiographic images (for example, chest radiographic images of a human body taken in a regular examination) taken by X-ray for medical diagnosis. Yes, it is composed of a magneto-optical disk or the like.
[0039]
The radiographic image data is obtained by irradiating a silver salt film on which a radiographic image is recorded with light from a light source such as a laser or a fluorescent lamp to obtain transmitted light of the silver salt film, and photoelectrically converting the transmitted light. Or the radiation transmitted through the subject is absorbed by the phosphor, and then the phosphor is excited by, for example, light or thermal energy, so that the radiation energy accumulated by the phosphor is emitted as fluorescence. It may be obtained by photoelectrically converting this fluorescence.
[0040]
In addition to the image storage unit 1, an image information storage unit 2 is provided. In the image information storage unit 2, as various information about each image stored in the image storage unit 1, for example, shooting is performed. Information on date / time, imaging location, imaging conditions, image processing conditions, subject, etc., and information on alignment processing between images taken of the same location of the same subject, detection results of abnormal shadows, etc. Can be done.
[0041]
The alignment information is a coordinate conversion of at least one of the plurality of images so as to relatively align the position of the common subject in a plurality of images including a common subject portion. This is information for processing, and the relative positional shift caused by the positioning of the subject at the time of imaging and the difference in the X-ray incident direction is corrected by coordinate conversion based on the alignment information, and the same of the plurality of images It is possible to superimpose image portions corresponding to anatomical structures.
[0042]
The image data stored in the image storage unit 1 and various accompanying information stored in the image information storage unit 2 are collated by the image management unit 3 and read out.
[0043]
However, the image information storage unit 2 may be omitted, and the image storage unit 1 may store the image data and various information corresponding to each image in pairs.
The storage data of the image storage unit 1 and the image information storage unit 2 is read by the image management unit 3 (image reading unit) as needed by arbitrarily selecting a read image by the console 4. The read image data is subjected to image processing in the image processing unit 5 (image processing unit) as necessary, and then the image display unit of the image display unit A (image display unit) is configured to read the radiation image. 6 is displayed.
[0044]
Accordingly, it is not necessary to search for a target film and apply it to the shaucusten, which is performed when the radiation film is read using the shaucusten, and an efficient interpretation work is possible.
[0045]
The image display unit A includes an image memory 7 and a display control unit 8 in addition to the image display unit 6.
As the image display unit 6, a CRT, a plasma display, a liquid crystal display, or the like is used. CRT is preferably used from the viewpoint of gradation expression performance, and more than 1000 scanning lines known as medical high-definition CRTs are used. It is more preferable to use a CRT higher than the system.
[0046]
Image data read from the image storage unit 1 (or image data subjected to image processing after reading) is stored in the image memory 7 of the image display unit A, and the image data stored in the image memory 7 Is displayed on the image display unit 6 under the control of the display control unit 8.
[0047]
The display control unit 8 controls the display image in accordance with a display format instruction performed via the console 4.
By the way, for a subject who regularly performs chest X-ray imaging or the like by periodic medical examination or the like, a temporal image series (hereinafter referred to as a time series image) for each subject is completed.
[0048]
In addition, by performing difference processing (a kind of time-series processing) between multiple time-series images of the same part of the same subject photographed at different times in this way, the time-varying portion of the subject is selected. Therefore, by detecting the difference image (the image generated by the difference process, the same applies hereinafter), a time-change portion (a newly generated lesion or a lesion whose disease state has changed) can be detected. It becomes easy to do.
[0049]
Therefore, in the present embodiment, the difference processing (time-series processed image) is performed on the time-series image (original image) in advance and the difference image (time-series processed image) is stored in the storage unit 1 together with the time-series image. A plurality of time-series images are read from the storage unit 1, and based on these, the image processing unit 5 (time-series processing means) newly generates the difference image, and the difference image obtained by any one of the methods will be described later. By processing and displaying in this way, it is possible to easily detect a portion that changes with time.
[0050]
The difference process is performed, for example, as shown in the flowchart of FIG. First, preprocessing (S3, S4) is performed for two time-series images (1), (2) (S1, S2) acquired at different times.
[0051]
The pre-processing is image reduction processing for simplifying the calculation of difference processing, and for example, pixel thinning and averaging processing are performed.
When the preprocessing is completed, a positioning process for aligning the relative position shift of the subject portion between images due to the positioning of the subject at the time of imaging and the difference in the X-ray incident direction is performed (S5).
[0052]
The alignment process can be performed using various known methods as disclosed in Japanese Patent Publication No. 61-14553, Japanese Patent Laid-Open No. 63-278183, Japanese Patent Laid-Open No. 01-70236, and the like.
[0053]
Specifically, for example, the positional deviation between the two images corresponding to each other is obtained by linear approximation, and a correction function for nonlinear positional deviation between the two images is obtained from the obtained positional deviation amount.
[0054]
In addition, a configuration may be used in which, after performing rough alignment based on parameters input from the outside, distortion is corrected by calculating a shift amount by a cross-correlation method for each corresponding region.
[0055]
The alignment information includes, for example, a parallel movement amount, a combination of a parallel movement amount and a rotation amount, a polynomial order (in the case of polynomial transformation), and a combination of an X-direction movement amount and a Y-direction movement amount for all pixels. , Given as a combination of the amount of movement in the X direction and the amount of movement in the Y direction with respect to the representative pixel.
[0056]
The alignment process may be performed based on the alignment information stored in advance, or is performed by detecting the misalignment between the read images and setting the alignment information. It is possible to adopt a configuration that allows
[0057]
When the alignment process is completed, a difference process (S6) is performed to obtain a difference between the image data between the corresponding pixels of the two time-series images. When a time-difference image is obtained, a predetermined offset value is subsequently set. A post-process (S7) such as an adding process and a gradation process is performed, and a differential image (a time-dependent differential image as one type of time-series processed image) finally obtained based on the time-series image is set ( S8).
[0058]
As shown in the flowchart of FIG. 3, immediately before (or immediately after) the alignment process (S5), the density / gradation correction process (S5) for adjusting the density / gradation of the entire image to the standard density / gradation characteristics. ') May be performed.
[0059]
Specifically, density / gradation correction processing as disclosed in US Pat. No. 5,224,177 can be used.
Alternatively, a method may be used in which an image is divided into a plurality of small regions, and the pixel values of one image are corrected so that the statistical values of the pixel values in the corresponding small regions are equal.
[0060]
As the statistic, an average value, a variance value, or the like is used.
By the way, in the time-difference difference image (time-series processed image), although the temporally changing portion is emphasized and the temporally changing portion is easy to detect, it is difficult to interpret the structure that has not changed with time. Therefore, even if a temporally changing portion (lesion portion) is detected by observing the difference image, it is difficult to recognize the exact position and region in the normal structure from the same difference image.
[0061]
Therefore, in the present embodiment, processing for adding a time-series image (original image) to the difference image (time-series processed image) is performed as described below (image adding means), and the added image generated by such processing is added. By displaying it, the temporally changing portion in the image can be presented to the image interpreter with the positional relationship with the structure portion that has not changed clearly defined.
[0062]
In other words, by adding the time-series image that is the original image to the difference image, it is possible to obtain an image that selectively emphasizes the temporally changing portion while displaying a normal structure that does not change. A normal structure without change can be recognized as the background.
[0063]
Hereinafter, an embodiment of the addition process will be described.
FIGS. 4 to 6 show that a time-series image (original image) is subjected to image processing (image processing means), added with a difference image (image adding means), and the added image is displayed (image display means). ) Shows an embodiment.
[0064]
In the example shown in FIG. 4, the time series image is subjected to gradation processing using a gradation conversion table to reduce the contrast (gradation processing means), and then the image processing (gradation processing) is performed. A time-series image is added to the difference image (image adding means), and the added image is displayed (image display means).
[0065]
By reducing the contrast of the time-series image, the time-varying portion emphasized in the difference image is buried in the fine shadow of the structure portion that does not change with time in the added image, making it difficult to detect the time-varying portion. Thus, it is possible to superimpose and display on the image of the structure that does not change with time, in a form that makes it easy to see the time-changed portion emphasized in the difference image.
[0066]
Then, by observing the added image, it is possible to easily detect the temporally changing portion after clarifying the positional relationship with the structure that has not changed with time.
In the example shown in FIG. 5, after a non-sharpening process as a frequency process is performed on a time-series image (frequency processing means), the difference image is added (image addition means), and the added image is displayed ( Image display means).
[0067]
The unsharpening process is, for example, obtaining an average value of image data for each of a plurality of image areas each having a plurality of vertical and horizontal pixels, and replacing the average value with image data of a central pixel of the image area. An image is generated.
[0068]
Also in this case, it is avoided by the unsharpening process for the time-series image that the time-varying portion emphasized in the difference image is buried in a portion that does not change with time in the added image, and the accurate position of the time-varying portion is , The area can be detected.
[0069]
Further, in the example shown in FIG. 6, the time-series image is subjected to high-frequency extraction processing as frequency processing (frequency processing means) to extract the contour of the time-series image, and the time-change portion emphasized by the difference image. Is not camouflaged by the low-frequency shading of the structure in the added image.
[0070]
In the above embodiment, the time series image (original image) is subjected to image processing such as gradation processing and frequency processing (image processing means) and then added to the difference image (time series processed image). On the contrary, the difference image may be subjected to image processing and then added to the time-series image. An embodiment corresponding to this is shown in FIG.
[0071]
In the example shown in FIG. 7, the difference image (time-series processed image) is subjected to gradation processing for enhancing contrast by conversion of image data using a preset gradation conversion table (gradation processing means). The added image obtained by adding the gradation-processed difference image to the time-series image (original image) (image adding means) is displayed (image display means).
[0072]
As described above, if gradation processing for enhancing the contrast of the difference image is performed and then added to the time-series image to obtain the addition image, the time-varying portion emphasized by the difference image is It is possible to avoid being buried in the shadow of the time-series image, so that the temporally changing portion can be presented in an easy-to-see manner after clarifying the positional relationship with the normal structure.
[0073]
Here, instead of the gradation processing, frequency processing is performed to remove high-frequency components of the difference image, and high-frequency artifacts caused by slight positional deviations such as rib edges and blood vessels when obtaining the difference image are removed. Therefore, it may be configured to add to the time-series image.
[0074]
Further, the example shown in FIG. 8 is an embodiment in which the image processing is performed on the time-series image (original image) and then the difference image (time-series processed image) is added. In this case, the time-series image A process (structure extraction means) for extracting the outline of the structure (lung field outline, rib outline, spine line, etc.) in the inside is generated, and a graphic representing the outline is generated (graphic generation means). A difference image is added to the figure indicating (image addition means), and an image in which the temporally changing portion is emphasized is superimposed on the outline of the structure.
[0075]
The contour extraction can be obtained from profile information as disclosed in Japanese Patent Application No. 62-77353, for example.
Instead of expressing the contour as a line drawing, a configuration may be used in which a figure that expresses the lung field region or the heart region with a filled pattern is generated based on the contour extraction result.
[0076]
If the structure is extracted and made into a graphic as described above, the visibility of the positional relationship of the temporally changing portion with respect to the structure can be enhanced.
In the embodiment shown in FIG. 9, the difference image is binarized by comparing the image data of each pixel of the difference image (time-series processed image) with a predetermined threshold value.
[0077]
By such binarization processing, unnecessary image portions due to slight positional deviations such as rib edges and blood vessels when a difference image is obtained are removed.
Then, an area (island) having a predetermined size or larger is extracted from the area by using a labeling process for discriminating each area by obtaining an area where a plurality of pixels equal to or greater than the threshold corresponding to the temporally changing portion are obtained. The extracted area is expressed by a fill pattern.
[0078]
Here, the image expressing the temporally changing portion with a filled pattern is added to a time-series image (original image), and the added image is displayed.
According to the above configuration, it is possible to increase the degree of emphasis of the temporally changing portion while removing unnecessary image portions caused by the positional deviation between images when obtaining the difference image by binarization of the difference image, When added to the time-series image, the temporally changing portion is not camouflaged by the fine shadows of the normal structure of the time-series image.
[0079]
Therefore, in this case as well, the temporally changing portion can be presented in an easy-to-see manner while clarifying the positional relationship with the normal structure portion having no temporal change.
The time-varying portion extracted by binarization of the difference image is a mark (not shown in the figure) set in advance in the center portion of the region where the time-varying has occurred, as shown in FIG. May be displayed and expressed.
[0080]
In each of the embodiments described above, the image processing is performed on one of the time-series image (original image) and the difference image (time-series processed image), and then both are added to obtain an added image. The addition may be performed after performing image processing on both the time-series image (original image) and the difference image (time-series processed image).
[0081]
By the way, the time-series image (original image) and the difference image (time-series processed image), which are the radiation images, are monochrome images having a density according to the radiation transmission level, and are colored by image processing. The (color operation means) can also make it possible to easily express the temporally changing portion in the added image.
[0082]
As the color operation, for example, a time-series image (or an image obtained by performing image processing on the time-series image) and a difference image (or an image obtained by performing image processing on the difference image) are expressed in mutually different colors. It can be set as the structure to do.
[0083]
According to such a configuration, in the added image, it is easy to distinguish and recognize the temporally changing portion and the invariant structural portion, and it is easier to recognize the temporally changing portion while clarifying the positional relationship with the normal structure. .
[0084]
In addition, when extracting the outline of a structure from a time-series image as shown in FIG. 8, a line drawing or a fill pattern that expresses the outline is expressed in color, and an image that is the background of the outline image is displayed in monochrome. You may make it do.
[0085]
Furthermore, without adding color to the time-series image, only the difference image (or the image obtained by performing image processing on the difference image) is colored to generate a colored time-series processed image, and then the addition process is performed. Only the temporally changing portion may be expressed in color with respect to the normal structure portion.
[0086]
In coloring the difference image, as shown in FIG. 11, the hue may be changed based on the pixel value of the difference image (time-series processed image). Further, as shown in FIG. The density may be changed together with the hue based on the above.
[0087]
The color operation shown in FIG. 11 is not colored for pixels that do not change with time, but for pixels that have changed with time, either red or blue is colored depending on the change direction of the image data. It is.
[0088]
In addition, in the color operation shown in FIG. 12, as with the color operation shown in FIG. 11, the pixels that have changed with time are colored differently depending on the direction of the change, but the change with time is also large. As is apparent, the coloring density is increased.
[0089]
For example, when the difference processing is expressed as a difference image (time-series processed image) = (past image) − (new image) + constant, the lesion part generally has a reduced radiation transmittance, and image data Because of the color operation on the difference image shown in FIG. 11, the newly generated lesion is displayed in red because the pixel value of the difference image is large, and the improved lesion is displayed in blue because the pixel value of the difference image is small. Thus, if the color operation shown in FIG. 12 is performed, the degree of deterioration or improvement of the lesion can be estimated from the color density.
[0090]
By the way, the display of the addition image generated by performing various image processing as described above can present the time-varying portion in an easy-to-see manner while clarifying the positional relationship with the normal structure portion. In the confirmation and detailed observation of the part that changes over time, it may be necessary to display a difference image or a time-series image (an image before being subjected to addition processing).
[0091]
Therefore, an interpreter such as a doctor can perform an operation between the addition image and the time-series image or between the addition image and the difference image through the operation of the console 4, and the addition image, the time-series image, and the difference image. It is preferable that the display can be arbitrarily switched among the three parties (display switching means).
[0092]
As the display image switching pattern, for example, a time-series image or a difference image is usually displayed, and an addition image is displayed when requested through the console 4, or an addition image is usually displayed. And a time-series image or a difference image can be displayed when a request is made via the console 4.
[0093]
If the display image is switched as described above, the time-varying portion can be easily confirmed by comparing the added image and the difference image, and the time-varying portion can be confirmed by the time-series image after the time-varying portion is confirmed. Detailed observation is possible.
[0094]
In addition, if it is the structure provided with two or more image display parts 6, it is also possible to display a time-sequential image or a difference image (image before an addition process) with an addition image simultaneously on a different display screen, Furthermore, the same screen It is also possible to display the time-series image or the difference image simultaneously with the added image by reducing the size (multi-image display means).
[0095]
  The image processing (gradation processing, frequency processing, color operation) conditions may be arbitrarily specified by the image interpreter via the console 4. Furthermore, a plurality of added images (processing condition adjusting means) obtained by changing the conditions of image processing (gradation processing, frequency processing, color operation) in multiple stages are sequentially processed according to instructions via the console 4. It may be switched to displayNo(Display switching means).
[0096]
In this case, by changing the image processing conditions in multiple stages, it is possible to observe while changing the degree of emphasis of the temporally changing portion or the invariant structure portion.
The image processing conditions to be changed in multiple stages include a gradation conversion curve for gradation processing, a filter size and mask size for frequency processing, a threshold value for threshold processing, and the like.
[0097]
In addition, when there is a subject part that is not common between images when difference processing is performed with alignment, and the non-common subject part is included in the periphery of the difference image, the non-common subject is used for observation of the difference image. Since the image of the part is unnecessary, it is preferable to perform a process of masking or trimming the unnecessary part.
[Brief description of the drawings]
FIG. 1 is a system configuration diagram of an embodiment of the present invention.
FIG. 2 is a flowchart showing a state of difference processing in the embodiment.
FIG. 3 is a flowchart showing a state of difference processing in the embodiment.
FIG. 4 is a diagram illustrating a state in which gradation processing is performed on an original image to obtain an added image.
FIG. 5 is a diagram illustrating a state in which an unsharp process is performed on an original image to obtain an added image.
FIG. 6 is a diagram illustrating a state in which an addition image is obtained by performing high-frequency extraction processing on an original image.
FIG. 7 is a diagram showing a state in which gradation processing is performed on a time-series processed image to obtain an added image.
FIG. 8 is a diagram illustrating a state where an outline of a structure is extracted from an original image to obtain an added image.
FIG. 9 is a diagram showing a state in which a temporally changing portion having a predetermined size or more is extracted from a time-series processed image to obtain an added image.
FIG. 10 is a diagram illustrating a state in which a temporally changing portion having a predetermined size or more is extracted from a time-series processed image to obtain an added image.
FIG. 11 is a diagram illustrating coloring characteristics according to pixel values of a time-series processed image.
FIG. 12 is a diagram illustrating coloring characteristics according to pixel values of a time-series processed image.
[Explanation of symbols]
1 ... Image storage unit
2. Image information storage unit
3. Image management department
4 ... console
5. Image processing unit
6 ... Image display section
7 ... Image memory
8. Display control unit
A ... Image display unit

Claims (22)

  1. Difference image generation means for generating a difference image of a lesion part by performing difference processing between time-series original images;
    For the pixels of the difference image, color operation means for coloring different colors depending on the change direction of the image data ;
    Image processing means for performing predetermined image processing on the original image corresponding to the difference image;
    Image adding means for adding the original image image-processed by the image processing means and the difference image colored by different colors by the color operation means;
    Image display means for displaying the addition image obtained by the image addition means in a stationary state;
    A display device for time-series processed images, comprising:
  2.   The time-series processed image display device according to claim 1, wherein the predetermined image processing adjusts contrast with respect to the original image.
  3.   The time-series processed image display device according to claim 1, wherein the predetermined image processing performs unsharpening processing on the original image.
  4.   The time-series processed image display device according to claim 1, wherein the predetermined image processing performs contour extraction processing of the original image.
  5. The predetermined image processing is to perform contour extraction processing of the original image,
    A graphic generation means for generating a graphic representing the outline of the original image extracted by the contour extraction processing;
    2. The time-series processed image display device according to claim 1, wherein the image adding unit adds the graphic generated by the graphic generating unit and the difference image colored with the different color.
  6.   6. The time-series processed image display device according to claim 1, wherein the color operation unit changes a color density based on a pixel value of the difference image.
  7.   The image display means includes display switching means for switching between a state in which the addition image is displayed and a state in which an image before the addition processing is performed in the image addition means. The time-series processed image display device according to any one of 1 to 6.
  8.   2. The difference image generation unit performs difference processing after performing alignment processing for adjusting a relative positional shift of a subject portion between original images based on alignment information. The display apparatus of the time-sequential process image as described in any one of -7.
  9. The alignment process in the difference image generating means is
    After obtaining the position shift of the corresponding parts between the original images by linear approximation,
    9. The time-series processed image display apparatus according to claim 8, wherein a correction function for nonlinear positional deviation between original images is obtained based on the positional deviation amount obtained by the linear approximation.
  10. The alignment process in the difference image generating means is
    Based on parameters input from the outside, after roughly aligning the misalignment of the corresponding parts between the original images,
    9. The time-series processed image display device according to claim 8, wherein distortion correction is performed by calculating a deviation amount by a cross-correlation method for each corresponding region.
  11. The alignment process in the difference image generating means is
    Parallel movement amount, combination of parallel movement amount and rotation amount, degree of polynomial, combination of X direction movement amount and Y direction movement amount for all pixels, X direction movement amount and Y direction movement for representative pixel 9. The time-series processed image display device according to claim 8, wherein the time-series processed image display device is one of a combination with a quantity.
  12. Difference processing is performed between time-series original images, and a difference image generating means generates a difference image of the lesion part ,
    For the pixels of the difference image, color different colors depending on the change direction of the image data with the color operation means,
    The image processing means performs predetermined image processing on the original image corresponding to the difference image,
    An added image obtained by adding the original image processed by the image processing means and the difference image colored by the color operation means is displayed on the image display means in a stationary state. How to display time-series processed images.
  13.   The time-series processed image display method according to claim 12, wherein the predetermined image processing adjusts contrast with respect to the original image.
  14.   The time-series processed image display method according to claim 12, wherein the predetermined image processing performs unsharpening processing on the original image.
  15.   The time-series processed image display method according to claim 12, wherein the predetermined image processing performs contour extraction processing of the original image.
  16. The predetermined image processing is to perform contour extraction processing of the original image,
    Generating a figure representing the outline of the original image extracted by the outline extraction process,
    13. The method for displaying a time-series processed image according to claim 12, wherein the figure represented by the line drawing is added to the difference image colored with the different color.
  17.   17. The time-series processed image display method according to claim 12, wherein the color operation unit changes a color density based on a pixel value of the difference image.
  18.   18. The display device according to claim 12, wherein the image display unit switches between a state in which the addition image is displayed and a state in which an image before the addition process is displayed. 18. The display method of the time-sequential process image described in 2.
  19.   13. The difference image generation unit performs difference processing after performing alignment processing for aligning a relative positional shift of a subject portion between original images based on alignment information. The display method of the time-sequential process image as described in any one of -18.
  20. The alignment process in the difference image generating means is
    After obtaining the position shift of the corresponding parts between the original images by linear approximation,
    20. The method of displaying a time-series processed image according to claim 19, wherein a correction function for nonlinear positional deviation between original images is obtained based on the amount of positional deviation obtained by the linear approximation.
  21. The alignment process in the difference image generating means is
    Based on parameters input from the outside, after roughly aligning the misalignment of the corresponding parts between the original images,
    20. The time-series processed image display method according to claim 19, wherein distortion correction is performed by calculating a shift amount by a cross-correlation method for each corresponding region.
  22. The alignment process in the difference image generating means is
    Parallel movement amount, combination of parallel movement amount and rotation amount, degree of polynomial, combination of X direction movement amount and Y direction movement amount for all pixels, X direction movement amount and Y direction movement for representative pixel 20. The method for displaying a time-series processed image according to claim 19, wherein the display method is one of a combination with a quantity.
JP2002324837A 2002-11-08 2002-11-08 Time-series processed image display device and display method Expired - Fee Related JP3931792B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2002324837A JP3931792B2 (en) 2002-11-08 2002-11-08 Time-series processed image display device and display method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2002324837A JP3931792B2 (en) 2002-11-08 2002-11-08 Time-series processed image display device and display method

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP06209768 Division

Publications (2)

Publication Number Publication Date
JP2003224775A JP2003224775A (en) 2003-08-08
JP3931792B2 true JP3931792B2 (en) 2007-06-20

Family

ID=27751428

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2002324837A Expired - Fee Related JP3931792B2 (en) 2002-11-08 2002-11-08 Time-series processed image display device and display method

Country Status (1)

Country Link
JP (1) JP3931792B2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8483456B2 (en) 2007-12-19 2013-07-09 Konica Minolta Medical & Graphic, Inc. Dynamic image processing system
US9504852B2 (en) 2012-09-03 2016-11-29 Toshiba Medical Systems Corporation Medical image processing apparatus and radiation treatment apparatus

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE602004029211D1 (en) * 2004-11-10 2010-10-28 Agfa Healthcare Method of taking measurements on digital images
EP1657679A1 (en) * 2004-11-10 2006-05-17 Agfa-Gevaert Method of superimposing images
EP1657680A1 (en) * 2004-11-10 2006-05-17 Agfa-Gevaert Display device for displaying a blended image
JP4518985B2 (en) * 2005-03-11 2010-08-04 株式会社リコー Imaging device
FR2946171B1 (en) * 2009-05-29 2011-07-15 Groupe Des Ecoles De Telecommunications Get Ecole Nationale Superieure Des Telecommunications Enst Method of quantifying the evolution of pathologies involving changes in body volumes, in particular tumors
JP6140478B2 (en) * 2013-03-04 2017-05-31 株式会社メガチップス Object detection device, program, and integrated circuit
WO2014207901A1 (en) * 2013-06-28 2014-12-31 キヤノン株式会社 Image processing device and image processing method

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8483456B2 (en) 2007-12-19 2013-07-09 Konica Minolta Medical & Graphic, Inc. Dynamic image processing system
US9125621B2 (en) 2007-12-19 2015-09-08 Konica Minolta, Inc. Dynamic image processing system
US9504852B2 (en) 2012-09-03 2016-11-29 Toshiba Medical Systems Corporation Medical image processing apparatus and radiation treatment apparatus

Also Published As

Publication number Publication date
JP2003224775A (en) 2003-08-08

Similar Documents

Publication Publication Date Title
JP4355746B2 (en) X-ray imaging method
JP4130661B2 (en) Device for detecting temporal changes between temporally continuous chest images
US6775399B1 (en) ROI segmentation image processing system
US9336592B2 (en) Method and apparatus for determining tumor shift during surgery using a stereo-optical three-dimensional surface-mapping system
US7194118B1 (en) System for optically sectioning and mapping surgically excised tissue
US7324673B1 (en) Image processing apparatus, image processing method, and image processing program storage medium
Helferty et al. Videoendoscopic distortion correction and its application to virtual guidance of endoscopy
US6862364B1 (en) Stereo image processing for radiography
US7162066B2 (en) Image display method and image display apparatus
US7433507B2 (en) Imaging chain for digital tomosynthesis on a flat panel detector
JP4874810B2 (en) X-ray CT system
US6853357B2 (en) Image display apparatus and method, and storage medium
JP4709604B2 (en) Image display device, image display method, storage medium, and program
EP0880109B1 (en) Method for determining the transformation between an object and its three dimensional representation and device for carrying out this method
JP5314614B2 (en) Medical image display device, medical image display method, and program
JP6400793B2 (en) Generating image display
JP2006014928A (en) Method, device and program for displaying image
CN100581467C (en) Method and device for contour visualization of regions of interest in 2d fluoroscopy images
US8200040B2 (en) Image system for retaining contrast when merging image data
JP2001511570A (en) A method for detecting the interval change in the radiation photo
FR2836577A1 (en) Algorithm for reducing motion artifacts for bi-energy radiography with two exhibitions
CN1620990A (en) Method and apparatus for segmenting structure in CT angiography
JP2001299733A (en) Pci radiation beam image processing apparatus, pci radiation beam image detecting and processing apparatus, pci radiation beam image outputting apparatus and pci radiation beam image diagnosis supporting apparatus
DE10254942B3 (en) Method for automatically determining the coordinates of images of marks in a volume data set and medical device
JP2006320721A (en) Method of expanding display range of volume photographing of object region

Legal Events

Date Code Title Description
A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20050118

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20050318

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20051025

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20051221

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20060718

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20060919

A911 Transfer of reconsideration by examiner before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20061102

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20061128

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20070117

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20070220

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20070305

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100323

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110323

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120323

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130323

Year of fee payment: 6

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140323

Year of fee payment: 7

LAPS Cancellation because of no payment of annual fees