JP2012000477A - Image processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing apparatus, capable of synchronously displaying a plurality of images of display operation and image processing on the basis of imaging information when capturing an image and display parameters, facilitating comparison of the images, facilitating confirmation of change with time and therapeutic effect, and capable of providing medical information for helping medical examination and diagnosis.SOLUTION: The image processing apparatus is capable of processing a plurality of three-dimensional images. The apparatus includes: a synchronizing device for synchronously processing the second three-dimensional image so as to become the same embodiment as the first three-dimensional image according to a predetermined operation; a synthesis device for synthesizing the first three-dimensional image with the second three-dimensional image, which are synchronously processed, so as to match a specified point; and a display device capable of displaying the synthesized first and second three-dimensional images.

Description

  The present invention relates to an image processing apparatus that displays medical images and medical information obtained by an image diagnostic apparatus.

  Conventionally, an image processing apparatus capable of image display and image processing is used to observe a medical image of a patient photographed by a medical image diagnostic apparatus or the like. This image processing apparatus can observe a three-dimensional image in addition to displaying a two-dimensional image. At the time of this observation, for comparison, for example, the images can be easily compared by observing with the observation angle and magnification rate of each image display being exactly the same. Some apparatuses that display a three-dimensional image can display a plurality of three-dimensional images.

  A plurality of images displayed by an image processing apparatus including the conventional image monitor 18 shown in FIG. 4 are mainly operated separately for each display image. There is also an image processing device that can operate multiple display images at a time, but it only synchronizes the change from the display state at that time, for example, it can be operated at once to display in angle synchronization It is executed by an operation of at least two actions that the angle of two images is set to be the same by the apparatus and a display function to be operated at once is selected. Two three-dimensional images are displayed on the display screen 20, but the display scales of the two are not synchronized with each other, and several steps of operations are required to synchronize them.

JP-A-8-212325

  However, the conventional image processing apparatus has the following problems to be solved.

  In the operation method of the display image, in order to confirm the change of the displayed affected part image and the therapeutic effect, the image processing operations such as the observation angle, the enlargement ratio, and the display image processing are made the same for a plurality of images by manual operation It was necessary to observe.

  The time, labor, and labor of these operations, which require more skill, have been an obstacle to spreading comparative interpretation of 3D images. The fact that comparative interpretation is a useful diagnostic / diagnosis method in clinical medicine has already been widely recognized in two-dimensional images such as X-ray imaging, CT, and MRI tomographic images. Similarly, it is not difficult to imagine that comparative interpretation of a three-dimensional image is useful, and an image processing apparatus that can synchronize an imaging angle, an enlargement ratio, and display image processing has been desired.

  The image processing apparatus of the present invention solves these problems, and can display and synchronize a plurality of images based on shooting information and display parameters at the time of shooting, thereby facilitating comparison of images. It is an object of the present invention to provide an image processing apparatus that can easily check changes over time and treatment effects, and can provide medical information that assists in diagnosis and diagnosis.

  In an image processing apparatus according to an embodiment of the present invention, in the image processing apparatus capable of processing a plurality of three-dimensional images, according to a predetermined operation, the second three-dimensional image has the same aspect as the first three-dimensional image. Synchronizing means for synchronously processing images, means for synthesizing the synchronized three-dimensional image and the second three-dimensional image so that designated points coincide with each other, and the synthesized first tertiary Display means capable of displaying the original image and the second three-dimensional image are provided.

BRIEF DESCRIPTION OF THE DRAWINGS Schematic for demonstrating the structure of the image processing apparatus by embodiment of this invention. BRIEF DESCRIPTION OF THE DRAWINGS Schematic for demonstrating the structure of the image processing apparatus by embodiment of this invention. The figure which shows one example of the screen display by the image processing apparatus by embodiment of this invention. The figure which shows one example of the screen display by the conventional image processing apparatus.

<First Embodiment>
FIG. 1 is a schematic diagram for explaining the configuration of an image processing apparatus according to a first embodiment of the present invention.

  The configuration of this image processing apparatus is connected to an image diagnostic apparatus such as a CT apparatus 4, an MRI apparatus 5, an ultrasonic apparatus 6, an X-ray apparatus 7 or a nuclear medicine apparatus and an image database 1 via a network 8. In each imaging apparatus, a three-dimensional image obtained by three-dimensionally imaging the internal structure of the patient is reconstructed, and the generated image is stored in the image database 1. Further, the number of image processing apparatuses is not limited to one, and a plurality of image processing apparatuses such as a first image processing apparatus 2 and a second image processing apparatus 3 are connected to the network 8 as shown in FIG. Yes.

  2 is a schematic diagram for explaining the internal configuration of the first image processing apparatus 2 and the second image processing apparatus 3 shown in FIG. The configuration of the image processing apparatus includes a CPU 14 for controlling the entire processing, an input device 13 for inputting patient and image selection and angle information, an image memory 9 for storing a three-dimensional image, a three-dimensional enlargement / reduction / movement, 3D AFIN processing unit 10 that performs rotation, 3D image processing such as volume rendering processing and surface rendering processing, 3D image processing unit 11 that constitutes a 3D display image, and converts the gradation of the 3D display image An LUT (Look Up Table) 12, a display unit (monitor) 15 that displays a three-dimensional display image, and a signal bus 16 that performs signal transmission in information transmission / reception.

  The image database 1 stores not only a three-dimensional image but also patient / imaging information attached to the image, information indicating the orientation of the image, and the like. Note that the CPU 14 may also serve as the three-dimensional AFIN processing 10 and the three-dimensional image processing 11. The display device 15 has a plurality of display areas and can display a plurality of three-dimensional display images at a time. The structure may be a multi-window display or may be formed by a plurality of monitors.

  Next, the overall operation of the image processing apparatus will be described.

  For example, consider a case where the three-dimensional images A and B registered in the image database 1 are three-dimensionally displayed on the image processing apparatus. The images A and B may be images taken with the same modality or images taken with different modalities. Each displayed image is usually displayed at different angles unless they are intentionally matched. By turning on the synchronization switch, the display from the same angle can be performed without intentional operation by the operator. Become an image.

  At this time, for example, if the current image A is a controllable image, the display angle of the image B is rotated so as to coincide with the display angle of the image A. This indicates that the change amount from the initial display angle is not made coincident, but conversion is performed so that the image is observed from the same angle in consideration of the orientation of the image. For example, in the example of the CT apparatus 4, the patient insertion direction, the image observation direction, the patient body position, and the like are listed as information indicating the image orientation.

  The order in which the reconstructed three-dimensional images are arranged changes depending on whether the patient is inserted into the CT apparatus 4 from the head or the foot. These are expressed as Top First (TF: Images are configured in order from the top of the head) / Foot First (FF: Images are configured in the order from the foot-and-tail direction). The image observation direction indicates the direction in which the image is observed, and is expressed as View from Top (VFT: image viewed from the top of the head) / View from Foot (VFF: image viewed from the foot-and-tail).

  The patient position indicates, for example, whether the patient is facing up, down, left, or right at the time of imaging. Therefore, for example, even if the image A and the image B are both at the initial display angle, it is assumed that the orientation of the image A is VFT and TF, and the orientation of the image B is VFF and FF. Assuming that both of the patient positions are upward, in this case, by inverting the image B up and down, the observation angles of both coincide.

  In the case of the MR1 apparatus, since the tomographic plane can be freely set for the patient, more detailed orientation information is required, but the principle is the same. While the synchronization switch is ON, processing applied to one image, for example, rotation, movement, enlargement / reduction, etc., is also applied to the other image. However, movement and enlargement / reduction are only relative changes. That is, when one image is doubled, the other image is doubled.

  Regarding rotation, even if an image displayed from the same angle is displayed almost anatomically in terms of apparatus, it may differ due to a slight change in the orientation of the patient before imaging. This image processing apparatus has two types of functions for correcting such deviation.

  The first function is a method for specifying three anatomically matching points on both images A and B. For example, it is assumed that the specified points are (aA, bA, cA) on the image A and (aB, bB, cB) on the image B. Furthermore, it is assumed that aA-aB, bA-bB, and cA-cB are anatomically coincident points. At this time, this correction can be made by calculating so that the straight lines aAbA and aBbB are in the same direction and aAcA and aBcB are in the same direction.

  Another function is the manual operation method. When an operation is performed while pressing a special button to which an arbitrary function is given, for example, a rotation operation while pressing the SHIFT key of the keyboard, the processing is performed only on one image. When the SHIFT key is released, the synchronization state is restored. However, at this time, whether it is the first method or the later method, the amount of change from the first synchronization state is stored as an error, and the subsequent synchronization is displayed after correcting the error. When the synchronization is stopped, the synchronization state is canceled by turning off the synchronization switch.

  FIG. 3 shows an example of a three-dimensional image that has been subjected to image processing by the image processing device according to the first embodiment of the present invention and displayed on the display device 15. A three-dimensional image of the site to be observed is displayed on the display screen 19 of the display monitor 17, and two images are shown in FIG. These two images are displayed in synchronization with each other, and when one of the scale, observation angle, and magnification is manipulated, the other three-dimensional image display is also changed in synchronization. In this way, a plurality of three-dimensional images can always be compared under the same conditions.

  In the present embodiment, the case where two three-dimensional display images are displayed has been described. However, the present invention is not limited to the number of images, and, for example, three or more image displays are possible. In this embodiment, the image processing apparatus, the inspection apparatus, and the image database 1 are all described as separate apparatuses. However, the present invention is not limited to the groove, and two or all of these apparatuses are described. Can be implemented even if they are configured in one apparatus.

<Second Embodiment>
A second embodiment of the present invention will be described below. The description of the same configuration as that of the first embodiment is omitted.

  Consider a case where the three-dimensional images A and B registered in the image database 1 are three-dimensionally displayed on the image processing apparatus. The images A and B may be images taken with the same modality or images taken with different modalities. Each display image has a different display angle and enlargement ratio unless they are intentionally matched, and the same enlargement ratio can be obtained from the same angle without bothering the operator by inputting synchronization instructions. Display image.

  Here, the synchronization of the enlargement ratio refers to displaying the physically same length on the display device. For example, if the current image A is a controllable image, the display angle and enlargement ratio of the image B are rotated so as to match the display angle of the image A. This does not simply match the initial display angle and the amount of change from the initial enlargement check, but takes into account the orientation of the image and the pixel pitch, so that it is observed from the same angle anatomically. Is converted into the same length on the display device.

  Here, the observation angle is the same as that in the first embodiment, and thus the description thereof is omitted. Regarding the enlargement ratio, for example, in the case of a CT apparatus, the pixel pitch on the tomographic plane is determined by the imaging region and matrix size, and the body axis direction is determined by the bed movement width (bed movement speed in the case of the helical scan method), the collimator width, and the like. Pixel pitch is determined. Assume that the pixel pitch in the tomographic plane and the body axis direction is 0.5 mm in the image A, and that the pixel pitch in the tomographic plane and the body axis direction is 0.7 mm in the image B. Even if the region is photographed, the image A is enlarged and displayed by 1.4 times more than the image B in the initial state.

  When the synchronous switch is ON, the pixel pitch is also corrected in consideration of this, and in this example, for example, if the image A is controllable and 1.2 times enlarged from the current initial display state, the image B is 1.68 (= 1.2 × 1.4) times enlarged and displayed. While the synchronization switch is ON, processing applied to one image, for example, rotation, movement, enlargement / reduction, etc., is also applied to the other image.

However, the movement is only a relative change. That is, when one image is moved 5 mm in the z-axis direction, the other image is also moved 5 mm in the z-axis direction. However, with regard to rotation and enlargement, even when displaying images displayed at almost the same anatomical angle and magnification, the observation angle is changed due to slight changes in the orientation of the patient before imaging, distortion of the captured image, etc. And the enlargement ratio may be different. Since the correction method for the observation angle has been described in the first embodiment, only the correction of the enlargement factor will be described here.

  The image processing apparatus of the present invention has two types of functions for correcting such deviation. The first function is a method for specifying two anatomically matching points on both images A and B. For example, when two of the points specified for specifying the angle error, (aA, bA) on image A, (aB, bB) on image B are used, or when it is determined that there is no angle error May specify (aA, bA) on image A and (aB, bB) on image B for only two points. At this time, this correction is possible by calculating the enlargement ratio so that the straight lines aAbA and aBbB have the same length.

  Another function is a manual operation method. When an operation is performed while pressing a button to which a predetermined function is assigned, for example, when an enlargement operation is performed while pressing the SHIFT key of the keyboard, processing is performed only on one image. When the SHIFT key is pressed, the synchronization state is restored. However, at this time, in both the former method and the latter method, the amount of change from the initial synchronization state is stored as an error, and the subsequent synchronization is displayed after correcting the error. When the synchronization is stopped, the synchronization state is canceled by turning off the synchronization switch.

  In this embodiment, the case where two three-dimensional display images are displayed has been described. Of course, the number of images is not limited, and three or more images can be processed simultaneously.

<Third Embodiment>
In the description of the third embodiment of the present invention, the description of the same parts as those of the first and second embodiments described above will be omitted. The system configuration is the same as that of the first embodiment.

  For example, the case where the three-dimensional images A and B registered in the image database 1 are three-dimensionally displayed on the image processing apparatus will be described. The images A and B may be images taken with the same modality or images taken with different modalities. Unless each display image is intentionally matched by the operator's intention, the displayed angle and display image processing are different. Therefore, by turning on the synchronization switch, the display image of the same surface image processing is obtained from the same angle without bothering the operator.

  For example, if the current image A is a controllable image, the display angle of image B and the display image processing are rotated and displayed so as to match the display angle of image A and the display image processing. This does not simply match the initial display angle and the amount of change from the image processing for initial display, but refers to changing the image so that it is observed from the same angle anatomically considering the orientation of the image. is there.

  Similarly, the same processing is performed on the display image processing. Here, two typical types of image processing will be described. In the surface rendering method, a threshold value is set, a region that falls within the threshold value range is set as a target region, and a pseudo operation is performed as if light hits the target from any direction, and the reflected light is calculated. A display image is calculated by calculating.

  Processing is performed so that the threshold, the position of the light source, the intensity, the target color, and the like at this time match. In the volume rendering method, a function (optical conversion function) for converting the number of pixels into optical parameters such as reflectance and refractive index is defined, and the reflected light is applied to the object from any direction. The display image data is calculated by calculating. Unlike the surface rendering method, the surface rendering method can clearly define the surface of an object and cannot display information hidden behind the surface.

  On the other hand, in volume rendering, depending on the definition of the optical conversion function, for example, the internal structure can be visualized so that the object looks blurred in fog.

  When the synchronization switch is turned on, the optical conversion function, the position of the light source, the intensity, the target color, etc. are processed so as to match. When the synchronization is stopped, the synchronization state is canceled by turning off the synchronization switch. In this embodiment, the case where two three-dimensional display screens are displayed has been described. Of course, the number of images is not limited and three or more image processes are possible.

<Fourth embodiment>
Regarding the description of the fourth embodiment of the present invention, the description overlapping with the first to third embodiments will be omitted. The system configuration of the image processing apparatus according to the fourth embodiment is the same as that of the first embodiment.

  A case where the three-dimensional images A and B registered in the image database 1 are three-dimensionally displayed on the image processing apparatus is taken as an example for explanation. In this example, the images A and B may be images shot with the same modality, or may be images shot with different modalities. Each display image has different display angle, enlargement ratio, and display image processing unless the operator deliberately matches them. By turning on the synchronization switch, the operator's hand is not bothered. The display images have the same angle, the same magnification, and the same surface treatment.

  For example, if the current image A is a controllable image, the display angle, enlargement ratio, and display image processing of the image B are rotated, enlarged, and matched to the display angle, enlargement ratio, and display image processing of the image A. Displayed in a reduced size. This is not just matching the initial display angle, the initial magnification, and the amount of change from the initial display image processing, but is observed from the same anatomical angle and the same size in consideration of the orientation of the image. It is to be changed as follows. Similarly, the same processing is performed on the display image processing. However, the optical conversion function at this time is corrected by the pixel pitch. For example, the pixel pitch of the image A is m, the pixel pitch of the image A is n, and the optical conversion function of the image B is corrected by the following function.

ここで反射率γは以下のような数式でモデル化しており、Ｎは画素値を示している。

ここでｘは距離を示す。この同期をやめる際は、同期スイッチをＯＦＦにすることにより同期状態は解除される。

Here, the reflectance γ is modeled by the following mathematical formula, and N indicates a pixel value.

Here, x represents a distance. When the synchronization is stopped, the synchronization state is canceled by turning off the synchronization switch.

  In this embodiment, the case where two three-dimensional display images are displayed has been described. However, the present invention is not limited to the number of images, and even three or more grooves are not formed.

<Fifth embodiment>
Of the present embodiment, the same portions as those of the first, second, third, and fourth embodiments are not described. The system composition is the same as in the first embodiment.

  A case where the three-dimensional images A and B registered in the image database 1 are three-dimensionally displayed on the image processing apparatus is taken as an example for explanation. The images A and B may be images taken with the same modality or images taken with different modalities. Each display image has a different angle, magnification, and display image processing unless the operator deliberately matches it, and automatically displays from the same angle by turning on the synchronization switch. Become an image. The enlargement ratio may be corrected, or if it is an image taken with the same modality and under the same conditions, there is no need to correct it, and if necessary, it may be corrected manually in advance. Moreover, you may correct | amend by the same method as 2nd Embodiment demonstrated previously. The display conditions can also be corrected by the method described in the third embodiment described above.

  The synthesizing (fusion) switch can be pushed from this synchronized state. In this case, the correction is performed by making the designated positions misalign with each other, and then the three-dimensional synthesis is performed. Once the synchronization switch is turned ON, the angle deviation, position deviation, and enlargement ratio deviation information between images is saved, and when the composition switch is pressed again, the display angle, position, and enlargement ratio are corrected to match. The synthesis is performed later.

<Sixth Embodiment>
The sixth embodiment of the present invention can be implemented as long as the basic configuration of the image processing apparatus is at least the same as any of the first to fifth embodiments described above. Portions overlapping with the first to fifth embodiments are omitted.

In the volume rendering method, pixel values are converted into optical parameters such as reflectance and refractive index, and a display image is calculated on the assumption that light is applied to an object configured with the optical parameters. In general, synthesis is performed by synthesizing alternate pixels every other pixel into one image. However, in the image processing apparatus of the present invention, the optical parameters of the composite image are calculated as follows using the optical parameters μA and μB of the converted images A and B.
μ = f (μA, μB)
At this time, f represents an arbitrary function, and is used as the following two types, for example.
μ = μA + μB
Or
μ = μA−μB

  By using the former, an image with good resolution can be obtained. Also, by using the latter, the difference between the image A and the image B can be clearly observed.

  Further, as a modification, instead of the method of combining optical parameters, after processing as separate images, they may be combined on the display image line. In this example, for example, by setting different colors, intensities, light source positions, and the like for each image, it is possible to clarify the distinction between the two while being a combined thumbtack.

  In another modification, a different color is used for each image. For example, a range of pixel values is specified and an area included in the range is determined, and a color between a portion where the regions overlap and a portion that does not overlap May be changed. Thereby, the distinction between the two at the site of interest can be made clear.

<Seventh embodiment>
The seventh embodiment of the present invention can be implemented even if the basic configuration of the image processing apparatus is the same as any of the first to sixth embodiments described above, and in the following description, Assuming that the basic configuration is the same as that of any of the first to sixth embodiments, the overlapping portion will be omitted.

  Diagnosis is performed based on the diagnostic image, patient data, and examination data read into the image processing apparatus, and the result is stored as a diagnostic result. At this time, the diagnosis database is composed of “part”, “disease name”, “comment (background of the diagnosis)”, and the like are registered in the database. In addition, this may include a dictionary indicating “part”, a dictionary indicating “disease name”, and the like based on the contents of the reporting system, and keywords that hit these may be extracted and automatically registered in the database.

  When making a diagnosis using the database constructed in this way, if information useful for a new diagnosis, such as an image or a test result, is added, a diagnosis is made based on the result, and the result is Follow the procedure to register in the database. At this time, past data of this patient is searched, and the contents are compared, and if there is diagnostic information in the same part or related part, the contents are displayed in a popup window as “diagnosis date”, “diagnostic”, “ If you want to observe the details of a case, part, etc., by clicking the detail button on the window, refer to the examination contents of the image, the results at that time (for example, the background to the diagnosis), etc. it can.

  According to the embodiment of the present invention described above, by turning on the synchronization switch, the observation angle, the enlargement ratio, and the display image processing are displayed synchronously based on the photographing conditions and display parameters unique to the photographing apparatus. Therefore, it is easy to compare the three-dimensional images, and it is easy to confirm the change with time and the treatment effect of the affected area.

  Further, by turning on the synchronization switch, the observation angle can be synchronized based on the photographing angle information unique to the photographing apparatus.

  In addition, the observation angle and magnification can be synchronized based on the imaging information unique to the imaging device, and the observation angle, magnification, and display image processing can be synchronized based on the imaging conditions and display parameters specific to the imaging device. can do.

  The embodiment described above is described in order to facilitate understanding of the present invention, and is not described in order to limit the present invention. Therefore, each element disclosed in the above embodiment includes all design changes and equivalents belonging to the technical scope of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... Image database, 2 ... 1st image processing apparatus (image processing apparatus), 3 ... 2nd image processing apparatus (image processing apparatus), 8 ... Network, 9 ... Image Memory, 10 ... 3D AFIN processing (AFIN), 11 ... 3D image processing, 12 ... LUT, 15 ... Display unit (monitor)

Claims (1)

In an image processing apparatus capable of processing a plurality of three-dimensional images,
Synchronization means for synchronously processing the second three-dimensional image so as to be in the same mode as the first three-dimensional image according to a predetermined operation;
Means for synthesizing the synchronized three-dimensional first image and the second three-dimensional image so as to match specified points;
Display means capable of displaying the synthesized first 3D image and second 3D image;
An image processing apparatus comprising:

Images