JP2011083619A - Image processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processor capable of synchronously displaying a plurality of images and facilitating comparison of images and confirmation of changes with time and a therapeutic effect. <P>SOLUTION: A CT device 4, an MRI device 5, an ultrasonic device 6 and an X-ray device 7 for photographing a subject are connected to a network 8. Diagnostic images are stored in an image database 1 through the network 8. A plurality of image processors such as a first image processor 2 and a second image processor 3 are connected to the network 8. A plurality of diagnostic images are simultaneously displayed, and the observation direction, magnification, scale, etc. of images can be synchronously displayed by a single operation by a CPU 14, an image memory 9, three-dimensional image processing 11, etc. A color code display of overlapped portions can also be made while further allowing a display of medical information serving to assist a diagnosis and a medical examination by a medical information providing means. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

The present invention relates to an image processing apparatus that displays medical images and medical information obtained by an image diagnostic apparatus.

Conventionally, an image processing apparatus capable of image display and image processing is used to observe a medical image of a patient photographed by a medical image diagnostic apparatus or the like. This image processing apparatus can observe a three-dimensional image in addition to displaying a two-dimensional image. At the time of this observation, for comparison, for example, the images can be easily compared by observing with the observation angle and magnification rate of each image display being exactly the same. Some apparatuses that display a three-dimensional image can display a plurality of three-dimensional images.

A plurality of images displayed by an image processing apparatus including the conventional image monitor 18 shown in FIG. 4 are mainly operated separately for each display image. There is also an image processing device that can operate multiple display images at a time, but it only synchronizes the change from the display state at that time, for example, it can be operated at once to display in angle synchronization It is executed by an operation of at least two actions that the angle of two images is set to be the same by the apparatus and a display function to be operated at once is selected. Two three-dimensional images are displayed on the display screen 20, but the display scales of the two are not synchronized with each other, and several steps of operations are required to synchronize them.

JP-A-8-212325

However, the conventional image processing apparatus has the following problems to be solved.
In the operation method of the display image, in order to confirm the change of the displayed affected part image and the therapeutic effect, the image processing operations such as the observation angle, the enlargement ratio, and the display image processing are made the same for a plurality of images by manual operation. It was necessary to observe.

The time, labor, and labor of these operations, which require more skill, have been an obstacle to spreading comparative interpretation of 3D images. Diagnosis and usefulness of comparative interpretation in clinical medicine
The examination method has already been widely recognized in two-dimensional images such as X-ray imaging, CT, and MRI tomographic images. Similarly, it is not difficult to imagine that comparative interpretation of a three-dimensional image is useful, and an image processing apparatus that can synchronize an imaging angle, an enlargement ratio, and display image processing has been desired.

The image processing apparatus according to the present invention solves these problems, and can display and synchronize a plurality of images for display operation and image processing, facilitate comparison of images, and confirm change over time and treatment effect. It is another object of the present invention to provide an image processing apparatus capable of providing medical information to assist diagnosis and diagnosis.

According to an embodiment for solving the above problems, in an image processing apparatus capable of processing a plurality of diagnostic images, a synchronization setting means for an operator to set a synchronization state, and a first of the plurality of diagnostic images. When the synchronization state is set by the display unit capable of displaying one diagnostic image and the second diagnostic image and the synchronization setting unit, based on incidental information attached to the second diagnostic image according to a predetermined operation When the second diagnostic image is synchronized so that the first diagnostic image displayed on the display means is in the same mode, and the synchronization state is not set, the synchronization processing is not performed according to the predetermined operation. And a synchronization processing means for processing only the second diagnostic image.

Further, the display synchronization means includes an enlargement ratio synchronization means for synchronizing the enlargement ratios of the three-dimensional images with each other. The display synchronization means includes image processing synchronization means for synchronizing image processing performed on the three-dimensional images with each other. The observation angle is synchronized with a coordinate system defined in the photographing means for photographing the three-dimensional image. The enlargement ratio synchronization means makes the display scales of the displayed three-dimensional images the same. In the image processing, at least one of an image display method, a position and intensity of a light source, an optical conversion function, and a display color is performed.

Further, there is fine adjustment means capable of arbitrarily finely adjusting the observation angle and the enlargement ratio. The fine adjustment means performs fine adjustment by specifying a plurality of clinically identical points on the plurality of three-dimensional images. The fine adjustment means performs the fine adjustment by inputting error information with an input device for fine adjustment. The image synthesizing unit is capable of synthesizing a plurality of the three-dimensional images in which the observation angle and the magnification rate are synchronized with each other. Image synthesis by the image synthesis means is synthesized based on a function of optical parameters. The function of the optical parameter is a function calculation of the optical parameter. The image synthesizing means includes color classification means capable of performing color-coded display with different display colors of the three-dimensional images synthesized. The image synthesizing means includes area color coding means capable of displaying different display areas and the same display areas in the three-dimensional image displayed after the image synthesis by color coding.

Further, in an image processing apparatus capable of performing image processing on a plurality of image data obtained from a patient, information provided from at least a patient database and a diagnostic database obtained by the patient examination, and an image base configured by the image data, respectively. And a medical information providing means capable of providing medical information for assisting diagnosis and diagnosis based on the comparison result of the contents of the diagnostic information database.

FIG. 1 is a schematic diagram for explaining a configuration of an image processing apparatus according to an embodiment of the present invention. FIG. 1 is a schematic diagram for explaining a configuration of an image processing apparatus according to an embodiment of the present invention. An example of the screen display by the image processing apparatus by embodiment of this invention is shown. An example of screen display by a conventional image processing apparatus is shown.

<First Embodiment>
FIG. 1 is a schematic diagram for explaining the configuration of an image processing apparatus according to a first embodiment of the present invention.

The configuration of this image processing apparatus is connected to an image diagnostic apparatus such as a CT apparatus 4, an MRI apparatus 5, an ultrasonic apparatus 6, an X-ray apparatus 7 or a nuclear medicine apparatus and an image database 1 via a network 8. In each imaging apparatus, a three-dimensional image obtained by three-dimensionally imaging the internal structure of the patient is reconstructed, and the generated image is stored in the image database 1. The image processing apparatus is 1
A plurality of image processing apparatuses such as a first image processing apparatus 2 and a second image processing apparatus 3 are connected to the network 8 as shown in FIG.

2 is a schematic diagram for explaining the internal configuration of the first image processing apparatus 2 and the second image processing apparatus 3 shown in FIG. The configuration of the image processing apparatus includes a CPU 14 for controlling the entire processing, an input device 13 for inputting patient and image selection and angle information, an image memory 9 for storing a three-dimensional image, a three-dimensional enlargement / reduction / movement, Rotating 3D AF
IN processing unit 10, 3D image processing such as volume rendering processing and surface rendering processing, 3D image processing unit 11 constituting 3D display image, LUT (Look Up Table) for converting gradation of 3D display image ) 12, a display unit (monitor) 15 that displays a three-dimensional display image, and a signal bus 16 that performs signal transmission in information transmission and reception.

The image database 1 stores not only a three-dimensional image but also patient / imaging information attached to the image, information indicating the orientation of the image, and the like. Three-dimensional AFIN processing 1
The CPU 14 may also serve as the 0 and 3D image processing 11. The display device 15 has a plurality of display areas and can display a plurality of three-dimensional display images at a time. The structure may be a multi-window display or a plurality of monitors.

  Next, the overall operation of the image processing apparatus will be described.

For example, consider a case where the three-dimensional images A and B registered in the image database 1 are three-dimensionally displayed on the image processing apparatus. The images A and B may be images taken with the same modality or images taken with different modalities. Each display image usually has a different displayed angle unless it is intentionally matched.
By setting it to N, a display image from the same angle is obtained without intentional operation by the operator.

At this time, for example, if the current image A is a controllable image, the display angle of the image B is rotated so as to coincide with the display angle of the image A. This indicates that the change amount from the initial display angle is not made coincident, but conversion is performed so that the image is observed from the same angle in consideration of the orientation of the image. For example, in the example of the CT apparatus 4, the patient insertion direction, the image observation direction, the patient body position, and the like are listed as information indicating the image orientation.

The order in which the reconstructed three-dimensional images are arranged changes depending on whether the patient is inserted into the CT apparatus 4 from the head or the foot. These are expressed as Top First (TF: Images are configured in order from the top of the head) / Foot First (FF: Images are configured in the order from the foot-and-tail direction). The image observation direction indicates the direction in which the image is observed, and View from Top (VFT: image viewed from the top of the head) / View from
m Foot (VFF: image viewed from the foot-and-tail direction).

The patient position indicates, for example, whether the patient is facing up, down, left, or right at the time of imaging. Therefore, for example, even if the image A and the image B are both at the initial display angle, it is assumed that the orientation of the image A is VFT and TF, and the orientation of the image B is VFF and FF. Assuming that both of the patient positions are upward, in this case, by inverting the image B up and down, the observation angles of both coincide.

In the case of the MR1 apparatus, since the tomographic plane can be freely set for the patient, more detailed orientation information is required, but the principle is the same. While the synchronization switch is ON, processing applied to one image, for example, rotation, movement, enlargement / reduction, etc., is also applied to the other image. However, movement and enlargement / reduction are only relative changes. That is, when one image is doubled, the other image is doubled.

Regarding rotation, even if an image displayed from the same angle is displayed almost anatomically in terms of apparatus, it may differ due to a slight change in the orientation of the patient before imaging. This image processing apparatus has two types of functions for correcting such deviation.

The first function is a method for specifying three anatomically matching points on both images A and B.
For example, the identified points are (aA, bA, cA) on image A, and (aB, bB, cB) on image B.
And Furthermore, it is assumed that aA-aB, bA-bB, and cA-cB are anatomically coincident points. At this time, the straight lines aAbA and aBbB are in the same direction, and aAcA and a
This correction is possible by calculating so that BcB is in the same direction.

Another function is a method by manual operation. In the operation while pressing a special button to which an arbitrary function is given, for example, a rotation operation while pressing the SHIFT key of the keyboard,
Processing is performed on only one image, and the state returns to the synchronized state when the SHIFT key is released. However, at this time, whether it is the first method or the later method, the amount of change from the first synchronization state is stored as an error, and the subsequent synchronization is displayed after correcting the error. When the synchronization is stopped, the synchronization state is canceled by turning off the synchronization switch.

In FIG. 3, the image processing apparatus according to the first embodiment of the present invention performs image processing, and the display apparatus 1
An example of the three-dimensional image displayed at 5 is shown. A three-dimensional image of the site to be observed is displayed on the display screen 19 of the display monitor 17, and two images are shown in FIG. These two images are displayed in synchronization with each other, and when one of the scale, observation angle, and magnification is manipulated, the other three-dimensional image display is also changed in synchronization. In this way, a plurality of three-dimensional images can always be compared under the same conditions.

In the present embodiment, the case where two three-dimensional display images are displayed has been described. However, the present invention is not limited to the number of images, and, for example, three or more image displays are possible. In this embodiment, the image processing apparatus, the inspection apparatus, and the image database 1 are all described as separate apparatuses. However, the present invention is not limited to the configuration, and two or all of these apparatuses are included. Even if it is configured in one apparatus, it can be implemented.

<Second Embodiment>
A second embodiment of the present invention will be described below. The description of the same configuration as that of the first embodiment is omitted.

Consider a case where the three-dimensional images A and B registered in the image database 1 are three-dimensionally displayed on the image processing apparatus. The images A and B may be images taken with the same modality or images taken with different modalities. Each display image has a different display angle and enlargement ratio unless they are intentionally matched, and the same enlargement ratio can be obtained from the same angle without bothering the operator by inputting synchronization instructions. Display image.

Here, the synchronization of the enlargement ratio refers to displaying the physically same length on the display device. For example, if the current image A is a controllable image, the display angle and enlargement ratio of the image B are rotated so as to match the display angle of the image A. This does not simply match the initial display angle and the amount of change from the initial enlargement check, but takes into account the orientation of the image and the pixel pitch, so that it is observed from the same angle anatomically. Is converted into the same length on the display device.

Here, the observation angle is the same as that in the first embodiment, and thus the description thereof is omitted. Regarding the enlargement ratio, for example, in the case of a CT apparatus, the pixel pitch on the tomographic plane is determined by the imaging region and matrix size, and the body axis direction is determined by the bed movement width (bed movement speed in the case of the helical scan method), the collimator width, and the like. Pixel pitch is determined. Assume that the pixel pitch in the tomographic plane and the body axis direction is 0.5 mm in the image A, and that the pixel pitch in the tomographic plane and the body axis direction is 0.7 mm in the image B. Even if the region is imaged, the image A is enlarged and displayed 1.4 times larger than the image B in the initial state.

When the synchronous switch is ON, the pixel pitch is also corrected in consideration of this, and in this example, for example, if the image A is controllable and 1.2 times enlarged from the current initial display state, the image B is 1.68 (= 1.2 × 1.4) times enlarged and displayed. While the synchronization switch is ON, processing applied to one image, for example, rotation, movement, enlargement / reduction, etc., is also applied to the other image.

However, the movement is only a relative change. That is, one image is 5m in the z-axis direction.
When moving m, the other image also moves 5 mm in the z-axis direction. However, with regard to rotation and enlargement, even when displaying images displayed at almost the same anatomical angle and magnification, the observation angle and The enlargement ratio may be different. Since the correction method for the observation angle has been described in the first embodiment, only the correction of the enlargement factor will be described here.

The image processing apparatus of the present invention has two types of functions for correcting such deviation. The first function is a method for specifying two anatomically matching points on both images A and B. For example, two of the points designated for specifying the angle error, (aA, bA) on the image A, (aB,
bB) is used, or when it is determined that there is no angle error, only two points on image A (
aA, bA) and (aB, bB) on the image B may be designated. At this time, straight lines aAbA and aB
This correction is possible by calculating the enlargement ratio so that bB has the same length.

Another function is a manual operation method. When an operation is performed while pressing a button to which a predetermined function is assigned, for example, when an enlargement operation is performed while pressing the SHIFT key of the keyboard, processing is performed only on one image. When the SHIFT key is pressed, the synchronization state is restored. However, at this time, in both the former method and the latter method, the amount of change from the initial synchronization state is stored as an error, and the subsequent synchronization is displayed after correcting the error. When the synchronization is stopped, the synchronization state is canceled by turning off the synchronization switch.

In this embodiment, the case where two three-dimensional display images are displayed has been described. Of course, the number of images is not limited, and three or more images can be processed simultaneously.

<Third Embodiment>
In the description of the third embodiment of the present invention, the description of the same parts as those of the first and second embodiments described above will be omitted. The system configuration is the same as that of the first embodiment.

For example, the case where the three-dimensional images A and B registered in the image database 1 are three-dimensionally displayed on the image processing apparatus will be described. The images A and B may be images taken with the same modality or images taken with different modalities. Unless each display image is intentionally matched by the operator's intention, the displayed angle and display image processing are different. Therefore, by turning on the synchronization switch, the display image of the same surface image processing is obtained from the same angle without bothering the operator.

For example, if the current image A is a controllable image, the display angle of image B and the display image processing are rotated and displayed so as to match the display angle of image A and the display image processing. This does not simply match the initial display angle and the amount of change from the initial display image processing.
Considering the orientation of the image, it means changing to be observed from the same angle anatomically.

Similarly, the same processing is performed on the display image processing. Here, two typical types of image processing will be described. In the surface rendering method, a threshold value is set, a region that falls within the threshold value range is set as a target region, and a pseudo operation is performed as if light hits the target from any direction, and the reflected light is calculated. A display image is calculated by calculating.

Processing is performed so that the threshold, the position of the light source, the intensity, the target color, and the like at this time match. In the volume rendering method, a function (optical conversion function) for converting the number of pixels into optical parameters such as reflectance and refractive index is defined, and the reflected light is applied to the object from any direction. The display image data is calculated by calculating. Unlike the surface rendering method, the surface rendering method can clearly define the surface of an object and cannot display information hidden behind the surface.

On the other hand, in volume rendering, depending on the definition of the optical conversion function, for example, the internal structure can be visualized so that the object looks blurred in fog.

When the synchronization switch is turned on, the optical conversion function, the position of the light source, the intensity, the target color, etc. are processed so as to match. When the synchronization is stopped, the synchronization state is canceled by turning off the synchronization switch. In this embodiment, the case where two three-dimensional display screens are displayed has been described. Of course, the number of images is not limited and three or more image processes are possible.

<Fourth embodiment>
Regarding the description of the fourth embodiment of the present invention, the description overlapping with the first to third embodiments will be omitted. The system configuration of the image processing apparatus according to the fourth embodiment is the same as that of the first embodiment. A case where the three-dimensional images A and B registered in the image database 1 are three-dimensionally displayed on the image processing apparatus is taken as an example for explanation. In this example, the images A and B may be images taken with the same modality or may be images taken with different modalities. Each display image has different display angle, enlargement ratio, and display image processing unless the operator deliberately matches them. By turning on the synchronization switch, the operator's hand is not bothered. The display images have the same angle, the same magnification, and the same surface treatment.

For example, if the current image A is a controllable image, the display angle, enlargement ratio, and display image processing of the image B are rotated, enlarged, and matched to the display angle, enlargement ratio, and display image processing of the image A. Displayed in a reduced size. This is not just matching the initial display angle, the initial magnification, and the amount of change from the initial display image processing, but is observed from the same anatomical angle and the same size in consideration of the orientation of the image. It is to be changed as follows. Similarly, the same processing is performed on the display image processing. However, the optical conversion function at this time is corrected by the pixel pitch. For example, the pixel pitch of the image A is m, the pixel pitch of the image B is n, and the optical conversion function of the image B is corrected by the following function.

ここでｘは距離を示す。この同期をやめる際は、同期スイッチをＯＦＦにすることによ
り同期状態は解除される。 Here, the reflectance γ is modeled by the following mathematical formula, and N indicates a pixel value.

Here, x represents a distance. When the synchronization is stopped, the synchronization state is canceled by turning off the synchronization switch.

In the present embodiment, the case where two three-dimensional display images are displayed has been described. However, the present invention is not limited to the number of images, and may be three or more.

<Fifth embodiment>
Of the present embodiment, the same portions as those of the first, second, third, and fourth embodiments will not be described. The system composition is the same as in the first embodiment.

A case where the three-dimensional images A and B registered in the image database 1 are three-dimensionally displayed on the image processing apparatus is taken as an example for explanation. The images A and B may be images taken with the same modality or images taken with different modalities. Each display image has a different angle, magnification, and display image processing unless the operator deliberately matches it, and automatically displays from the same angle by turning on the synchronization switch. Become an image. The enlargement ratio may be corrected, or if it is an image taken with the same modality and under the same conditions, there is no need to correct it, and if necessary, it may be corrected manually in advance. Moreover, you may correct | amend by the same method as 2nd Embodiment demonstrated previously. The display conditions can also be corrected by the method described in the third embodiment described above.

The synthesizing (fusion) switch can be pushed from this synchronized state. In this case, the correction is performed by making the designated positions misalign with each other, and then the three-dimensional synthesis is performed.
Once the synchronization switch is turned ON, the angle deviation, position deviation, and enlargement ratio deviation information between images is saved, and when the composition switch is pressed again, the display angle, position, and enlargement ratio are corrected to match. The synthesis is performed later.

<Sixth Embodiment>
The sixth embodiment of the present invention can be implemented as long as the basic configuration of the image processing apparatus is at least the same as any of the first to fifth embodiments described above. Portions overlapping with the first to fifth embodiments are omitted.

In the volume rendering method, pixel values are converted into optical parameters such as reflectance and refractive index, and a display image is calculated on the assumption that light is applied to an object configured with the optical parameters. In general, synthesis is performed by synthesizing alternate pixels every other pixel into one image. However, in the image processing apparatus of the present invention, the optical parameters of the composite image are calculated as follows using the optical parameters μA and μB of the converted images A and B.

μ = f (μA, μB)
At this time, f represents an arbitrary function, and is used as the following two types, for example.

μ = μA + μB
Or
μ = μA−μB
By using the former, an image with good resolution can be obtained. Also, by using the latter, the difference between the image A and the image B can be clearly observed.

Further, as a modification, instead of the method of combining optical parameters, after processing as separate images, they may be combined on the display image line. In this example, for example, different colors, intensities,
By setting the position of the light source and the like, it is possible to clarify the distinction between the two while being a combined thumbtack.

In another modification, a different color is used for each image. For example, a range of pixel values is specified and an area included in the range is determined, and a color between a portion where the regions overlap and a portion that does not overlap May be changed. Thereby, the distinction between the two at the site of interest can be made clear.

<Seventh embodiment>
The seventh embodiment of the present invention can be implemented even if the basic configuration of the image processing apparatus is the same as any of the first to sixth embodiments described above, and in the following description, Assuming that the basic configuration is the same as that of any of the first to sixth embodiments, the overlapping portion will be omitted.

Diagnosis is performed based on the diagnostic image, patient data, and examination data read into the image processing apparatus, and the result is stored as a diagnostic result. At this time, the diagnosis database is composed of “part”, “disease name”, “comment (background of the diagnosis)”, and the like are registered in the database. In addition, this may include a dictionary indicating “part”, a dictionary indicating “disease name”, and the like based on the contents of the reporting system, and keywords that hit these may be extracted and automatically registered in the database.

When making a diagnosis using the database constructed in this way, if information useful for a new diagnosis, such as an image or a test result, is added, a diagnosis is made based on the result, and the result is Follow the procedure to register in the database. At this time, past data of this patient is searched, and the contents are compared, and if there is diagnostic information in the same part or related part, the contents are displayed in a popup window as “diagnosis date”, “diagnostic”, “ "Case", "part" etc.,
When it is desired to observe the details, by pressing a detail button on the window, it is possible to refer to the examination contents such as the image, the result at that time (for example, the background to the diagnosis), and the like.

According to the embodiment of the present invention described above, by turning on the synchronization switch, the observation angle, the enlargement ratio, and the display image processing are displayed synchronously based on the photographing conditions and display parameters unique to the photographing apparatus. Therefore, it is easy to compare the three-dimensional images, and it is easy to confirm the change with time and the treatment effect of the affected area.

Further, by turning on the synchronization switch, the observation angle can be synchronized based on the photographing angle information unique to the photographing apparatus.

In addition, the observation angle and magnification can be synchronized based on the imaging information unique to the imaging device, and the observation angle, magnification, and display image processing can be synchronized based on the imaging conditions and display parameters specific to the imaging device. can do.

The embodiment described above is described in order to facilitate understanding of the present invention, and is not described in order to limit the present invention. Therefore, each element disclosed in the above embodiment includes all design changes and equivalents belonging to the technical scope of the present invention.

According to the embodiment for implementing the invention configured as described above, it is possible to display a plurality of images in synchronization with display operation and image processing, to easily compare images, and to easily check changes over time and treatment effects. An image processing apparatus can be provided.

DESCRIPTION OF SYMBOLS 1 ... Image database 2 ... 1st image processing apparatus (image processing apparatus)
3 ... Second image processing apparatus (image processing apparatus)
8 ... Network 9 ... Image memory 10 ... 3D AFIN processing (AFIN)
11 ... 3D image processing 12 ... LUT
15 ... Display section (monitor)

Claims (1)

In an image processing apparatus capable of processing a plurality of diagnostic images,
Synchronization setting means for the operator to set the synchronization state;
Display means capable of displaying a first diagnostic image and a second diagnostic image among the plurality of diagnostic images;
When the synchronization state is set by the synchronization setting means, the second operation is performed according to a predetermined operation.
The second diagnostic image is synchronized with the second diagnostic image so as to be in the same mode as the first diagnostic image displayed on the display means based on the incidental information attached to the diagnostic image,
If the synchronization state is not set, synchronization processing means for processing only the second diagnostic image without performing the synchronization processing according to the predetermined operation;
An image processing apparatus comprising:

Images