JP2012000135A - Multi-modality dynamic image diagnostic apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system enabling interpretation of radiogram while referring to dynamic images photographed by plural diagnostic apparatuses simultaneously on the display screens by synchronizing with the synchronization signal such as an electrocardiographic complex.SOLUTION: The image diagnostic apparatus takes the image data imaged by a first diagnostic device photographing repeated images having different frame rates, and a second diagnostic device photographing continuous images, respectively and performs image processing. The apparatus includes: an input device for inputting data in the image diagnostic device; a storage unit for storing data including the repeated and continuous images; a display unit for displaying the image including the repeated and continuous images; a synchronizing signal generator for generating a synchronizing signal in conjunction with photography of the continuous image; and a processor for correcting the frame rate of the repeated image so as to be synchronized with the synchronizing signal. The repeated image and continuous image are simultaneously displayed on the display while synchronizing.

Description

  The present invention relates to an image diagnostic apparatus, for example, a multi-modality moving image that simultaneously displays a plurality of pieces of synchronized image data information acquired by different image diagnostic apparatuses and enables diagnosis while referring to the display screen. The present invention relates to a diagnostic device.

  Real-time morphological image acquisition technology using various diagnostic imaging devices (modalities), such as CT (Computed Tomography) devices, SPECT (Single Photon Emission Computed Tomography) devices, and US (ultrasound diagnostics) devices, has advanced in real time. In addition to 2D images, 3D (3D) images can be captured and collected. Furthermore, with the increase in network speed and storage capacity, it has become possible to record long-time movies and use them for interpretation.

  On the other hand, there is a limit to the information obtained from one image diagnostic apparatus, and there is an increasing need for making a diagnosis while simultaneously referring to information obtained from a plurality of image diagnostic apparatuses.

  According to the ultrasonic diagnostic apparatus, in addition to morphological observation in a living body, for example, information on biological functions that are difficult to obtain with other diagnostic imaging apparatuses, such as temporal changes in blood flow rate or blood flow velocity, can be easily operated. Can be obtained in real time.

  On the other hand, it is difficult for the current ultrasonic diagnostic apparatus to obtain an image having a sufficiently high spatial resolution and temporal resolution over a wide range. Therefore, it is necessary to set an imaging condition for narrowing the observation area by reducing the viewing angle and collecting an image of a small area with high spatial resolution and temporal resolution.

  On the other hand, according to another diagnostic imaging apparatus, for example, a CT apparatus, it is possible to obtain a wide range of image data in a subject's living body. However, only information on the form and position of the organ can be obtained from the image data of the CT apparatus.

  Therefore, a doctor must arrange image data obtained by a plurality of diagnostic apparatuses, compare the forms, and observe them. In addition, moving image data that changes in time series must be observed.

  Therefore, it is required to synchronize with an image photographed by another diagnostic apparatus using an image photographed by one diagnostic apparatus as a reference image.

  As a technique to synchronize moving images, it is easy to compare both images by synchronizing the images previously captured with one diagnostic imaging device, for example, an ultrasound diagnostic device, with the currently captured images. A device has been proposed (see, for example, Patent Document 1).

Japanese Patent Laid-Open No. 2003-61961

  As described above, there is a growing need for performing diagnosis while confirming image data obtained by various image diagnostic apparatuses. Moreover, the image data is a moving image. These moving images have various forms depending on the diagnostic imaging apparatus. For example, an image taken by a US device is a continuous image and has various frame rates. Or the image image | photographed with the electrocardiogram synchronous myocardial SPECT apparatus or CT apparatus is a repetitive image, and it is a moving image for one period synchronized with a heartbeat, respiration, etc., and this also has various frame rates.

  By the way, the image data used for diagnosis may be an image taken by various image diagnostic apparatuses at the same time, or an image taken before and after surgery and having a very wide shooting interval.

  These image data have different frame rates for each diagnostic imaging apparatus, and even in the same diagnostic imaging apparatus, the photographing method and the photographing timing are different, so that the frame rate varies.

  Doctors and the like need to compare and interpret images with different frame rates. However, even if the obtained information increases, the time taken for interpretation does not increase at present.

  At present, it is difficult to compare and synchronize with images obtained by various image diagnostic apparatuses having different frame rates.

  Accordingly, an object of the present invention is to provide a system capable of interpreting moving images taken by a plurality of diagnostic imaging apparatuses while referring to them on a display screen in synchronization with a synchronization signal such as an electrocardiogram waveform. is there.

  In order to solve the above-described problems, the main diagnostic imaging apparatuses according to the present invention are a first diagnostic apparatus that captures repeated images having different frame rates and a second diagnostic apparatus that captures continuous images. In an image diagnostic apparatus that captures captured image data and performs image processing, an input unit that inputs data to the image diagnostic apparatus, a storage unit that stores data including a repeated image and a continuous image, and a repeated image and a continuous image Display means for displaying images, synchronization signal generating means for generating a synchronization signal in conjunction with continuous image shooting, and processing means for correcting the frame rate so that the frame rate of the repeated image is synchronized with the synchronization signal And repeatedly displaying the repetitive image and the continuous image on the display device at the same time.

  Alternatively, in an image diagnostic apparatus that performs image processing by capturing image data captured by each of a first diagnostic apparatus that captures repeated images having different frame rates and a second diagnostic apparatus that captures continuous images, Input means for inputting data to the diagnostic apparatus, storage means for storing data including repeated images and continuous images, display means for displaying images including repeated images and continuous images, and information necessary for synchronization from the repeated images Information extracting means for extracting, and processing means for correcting the frame rate so as to synchronize the frame rate of the repeated image with the extracted information, and the display device simultaneously synchronizes the repeated image and the continuous image. It is characterized by displaying.

  Alternatively, in an image diagnostic apparatus that captures image data including continuous images and performs image processing, input means for inputting data to the image diagnostic apparatus, display means for displaying images including continuous images, and interlocking with continuous image capturing Synchronization signal generating means for generating a synchronization signal and storage means for storing data including still images taken in a specific time phase of a continuous image synchronized with the synchronization signal, and synchronized with the specific time phase The still image is displayed on the display means.

That is,
1) When a synchronization signal such as an electrocardiogram is used, a repeated image is displayed simultaneously while being repeated many times in synchronization with the electrocardiogram of a continuous image.

  Also, other images are interpolated and displayed in accordance with the image having the highest frame rate, that is, the number of frames per heartbeat. With such a configuration, unlike a general image, it is possible to prevent information loss.

In addition, the number of images generated by interpolation can be automatically changed in accordance with the change in heart rate so that the change can be followed.
2) Information required for synchronization is automatically extracted from the image even when there is no synchronization signal such as an electrocardiogram. For example, a periodic change in the area or volume of the region of interest, a periodic density change in the entire image, or a periodic change in the Doppler signal is used. These can be used in place of the synchronization signal.
3) A still image is automatically created at a preset timing on the synchronization signal. With such a configuration, it is possible to easily perform comparison between images having significantly different heart rates because the photographing interval is wide.

  According to the present invention, it is possible to compare various images by synchronizing various image data having different frame rates. As a result, the interpretation time can be shortened and further oversight can be prevented.

The figure which shows an example of the screen display to which this invention is applied. The figure which shows the imaging | photography space | interval of the SPECT repetition image corresponding to an electrocardiogram waveform. The figure which shows the imaging | photography space | interval of CT repeating image corresponding to an electrocardiogram waveform. The figure which shows the imaging | photography space | interval of the US continuous image corresponding to an electrocardiogram waveform. The flowchart which shows the process sequence which synchronizes the imaging interval of the various captured images between 1 heartbeat with the imaging interval of the US image. FIG. 5 is a diagram illustrating the shooting intervals of the repeated image and the US image shown in the first embodiment. The figure which shows the timing at the time of synchronizing an image repeatedly on the basis of the electrocardiogram of the continuous image (US imaging | photography space | interval) shown in FIG. FIG. 5 is a diagram illustrating the shooting intervals of the repeated image and the US image shown in the first embodiment. The figure which shows the timing at the time of synchronizing an image repeatedly on the basis of the electrocardiogram of the continuous image (US imaging interval) shown in FIG. FIG. 6 is a diagram illustrating the shooting intervals of a repeated image having a high rate and a US image shown in the first embodiment. The figure which shows the timing at the time of synchronizing an image repeatedly on the basis of the electrocardiogram of the continuous image (US imaging interval) shown in FIG. FIG. 6 is a diagram illustrating the shooting intervals of a repeated image having a high rate and a US image shown in the first embodiment. The figure which shows the timing at the time of synchronizing a repeating image on the basis of the repeating image (CT imaging interval) shown in FIG. The figure which shows schematic structure of the diagnostic imaging apparatus of this invention. The figure which shows the data structure of a repeating image. The figure which shows the data structure for every flame | frame of a repeating image. The figure which shows the data structure of a continuous image. The figure which shows the data structure for every flame | frame of a continuous image. FIG. 10 is a diagram illustrating an example of extracting information necessary for synchronization illustrated in the second embodiment. FIG. 10 is a diagram illustrating another example of extracting information necessary for synchronization shown in the second embodiment. FIG. 10 is a diagram illustrating another example of extracting information necessary for synchronization shown in the second embodiment. Explanatory drawing of the specific time phase of an electrocardiogram waveform. FIG. 10 is a diagram illustrating another example of extracting information necessary for synchronization shown in the second embodiment. The figure which shows the example of the automatic extraction of the still image in the preset heartbeat timing (when a display is updated whenever a heartbeat progresses). The figure which shows the example of the automatic extraction of the still image in the preset heartbeat timing (comparison of the image image | photographed at different time). 10 is a flowchart illustrating a procedure for synchronizing repeated images shown in the third embodiment.

  Hereinafter, embodiments will be described in detail with reference to the drawings.

  FIG. 1 is a diagram showing an example of an image display screen when the present invention is applied. On the display screen 1, images taken by various image diagnostic apparatuses are displayed. That is, images (a variety of SPECT images 2a to 2c) photographed using a SPECT (Single Photon Emission Computed Tomography) apparatus are displayed on the top, and images (3D images 13a and slices) photographed by CT (Computed Tomography) are displayed on the middle. The image 14a) is displayed, and further, the image (B mode or Doppler) 13 photographed by a US (ultrasonic) diagnostic apparatus and the examination engineer or doctor, the subject, and the position of the probe currently being examined are displayed in the lower stage. A middle video 12 is displayed.

  In addition, on the left side of each image, ECG waveforms 3, 5, and 6 that are synchronized with the respective images are displayed. Each waveform can be adjusted by adjusting means 4 for finely displaying the display timing. Further, a continuous electrocardiogram waveform 7 is displayed in the lower stage.

  In addition, an input unit through which data can be input by the laboratory technician or doctor is provided at the lower right of the display screen 1. For example, “image selection” 11, “synchronization method selection” 10, “still image automatic generation” 9 It is possible to select appropriately.

  In “image selection” 11, selection of patient image data corresponding to patient designation and examination date and which modality (CT apparatus, SPECT apparatus, etc.) image can be selected can be selected. In “Method selection” 10, it is possible to select a method (such as from an electrocardiogram or an image) to synchronize. When “Automatic image generation” 9 is selected, a certain timing (for example, the heart has expanded) Time) still image can be generated.

  The displayed diagnostic imaging apparatus is a SPECT apparatus, a CT apparatus, and a US apparatus, but can be applied to other modalities, for example, a system using an MRI apparatus. Images taken with the device can be displayed.

A processing procedure for synchronizing a plurality of modality images and displaying them on the display screen 1 will be described below.
≪When ECG waveform can be used≫
The diagrams from FIG. 2A to FIG. 2C show an example of the acquired image of the diagnostic imaging apparatus targeted by the present invention.
First, the upper waveform shown in FIG. 2A shows an electrocardiogram waveform. On the lower side, an imaging interval (frame rate) for sequentially capturing SPECT images in synchronization with the R wave peak of the electrocardiogram waveform is shown. The SPECT image is acquired in synchronization with the electrocardiogram. That is, the SPECT imaging interval within one heartbeat synchronized with the electrocardiogram is shown. In this case, the imaging interval is equal, and 16 images are captured within one heartbeat. This image is a repetitive image in which one or a plurality of frames of a specific time phase are repeatedly displayed for each cardiac cycle.

  Next, the upper waveform in FIG. 2B shows an electrocardiogram waveform. On the lower side, an imaging interval (frame rate) for sequentially capturing CT images in synchronization with the R wave peak of the electrocardiogram waveform is shown. The CT image is acquired in synchronization with the electrocardiogram. That is, the CT imaging interval within one heartbeat synchronized with the electrocardiogram is shown. In this case, the imaging interval is equal, and 12 images are captured within one heartbeat. Similar to the SPECT image, this image is also a repeated image that is repeated at the same imaging interval.

  Furthermore, the upper waveform in FIG. 2C shows an electrocardiogram waveform, and in this example, up to two heartbeats are shown. On the lower side, the US shooting interval (frame rate) is shown.

  As shown in the figure, the heart rate is not constant, and changes between the first one heartbeat and the next one heartbeat. In this figure, the initial heart rate is about 75 times, and the subsequent heart rate is 90 times.

  The US image is a series of image data collected as a moving image, and is a continuous image. This continuous image is taken at 30 frames per second. Corresponding to each heart rate, the frame rate of the US image is 24 frames when the heart rate is about 75 times and 20 frames when the heart rate is about 90 times. Therefore, in the first heartbeat, 24 frames are captured in the US image in about 0.8 seconds, and in the next heartbeat, 20 frames are captured in about 0.66 seconds.

  FIG. 3 shows a procedure for synchronizing the electrocardiogram waveform synchronized with the continuous image shown in FIG. 2C and the repeated image taking timing shown in FIGS. 2A and 2B and simultaneously displaying the images taken with the respective modalities on the same screen. It is a flowchart to show.

  The flowchart of FIG. 3 will be described using FIG. 4 and FIG. 5 together.

  FIG. 4 is a diagram in which the imaging intervals (frame rates) of the SPECT image and the CT image corresponding to the first one heartbeat of the continuous image of the US image shown in FIG. 2C are arranged in one figure. The electrocardiogram waveform BC shown in the upper part corresponds to the case where the heart rate is about 75 in FIG. 2C.

  FIG. 5 shows an enlarged view of the imaging intervals of the SPECT image, CT image, and US image within the range of the frame X1 indicated by the dotted line in FIG.

  First, in STEP 2 shown in FIG. 3, first, i is initially set. Next, in Step 3, the R wave peak (R time) position of the ECG waveform is detected from the ECG BC synchronized with the continuous image B (see FIG. 4). Next, in Step 4, an i-th image B (i) of a frame, which is a continuous image for one heartbeat from the R time point to the next R time point, is read (see FIG. 5). Here, in FIG. 5, B (i) shows an example when the frame number is “2”. Further, in Step 5, the image of the repeated image is complemented to create a continuous image AA (i) for one heartbeat at the same timing as the i-th continuous image B (i) (see FIG. 5). Next, in Step 6, the continuous image B (i) and the continuous image AA (i) are displayed for one heartbeat while synchronizing the frames (see FIG. 5). This is repeated a predetermined number of times.

When I actually fit the Step3-6 in FIG 5, the frame number of the US imaging interval, for example, a time corresponding to the frame number 2, newly sets the frame number 2 ₂ CT imaging interval, similarly , set the frame number _{2 1} SPECT imaging interval. Similarly, corresponding to each frame number, 3 ₁ and 3 ₂ , 4 ₁ and 4 ₂ ,... Are newly set as frame numbers of CT imaging intervals and SPECT imaging intervals. This procedure uses the US shooting interval (frame rate) as a reference (Ref1).

Image data corresponding to a newly set frame number is created by interpolating already captured image data. This interpolation method, various some, for example, if the frame number 2 ₂ is calculated by using the image data in the frame number 1, the image data in the frame number 2.

  Here, the images already captured by each modality may be data recorded and stored in advance in the frame buffer 26 or the storage device 27 shown in FIG. 19, or data input in real time may be used. Normally, data input in real time is stored in a frame buffer. Data recorded and stored in advance means image data already taken before surgery. Moreover, the data input in real time means, for example, image data during a postoperative examination. A method for interpolating the images of the continuous image AA (i) will be described later.

  FIG. 6 is a diagram in which the imaging intervals (frame rates) of the SPECT image and the CT image corresponding to one heartbeat next to the continuous image of the US image shown in FIG. 2C are arranged in one figure. The electrocardiogram waveform BC shown in the upper part corresponds to the case where the heart rate is about 90 in FIG. 2C.

  FIG. 7 is an enlarged view of the imaging intervals of the SPECT image, CT image, and US image within the range of the frame X2 indicated by the dotted line in FIG.

The method for obtaining the continuous image AA (i) is the same as the case of FIG. 5 with the US photographing interval (frame rate) as a reference (Ref2).
≪High-rate repeated images≫
FIG. 8 is a diagram in which the imaging intervals (frame rates) of the SPECT image and the CT image corresponding to the first one heartbeat of the continuous image of the US image shown in FIG. 2C are arranged in one figure. The electrocardiogram waveform BC shown in the upper part corresponds to the case where the heart rate is about 75 in FIG. 2C.

  FIG. 9 shows an enlarged view of the imaging intervals of the SPECT image, CT image, and US image within the range of the frame X3 indicated by the dotted line in FIG. As in FIG. 4, when the heart rate is 75, the CT imaging interval is at a high rate. Specifically, CT imaging within one heartbeat is 22 frames, and the frame rate is nearly twice as high as 12 frames in the case shown in FIG. Note that the SPECT imaging interval and the US imaging interval are the same as those in FIG.

  The method for obtaining the continuous image AA (i) can be obtained using the flowchart of FIG. 3 with the US photographing interval (frame rate) as a reference (Ref3). A method for interpolating the images of the continuous image AA (i) will be described later.

  FIG. 10 is a diagram in which the imaging intervals (frame rates) of the SPECT image and the CT image corresponding to one heartbeat next to the continuous image of the US image shown in FIG. 2C are arranged in one figure. The electrocardiogram waveform BC shown in the upper part corresponds to the case where the heart rate is about 90 in FIG. 2C.

  FIG. 11 shows an enlarged view of the imaging intervals of the SPECT image, CT image, and US image within the range of the frame X4 indicated by the dotted line in FIG.

  In FIG. 11, the heart rate is 90 as in FIG. 4, but the CT imaging interval is at a high rate. Specifically, CT imaging within one heartbeat is 22 frames, and the frame rate is nearly twice as high as 12 frames in the case shown in FIG. Note that the SPECT imaging interval and the US imaging interval are the same as those in FIG. 9 is different from FIG. 9 in that the US imaging interval is used as a reference in FIG. 9, but the CT imaging interval is used as a reference (Ref4). In this description, the CT imaging interval is a high rate. However, it is also possible to synchronize with other repeated images having different frame rates on the basis of the frame rate of one repeated image.

  The method for obtaining the continuous image AA (i) can be obtained by appropriately replacing the flowchart of FIG. That is, the continuous image B is processed as a CT image, the repeated image A is processed as one heartbeat of a SPECT image or a US image, and the continuous image AA is generated by complementing an image of a SPECT image or a US image for one heartbeat. A method for interpolating the images of the continuous image AA (i) will be described later.

The method of interpolating and displaying other images on the basis of the high-rate repetitive images shown in FIGS. 10 and 11 has an effect of preventing information loss.
≪Image interpolation and display method≫
(1) One of the interpolation methods for the continuous image AA (i) described above will be described below. Here, for simplicity, a case where i = 2, that is, a case where AA (2) is obtained will be described. For example, how to determine the CT image data in the frame number 2 ₂ in Figure 5, is calculated using the CT image data in the frame number 1, the CT image data in the frame number 2.

  Volume data V1 corresponding to the CT image in frame number 1 is composed of data including voxel position 1 and voxel value 1. Similarly, the voxel position 2 and the voxel value 2 are given to the volume data V2 corresponding to the CT image in the frame number 2.

  When shooting has already been completed at frame number 1 and frame number 2, the shot image data is stored in storage means such as the frame buffer 26 and the storage device 27 shown in FIG.

Since it can be assumed that the continuous image AA (2) to be obtained by interpolation exists between the voxel position 1 and the voxel position 2 of the two stored image data, the voxel value 1 and the voxel position at the voxel position 1 by interpolating the voxel value 2 in 2, it is possible to determine the voxel position 2 ₂ and the voxel value 2 ₂ in the frame number 2 _2. At this time, the function used for interpolation can be either linear or non-linear.

The above description describes the interpolation method between frame number 1 and frame number 2.
Needless to say, the present invention can also be applied to interpolation between frame number n and frame number n + 1, such as frame number 2 and frame number 3. In addition, the case of CT images has been described as an example, but the same method can be applied to SPECT images. It is also possible to use higher-order interpolation using not only the frame number n and the frame number n + 1 but also the image of the frame number n-1.

Next, a method of displaying an image at each frame number obtained by the above interpolation method will be described.
Here, the case where it displays continuously in time series is assumed. Data processing in the processing apparatus differs depending on whether the image data is displayed using existing data that has been imaged in the past, or whether an image is currently displayed simultaneously with imaging of the subject.

Specifically, a case will be described in which a CT continuous image AA (2) is displayed using a previous examination image (for example, an examination image taken before surgery). The image data for each frame number is already stored in the storage device 27 or the like. The volume data V1 corresponding to the CT image in the frame number 1 is displayed at a timing corresponding to the frame number 1 of the US image, then using and the volume data V2 volume data V1, frame number 2 _second volume data V2 ₂ is obtained by the above interpolation method, and the result is displayed at a timing corresponding to frame number 2 of the US image. Image of the volume data V2 is without displaying displays at a timing corresponding volume data V3 ₂ of the frame number 3 ₂ to the frame number 3 of the US image. Subsequently, the frames after frame number 4 of the US image are displayed in the same manner.

On the other hand, a case will be described in which a CT continuous image AA (2) is displayed using an inspection image currently being inspected. First, a CT image at frame number 1 is taken and stored in storage means such as the frame buffer 26. The volume data V1 corresponding to the frame number 1 is displayed at a timing corresponding to the frame number 1 of the US image. Next, CT image data (volume data V2) corresponding to the frame number 2 is acquired, and the data is framed. It is stored in a storage means such as the buffer 26. Using this volume data V2 and already stored volume data V1, volume data V22 ₂ is obtained by the interpolation method described above, and the result is displayed at a timing corresponding to frame number 2 of the US image. Image of the volume data V2 is without displaying the frame number 3 ₂ volume data V3 ₂ As determined by the same interpolation method for displaying at a timing corresponding to the frame number 3 of the US image. Subsequently, the frames after frame number 4 of the US image are displayed in the same manner.

(2) as another interpolation method for interpolating the above-described method for continuous image AA (i), to divert the volume data V2 of the frame number 1 of volume data V1 or frame number 2 as the volume data V2 ₂ of the frame number 2 ₂ You can also.

For example, as shown in FIG. 9, when the difference between the CT photographing interval and US shooting interval is small, of obtaining the CT image data in the frame number 2 ₂ is calculated using the CT image data in the frame number 2 You can also. This method can be expected to save the processing time required for interpolation and the storage capacity of the frame buffer 26 and the like.

The above description has dealt method of interpolating frame number 2 _2, it is naturally applicable to a method of interpolating frame number 3 _2, and later frame number n _2.
In addition, the case of CT images has been described as an example, but the same method can be applied to SPECT images. The present invention can also be applied to the US image described in the example of the high-rate repeated image.
≪Configuration of diagnostic imaging system≫
FIG. 12 shows an example of the configuration of the diagnostic imaging apparatus shown in this embodiment. In this figure, the diagnostic device is composed of three types of diagnostic devices: a diagnostic device (1) 20, a diagnostic device (2) 21, and a diagnostic device (3) 22. In this example, the diagnostic device (1) is a SPECT device, the diagnostic device (2) is a CT device, and the diagnostic device (1) is a US device.

  Each diagnostic device 1-3 is electrically connected to the processing device 24 so that signals can be exchanged, and an input device 25, a display device 23, and a storage device 27 are connected to the processing device 24, respectively. A frame buffer 26 is connected to the display device 23, and image data is temporarily stored in the frame buffer 26 when a moving image is displayed.

The display device 23 displays a moving image for each modality that is synchronized as shown in FIG.
<< Data structure >>
FIG. 13 shows an example of the data structure of a captured image. The database stores a modality ID for identifying an imaging device, a patient ID, an imaging time, an imaging site, an imaging method, image data, an electrocardiogram data, and an imaging time.

  Also, the method for expressing the shooting time differs for each device. For example, there are a device X having an acquisition start time as a shooting time, and a device Y having a median value from the acquisition start to the acquisition end as a shooting time. Therefore, in order to express which expression method is used for each device, the database stores shooting time definition data for each modality ID.

  In the shooting time definition, when a device having an acquisition start time as a shooting time and a device having a median value as a shooting time coexist, processing for correcting the expression of the shooting time is performed. Specifically, the shooting time of the device having the median as the shooting time is expressed using the value obtained by subtracting ½ of the shooting time T from the shooting time to represent the shooting time of the device having the median as the shooting time. In addition, image interpolation and display are performed.

FIG. 14 shows the data structure of repeated images and continuous images. The data structure of each frame is shown.
That is, an image size, the number of image data, and image data are input to the data structure. In this example, the number of image data is 16. That is, 16 frames are shot during one heartbeat.

  FIG. 15 shows the data structure of electrocardiogram data. As shown in the figure, the sampling rate, the total number of data, and each data are input. Corresponding to the total number of input data (n), photographed image data is input from data (1) to data (n).

  FIG. 16 shows a data structure in the case of a US device. The data structure of each frame is shown. That is, an image size, the number of image data, and image data are input to the data structure. In this example, the number of image data is N.

≪When ECG waveform cannot be used≫
The synchronization method in the case where there is no electrocardiogram waveform synchronized with the US image as shown in FIGS. 2A-2C will be described below with reference to FIGS.

The upper part of FIG. 17 shows a US image taken with a US device. The electrocardiogram waveform is shown in the middle of the figure, but this is shown for the sake of explanation. In the case of this embodiment, it is assumed that there is no electrocardiogram waveform synchronized with the US image.
In the lower part of the figure, the vertical axis represents the size (for example, area or volume) of the left ventricle of the heart, and the horizontal axis represents the time axis. The size of the left ventricle is acquired by taking a time series, and the curve shown in the figure is obtained by plotting it. Since image acquisition is not always obtained continuously, in the case of discrete data, the curve shown in the figure is appropriately obtained by an interpolation method such as linear interpolation.
Since the lower curve in the figure has several specific time phases, it is possible to map the specific time phases of the electrocardiogram waveform as shown in the middle of the figure from that time phase. For example, an R wave peak. Periodicity and end diastole timing can be obtained from the curve shown in the lower part of the figure. As a result, it is possible to specify an R wave peak (end diastole timing) that can be used as a time for one heartbeat or a trigger for image capturing. That is, an alternative method using an electrocardiogram waveform as described in the first embodiment as a synchronization signal can be used.
Specifically, the circles in the figure indicate the size of the left ventricle actually acquired. For example, when 20 frames are taken per heartbeat, a maximum of 20 measurement points can be obtained per heartbeat. Actually, the measurement result includes an error due to the influence of noise on the image or movement of the probe during photographing. For this reason, the moving average of the measurement points along the time axis and the first and second interpolation processes are performed. Alternatively, the time point when the size of the left ventricle becomes the maximum is estimated more accurately from the measurement point having the maximum left ventricle size and the measurement points before and after the measurement point, and this time point is set as the end diastole. These processes have the effect of preventing the influence of this error as much as possible.

  FIG. 18 shows another application example using the end diastole timing. That is, an average (amount of motion) of density change between heart slices can be used. In each stage according to the motion of the heart, a slice image is obtained, the average of the density of each image is obtained, and the position corresponding to the electrocardiogram waveform is obtained in correspondence with the change of the average value. Thereby, it can use as a synchronizing signal instead of the electrocardiogram waveform synchronized with the US image.

  FIG. 19 shows still another application example using the end diastole timing. The position corresponding to the electrocardiogram waveform can be obtained by capturing the blood flow or blood flow velocity flowing through the heart based on the intensity of the Doppler signal. Thereby, it can use as a synchronizing signal instead of the electrocardiogram waveform synchronized with the US image.

FIG. 20 shows an electrocardiography (ECG) waveform obtained from a human heart. ECG is a scalar representation that shows fluctuations resulting from atrial and ventricular activity as changes in voltage magnitude and polarity over time. These shakes are called “waves”. One cycle of ECG is composed of P wave, Q wave, R wave, S wave, T wave, and U wave. From the P wave to the Q wave represents the atrial excitement, from the Q wave to the T wave represents the ventricular excitement, and from the end of the T wave to the U wave represents the relaxation period of the ventricle.
One of the ECGs of particular interest is the QRS interval or QRS wave group, especially the R wave peak. The R wave peak is also called QRS trigger.

  The cardiac cycle is defined as a period from the start point of one heartbeat to the start point of the next heartbeat. There are two important time intervals in each cardiac cycle: systole and diastole. In FIG. 20, the end diastole is shown immediately before the R wave, and the end systole is shown between the S wave and the T wave or between the T wave and the U wave. The former end systole is referred to as end systole (1), and the latter is referred to as end systole (2). During the diastole, the left ventricle is filled with blood flow. During the systole, the left ventricle contracts and pumps blood out of the heart. During the systole, the momentum is large anatomically, whereas during the diastole, the momentum is small. From a diagnostic standpoint, there is an interest in the anatomical structure during systole. QRS trigger (R wave peak) is a convenient means to detect the onset of systole. Used for ultrasonic scanner control and image data acquisition.

  FIG. 21 shows an example using the end systole shown in FIG. In addition to the end diastole timing described above, end systole timing can also be used. In the figure, the end diastole timing is indicated by (b), and the end systole timing is indicated by (c).

  In FIG. 22, a continuous electrocardiogram waveform 31 is illustrated at the lower left of the display screen 1, and a further enlarged view of one heartbeat is illustrated above the waveform diagram. The ECG waveform 32 for one heartbeat is numbered (1)-(3) according to the timing, and a US still image 30 corresponding to each number is displayed on the right side in the figure. . On the left in the figure, a US still image 34 taken at the time immediately before the present time (one heartbeat 33 in the figure) is displayed, and on the right, the current US still image 30 is displayed.

  The US still image 30 is automatically displayed as an image taken at a preset timing on the synchronization signal (corresponding to the above-described electrocardiogram waveforms (1) to (3) in this example). The automatically created program may be stored in the storage device 27 shown in FIG. The automatically displayed US still image 30 is stored in the frame buffer 26 or the storage device 27.

  FIG. 23 differs from FIG. 22 in that the time when the US still image 30 is taken is different. That is, the previous inspection image is shown on the left in the figure, and the current inspection image is shown on the right. Each image was taken at a timing corresponding to a preset timing (ECG waveforms (1) to (3) in the figure) corresponding to the previous and current ECG waveforms 31 shown on the left side of the figure. US still image. The ECG waveforms of the previous time and this time are usually different (see the ECG waveform of FIG. 23). In this example, the timing of (1) corresponds to the end diastole, (2) corresponds to the end systole (1), and (3) corresponds to the end systole (2).

  In the present embodiment, since the imaging interval is open, when the comparison is performed between images having significantly different heart rates and the like, the open interval can be complemented, and the comparison can be easily performed.

  FIG. 24 is a flowchart showing a procedure for generating a repeated image synchronized with a continuous image different from FIG. That is, the reproduction speed of the repeated image is obtained from the periodicity of the electrocardiogram, and the repetition speed is reproduced based on the speed. Here, it is assumed that the diagnostic apparatus has a function capable of displaying repeated images at a free speed.

  First, in STEP 2 shown in FIG. 24, i is initially set. Next, the R wave peak (R time) position of the ECG waveform is detected from the ECG BC synchronized with the continuous image B (STEP 3). Next, an i-th image B (i) and an electrocardiogram BC (i) of one frame from the R time point to the next R time point are read (STEP 4). A time t between R and R of one heartbeat is calculated from the electrocardiogram BC (i) (STEP 5). The elapsed time of one heartbeat of the repeated image is divided by t, and the value is set as a reproduction speed V (STEP 6). The playback speed of the repeated image A is set to V, and the continuous image B (i) and the repeated image A are simultaneously displayed for one heartbeat (STEP 7). This is repeated a predetermined number of times.

  The effect of this embodiment is that it is not necessary to use the image interpolation processing shown in FIGS. Further, when comparison is made between images with significantly different heart rates because of the shooting interval, there is an effect that blurring of images and generation of false images due to interpolation can be prevented.

1 ... Display screen,
2a, 2b, 2c ... SPECT images,
3 ... ECG waveform,
4. Display timing adjustment means,
5 ... ECG waveform,
6 ... ECG waveform,
7: Continuous ECG waveform,
8 ... All video timing fine adjustment section,
9: Still image automatic generation instruction section,
10 ... synchronization method selection section,
11: Image selection unit,
12 ... Video during inspection,
13 ... US image,
14a, 14b ... CT image,
20 ... diagnostic device 1 (SPECT device),
21 ... Diagnostic device 2 (CT device),
22 ... diagnostic device 3 (US device),
23. Display device,
24 ... processing device,
25. Input device,
26: Frame buffer,
27 ... Storage device,
30 ... US still image,
31 ... ECG waveform,
32 ... ECG waveform (for one heartbeat),
33 ... US still image taken at the previous time,
A ... Repeated images,
B ... Continuous image,
BC: ECG waveform,
T: Time required for image acquisition,
X: Equipment whose acquisition time is the shooting start time,
Y: A device whose shooting time is the central time point during acquisition.

Claims (11)

In an image diagnostic apparatus that captures image data captured by each of a first diagnostic apparatus that captures repeated images having different frame rates and a second diagnostic apparatus that captures continuous images, and performs image processing,
Input means for inputting data to the diagnostic imaging apparatus;
Storage means for storing data including the repeated image and the continuous image;
Display means for displaying the image including the repeated image and the continuous image;
Synchronization signal generating means for generating a synchronization signal in conjunction with the continuous image capturing;
Processing means for correcting the frame rate so as to synchronize the frame rate of the repetitive image with the synchronization signal;
An image diagnostic apparatus, wherein the repetitive image and the continuous image are simultaneously displayed on the display device while being synchronized. The diagnostic imaging apparatus according to claim 1,
The image processing apparatus is characterized in that the processing unit synchronizes another repeated image with the continuous image in accordance with the repeated image having the highest frame rate. The diagnostic imaging apparatus according to claim 1,
The input means captures images taken at different frame rates from a plurality of the first diagnostic devices,
The image diagnosis apparatus characterized in that the processing means synchronizes repeated images having other frame rates in accordance with one frame rate of the repeated images having different frame rates. The diagnostic imaging apparatus according to claim 1,
An image diagnostic apparatus characterized in that the synchronization signal generating means is an electrocardiogram. In an image diagnostic apparatus that captures image data captured by each of a first diagnostic apparatus that captures repeated images having different frame rates and a second diagnostic apparatus that captures continuous images, and performs image processing,
Input means for inputting data to the diagnostic imaging apparatus;
Storage means for storing data including the repeated image and the continuous image;
Display means for displaying the image including the repeated image and the continuous image;
Information extracting means for extracting information necessary for synchronization from the repeated image;
Processing means for correcting the frame rate so as to synchronize the frame rate of the repeated image with the extracted information;
An image diagnostic apparatus, wherein the repetitive image and the continuous image are simultaneously displayed on the display device while being synchronized. The diagnostic imaging apparatus according to claim 5, wherein
The image diagnostic apparatus, wherein the information extraction unit calculates information necessary for synchronization based on a change amount of a specific time phase of biological information obtained from the continuous images. The diagnostic imaging apparatus according to claim 6, wherein
The image processing apparatus is characterized in that the processing unit synchronizes another repeated image with the continuous image in accordance with the repeated image having the highest frame rate. The diagnostic imaging apparatus according to claim 6, wherein
The input means captures images taken at different frame rates from a plurality of the first diagnostic devices,
The image diagnosis apparatus characterized in that the processing means synchronizes repeated images having other frame rates in accordance with one frame rate of the repeated images having different frame rates. The diagnostic imaging apparatus according to claim 6, wherein
The biometric information was imaged by the area or volume of the left ventricle of the heart imaged by an ultrasonic device, or the average value of changes in concentration between heart slices imaged by an ultrasonic device, or by an ultrasonic device. An image diagnostic apparatus characterized by being one of the strengths of a heart Doppler signal. In an image diagnostic apparatus that captures image data including continuous images and performs image processing,
Input means for inputting data to the diagnostic imaging apparatus;
Display means for displaying an image including the continuous image;
Synchronization signal generating means for generating a synchronization signal in conjunction with the continuous image capturing;
Storage means for storing data including still images taken in a specific time phase of the continuous image synchronized with the synchronization signal,
An image diagnostic apparatus, wherein the still image is displayed on the display means in synchronization with the specific time phase. The diagnostic imaging apparatus according to claim 10.
An image diagnostic apparatus characterized in that a plurality of still images photographed at different times are displayed in parallel on the display means in synchronization with the specific time phase of each still image.

Images