JP2010094181A - Ultrasonic diagnostic apparatus and data processing program of the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an ultrasonic diagnostic apparatus and a data processing program of the ultrasonic diagnostic apparatus, for enabling a user to more easily or more accurately evaluate three-dimensional ultrasonic images, associating them to images captured in another image diagnostic apparatus. <P>SOLUTION: The ultrasonic diagnostic apparatus is provided with an image gathering means, a position specifying means, an area preparation means, and a display means. The image gathering means gathers the three-dimensional ultrasonic images (FREEZE-FLAME) of a subject by transmitting and receiving ultrasonic waves to/from the subject. The position specifying means specifies the position M of interest by performing marking on the three-dimensional ultrasonic image (FREEZE-FLAME). The area preparation means prepares a three-dimensional space area C with the position M of interest as a reference. The display means superimposes the three-dimensional space area C and the three-dimensional ultrasonic image (FREEZE-FLAME) and displays them. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an ultrasonic diagnostic apparatus and an ultrasonic diagnosis for obtaining biological information in a subject by irradiating an ultrasonic pulse in the subject, receiving an ultrasonic echo generated in the subject, and performing various processes. BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data processing program for an apparatus, and more particularly to an ultrasonic diagnostic apparatus capable of setting a three-dimensional region by performing point designation by marking on a three-dimensional ultrasonic image and a data processing program for the ultrasonic diagnostic apparatus. .

  The ultrasonic diagnostic apparatus irradiates an ultrasonic pulse into the subject from a piezoelectric vibrator (ultrasonic vibrator) built in the ultrasonic probe, and receives the ultrasonic echo generated in the subject with the piezoelectric vibrator. The apparatus obtains biological information such as tomographic images and blood flow images of biological tissue in the subject by performing various processes (see, for example, Patent Document 1).

  In recent ultrasonic diagnostic apparatuses, three-dimensional ultrasonic image data can be dynamically captured and displayed as a moving image in real time. Such an ultrasonic diagnostic apparatus is called a real-time 3D (three-dimensional) ultrasonic diagnostic apparatus or a 4D (four-dimensional) ultrasonic diagnostic apparatus.

Conventionally, evaluation of wall motion in a stenotic region of a coronary artery identified by an X-ray angio test or a nuclear medicine test has been performed using such a real-time 3D ultrasonic diagnostic apparatus. In addition, after coronary reconstruction such as percutaneous coronary intervention (PCI), wall motion is evaluated by monitoring with a real-time 3D ultrasonic diagnostic device, or contrast echocardiography using a contrast agent is performed. Perfusion evaluation is performed by.
JP 2008-113699 A

  However, there is a problem that it is difficult to accurately correlate and evaluate the stenotic region of the coronary artery identified by the X-ray angio examination or the nuclear medicine examination and the ultrasonic image of the myocardium imaged by the ultrasonic diagnostic apparatus. For example, if a real-time 3D ultrasonic diagnostic apparatus is used, a user can observe a three-dimensional image of the myocardium as a moving image or a multi-planar reconstruction (MPR) image as a moving image. However, on a three-dimensional ultrasound image, it is difficult to simply and accurately observe a site where the wall motion is abnormal centering on the stenotic site of the coronary artery.

  That is, for example, if an image diagnostic apparatus capable of performing 3D imaging of the circulatory organ such as an X-ray CT (computed tomography) apparatus can be used, a three-dimensional coronary artery image can be accurately drawn. The stenosis site can be accurately identified. However, the three-dimensional ultrasonic image captured by the ultrasonic diagnostic apparatus and the three-dimensional image captured by another diagnostic imaging apparatus are obtained separately. For this reason, it is difficult to easily and accurately associate the three-dimensional ultrasonic image with the three-dimensional image captured by another image diagnostic apparatus, and the usefulness in the diagnosis of the three-dimensional ultrasonic image is impaired. ing.

  Therefore, it is desired to develop a technique for allowing a user to evaluate a three-dimensional ultrasonic image in a simpler or more accurate manner with an image captured by another diagnostic imaging apparatus.

  The present invention has been made to cope with such a conventional situation, and allows a user to evaluate a three-dimensional ultrasonic image in association with an image captured in another diagnostic imaging apparatus more easily or more accurately. An object of the present invention is to provide an ultrasonic diagnostic apparatus and a data processing program for the ultrasonic diagnostic apparatus.

  In order to achieve the above object, an ultrasonic diagnostic apparatus according to the present invention collects a three-dimensional ultrasonic image of the subject by transmitting and receiving ultrasonic waves to and from the subject as described in claim 1. An image collecting means for performing, a position specifying means for specifying a position of interest by marking on the three-dimensional ultrasound image, an area creating means for creating a three-dimensional spatial area based on the position of interest, and the 3 It has a display means for superimposing and displaying a three-dimensional space area and the three-dimensional ultrasonic image.

  In order to achieve the above object, the data processing program of the ultrasonic diagnostic apparatus according to the present invention causes a computer to display on a collected three-dimensional ultrasonic image of a subject. Position specifying means for specifying the position of interest by marking in the area, area creating means for creating a three-dimensional space area based on the position of interest, and a display device for displaying the three-dimensional space area and the three-dimensional ultrasound image It is made to function as a display means to superimpose and display on the screen.

  In the ultrasonic diagnostic apparatus according to the present invention, a user can evaluate a three-dimensional ultrasonic image in association with an image captured by another diagnostic imaging apparatus more easily or more accurately.

  Embodiments of an ultrasonic diagnostic apparatus according to the present invention will be described with reference to the accompanying drawings.

  FIG. 1 is a configuration diagram showing a first embodiment of an ultrasonic diagnostic apparatus according to the present invention.

  The ultrasound diagnostic apparatus 1 has a function as a 3D ultrasound diagnostic apparatus that acquires a 3D ultrasound diagnostic image of a subject by transmitting and receiving ultrasound to and from the subject. More preferably, the ultrasonic diagnostic apparatus 1 has a function as a 4D ultrasonic diagnostic apparatus that continuously (dynamically) collects 3D ultrasonic diagnostic images and displays them in real time, for example, as a moving image.

  The ultrasonic diagnostic apparatus 1 is configured by connecting an ultrasonic probe 3, an operation panel 4, and a monitor 5 to the apparatus main body 2. The operation panel 4 is provided with an input device 6 such as a keyboard and a trackball (or a mouse). In addition, the apparatus main body 2 is connected to an image server such as an X-ray CT apparatus 8A or another image diagnostic apparatus (modality) such as an MRI (magnetic resonance imaging) apparatus and a DICOM (Digital Imaging and Communications in Medicine) server via a network 7. 9 and an image processing apparatus (not shown).

  Further, an ECG (electro cardiogram) unit 10 is connected to the apparatus main body 2. The ECG unit 10 has a function of acquiring the ECG signal of the subject and outputting it to the apparatus main body 2.

  The ultrasonic probe 3 includes a plurality of ultrasonic transducers. Each ultrasonic transducer converts an electrical pulse applied from the apparatus main body 2 into an ultrasonic pulse and transmits it to the subject, while receiving an ultrasonic echo generated in the subject and receiving an electrical signal. It has a function of outputting to the apparatus main body 2 as a signal. The ultrasonic probe 3 is configured to form an ultrasonic transmission beam by an ultrasonic pulse transmitted from each ultrasonic transducer and to scan a subject three-dimensionally. That is, the ultrasound diagnostic apparatus 1 is provided with a 3D scanning probe as the ultrasound probe 3. Examples of 3D scanning probes include 2D array probes and mechanical 4D probes.

  FIG. 2 is a diagram for explaining a scanning method using a 2D array probe used as the ultrasonic probe 3 shown in FIG.

  A plurality of ultrasonic transducers are two-dimensionally arranged on the 2D array probe 3A. Therefore, in the 2D array probe 3A, the angle of the scan plane is arbitrarily controlled as shown in FIG. 2 by controlling the delay time of the ultrasonic pulse transmitted from each ultrasonic transducer toward the subject. Therefore, 3D scanning of a subject can be performed using an ultrasonic beam.

  FIG. 3 is a diagram for explaining a scanning method using a mechanical 4D probe used as the ultrasonic probe 3 shown in FIG.

  A plurality of ultrasonic transducers are arranged one-dimensionally on the mechanical 4D probe 3B. The mechanical 4D probe 3B can be mechanically swung in a certain angular direction. Therefore, in the mechanical 4D probe 3B, the delay time of the ultrasonic pulse transmitted from each ultrasonic transducer toward the subject is controlled, and the mechanical 4D probe 3B is swung as shown in FIG. The 3D scan of the subject can be performed using the ultrasonic beam.

  On the other hand, the apparatus main body 2 shown in FIG. 1 applies electric pulses to a plurality of ultrasonic transducers provided in the ultrasonic probe 3 while processing received signals acquired from the ultrasonic transducers of the ultrasonic probe 3. Thus, a function of generating an image signal and a function of outputting the generated image signal to the monitor 5 are provided. For this purpose, the apparatus main unit 2 includes an ultrasonic transmission unit 11, an ultrasonic reception unit 12, a B mode processing unit 13, a color mode processing unit 14, a 3D processing unit 15, a display unit 16, a CPU (Central Processing Unit) 17, an image. A database 18 and a cine memory 19 are provided.

  The ultrasonic transmission unit 11 has a predetermined delay time corresponding to each of a plurality of ultrasonic transducers provided in the ultrasonic probe 3 so that the ultrasonic transmission beam is transmitted from the ultrasonic probe 3 to a desired position. It has a function of applying an electric pulse.

  The ultrasonic receiving unit 12 acquires a plurality of reception signals output from the respective ultrasonic transducers of the ultrasonic probe 3 and performs reception processing such as reception delay processing and phasing addition processing to generate an ultrasonic reception beam. And a function of giving a reception signal corresponding to the ultrasonic reception beam obtained by the reception processing to the B mode processing unit 13 and / or the color mode processing unit 14. That is, when the received signal is a B-mode image generation (B mode) reception signal, the ultrasonic reception unit 12 supplies the reception signal to the B-mode processing unit 13 while the reception signal is used for color Doppler image generation. In the case of a (color mode) received signal, the received signal is provided to the color mode processing unit 14.

  The B-mode processing unit 13 generates B-mode data by performing predetermined signal processing such as filtering, gain adjustment, envelope detection, and the like on the received signal acquired from the ultrasonic receiving unit 12 for each ultrasonic reception beam. And a function of providing the 3D processing unit 15 with B-mode data for each generated ultrasonic reception beam.

  The color mode processing unit 14 generates color Doppler data by performing predetermined signal processing such as filter processing and speed detection on the received signal acquired from the ultrasonic receiving unit 12 for each ultrasonic reception beam; A function of providing the 3D processing unit 15 with color Doppler data for each generated ultrasonic reception beam.

  The 3D processing unit 15 has a function of creating 3D ultrasound image data (ultrasound volume data) from B mode data or color Doppler data for each ultrasound reception beam acquired from the B mode processing unit 13 or the color mode processing unit 14. And a function of giving the created 3D ultrasonic image data to the display unit 16.

  The display unit 16 performs image processing on the 3D ultrasound image data acquired from the 3D processing unit 15 to generate ultrasound display image data corresponding to the selected display mode, and the generated ultrasound. It has a function of displaying an ultrasonic display image by giving the sound wave display image data to the monitor 5. Further, the display unit 16 temporarily writes the generated ultrasonic display image data sequentially in the cine memory 19 and saves it, while reading a plurality of time-series ultrasonic display image data from the cine memory 19 and applying them to the monitor 5. The ultrasonic display image can be displayed as a moving image.

  Examples of the ultrasonic display image include a volume rendering (VR) image and an MPR image. As a display mode, a plurality of modes for displaying a plurality of arbitrary ultrasonic display images in parallel (dual display) on the monitor 5 and a mode for displaying a single ultrasonic display image are set to be selectable in advance. Can do. The display unit 16 is configured to acquire display mode selection information from the CPU 17.

  In addition, when the display unit 16 acquires marking information or a spatial area indicating the position on the 3D ultrasonic image data designated by the operation of the input device 6 from the CPU 17, the display unit 16 performs marking on the ultrasonic display image. A two-dimensional region such as a position corresponding to information or a cross-sectional region corresponding to a spatial region is obtained and superimposed on an ultrasonic display image on the monitor 5 so as to be identifiable.

  In addition, when the ultrasonic display image is displayed as a moving image, the marking position or the position based on the marking information indicating the position on the 3D ultrasonic image data at a specific time or the spatial region before or during the moving image reproduction or during the moving image reproduction. A 2D area such as a cross-sectional area corresponding to the space area is displayed on the monitor 5. The 3D ultrasound image data in which the marking position and the spatial region are set can be made into 3D ultrasound image data of a desired cardiac phase using the ECG signal acquired in the ECG unit 10.

  The marking position can be displayed by, for example, characters or symbols, and the 2D area corresponding to the space area can be displayed by a figure or a line. For example, when the spatial region is a region within a spherical surface, the 2D region is within a circle indicated by the intersection of the cross section and the spherical surface on the MPR image. The 2D area corresponding to the marking position and the space area can be displayed in color on the monitor 5. In addition, when a plurality of MPR images or VR images having different line-of-sight directions are displayed in parallel or dually on the monitor 5, 2D regions corresponding to the corresponding marking positions and spatial regions on the respective ultrasonic display images. Will be displayed in an identifiable manner.

  In addition, the display unit 16 is generated based on the function of displaying the image on the monitor 5 by giving the image data read from the image database 18 to the monitor 5, and the 3D ultrasonic image data and the 3D ultrasonic image data. It has a function of writing and storing ultrasonic display image data in the image database 18. For this reason, it is possible to display the reference image and the ultrasonic display image in parallel on the monitor 5 by reading the reference image data from the image database 18 and giving them to the monitor 5. In addition, 3D ultrasound image data, 4D ultrasound image data, and ultrasound display image data collected in the past can be displayed on the monitor 5. In particular, when 3D ultrasound image data, 4D ultrasound image data, and ultrasound display image data are acquired in synchronization with an ECG signal acquired from the ECG unit 10, 3D ultrasound image data in a desired cardiac phase is acquired. Or ultrasonic display image data can be selectively read from the image database 18 and displayed on the monitor 5.

  The monitor 5 has a function of displaying ultrasonic display image data and reference image data given as an image signal from the display unit 16 as an ultrasonic display image and a reference image.

  The image database 18 is connected via a network 7 to an image diagnostic apparatus such as an X-ray CT apparatus 8A and an MRI apparatus 8B, an image server 9 such as a DICOM server, and an image processing apparatus (not shown). In addition, a media drive for reading information stored in information recording media such as MO (magneto-optic disc), CD-R (compact disc recordable), DVD (Digital Versatile Disc), etc. may be connected to the image database 18. it can.

  The image database 18 has a function of acquiring desired image data such as a diagnostic report image from the image diagnostic apparatus, the image server 9, or an information recording medium, and storing it as reference image data. The image database 18 can store ultrasonic display image data such as still images and moving images, ultrasonic image data, and 4D ultrasonic image data provided from the display unit 16. That is, the image database 18 stores ultrasonic display image data, ultrasonic image data, and image data input from the outside of the ultrasonic diagnostic apparatus 1 created in the past.

  The CPU 17 has a function of comprehensively controlling each component provided in the apparatus main body 2. Information necessary for control of the apparatus main body 2 is given as operation information from the operation panel 4 to the CPU 17. Further, the CPU 17 controls each component so that 3D ultrasonic image data in a desired cardiac phase is collected using the ECG signal from the ECG unit 10 in synchronization with the ECG signal as necessary. It is configured. Further, the CPU 17 is configured to be able to obtain a cardiac time phase of each 3D ultrasound image data and ultrasound display image data when a plurality of 3D ultrasound image data is collected under ECG synchronization. The

  Further, the CPU 17 is loaded with a data processing program for performing three-dimensional image data processing. For this reason, the CPU 17 has a function as a 3D image data processing device by performing arithmetic processing according to the data processing program.

  FIG. 4 is a functional block diagram showing details of the 3D image data processing function of the CPU 17 shown in FIG.

  As illustrated in FIG. 4, the CPU 17 functions as a position of interest specifying unit, a spatial region creating unit, a region interlocking unit, and an analyzing unit. In FIG. 4, illustration of functions other than the 3D image data processing function is omitted.

  The position-of-interest specifying unit acquires operation information input from the input device 6 through the operation panel 4, so that the input device 6 performs an ultrasonic display image such as a VR image or MPR image of the subject displayed on the monitor 5. A function for acquiring a specified position, a function for obtaining a position on 3D ultrasound image data corresponding to a position on the acquired ultrasound display image, specifying a position on the obtained 3D ultrasound image data as a position of interest, It has a function of giving the specified position of interest to the spatial region creation unit and a function of giving the specified position of interest to the display unit 16 as marking information. Further, the position-of-interest specifying unit is configured to be able to acquire from the display unit 16 or the image database 18 the spatial position information necessary for obtaining the position on the 3D ultrasonic image data corresponding to the position on the ultrasonic display image. The

  Note that a plurality of positions of interest can be set. Further, the position of interest is not limited to a point, and may be specified as a line segment or a two-dimensional region. In such a case, in addition to the position designated by the input device 6, the position of interest can be specified by interpolation processing between a plurality of points or lines.

  When 3D ultrasound image data exists in time series, that is, when it is 4D ultrasound image data, 3D ultrasound image data at a predetermined time is selected and displayed on the corresponding ultrasound display image. The position will be specified. Since the ECG signal can be referred to when selecting 3D ultrasonic image data, the position can be specified by the input device 6 on the ultrasonic display image of a desired cardiac phase.

  The spatial region creation unit has a function of creating a three-dimensional spatial region based on the position of interest acquired from the position of interest specifying unit, and a function of giving the created spatial region to the display unit 16 and the region interlocking unit. A method for creating a three-dimensional space area and information necessary for the creation can be instructed or given to the space area creating section through the operation panel 4 by operating the input device 6. The three-dimensional space region can have a desired shape. For example, a region in a spherical surface having a desired radius centered on the position of interest, or a region in a tube or cylinder created by a desired method with the position of interest as a reference can be used. As a more specific example, a line segment along a blood vessel is created by specifying a plurality of positions of interest, or a line segment along a blood vessel is specified as a position of interest, and a tube or cylinder around the line segment is specified. The region can be a three-dimensional space region.

  The area interlocking unit has a function of interlocking an area or a range set for another purpose with the spatial area acquired from the spatial area creating unit. For example, a region of interest (ROI) (range gate for collecting color Doppler data) or spectrum Doppler image data for capturing a color Doppler image can be obtained from the spatial region acquired from the spatial region creation unit by the region interlocking unit. It can be automatically set as a range gate for collection. In this case, the electric pulse output from the ultrasonic transmission unit 11 to the ultrasonic probe 3 is controlled according to the range gate automatically set corresponding to the spatial region.

  As another example, when a cropping process for removing an unnecessary portion of an ultrasonic display image displayed on the monitor 5 is performed, an ROI (cropping region) remaining as a necessary portion can be automatically set as a spatial region. . In this case, the area interlocking unit is configured to provide the display unit 16 with instruction information for the cropping process in which the spatial region is the cropping region, and the display unit 16 is configured so that 2D region data corresponding to the spatial region remains. Cropping processing is performed on the ultrasonic display image data, and only the ultrasonic display image in the 2D region corresponding to the spatial region is displayed on the monitor 5.

  As another example, when quantifying two-dimensional ultrasonic display image data or 3D ultrasonic image data or performing analysis for other purposes, the ROI to be analyzed is changed to a spatial region or a spatial region. The corresponding 2D area can be set automatically. In this case, the region interlocking unit is configured to give analysis instruction information in which the ROI to be analyzed is set to a spatial region or a 2D region corresponding to the spatial region.

  The analysis unit performs the specified type of analysis on the ultrasonic display image data in the ROI when the spatial interface set in the ROI or the 2D region corresponding to the spatial region is given as analysis instruction information from the region interlocking unit. Or it has the function performed based on 3D ultrasonic image data, and the function displayed on the monitor 5 by giving an analysis result to the display part 16. FIG. An instruction for designating whether the type of analysis or the data to be analyzed is ultrasonic display image data or 3D ultrasonic image data can be given to the analysis unit through the operation panel 4 by operating the input device 6.

  On the other hand, the operation panel 4 shown in FIG. 1 has a function of operating the apparatus main body 2 via the CPU 17 by an operation device such as an input device 6, a key (not shown), or a dial. In particular, the input device 6 provides the necessary information to the interested position specifying unit and the spatial region creating unit to perform marking on the ultrasonic display image to specify the interested position, and the space of the 3D ultrasonic image data based on the interested position. An area can be created.

  In addition, selection of a display mode for designating the type of ultrasonic display image to be displayed on the monitor 5 can be given to the display unit 16 via the operation panel 4 and the CPU 17 by operating the input device 6. When displaying an MPR image, selection or change of a display section can be instructed to the display unit 16 via the operation panel 4 and the CPU 17 by operating the input device 6.

  Next, the operation and action of the ultrasonic diagnostic apparatus 1 will be described.

  FIG. 5 shows a 4D image of a coronary artery stenosis site or a PCI treatment site using the ultrasonic diagnostic apparatus 1 shown in FIG. 1, and uses a CT image of the circulatory organ previously collected by the X-ray CT apparatus 8A as a reference image. It is a flowchart which shows an example in the case of setting a space area | region for a diagnosis, and the code | symbol which attached | subjected the number to S in the figure shows each step of a flowchart.

  First, X-ray CT image data in a subject's circulatory organ is collected in advance by the X-ray CT apparatus 8A, and a coronary artery stenosis site or a treatment site by PCI is identified. For example, the X-ray CT image data is transferred from the X-ray CT apparatus 8A to the image server 9 via the network 7, and stored and managed in the image server 9 such as a DICOM server.

  In step S1, the ultrasound diagnostic apparatus 1 acquires the X-ray CT image data of the circulatory organ in which the coronary artery stenosis site and the treatment site are identified from the X-ray CT apparatus 8A via the network 7, The acquired X-ray CT image data is stored in the image database 18 as reference image data.

  The DICOM server usually stores various X-ray CT image data of a plurality of subjects. For this reason, necessary X-ray CT image data among the X-ray CT image data collected by the circulatory examination by the past X-ray CT apparatus 8A of the subject to be diagnosed by the ultrasonic diagnostic apparatus 1 is stored in the input device 6. It is selected for reading into the ultrasonic diagnostic apparatus 1 by operation. When the selected X-ray CT image data is X-ray CT image data corresponding to a plurality of myocardial cross-sectional images, or when it is 3D X-ray CT image data in the middle diastole of the myocardium, it covers a plurality of time phases. In some cases, it is 4DX line CT image data. In the X-ray CT image data of the circulatory organ, for example, when a coronary artery stenosis site is detected, the X-ray CT image data from which the coronary artery stenosis site is detected is selected by the operation of the input device 6 and is stored in the ultrasonic diagnostic apparatus 1. Are stored in the image database 18.

  Next, in step S2, for example, time-series 3D ultrasonic image data of the heart of the subject is sequentially collected in real time by dynamic 3D scanning by the ultrasonic diagnostic apparatus 1. Further, an ECG signal is acquired by the ECG unit 10 as necessary, and 3D scanning is performed under electrocardiographic synchronization using the ECG signal. In this case, 3D ultrasound image data in a desired cardiac time phase such as the middle diastole of the myocardium can be selectively collected.

  That is, the ultrasonic transmission unit 11 sequentially applies the electrical pulse a plurality of times with a predetermined delay time corresponding to each of the plurality of ultrasonic transducers provided in the ultrasonic probe 3. Then, each ultrasonic transducer of the ultrasonic probe 3 sequentially converts the electric pulses continuously applied from the ultrasonic transmission unit 11 into ultrasonic pulses and transmits the ultrasonic pulses to the subject with a corresponding delay time. Then, an ultrasonic transmission beam traveling in a predetermined direction is formed. Then, three-dimensional scanning of the subject is performed by controlling the delay time in the ultrasonic transmitter 11 and mechanically swinging the ultrasonic probe 3.

  The ultrasonic echoes generated in the subject due to the continuous transmission of ultrasonic pulses are sequentially received by each ultrasonic transducer of the ultrasonic probe 3 and output to the ultrasonic receiving unit 12 as a reception signal which is an electric signal. The The ultrasonic receiving unit 12 acquires a plurality of reception signals output from the respective ultrasonic transducers of the ultrasonic probe 3 and performs reception processing such as reception delay processing and phasing addition processing to generate an ultrasonic reception beam. Form. Further, when the reception signal is a reception signal for generating a B-mode image, the ultrasonic reception unit 12 gives the reception signal to the B-mode processing unit 13 and the reception signal is a reception signal for generating a color Doppler image. In this case, the received signal is given to the color mode processing unit 14.

  The B-mode processing unit 13 generates B-mode data by performing predetermined signal processing such as filtering, gain adjustment, envelope detection, and the like on the received signal acquired from the ultrasonic receiving unit 12 for each ultrasonic reception beam. Then, the generated B-mode data for each ultrasonic reception beam is given to the 3D processing unit 15. In addition, the color mode processing unit 14 performs predetermined signal processing such as filter processing and velocity detection on the reception signal acquired from the ultrasonic reception unit 12 for each ultrasonic reception beam, thereby generating time-series 3D color Doppler data. And the generated color Doppler data is sequentially supplied to the 3D processing unit 15.

  The 3D processing unit 15 creates time-series 3D ultrasound image data from the B mode data or color Doppler data for each ultrasound reception beam acquired from the B mode processing unit 13 or the color mode processing unit 14. That is, tomographic image data of a tissue such as the heart of the subject is created from the B-mode data, and blood flow image data such as blood flow velocity, power, and dispersion is created from the color Doppler data. The created tomographic image data and blood flow image data are combined into time-series 3D ultrasound image data. The created 3D ultrasound image data is given from the 3D processing unit 15 to the display unit 16.

  Next, in step S3, the ultrasonic display image and the reference image are displayed in parallel on the monitor 5 of the ultrasonic diagnostic apparatus 1. That is, the display unit 16 reads the designated reference image data from the image database 18 and applies the reference image data to the monitor 5 to display the reference image on the monitor 5. The designation of the reference image data to be displayed can be performed by inputting designation information to the CPU 17 through the operation panel 4 by operating the input device 6. The CPU 17 controls the image database 18 according to the designation information of the reference image data to be displayed, and the image database 18 causes the monitor 5 to output the reference image data corresponding to the designation information.

  In parallel, the display unit 16 generates two-dimensional ultrasonic display image data by performing image processing on the 3D ultrasonic image data. For example, when MPR image display mode selection information for creating a moving image MPR image as ultrasonic display image data is input to the CPU 17 through the operation panel 4 by operating the input device 6, the MPR image is displayed on the display unit 16 from the CPU 17. Instructions for creating are given. For this reason, the display unit 16 creates single or plural MPR image data in a predetermined cross-sectional direction from the 3D ultrasonic image data as ultrasonic display image data, and temporarily writes them in the cine memory 19 sequentially. Then, time-series MPR image data is read from the cine memory 19 to the display unit 16 in accordance with the display timing, and is supplied to the monitor 5.

  As a result, the monitor 5 displays the X-ray CT image of the circulatory organ in which the coronary artery stenosis site and the treatment site are identified as a reference image together with the ultrasonic MPR moving image in each cardiac phase. The display unit 16 also stores 3D ultrasonic image data and ultrasonic MPR moving images in the image database 18.

  Here, when the user inputs an instruction of an ultrasonic MPR image of a still image in the middle diastole of the heart through the operation panel 4 to the CPU 17 by operating the input device 6, the display unit 16 performs 3D in the middle diastole of the heart from the image database 18. The ultrasonic image data or the ultrasonic MPR image is read, and the ultrasonic MPR image in the middle diastole of the heart is displayed on the monitor 5. For this reason, the user can observe the ultrasonic MPR image in the middle diastole of the heart while referring to the coronary artery stenosis site and the treatment site identified in the X-ray CT image.

  The acquisition and display of the reference image data from the image server 9 is not limited to being performed in advance before the display of the ultrasonic display image, but may be performed after the display.

  FIG. 6 is a diagram showing an example of an X-ray CT image and an ultrasonic MPR image that are dual-displayed on the monitor 5 of the ultrasonic diagnostic apparatus 1 shown in FIG.

  On the monitor 5, for example, an X-ray CT image as reference image data (REFERENCE) indicating a short chamber axial image of the heart as shown in FIG. 6 and an ultrasonic MPR image (FREEZE-FLAME) of a still image are displayed in parallel. The In FIG. 6, the left image is an X-ray CT image, and the right image is an ultrasonic MPR image. In the example of FIG. 6, X-ray CT image data indicating left ventricular short-axis image data at the papillary muscle level in the middle diastole in which the coronary artery region to be examined is depicted is selected from the image database 18 and is used as a reference image on the monitor 5. Is displayed. In the X-ray CT image, a coronary artery stenosis site P can be confirmed as an abnormal site.

  Also, 3D ultrasound image data in the middle diastole is selected from 4D ultrasound image data (time-series 3D ultrasound image data) of the heart acquired by 4D scanning by the ultrasound diagnostic apparatus 1 and displayed as an MPR image. ing.

  As described above, in accordance with an X-ray CT image displayed in advance, an ultrasonic MPR image at a corresponding time phase of a corresponding part may be selected and displayed by operating the input device 6, or displayed ultrasonic waves. The X-ray CT image in the corresponding time phase of the corresponding part may be selected and displayed by operating the input device 6 according to the MPR image. FIG. 6 shows an example in which an X-ray CT image showing a left ventricular short-axis image of the corresponding papillary muscle level is selected and displayed by operating the input device 6 according to the ultrasonic MPR image in the middle diastole displayed on the monitor 5. Indicates.

  Then, the user refers to the X-ray CT image of the left ventricular short-axis image and the ultrasonic MPR image in the dual phase displayed on the monitor 5, thereby detecting the abnormal part of the coronary artery detected on the X-ray CT image. The position on the ultrasonic MPR image corresponding to can be recognized.

  Next, in step S4, with reference to the X-ray CT image, the user moves to a position on the ultrasonic MPR image corresponding to the coronary artery stenosis site detected on the X-ray CT image by operating the input device 6 such as a trackball. Mark. Thereby, the coronary artery stenosis site on the ultrasonic MPR image is specified as the position of interest, and the marking position is displayed on the monitor 5.

  That is, when the position on the ultrasonic MPR image displayed on the monitor 5 is designated by an operation such as a click by the input device 6, the operation information of the input device 6 is given to the interested position specifying unit of the CPU 17 through the operation panel 4. Then, the position-of-interest specifying unit acquires the position specified by the input device 6 on the ultrasonic MPR image, and the corresponding 3D ultrasonic image based on the spatial position information of the 3D ultrasonic image data acquired from the display unit 16. Find the position on the data. Then, the interested position specifying unit specifies the obtained position on the 3D ultrasound image data as the interested position, and provides the specified interested position as marking information to the display unit 16 and the spatial region creating unit.

  Further, the display unit 16 obtains a position on the ultrasonic MPR image corresponding to the marking information indicating the position on the 3D ultrasonic image data acquired from the position of interest specifying unit, and identifies the obtained position on the ultrasonic MPR image. Image information for display is output to the monitor 5. Thereby, the marking position is displayed on the ultrasonic MPR image displayed on the monitor 5.

  FIG. 7 is a diagram showing an example in which the marking position on the ultrasonic MPR image shown in FIG. 6 is displayed.

  As shown in FIG. 7, the position of the marked abnormal site of the coronary artery is identified and displayed by a marking symbol M, for example. That is, the abnormal part of the coronary artery on the ultrasonic MPR image corresponding to the coronary artery stenosis part P on the X-ray CT image is marked with the marking symbol M.

  Next, in step S5, the spatial region creation unit creates a three-dimensional spatial region based on the position of interest acquired from the position of interest specifying unit. For example, the inside of the spherical surface centered on the position of interest is a three-dimensional space region. The spatial region creation unit gives spherical information centered on the position of interest to the display unit 16 and the region interlocking unit. Then, the display unit 16 obtains a circle centered on the position of interest, which is the intersection of the spherical surface centered on the position of interest and the ultrasonic MPR image. Further, the display unit 16 causes the monitor 5 to output image information for identifying and displaying a circle corresponding to the spatial region on the obtained ultrasonic MPR image. Thereby, a circle corresponding to the spatial region is displayed on the ultrasonic MPR image displayed on the monitor 5.

  FIG. 8 is a diagram showing an example in which a spherical space region based on the marking position on the ultrasonic MPR image shown in FIG. 7 is displayed.

  As shown in FIG. 8, in order to clarify the region near the abnormal region of the marked coronary artery, a spatial region is created as a region within a sphere centered on the marking position, and is formed as a circle C on the ultrasonic MPR image. Is displayed. The radius of the circle C corresponding to the radius of the space region can be varied by operating the input device 6 such as a trackball.

  Once the marking position and spatial area on the 3D ultrasonic image data are obtained, the corresponding marking position and spatial area can be identified and displayed when various ultrasonic display images are displayed.

  FIG. 9 is a diagram illustrating an example in which the ultrasonic MPR image illustrated in FIG. 8 is displayed as an operation target image.

  If an abnormal part of the coronary artery and an area of the spherical inner surface near the coronary artery are identified and displayed on the ultrasonic MPR image, the X-ray CT image becomes unnecessary for diagnosis. Therefore, for example, as shown in FIG. 9, a single display mode in which the X-ray CT image is not displayed and the ultrasonic MPR image is an operation target can be set. The display mode can be changed by controlling the display unit 16 through the CPU 17 by operating the input device 6.

  As a result, the translation operation and the rotation operation of the cross section of the ultrasonic MPR image in which the abnormal part of the coronary artery and the region of the spherical inner surface in the vicinity are displayed can be performed. That is, since the ultrasonic MPR image is a cross-sectional image of 3D ultrasonic image data, the cross-section is freely changed by operating the input device 6 such as a trackball, and the ultrasonic image is displayed and observed three-dimensionally. It is possible.

  FIG. 10 is a diagram illustrating an example in which an ultrasonic MPR image and a perspective image of a plurality of different cross sections are displayed based on the ultrasonic MPR image illustrated in FIG. 9.

  For example, as shown in FIG. 10, ultrasonic MPR images having a plurality of different cross sections can be displayed in parallel on the monitor 5. As shown in FIG. 10, when the ultrasonic MPR image is subjected to translation operation or cross-section rotation operation, the corresponding marking position and space area are obtained by the display unit 16 following the operation, and are displayed on the monitor 5. Is displayed. In the example of FIG. 10, since the spatial region set in the 3D ultrasound image data is a region in a spherical surface, a circle C that is an intersection line with the spherical surface is centered on the marking symbol M on each ultrasonic MPR image. It is displayed as.

  According to the ultrasonic MPR image shown in FIG. 10, it can be easily understood that the portion inside the circle indicating the spatial region is a myocardial region within a certain distance from the abnormal portion of the coronary artery. Further, by moving the cross section of the ultrasonic MPR image in an arbitrary three-dimensional manner, it becomes possible to compare the vicinity of the abnormal site of the coronary artery and the surrounding situation in a three-dimensional manner. Then, the periphery of the stenosis site can be observed while being aware of the distance from the stenosis site.

  Further, when a 4D scan is performed by the ultrasonic diagnostic apparatus 1, 3D ultrasonic image data is stored in the image database 18 in time series. Accordingly, it is possible to reproduce a moving image of the ultrasonic MPR image while displaying the marking position and the space area. For this reason, it becomes possible to easily compare and evaluate the wall motion of the myocardium in the vicinity of and around the abnormal site. Furthermore, by freely changing the cross section, it is possible to observe the wall motion while considering the distance from the abnormal site.

  As described above, in the 3D ultrasonic image data and the 4D ultrasonic image data stored in the image database 18, the abnormal region marking and the creation / display of a spatial region such as a spherical surface are performed, and then stored in the image database 18. Evaluation of an arbitrary cross section based on 3D ultrasonic image data and evaluation of moving images of ultrasonic MPR images based on 4D ultrasonic image data can be performed. In addition, a live image of an ultrasonic MPR image can be displayed as an X-ray CT image and a dual display by performing a 4D scan after marking and creating a spatial region.

  FIG. 11 is a diagram showing an example in which a LIVE image of an X-ray CT image and an ultrasonic MPR image is displayed on the monitor 5 of the ultrasonic diagnostic apparatus 1 shown in FIG.

  If a 4D scan is performed after marking an abnormal part and setting a spherical surface as a space area, as shown in FIG. 11, the display is switched to a dual display of an X-ray CT image as a reference image and a live image of an ultrasonic MPR image. Can do. In the example of FIG. 11, the X-ray CT image is displayed on the left side of the monitor 5, and the LIVE image of the ultrasonic MPR image is displayed on the right side. In this case, it is necessary that the ultrasonic probe 3 is not moved after it is optimally placed on the body surface of the subject. As shown in FIG. 11, the abnormal part can be easily evaluated by the LIVE image of the ultrasonic MPR image.

  It is possible to display a desired cross section by operating the input device 6 and the operation panel 4 during the display of the LIVE image of the ultrasonic MPR image, that is, during the ultrasonic examination, and it is also possible to change the display mode. Thus, even if the time changes in the LIVE image of the ultrasonic MPR image or the display mode is changed, since the spherical surface that defines the marking position and the spatial region is fixed on the 3D ultrasonic image data, the marking position and The space area does not move.

  Therefore, the time-series ultrasonic MPR image that is the target for setting the marking position and the spatial region and the LIVE image of the ultrasonic MPR image taken after setting the marking position and the spatial region can be displayed in Dual.

  FIG. 12 shows a time-series ultrasonic MPR image for setting the marking position and the spatial region on the monitor 5 of the ultrasonic diagnostic apparatus 1 shown in FIG. 1 and the ultrasonic MPR collected after setting the marking position and the spatial region. It is a figure which shows the example which displayed the LIVE image of the image in Dual.

  For example, as shown in FIG. 12, a moving image of the past myocardium in the middle diastole including the ultrasonic MPR image for which the marking position and the spatial region are set is displayed on the left side of the monitor 5, while the marking position is displayed on the right side of the monitor 5 In addition, it is possible to display a continuous LIVE image of the ultrasonic MPR image collected after setting the spatial region. In this case, the marking position (marking symbol M) and the spatial region (circle C) do not move, and the continuous LIVE image of the ultrasonic MPR image and the moving image of the ultrasonic MPR image in the middle diastole of the myocardium change with time. Become. In addition, when the display section of the continuous LIVE image of the ultrasound MPR image on the right side of the monitor 5 is changed, the display section of the ultrasound MPR image in the middle expansion period on the left side of the monitor 5 is automatically linked to the changed display section. It can also be changed to.

  As another example of the display mode, the cardiac phase of the ultrasound MPR image in the middle diastole of the myocardium for which the marking position and the spatial region are set is obtained, and the cardiac phase is the same as the obtained cardiac phase. Sound MPR images can be collected by ECG synchronization and displayed as a live image. Also in this case, it is useful for diagnosis to display the LIVE image of the ultrasonic MPR image and the continuous LIVE image of the ultrasonic MPR image in the middle diastole of the myocardium. In addition, when the display section of the continuous LIVE image of the ultrasound MPR image is changed, the display section of the ultrasound MPR image in the middle diastole of the myocardium can be automatically changed in conjunction with the changed display section. . As described above, the ultrasonic MPR image in the middle diastole of the myocardium in which the spatial region is set can always be displayed in dual display.

  Further, the example in the case where the marking position and the space area are single has been described so far, but a plurality of marking positions and space areas can be set. Furthermore, it is possible to display the space area in a colored manner.

  FIG. 13 is a diagram showing an example in which two spatial regions set in the ultrasonic diagnostic apparatus 1 shown in FIG. 1 are colored and displayed.

  For example, as shown in FIG. 13, two spatial regions can be set. Each spatial region can be displayed in a desired color. As shown in FIG. 13, if the vicinity region of the abnormal part is colored and displayed, the vicinity region can be easily grasped. FIG. 13 shows an example in which marking is performed at two locations, and if the cross-section operation and the display mode are appropriately changed, it is possible to easily understand the overlapping state and positional relationship between the two spatial regions in the three-dimensional space. can do. Practically, when evaluating the wall motion of the myocardium in a spatial region including two abnormal sites from various directions, there is an advantage that the recognition of each abnormal site becomes simple.

  A plurality of marking positions and spatial regions can be set not only in the three-dimensional space but also between different times and cardiac phases. For example, it is possible to mark the same abnormal site identified in advance by comparing X-ray CT images with 3D ultrasound image data at the end diastole and 3D ultrasound image data at the end systole of the myocardium. In this case, it is useful to perform a 4D scan to collect 3D ultrasound image data at the end of diastole of myocardium synchronized with ECG and a 4D scan to collect 3D ultrasound image data at the end of systole of myocardium. It is.

  In this way, if multiple positions of interest are identified by marking the same part on 3D ultrasound image data at different times and cardiac phases, interpolation of the positions of interest at arbitrary times and cardiac phases It is possible to estimate. Then, regardless of whether interpolation processing is involved or not, if a plurality of positions of interest are set in the time direction, when displaying an ultrasonic MPR image in a moving image, a circle in the circle corresponding to the set region of interest and the spatial region is set. The area can be displayed following the movement of the myocardium. As a result, it is possible to perform an evaluation using a more accurate position of interest and a spatial region in accordance with the movement of the myocardium.

  Then, the area and range set for other purposes can be linked to the spatial area on the 3D ultrasonic image data set in this way as necessary.

  In this case, in step S6 of FIG. 5, the region interlocking unit interlocks the spatial region acquired from the spatial region creating unit with a region or range set for another purpose.

  FIG. 14 is a diagram showing an example in which the spatial region set in the ultrasonic diagnostic apparatus 1 shown in FIG. 1 is linked to the cropping region.

  For example, as shown in FIG. 14, a region in a circle C on the ultrasonic MPR image corresponding to the spatial region can be set as the cropping region. In this case, the region interlocking unit provides the display unit 16 with instruction information for the cropping process in which the spatial region is the cropping region. Then, the display unit 16 causes the monitor 5 to display an ultrasonic MPR image of only a region within a circle that is a cropping region. This makes it possible to selectively extract only the vicinity of the abnormal part of the coronary artery and easily observe it. In particular, if a plurality of spatial regions are set and the myocardial wall motion is compared, masking unnecessary regions by the cropping process can improve the ease of evaluation.

  In addition, the space area can be automatically set by the area interlocking unit as a range gate for collecting color Doppler image ROI and spectrum Doppler image data. As another example, ROI for quantitative analysis can be linked to a spatial domain. For example, the region in the circle on the ultrasonic MPR image corresponding to the spatial region is automatically set by the region interlocking unit as the ROI of the quantitative analysis for obtaining the temporal change of the average luminance, and the analysis instruction is given to the analyzing unit.

  Next, in step S <b> 7, quantitative analysis by the analysis unit is performed on a region in a circle on the ultrasonic MPR image automatically set as ROI. That is, the average luminance of the area in the circle on the ultrasonic MPR image at each time (cardiac time phase) is calculated, and graph information indicating the temporal change of the average luminance is created. The analysis unit gives the created graph information to the display unit 16, and the display unit 16 displays the graph on the monitor 5.

  FIG. 15 is a diagram illustrating an example in which an analysis result obtained by linking the spatial region set in the ultrasonic diagnostic apparatus 1 illustrated in FIG. 1 with the ROI of the quantitative analysis is displayed.

  For example, as shown in FIG. 15, the temporal change in the average luminance of the area in the circle C on the ultrasonic MPR image corresponding to the spatial area can be obtained and displayed as a graph G.

  In the above description, the case of diagnosing myocardial wall motion and coronary artery stenosis has been described as an example. However, the same applies to a case where a color Doppler image is to be evaluated or a contrast image using a contrast medium is to be evaluated. In addition, it is possible to perform image processing such as specifying a position of interest by marking and setting / displaying a spatial region. Further, the present invention can be applied not only to cardiovascular coronary artery disease and heart application but also to diagnosis of various clinically useful organs and parts. In addition, the use of X-ray CT images was illustrated as a reference image, but other diagnostic imaging such as MR (magnetic resonance) images and examination data collected by nuclear medicine diagnostic equipment such as PET (positron emission computed tomography) equipment. An image collected by the modality can be used as a reference image.

  Further, the example in which a spherical surface is created as a spatial region as described above has been described, but any shape such as a tube or an elliptical sphere can be used, and the spatial region once created can be manually operated by operating the input device 6. It can be transformed into any shape.

  That is, the ultrasonic diagnostic apparatus 1 as described above uses, as a reference image, an image in which a target site such as a stenosis site or a treatment site of a coronary artery identified in advance by an examination using an image diagnostic apparatus such as the X-ray CT apparatus 8A is depicted. A position corresponding to the target part can be marked on the 3D ultrasonic image data, and a space area for identifying and displaying the peripheral area of the target part can be created based on the marking position.

  Therefore, according to the ultrasonic diagnostic apparatus 1, the wall motion and perfusion around the abnormal part of the coronary artery are evaluated with reference to the accurate coronary artery information obtained by the examination by the image diagnostic apparatus such as the X-ray CT apparatus 8A. Compared to the conventional method, it can be performed easily and accurately. For example, it is possible to observe wall motion using ultrasound and evaluate blood flow using a contrast agent while grasping the spatial distance from the stenosis site. In particular, in diagnosis, treatment support, and treatment application using the ultrasonic diagnostic apparatus 1 capable of performing 4D scanning, the position information of the abnormal region and the region of interest obtained with other modalities should be used effectively. Can do.

  FIG. 16 is a block diagram showing a second embodiment of the ultrasonic diagnostic apparatus according to the present invention.

  The ultrasonic diagnostic apparatus 1A shown in FIG. 16 is different from the ultrasonic diagnostic apparatus 1 shown in FIG. 1 in that the apparatus main body 2 is provided with a reference image 3D image processing unit 20. Since other configurations and operations are not substantially different from those of the ultrasonic diagnostic apparatus 1 shown in FIG. 1, the same components are denoted by the same reference numerals and description thereof is omitted.

  That is, the reference image 3D image processing unit 20 is provided in the apparatus main body 2 of the ultrasonic diagnostic apparatus 1A. The reference image 3D image processing unit 20 reads desired reference image data collected in another image diagnostic apparatus from the image database 18 and performs a desired 3D image display process such as a cross-section conversion process to perform 3D reference. It has a function of creating 2D reference image data for display from image data and a function of outputting the created 2D reference image data to the display unit 16. For example, the reference image 3D image processing unit 20 has a function of creating, from 3D reference image data, cross-sectional image data corresponding to cross-sectional image data that is typically created as ultrasonic display image data.

  According to the ultrasonic diagnostic apparatus 1A having such a configuration, 3D image processing of reference image data can be performed so that it can be easily compared with an ultrasonic display image such as an ultrasonic MPR image. That is, in the image database 18, 3D or 4D image data such as CT image data of a subject to be examined by the ultrasonic diagnostic apparatus 1 </ b> A is written via the network 7 or from a medium and stored as reference image data. Yes. Therefore, desired reference image data is selected and read from the image database 18 into the reference image 3D image processing unit 20. Then, in the reference image 3D image processing unit 20, reference display image data such as a tomographic image is generated by 3D image processing such as cross section conversion processing and transferred to the display unit 16.

  The reference image data after image processing transferred to the display unit 16 is output and displayed on the monitor 5. The user can change the cross-sectional position by operating the input device 6 or the operation panel 4 while referring to the displayed reference image. Further, operations such as changing the display format and changing the viewing direction can be performed. For example, cross-sectional image data corresponding to cross-sectional image data that is typically created as ultrasonic display image data can be created from reference image data and displayed for comparison.

  FIG. 17 is a view showing a cross section of the heart that is normally inspected by the ultrasonic diagnostic apparatus 1A shown in FIG.

  For example, as shown in FIG. 17, a standard heart cross section is set in advance, and an ultrasonic MPR image of the set cross section is often displayed on the monitor 5. Although a simplified diagram is shown in FIG. 17, in practice, a cross section obtained by dividing the left ventricular wall of the heart into 16 parts is often used.

  Therefore, when display by a standard cross section is instructed by operating the input device 6 or the operation panel 4, the reference image 3D image processing unit 20 corresponds to a standard inspection cross section from the reference image data such as 3D CT image data. Create cross-sectional image data. Then, the created standard cross-sectional image data is output to the monitor 5 via the display unit 16.

  18 is a diagram showing an example in which the ultrasound MPR image and a plurality of reference images corresponding to the standard cross section shown in FIG. 17 are dual-displayed in the ultrasound diagnostic apparatus 1A shown in FIG.

  For example, as shown in FIG. 18, an ultrasonic MPR image of a certain cross section is displayed on the right side of the monitor 5. Further, on the left side of the monitor 5, an X-ray CT image of three standard cross sections and a perspective view for confirming each cross section are displayed as a reference image. In the example of FIG. 18, slice CT images in three cross-sections in the short axis direction from the heart apex of a standard heart to the valve annulus in ultrasonic examination are displayed based on 3D X-ray CT image data. In the slice CT image shown in FIG. 18, the anterior descending branch of the coronary artery at the papillary muscle level is identified as an abnormal site.

  Therefore, a short-axis image of the papillary muscle level of the heart can be displayed as a dual-displayed ultrasonic MPR image and marked at a corresponding position. As a result, a circle C corresponding to a spatial area created as a spherical area centered on the marking position indicated by the marking symbol M is displayed on the ultrasonic MPR image. When the marking position and the space area are displayed, the cross-sectional direction and display mode of the ultrasonic MPR image can be freely changed and observed by operating the input device 6 or the operation panel 4 as described above. For example, it is possible to accurately evaluate the wall motion of the abnormal part if the moving picture is reproduced in the cardiac cycle, and it is possible to evaluate the presence or absence of perfusion of the abnormal part if the moving picture is reproduced in the ultrasonic contrast mode. Also, an ultrasonic MPR image having a standard cross section as shown in FIG. 17 can be displayed.

  FIG. 19 is a diagram showing an example in which the display of the ultrasonic MPR image shown in FIG. 18 is switched to the display of a plurality of ultrasonic MPR images having a standard cross section.

  For example, as shown in FIG. 19, not only the reference image on the left side but also the display of the ultrasonic MPR image on the right side of the monitor 5 can be switched to the display of a plurality of ultrasonic MPR images having a standard cross section. That is, the ultrasonic MPR image in the short-axis cross section of the heart is displayed in multi-slice. In this way, both the reference image such as the X-ray CT image and the cross section of the ultrasonic MPR image are standard cross sections, so that it is possible to make a diagnosis by comparing the reference image and the ultrasonic MPR image for each cross section. It becomes. Thereby, the abnormal site | part of the coronary artery detected on reference image data, such as X-ray CT image data, and the interested position on an ultrasonic MPR image can be matched easily.

  If the reference image is displayed in multi-slice, a plurality of markings can be performed at different positions in the space. Therefore, a plurality of ultrasonic MPR images and reference images can be displayed dually for marking at a plurality of points.

  20 is a diagram showing an example in which a plurality of reference images and a plurality of ultrasonic MPR images are dual-displayed so as to correspond to the standard cross section shown in FIG. 17 in the ultrasonic diagnostic apparatus 1A shown in FIG. It is.

  For example, as shown in FIG. 20, on the left side of the monitor 5, as in FIG. 18, a standard three-slice multi-slice X-ray CT image in the short axis direction and a perspective view for confirming each cross section are used as a reference image. Is displayed. On the other hand, on the right side of the monitor 5, multi-slice ultrasonic MPR images of cross sections in three standard short axis directions are displayed.

  When a plurality of reference images are displayed, it is possible to observe an abnormal region spatially including the depth direction. For example, when cross-sectional images in the short axis direction of a plurality of hearts as shown in FIG. 20 are displayed as reference images, it is possible to observe the coronary arteries along the running direction while recognizing the connection of the main coronary arteries. it can. FIG. 20 shows an example in which an anomaly in which the anterior descending branch is constricted at the papillary muscle level is depicted on an X-ray CT image. In other multi-slice X-ray CT images, the anterior descending branch on another surface is shown. Easy to find.

  Therefore, if a plurality of multi-slice ultrasound MPR images in a similar short-axis cross-section corresponding to each multi-slice X-ray CT image is displayed, each ultrasound MPR can be easily referred to by referring to the multi-slice X-ray CT image. The front descending branch on the image can be marked. Furthermore, by interpolating in a 3D space between a plurality of marking positions on the ultrasonic MPR image, the position of interest can be set as a line segment along the front descending branch.

  Then, an area in the tube having a desired radius with the position of interest set as a line segment as a center line can be created as a spatial area. As a result, on the 3D ultrasound image data, the position that serves as an indication of the front descending branch is recorded as the position of interest, and the area near the front descending branch is recorded as the tube-shaped spatial area. As shown in FIG. 20, the spatial region in the tube is displayed as a curve such as a circle C or an ellipse E on each ultrasonic MPR image.

  FIG. 21 is a diagram showing an example in which the multi-slice ultrasonic MPR image shown in FIG. 20 is displayed by switching to the single display mode.

  As shown in FIG. 21, after setting the marking position and the spatial region, the multi-slice X-ray CT image that is the reference image is not displayed, and only the multi-slice ultrasonic MPR image can be observed and operated. That is, it is possible to observe the ultrasonic MPR image by changing the cross-sectional direction and the display mode freely by operating the input device 6 and the operation panel 4. For this reason, it is possible to observe the dominant area of the front descending branch from various directions. Furthermore, if an ultrasonic MPR image is reproduced as a moving image, it is possible to accurately evaluate the wall motion in the dominant region of the front descending branch. In addition, when marking is performed for a plurality of coronary arteries, wall motion, perfusion, and blood flow in the control region of each coronary artery can be accurately evaluated.

  As another example of the display mode, a multi-slice X-ray CT image and a live image of a multi-slice ultrasonic MPR image in a standard cross section can be displayed dually after setting a marking position and a spatial region.

  FIG. 22 is a diagram showing an example in which the plurality of ultrasonic MPR images shown in FIG. 20 are switched to a live image display.

  For example, as shown in FIG. 22, a multi-slice X-ray CT image is displayed on the right side of the monitor 5, marking is performed on the corresponding multi-slice ultrasonic MPR image to set a spatial region, and then the multi-slice ultrasonic MPR image is displayed. You can also switch to a LIVE image. Further, as in the case of the ultrasonic diagnostic apparatus 1 in the first embodiment shown in FIG. 1, a live image in the middle diastole of the myocardium including a multi-slice ultrasonic MPR image for which a marking position and a spatial region are set A continuous LIVE image collected after setting the marking position and the space area can also be displayed dual. Further, similarly to the case of the ultrasonic diagnostic apparatus 1 in the first embodiment shown in FIG. 1, the cardiac time phase identical to the cardiac time phase of the multi-slice ultrasonic MPR image which is the setting target of the marking position and the spatial region. The LIVE image of the multi-slice ultrasound MPR image and the continuous LIVE image of the multi-slice ultrasound MPR image in the middle diastole of the myocardium collected in Step 2 can be displayed in Dual.

  In other words, the ultrasonic diagnostic apparatus 1A as described above can easily compare with the ultrasonic display image by performing three-dimensional image processing on the reference image data collected in other modalities, and perform marking and marking. This makes it possible to set the space area more appropriately.

  In addition, without performing image processing on the reference image data in the apparatus main body 2 of the ultrasonic diagnostic apparatus 1A, image processing is performed in advance by an image processing apparatus such as a workstation to generate reference image data in a desired cross section. The image data may be transferred to the image database 18 via the network 7.

  In the ultrasonic diagnostic apparatus 1A, the image processing is performed on the reference image data so that the display section of the reference image data is matched with the standard display section of the ultrasonic display image. Image processing may be performed on the 3D ultrasound image data so that the display format of the ultrasound display image matches the standard image display format of the reference image data. For example, since it is standard to generate a cross-sectional image of the heart in an X-ray CT image, a multi-slice ultrasonic MPR image of the myocardium corresponding to the cross-sectional image of the X-ray CT image is created from 3D ultrasonic image data. Display, it is possible to easily compare the two.

  FIG. 23 is a block diagram showing a third embodiment of the ultrasonic diagnostic apparatus according to the present invention.

  The ultrasonic diagnostic apparatus 1B shown in FIG. 23 is different from the ultrasonic diagnostic apparatus 1A shown in FIG. 16 in that the 3D image alignment processing unit 30 is provided in the apparatus main body 2. Since other configurations and operations are not substantially different from those of the ultrasonic diagnostic apparatus 1A shown in FIG. 16, the same components are denoted by the same reference numerals and description thereof is omitted.

  In other words, the 3D image alignment processing unit 30 is provided in the apparatus main body 2 of the ultrasonic diagnostic apparatus 1B. The 3D image alignment processing unit 30 acquires reference image data after image processing from the reference image 3D image processing unit 20, while acquiring 3D ultrasound image data from the 3D processing unit 15 to obtain reference image data and 3D image data. The function of performing spatial and / or temporal alignment by comparing with the sonic image data, and positional relationship information between the reference image data and the 3D ultrasonic image data based on the alignment result are displayed on the display unit 16. And a function to be given to the CPU 17.

  The alignment method can be performed by an arbitrary method. For example, it can be performed by a correlation process between equivalent cardiac phases such as the middle diastole. Furthermore, the positional relationship between the reference image data and the 3D ultrasonic image data can be finely adjusted manually by the control of the CPU 17 by operating the input device 6 or the operation panel 4 as necessary. When fine adjustment of the positional relationship between the reference image data and the 3D ultrasound image data by manual is performed, the positional relationship information after fine adjustment is given to the display unit 16 as positional relationship information.

  In the ultrasonic diagnostic apparatus 1B, it is possible to perform marking on both the reference image and the ultrasonic display image displayed on the monitor 5. Marking on the reference image can be performed in the same manner as marking on the ultrasonic display image by the position of interest specifying unit. When one of the reference image and the ultrasonic display image displayed on the monitor 5 is marked, the position-of-interest specifying unit refers to the 3D reference by referring to the positional relationship information acquired from the 3D image alignment processing unit 30. The position of interest is specified in both image data and 3D ultrasound image data. Further, the display unit 16 automatically identifies and displays the marking position at the corresponding position of the other in conjunction with one of the reference image and the ultrasonic display image marked by referring to the positional relationship information.

  The creation and display of the space area can be performed by the method described above. Furthermore, the operation of the cross section and the change of the display mode after the creation of the space area can be performed as described above.

  According to the ultrasonic diagnostic apparatus 1B having such a configuration, since it is possible to perform marking directly on a reference image such as an X-ray CT image in which a target region is identified, the user's arbitrary intention is eliminated and the interest is simplified. The position and the spatial area can be set on the 3D ultrasonic image data. Thereby, diagnostic accuracy can be improved.

1 is a configuration diagram showing a first embodiment of an ultrasonic diagnostic apparatus according to the present invention. FIG. The figure explaining the scanning method by the 2D array probe used as an ultrasonic probe shown in FIG. The figure explaining the scanning method by the mechanical 4D probe used as an ultrasonic probe shown in FIG. FIG. 2 is a functional block diagram showing details of a 3D image data processing function of the CPU shown in FIG. 1. A 4D image of a coronary artery stenosis site or PCI treatment site is obtained using the ultrasonic diagnostic apparatus shown in FIG. 1, and a spatial region is used for diagnosis while using a CT image of a circulatory organ collected in advance by an X-ray CT apparatus as a reference image. The flowchart which shows an example in the case of setting. The figure which shows an example of the X-ray CT image and ultrasonic MPR image which were Dual-displayed on the monitor 5 of the ultrasonic diagnostic apparatus shown in FIG. The figure which shows the example which displayed the marking position on the ultrasonic MPR image shown in FIG. The figure which shows the example which displayed the spherical space area | region on the basis of the marking position on the ultrasonic MPR image shown in FIG. The figure which shows the example which displayed the ultrasonic MPR image shown in FIG. 8 as an operation target image. The figure which shows the example which displayed the ultrasonic MPR image and perspective image of several different cross sections based on the ultrasonic MPR image shown in FIG. The figure which shows the example which made the LIVE image of an X-ray CT image and an ultrasonic MPR image display in Dual on the monitor of the ultrasonic diagnostic apparatus shown in FIG. A time-series ultrasonic MPR image for setting the marking position and the spatial region and a LIVE image of the ultrasonic MPR image collected after setting the marking position and the spatial region are displayed on the monitor of the ultrasonic diagnostic apparatus shown in FIG. The figure which shows the example made to display Dual. The figure which shows the example which carried out the color display of the two space area | regions set in the ultrasonic diagnosing device shown in FIG. The figure which shows the example which linked the space area | region set in the ultrasound diagnosing device shown in FIG. 1 to the cropping area | region. The figure which shows the example which displayed the analysis result obtained by linking the space area | region set in the ultrasonic diagnosing device shown in FIG. 1 with ROI of quantitative analysis. The block diagram which shows 2nd Embodiment of the ultrasonic diagnosing device which concerns on this invention. The figure which shows the cross section of the heart normally test | inspected by the ultrasonic diagnosing device shown in FIG. FIG. 18 is a diagram showing an example in which an ultrasonic MPR image and a plurality of reference images corresponding to the standard cross section shown in FIG. 17 are dual-displayed in the ultrasonic diagnostic apparatus shown in FIG. 16. The figure which shows the example which switched the display of the ultrasonic MPR image shown in FIG. 18 to the display of the several ultrasonic MPR image of a standard cross section. FIG. 18 is a diagram showing an example in which a plurality of reference images and a plurality of ultrasonic MPR images are dual-displayed so as to correspond to the standard cross section shown in FIG. 17 in the ultrasonic diagnostic apparatus shown in FIG. 16. The figure which shows the example which switched and displayed the multi-slice ultrasonic MPR image shown in FIG. 20 to single display mode. The figure which shows the example which switched and displayed the some ultrasonic MPR image shown in FIG. 20 to the display of a LIVE image. The block diagram which shows 3rd Embodiment of the ultrasonic diagnosing device which concerns on this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1, 1A, 1B Ultrasonic diagnostic apparatus 2 Apparatus main-body part 3 Ultrasonic probe 3A 2D array probe 3B Mechanical 4D probe 4 Operation panel 5 Monitor 6 Input apparatus 6A Keyboard 6B Trackball 7 Network 8A X-ray CT apparatus 8B MRI apparatus 9 Image Server 10 ECG unit 11 Ultrasonic transmission unit 12 Ultrasonic reception unit 13 B mode processing unit 14 Color mode processing unit 15 3D processing unit 16 Display unit 17 CPU (Central Processing Unit)
17A Interest location specifying unit 17B Spatial region creation unit 17C Region interlocking unit 17D Analysis unit 18 Image database 19 Cine memory 20 Reference image 3D image processing unit 30 3D image alignment processing unit

Claims (17)

Image collection means for collecting a three-dimensional ultrasound image of the subject by transmitting and receiving ultrasound to and from the subject;
Position specifying means for specifying a position of interest by marking on the three-dimensional ultrasonic image;
Region creating means for creating a three-dimensional spatial region based on the position of interest;
Display means for displaying the three-dimensional spatial region and the three-dimensional ultrasound image in a superimposed manner;
An ultrasonic diagnostic apparatus comprising: The image acquisition means is configured to dynamically acquire a plurality of three-dimensional ultrasonic images, and the position specifying means specifies the position of interest by marking on a three-dimensional ultrasonic image at a specific time. The ultrasonic diagnostic apparatus according to claim 1, wherein the display unit is configured to display the plurality of three-dimensional ultrasonic images as moving images. The image collecting unit is configured to generate a cross-sectional transformation image from the three-dimensional ultrasonic image, and the position specifying unit is configured to identify the position of interest by marking on the cross-sectional transformation image. The ultrasonic diagnostic apparatus according to claim 1, wherein the display unit is configured to display the cross-sectional transformation image as the three-dimensional ultrasonic image. The ultrasonic diagnostic apparatus according to claim 1, wherein the region creating unit is configured to create a region in a spherical surface having a desired radius centered on the position of interest as the three-dimensional spatial region. . 2. The region creation unit is configured to create a region in a tube or a cylinder created by a desired method based on the position of interest as the three-dimensional space region. Ultrasonic diagnostic equipment. The ultrasonic diagnostic apparatus according to claim 1, wherein the display unit is configured to display an image captured by another image diagnostic apparatus in parallel with the three-dimensional ultrasonic image. The ultrasonic diagnostic apparatus according to claim 1, wherein the display unit is configured to color-display the three-dimensional space region. And a region setting means for setting the three-dimensional spatial region to at least one of a region of interest for photographing a color Doppler image, a range gate of a spectrum Doppler image, a cropping region, and a region of interest set for analysis. The ultrasonic diagnostic apparatus according to claim 1. The image acquisition means is configured to dynamically acquire a plurality of three-dimensional ultrasonic images, and the position specifying means specifies the position of interest by marking on a three-dimensional ultrasonic image at a specific time. And the image acquisition means is configured to dynamically acquire a plurality of three-dimensional ultrasound images in the same cardiac phase as the cardiac phase of the three-dimensional ultrasound image at the specific time. The ultrasonic diagnostic apparatus according to claim 1, wherein: The ultrasonic diagnosis according to claim 9, wherein the image acquisition unit is configured to dynamically acquire the plurality of three-dimensional ultrasonic images in the same cardiac time phase under electrocardiographic synchronization. apparatus. The image acquisition means is configured to dynamically acquire a plurality of three-dimensional ultrasound images, and the position specifying means is respectively provided on a plurality of three-dimensional ultrasound images corresponding to different times or cardiac phases. The ultrasonic diagnostic apparatus according to claim 1, wherein the ultrasonic diagnostic apparatus is configured to identify a plurality of positions of interest by marking. The ultrasonic diagnostic apparatus according to claim 11, wherein the position specifying unit is configured to specify a plurality of positions of interest that change in time series by an interpolation process using a marked position. 7. The ultrasonic diagnosis according to claim 6, further comprising image processing means for generating predetermined cross-sectional image data by performing three-dimensional image processing on an image picked up by the other image diagnostic apparatus. apparatus. The image processing apparatus further includes image processing means for generating cross-sectional image data in a cross section equivalent to the three-dimensional ultrasonic image by performing three-dimensional image processing on an image captured by the other image diagnostic apparatus. The ultrasonic diagnostic apparatus according to claim 6. The ultrasonic wave according to claim 6, further comprising position information acquisition means for performing alignment by obtaining a positional relationship between an image captured by the other image diagnostic apparatus and the three-dimensional ultrasonic image. Diagnostic device. The position information acquisition unit performs the alignment by performing a correlation process between an image captured by the other diagnostic imaging apparatus acquired in a cardiac phase equivalent to each other and the three-dimensional ultrasonic image. The ultrasonic diagnostic apparatus according to claim 15, which is configured as follows. Computer
A position specifying means for specifying a position of interest by marking on a three-dimensional ultrasonic image of the collected subject;
Region creating means for creating a three-dimensional spatial region with reference to the position of interest; and display means for displaying the three-dimensional spatial region and the three-dimensional ultrasonic image in a superimposed manner on a display device;
A data processing program for an ultrasonic diagnostic apparatus, characterized in that

Images