JP7027029B2 - Ultrasound diagnostic equipment and medical image processing equipment - Google Patents

Description

Embodiments of the present invention relate to an ultrasonic diagnostic apparatus and a medical image processing apparatus.

Conventionally, an ultrasonic diagnostic apparatus has been known as a medical diagnostic imaging apparatus. The ultrasonic diagnostic device is a device that generates an in-vivo image showing the inside of a subject and a doctor, a laboratory technician, or the like interprets the in-body image.

In such an ultrasonic diagnostic apparatus, an image other than an ultrasonic image taken in the body of the subject in the past, for example, an image captured by a CT apparatus or an MRI apparatus is used as a reference image, and this reference image and the subject from now on. An inspection method that simultaneously displays an ultrasonic image to be inspected is being studied. For example, it is considered to simultaneously display a reference image of a captured 3D image based on 3D image data and an ultrasonic image corresponding to the reference image.

However, since both the displayed reference image and the ultrasonic image are displayed as a two-dimensional planar image, it is difficult to perform alignment in the depth direction even if planar alignment can be performed. rice field.

Japanese Unexamined Patent Publication No. 2007-244575

The problem to be solved by the present invention is to provide an ultrasonic diagnostic apparatus and a medical image processing apparatus capable of performing more accurate and highly accurate alignment when displaying two images having a depth direction at the same time. That is.

The ultrasonic diagnostic apparatus of the embodiment extracts a collection unit that collects a first volume data including a mark specified on the ultrasonic image and a second volume data including the mark specified on the reference image. The second volume data using the extraction unit, the generation unit that collates the first volume data and the second volume data, and generates conversion data based on the difference, and the conversion data. Is converted to the position of the first volume data, and is provided with a conversion unit for aligning the position.

The schematic block diagram which showed an example of the schematic structure of the ultrasonic diagnostic apparatus of 1st Embodiment. The flowchart which showed the process that the ultrasonic diagnostic apparatus which concerns on this embodiment performs the alignment process and displays the reference image and the ultrasonic image in synchronization. The explanatory view which shows the example which the ultrasonic diagnostic apparatus which concerns on this embodiment displays a CT image and a UL image on a display. The explanatory view which showed the concept that the processing circuit of the ultrasonic diagnostic apparatus which concerns on this Embodiment collects the 1st volume data from the ultrasonic volume data. The explanatory view which showed the concept that the processing circuit of the ultrasonic diagnostic apparatus which concerns on this embodiment extracts the second volume data from CT volume data. The explanatory diagram which showed the concept when the 1st volume data does not have the amount of data necessary for collation. An explanatory diagram showing an example in which a model of a subject is displayed on a display and an operator is urged to perform an ultrasonic scan along a direction with an ultrasonic probe. An explanatory view showing an example in which an ultrasonic diagnostic apparatus according to the present embodiment displays a UL image including a xiphoid process and a CT image including the xiphoid process on a display. The schematic block diagram which showed an example of the schematic structure of the medical image processing apparatus of 2nd Embodiment.

Hereinafter, the ultrasonic diagnostic apparatus of the embodiment will be described with reference to the attached drawings.

(First Embodiment)
FIG. 1 is a schematic configuration diagram showing an example of a schematic configuration of the ultrasonic diagnostic apparatus 100 of the first embodiment.

As shown in FIG. 1, the ultrasonic diagnostic apparatus 100 of the first embodiment includes an ultrasonic probe 10, an ultrasonic diagnostic apparatus main body 20, a magnetic sensor 30, a magnetic generator 31, and a position information collecting apparatus 32. There is.

The ultrasonic probe 10 is configured to include an ultrasonic vibration element. The ultrasonic vibration element has a function of converting an electric drive signal into a transmission ultrasonic wave at the time of transmission, and converting an ultrasonic reflected wave (received ultrasonic wave) into an electric reception signal at the time of reception. The ultrasonic probe 10 is provided with a magnetic sensor 30.

In the ultrasonic probe 10, ultrasonic vibration elements are arranged in 2D (dimension) so that scanning can be performed electronically. For example, in a display method using an application called Fusion3D, a scan is performed using an ultrasonic probe 10 that can obtain a three-dimensional image, and a three-dimensional image of an organ obtained by the scan and a three-dimensional image of blood flow are superimposed and displayed. , Vertical, horizontal, diagonal, etc. can be displayed in a predetermined cross section. The image displayed in cross section is also called an ultrasonic tomographic image.

The ultrasonic diagnostic apparatus main body 20 includes a transmission / reception circuit 21, an image generation circuit 22, an image processing circuit 23, a volume data generation circuit 24, a processing circuit 25, a storage circuit 26, an input circuit 27, a display 28, and a network interface 29. ..

The transmission / reception circuit 21 includes a transmission circuit and a reception circuit. The transmission circuit has a function of supplying a drive signal for radiating transmitted ultrasonic waves to the ultrasonic probe 10 in a predetermined direction of the subject. The receiving circuit is realized by including a phase detection circuit and a beam forming circuit. In the phase detection circuit, each of the received signals of the plurality of channels received from the ultrasonic probe 10 is divided into a baseband band in-phase signal (I signal, I: In-phase) and an orthogonal signal (Q signal, Q: Quadrature-). It is decomposed into phase) and further converted into a digital signal. The beam forming circuit forms a beam by adding a predetermined delay to the signals (I signal and Q signal) of each channel and then adding them. Then, the receiving circuit inputs the formed beam as a beam signal to the image generation circuit 22.

Further, the transmission / reception circuit 21 can also transmit the formed beam to the volume data generation circuit 24. For example, the transmission / reception circuit 21 receives control from the processing circuit 25 when converting a reception signal of a plurality of channels into a digital signal in the phase detection circuit or when forming a beam in the beam forming circuit. Then, the transmission / reception circuit 21 can not only input the formed beam signal to the image generation circuit 22, but also input the beam signal to the volume data generation circuit 24.

The image generation circuit 22 acquires a beam signal from the reception circuit of the transmission / reception circuit 21. For example, in the B mode, the image generation circuit 22 detects the envelope of the beam signal and generates a B mode image. Further, in the color Doppler mode, the beam signal is subjected to processing such as autocorrelation to generate image data of the color Doppler image. Further, in the pulse Doppler mode and the continuous wave Doppler mode, the image data of the Doppler image is generated by using the FFT method (Fast Fourier Transform method) for the beam signal.

Hereinafter, the B mode image generated by the image generation circuit 22, the image data of the color Doppler image, the image data of the continuous wave Doppler image, and the like are also referred to as ultrasonic image data. The image generation circuit 22 supplies the generated ultrasonic image data to the image processing circuit 23 and the volume data generation circuit 24, or stores the ultrasonic image data in the storage circuit 26 via the processing circuit 25.

The image processing circuit 23 has a function of performing coordinate conversion processing for matching the coordinate system to the photographed cross section of the subject with respect to the ultrasonic image data generated by the image generation circuit 22. The image processing circuit 23, for example, converts ultrasonic image data from a scan-type coordinate system to a television-type coordinate system. Further, the image processing circuit 23 has a function of performing tone setting suitable for image display and image processing for changing the resolution or frame rate on the coordinate-transformed ultrasonic image data.

The volume data generation circuit 24 is adapted to construct ultrasonic volume data from ultrasonic image data. The ultrasonic volume data is constructed by, for example, a plurality of ultrasonic tomographic images obtained by moving the ultrasonic image data in a direction orthogonal to the scanning plane. Further, each of the plurality of ultrasonic tomographic images is associated with position information based on the signal from the magnetic sensor 30 provided on the ultrasonic probe 10, and the operator can use the ultrasonic probe 10. By moving the ultrasonic waves in a direction orthogonal to the scan surface, the image generation circuit 22 generates ultrasonic tomographic images on each scan surface, and these ultrasonic tomographic images are input to the volume data generation circuit 24. Then, the ultrasonic volume data generated by the volume data generation circuit 24 is stored in the storage circuit 26 via the processing circuit 25.

Further, the volume data generation circuit 24 can also construct ultrasonic volume data based on the beam signal input from the transmission / reception circuit 21. For example, the volume data generation circuit 24 receives the instruction of the processing circuit 25 and directly generates ultrasonic volume data from the beam signal. Therefore, the volume data generation circuit 24 can not only construct the ultrasonic volume data from the ultrasonic image data, but also can construct the ultrasonic volume data from the beam signal.

The processing circuit 25 has a function of comprehensively controlling the ultrasonic diagnostic apparatus 100. For example, the processing circuit 25 is a processor that realizes a function corresponding to the program by reading the program from the storage circuit 26 and executing the program. Further, the processing circuit 25 reads a program and realizes a collection function, an extraction function, a generation function, and a conversion function.

The collection function is a function for collecting first volume data including a mark designated on an ultrasonic image. The first volume data refers to the ultrasonic volume data collected by the ultrasonic diagnostic apparatus 100. The first volume data can be represented by, for example, a coordinate system having the position of the magnetic generator 31 as the origin (hereinafter, referred to as an ultrasonic device coordinate system).

The extraction function is a function for extracting the second volume data including the mark specified on the reference image. The second volume data refers to CT volume data and MRI volume data, and the reference image refers to a tomographic image obtained from CT (Computed Tomography) volume data and MRI (Magnetic Resonance Imaging) volume data. .. Further, the reference image may be a tomographic image of CT volume data or a tomographic image of MRI volume data. It is assumed that the CT volume data and the MRI volume data are stored in the storage circuit 26. The second volume data can be represented by a coordinate system corresponding to the collected device, for example, a CT device coordinate system or an MRI device coordinate system.

The generation function is a function of collating the first volume data and the second volume data and generating conversion data based on the difference. The conversion data can be expressed as, for example, a conversion matrix between the ultrasonic device coordinate system and the CT device coordinate system (or the MRI device coordinate system).

The conversion function is a function of converting the second volume data to the position of the first volume data using the generated conversion data and aligning the positions.

The collection function, the extraction function, the generation function, and the conversion function in the present embodiment are examples of the collection unit, the extraction unit, the generation unit, and the conversion unit, respectively, within the scope of the claims.

Further, the processing circuit 25 has a function of controlling the transmission / reception circuit 21. For example, the processing circuit 25 can control the transmission / reception circuit 21 to automatically acquire an ultrasonic tomographic image that is lacking in the first modification described later. Further, the processing circuit 25 can not only control the ultrasonic image data generated in the image generation circuit 22 for the transmission / reception circuit 21, but also construct the ultrasonic volume data for the volume data generation circuit 24. It can also be controlled.

The storage circuit 26 includes a ROM (Read Only Memory), a RAM (Random Access Memory), and the like as memories. In addition to storing the above program, the storage circuit 26 stores IPL (Initial Program Loading) and BIOS (Basic Input / Output System) data, and also stores the work memory of the processing circuit 25 and ultrasonic image data. I use it. Further, the ultrasonic image data corresponds to the image data as an ultrasonic image. The storage circuit 26 stores ultrasonic volume data, CT volume data, MRI volume data, and the like generated by the volume data generation circuit 24.

The input circuit 27 is a circuit for inputting signals from an input device such as a pointing device (mouse or the like) or a keyboard that can be operated by an operator such as a doctor or an inspection engineer. Here, the input device itself is also an input circuit 27. It shall be included in. In this case, the input signal according to the operation is sent from the input circuit 27 to the processing circuit 25.

The display 28 has a function of displaying the ultrasonic image data of the subject taken by the ultrasonic probe 10 as an image. The display 28 is composed of, for example, a liquid crystal display, a monitor, or the like. In the present embodiment, the display 28 can display not only the ultrasonic image but also the reference image at the same time. Further, the display 28 can simultaneously display the reference image aligned with the ultrasonic image together with the ultrasonic image in accordance with the movement of the ultrasonic probe 10.

The network interface 29 controls communication according to the communication standard, and externally connects the ultrasonic diagnostic apparatus main body 20 through, for example, a wireless LAN (Local Area Network) compliant with the 802.11 series, short-range wireless communication, or a telephone line. Has the function of connecting to the network of.

The word "processor" used in the above description is, for example, a dedicated or general-purpose CPU (Central Processing Unit), an integrated circuit for a specific application (ASIC), or a programmable logic device (for example, a simple programmable logic). It means a circuit such as a device (Simple Programmable Logic Device: SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA).

The processor realizes each function by reading and executing a program stored in the storage circuit 26 as a memory or directly incorporated in the circuit of the processor. When a plurality of processors are provided, the memory for storing the program may be individually provided for each processor, or for example, the storage circuit 26 in FIG. 1 stores the program corresponding to the function of the processor. It doesn't matter if it is a thing.

Next, the magnetic sensor 30, the magnetic generator 31, and the position information collecting device 32 will be described.

The magnetic sensor 30 is provided in the ultrasonic probe 10, and uses the magnetism generated by the magnetic generator 31 to provide information (position) regarding the position and posture at which the ultrasonic probe 10 abuts on the body surface of the subject. Data) is to be measured. For example, the position of the ultrasonic probe 10 is measured by acquiring the position data of 6 degrees of freedom consisting of the coordinates (x, y, z) of the three-dimensional position and the data of the posture (Pitch, Yaw, Roll). ..

The magnetic generator 31 is arranged near the subject and is adapted to generate a magnetic force for causing the magnetic sensor 30 to measure the position.

The position information collecting device 32 is adapted to perform various controls in which a magnetic field is generated in the magnetic generator 31 and the generated magnetic field is measured by the magnetic sensor 30.

Next, the image server 200 and the network 300 shown in FIG. 1 will be described.

The image server 200 is a management server for managing medical images acquired by an imaging device or another diagnostic imaging device. The image server 200 constitutes, for example, a part of a medical image management system (PACS: Picture Archiving and Communication System) that stores, browses, and manages medical images. The image server 200 manages volume data that forms an image taken by, for example, an X-ray CT device, an MRI device (magnetic resonance diagnostic device), an ultrasonic diagnostic device, a nuclear medicine diagnostic device, or the like. In the present embodiment, the image server 200 manages CT volume data, MRI volume data, and the like, and is not limited to the type of volume data.

The network 300 has a function of connecting the ultrasonic diagnostic apparatus main body 20 of the ultrasonic diagnostic apparatus 100 and the image server 200. For example, the ultrasonic diagnostic apparatus 100 can be connected to the image server 200 via the network 300, acquires volume data from the image server 200 via the network 300 and the network interface 29, and is stored in the storage circuit 26. Remember.

In the present embodiment, the alignment process of the reference image and the ultrasonic image is performed, and in particular, the alignment process is performed by collating with the volume data.

(Synchronous display processing)
The synchronous display processing of the reference image and the ultrasonic image, which is executed by the ultrasonic diagnostic apparatus 100 of the first embodiment, will be described. In the present embodiment, as an example, synchronous display processing of the reference image and the ultrasonic image is realized by executing the alignment processing.

FIG. 2 is a flowchart showing a process in which the ultrasonic diagnostic apparatus 100 according to the present embodiment performs an alignment process and displays a reference image and an ultrasonic image in synchronization with each other. In FIG. 2, a reference numeral S is an indication of each step in the flowchart.

First, the operator operates the input circuit 27 of the ultrasonic diagnostic apparatus 100 to select the volume data of the subject from the storage circuit 26. The ultrasonic diagnostic apparatus 100 reads, for example, CT volume data from the storage circuit 26 according to the instruction of the operator (step S001).

The ultrasonic diagnostic apparatus 100 displays a tomographic image of CT volume data on the display 28 as a reference image by the operator operating the input circuit 27 (step S003). For example, assuming that the subject is lying on the bed, the ultrasonic diagnostic apparatus 100 displays an MPR (Multi Planar Reconstruction) tomographic image in which the abdomen is displayed vertically with respect to the bed. The tomographic image of the CT volume data is also appropriately referred to as a CT image.

Then, the ultrasonic diagnostic apparatus 100 sets a mark as a guideline for alignment on the tomographic image of the displayed CT volume data by the operator operating the input circuit 27 (step S005). This marker is set, for example, for the anatomical feature structure on the tomographic image of the CT volume data. For example, the ultrasonic diagnostic apparatus 100 sets a mark on a specific blood vessel branch point (blood vessel branch point) or a specific bone shape as an anatomical feature structure on a tomographic image of CT volume data.

Next, the operator abuts the ultrasonic probe 10 on the surface of the body surface of the subject to be inspected, and starts the inspection by ultrasonic scanning (step S007). In this case, the ultrasonic diagnostic apparatus 100 acquires information on the position and orientation of the ultrasonic probe 10, that is, the position data of the ultrasonic probe 10 from the magnetic sensor 30 as the position information of the ultrasonic probe 10.

The ultrasonic diagnostic apparatus 100 receives the ultrasonic reception signal received by the ultrasonic probe 10 from the transmission / reception circuit 21 by the operator operating the ultrasonic probe 10, and generates an ultrasonic tomographic image. It is displayed on the display 28 (step S009). The displayed ultrasonic tomographic image is also referred to as a UL image as appropriate. This ultrasonic tomographic image can be represented by the ultrasonic device coordinate system based on the position information of the ultrasonic probe 10.

The operator operates the ultrasonic probe 10 so that the ultrasonic tomographic image corresponding to the tomographic image of the CT volume data displayed on the display 28 is displayed. For example, when the subject is lying on the bed as a reference, ultrasonic waves are estimated from the tomographic image of the displayed CT volume data while estimating the angle and position at which the ultrasonic probe 10 abuts on the subject. Operate the probe 10.

For example, when the tomographic image (reference image) of the CT volume data is perpendicular to the bed, the operator abuts the ultrasonic probe 10 perpendicularly to the subject and sets the anatomy on the reference image. The ultrasonic probe 10 is moved so that the anatomical feature structure corresponding to the feature structure (eg, the marked vascular bifurcation) is displayed. Further, the magnetic sensor 30 may be used to calculate how much the ultrasonic probe 10 should be tilted with respect to the subject from the positional relationship between the CT volume data and the subject.

Then, the ultrasonic diagnostic apparatus 100 sets a mark as a guideline for alignment on the displayed ultrasonic tomographic image by the operator operating the input circuit 27 (step S011). This marker is set, for example, for the anatomical feature structure on the ultrasound tomographic image that corresponds to the marker on the reference image. The ultrasonic diagnostic apparatus 100 sets a mark on a specific vascular bifurcation point or a specific bone shape as an anatomical feature structure, for example, on an ultrasonic tomographic image.

When selecting a blood vessel as an anatomical feature structure in an ultrasonic tomographic image, the ultrasonic tomographic image or ultrasonic volume data is collected using the color Doppler method in order to depict the blood vessel more clearly. Is preferable.

For example, in the ultrasonic diagnostic apparatus 100, the ultrasonic probe 10 is operated to display an ultrasonic tomographic image such as a B-mode image on the display 28, and a color Doppler scan is performed to obtain ultrasonic waves from a plurality of ultrasonic tomographic images. Generate image data. In this case, the volume data generation circuit 24 can simultaneously construct ultrasonic volume data for alignment from the ultrasonic image data.

FIG. 3 is an explanatory diagram showing an example in which the ultrasonic diagnostic apparatus 100 according to the present embodiment displays the CT image CG and the UL image UG on the display 28.

As shown in FIG. 3, the UL image UG is displayed on the right side of the display 28. Further, a CT image CG is displayed on the left side of the display 28. A blood vessel BD1 as an anatomical feature structure is displayed on the UL image UG, and a mark MK1 which is a mark is attached to the blood vessel branch point. On the other hand, the CT image CG also displays the blood vessel BD2 as the corresponding anatomical feature structure, and the blood vessel branch point is provided with the mark MK2 which is a mark. Further, a collation start button VS indicating the start of collation is provided at the lower part on the display 28.

In the present embodiment, the operator starts collation between the UL image UG and the CT image CG based on the operation of clicking the collation start button VS. The UL image UG and the CT image CG do not have to be exactly the same, and if they are displayed as roughly the same image, the collation can be started.

When the collation start button VS is clicked, the processing circuit 25 collects the first volume data including the blood vessel branch point of the mark MK1 of the UL image UG from the ultrasonic volume data for alignment stored in the storage circuit 26. (Step S013). The processing circuit 25 collects the first volume data including the blood vessel BD1 centered on the mark MK1 so as to include the blood vessel BD1 of the mark MK1, for example.

FIG. 4 is an explanatory diagram showing a concept that the processing circuit 25 of the ultrasonic diagnostic apparatus 100 according to the present embodiment collects the first volume data VD1 from the ultrasonic volume data UV.

As shown in FIG. 4, the first volume data VD1 has a blood vessel BD1 including a marker MK1, and includes a blood vessel bifurcation point and a blood vessel structure of the blood vessel BD1. That is, the first volume data VD1 is collected from the ultrasonic volume data UV so as to include the blood vessel BD1 in a predetermined range centered on the mark MK1.

Next, the processing circuit 25 extracts the second volume data including the blood vessel branch point of the mark MK2 of the CT image CG from the CT volume data stored in the storage circuit 26 (step S015). The processing circuit 25 extracts the second volume data including the blood vessel BD2 centered on the mark MK2 so as to include the blood vessel BD2 of the mark MK2, for example.

FIG. 5 is an explanatory diagram showing a concept that the processing circuit 25 of the ultrasonic diagnostic apparatus 100 according to the present embodiment extracts the second volume data VD2 from the CT volume data CV.

As shown in FIG. 5, the second volume data VD2 has a blood vessel BD2 containing a marker MK2, and includes a blood vessel bifurcation point and a blood vessel structure of the blood vessel BD2. That is, the second volume data VD2 is extracted from the CT volume data CV so as to include the blood vessel BD2 in a predetermined range centered on the mark MK2.

Next, the processing circuit 25 collates the first volume data VD1 with the second volume data VD2 (step S017). Specifically, the anatomical feature structure (including the blood vessel BD1 including the blood vessel bifurcation point) included in the first volume data VD1 and the anatomical feature structure (including the blood vessel bifurcation point) included in the second volume data VD2. The blood vessel BD2) is three-dimensionally matched using a known matching technique.

Conventionally, for example, the display of the blood vessel branch point on the ultrasonic image is matched with the display of the blood vessel branch point on the reference image to complete the collation. In this case, the reference image is also a two-dimensional image, and the ultrasonic image is also a two-dimensional image. For this reason, the two-dimensional images are collated with each other, and the collation in the depth direction and the collation of the cross-sectional angle of the tomographic image are not always accurate.

On the other hand, in the present embodiment, the processing circuit 25 can collate the blood vessel BD1 of the first volume data VD1 with the blood vessel BD2 of the second volume data VD2 and collate them three-dimensionally. , It is possible to eliminate the collation error in the depth direction between the UL image UG and the CT image CG and the collation error of the fault plane angle.

Further, the processing circuit 25 generates conversion data from the difference between the first volume data VD1 represented by the ultrasonic device coordinate system and the second volume data VD2 represented by the CT device coordinate system (step). S019).

By applying the converted data to the second volume data VD2, the processing circuit 25 causes the display 28 to display the CT image CG that exactly corresponds to the displayed UL image UG (step S021).

Further, the processing circuit 25 of the ultrasonic diagnostic apparatus 100 follows the change in the tilt and position of the ultrasonic probe 10 even when the tilt and position of the ultrasonic probe 10 are moved, and matches the UL image UG. The CT image CG is displayed together with the UL image UG (step S023).

By the processing from step S001 to step S021, the processing circuit 25 of the ultrasonic diagnostic apparatus 100 performs the alignment processing of the CT image CG which is the tomographic image of the CT volume data and the UL image UG which is the ultrasonic tomographic image. be able to. Further, since the ultrasonic diagnostic apparatus 100 can perform three-dimensional collation with the blood vessel BD1 of the first volume data VD1 and the blood vessel BD2 of the second volume data VD2, the ultrasonic diagnostic apparatus 100 can perform a three-dimensional collation with the first volume data VD1. The positional relationship with the second volume data VD2 can be inherited by the converted data by performing more accurate and highly accurate positioning.

As a result, the ultrasonic diagnostic apparatus 100 can simultaneously display the CT image CG corresponding to the UL image UG together with the UL image UG while following the change of the ultrasonic probe 10. As described above, when the synchronous display of the CT image CG and the UL image UG is started, the ultrasonic diagnostic apparatus 100 of the first embodiment ends the synchronous display process.

As described above, the ultrasonic diagnostic apparatus 100 of the first embodiment collects the first volume data VD1 including the mark MK1 designated on the UL image UG and is designated on the CT image CG. The second volume data including the mark MK2 is extracted. The ultrasonic diagnostic apparatus 100 collates the first volume data VD1 and the second volume data VD2, generates conversion data based on the difference, and uses the conversion data to generate the second volume data VD2. Convert to the position of the first volume data VD1 and align the position.

As a result, the ultrasonic diagnostic apparatus 100 of the first embodiment has more accurate and highly accurate alignment with respect to the CT image CG and the UL image UG when the CT image CG is displayed together with the UL image UG. It can be performed. That is, when displaying two images having a depth direction at the same time, more accurate and highly accurate alignment can be performed.

In the present embodiment, after setting a mark on the tomographic image of CT volume data in the processing from step S001 to step S005, the mark is set on the ultrasonic tomographic image in the processing from step S007 to step S011. It was supposed to do, but it is not limited to this.

For example, the order in which the marks are set is changed, for example, the processes from step S007 to step S011 are performed first, the marks are set on the ultrasonic tomographic image, and then steps S001 to S005 are performed. It is also possible to perform the processes up to and set a mark on the tomographic image of the CT volume data.

(First modification)
In the first embodiment, the processing circuit 25 of the ultrasonic diagnostic apparatus 100 has a first volume including the blood vessel branch point of the mark MK1 of the UL image UG from the ultrasonic volume data stored in the storage circuit 26 in step S013. It was supposed to collect data. The present embodiment is not limited to this.

When the ultrasonic diagnostic apparatus 100 collects the first volume data VD1 from the ultrasonic volume data UV, it is assumed that there is not enough ultrasonic volume data UV to collect the first volume data VD1.

In this case, for example, when the first volume data VD1 does not have the amount of data required for collation with the second volume data VD2, the ultrasonic diagnostic apparatus 100 uses the first volume data of the UL image UG. The operator may be notified that the data is insufficient.

FIG. 6 is an explanatory diagram showing a concept when the first volume data VD1 does not have the amount of data required for collation.

As shown in FIG. 6, the first volume data VD3 is composed of a predetermined number of ultrasonic tomographic images U1, U2, U3 and the like, and the ultrasonic tomographic images U1, U2, U3 and the like are marked with MK1. The blood vessel BD1 is included. Here, in the case of three-dimensional collation with the second volume data VD2, for example, the range of the blood vessel BD1 included in the first volume data VD3 is collated with the blood vessel BD2 included in the second volume data VD2. If the amount of data is not sufficient, the ultrasonic diagnostic apparatus 100 informs the direction S that further ultrasonic scanning needs to be performed.

The ultrasonic diagnostic apparatus 100 displays, for example, on the display 28, "Please perform an ultrasonic scan along the direction S.", Or, for example, outputs a voice, "of the subject. Perform an ultrasonic scan from the lower abdomen to the head. "

As described above, when the first volume data VD1 of the UL image UG is insufficient, the ultrasonic diagnostic apparatus 100 notifies the operator of the direction of the first volume data of the insufficient UL image UG. be able to.

Further, the ultrasonic diagnostic apparatus 100 may display the model P, which is a model of the subject, on the display 28, and specifically display the ultrasonic probe 10 as a guide.

FIG. 7 is an explanatory diagram showing an example in which the model P of the subject is displayed on the display 28 and the operator is urged to perform the ultrasonic scan of the ultrasonic probe 10 along the direction S.

As shown in FIG. 7, the display 28 shows a model P showing the subject. Further, on the body surface of the model P, the ultrasonic probe 10S schematically showing the ultrasonic probe 10 and the direction S for operating the probe 10S are displayed.

The operator can additionally acquire the missing ultrasonic tomographic image by performing an ultrasonic scan while looking at the display 28 on which such a model P is displayed, for example, and the first volume data. The shortage of VD1 can be supplemented.

Further, when the ultrasonic probe 10 can automatically acquire the insufficient ultrasonic tomographic image, the ultrasonic diagnostic apparatus 100 automatically obtains the insufficient ultrasonic tomographic image regardless of the operation of the operator. It may be obtained as a target.

(Second modification)
In the first embodiment described above, the blood vessel BD1 is displayed on the UL image UG, and the mark MK1 which is a mark is attached to the blood vessel branch point. Further, the blood vessel BD2 was displayed on the CT image CG, and the mark MK2, which is a mark, was attached to the blood vessel branch point. As described above, in the description of the first embodiment, blood vessels and blood vessel bifurcation points have been described as examples as anatomical feature structures serving as collation marks, but the present invention is not limited thereto.

In the second modification of the first embodiment, a case where a bone is applied instead of the blood vessel BD1 of the UL image UG will be described. In this case, the first volume data VD1 and the second volume data VD2 each include bone, and the processing circuit 25 of the ultrasonic diagnostic apparatus 100 includes the bone in the first volume data VD1 and the second volume data. The conversion data is generated based on the bone in VD2. As an example of bone, a case where a xiphoid process is applied will be described.

For example, in the ultrasonic diagnostic apparatus 100, the UL image UG is displayed on the display 28 according to the display scan condition for displaying the sword-shaped protrusion by operating the ultrasonic probe 10, and the display scan condition is the focus. Scanning is performed according to the scanning conditions for alignment in which the positions and the like are different, and ultrasonic image data different from the UL image UG which is the display image is generated. In this case, the volume data generation circuit 24 can construct ultrasonic volume data for alignment from ultrasonic image data different from the UL image UG.

FIG. 8 is an explanatory diagram showing an example in which the ultrasonic diagnostic apparatus 100 according to the present embodiment displays the UL image UG including the xiphoid process SB1 and the CT image CG including the xiphoid process SB2 on the display 28. Is.

As shown in FIG. 8, the xiphoid process SB1 showing the xiphoid process is displayed on the right UL image UG on the display 28, and the xiphoid process SB1 on the left side of the display 28 shows the xiphoid process. The xiphoid process SB2 indicating the protrusion is displayed.

In the second modification, when the operator clicks the collation start button VS of the display 28, the first volume data VD1 including the xiphoid process SB1 of the UL image UG is obtained from the ultrasonic volume data for alignment. While collecting, the second volume data VD2 including the xiphoid process SB2 of the CT image CG is extracted, collated, and converted data is generated.

As described above, in the second modification of the first embodiment, the xiphoid process SB1 of the first volume data VD1 and the xiphoid process SB2 of the second volume data VD2 are three-dimensional. By performing collation, conversion data can be generated.

(Second embodiment)
In the first embodiment, the ultrasonic diagnostic apparatus 100 includes a processing circuit 25, and the processing circuit 25 includes a collecting function, an extraction function, a generation function, and a conversion function. However, the present embodiment is not limited to this.

In the second embodiment, for example, when each process and each function shown as the ultrasonic diagnostic apparatus 100 of the first embodiment is applied to the medical image processing apparatus and comparative interpretation is performed in the medical image processing apparatus. Will be explained.

FIG. 9 is a schematic configuration diagram showing an example of a schematic configuration of the medical image processing apparatus 400 of the second embodiment.

As shown in FIG. 9, the medical image processing apparatus 400 of the second embodiment includes a processing circuit 410, an input circuit 420, a display 430, a storage circuit 440, a network interface 450, and an internal bus 460.

The processing circuit 410 is a processor corresponding to the processing circuit 25 of the ultrasonic diagnostic apparatus 100 of the first embodiment, and the input circuit 420 corresponds to the input circuit 27 of the ultrasonic diagnostic apparatus 100 of the first embodiment. It is an input circuit. Further, the display 430 is a display device corresponding to the display 28 of the ultrasonic diagnostic apparatus 100 of the first embodiment, and the storage circuit 440 corresponds to the storage circuit 26 of the ultrasonic diagnostic apparatus 100 of the first embodiment. It is a memory circuit to do.

The network interface 450 performs communication control according to a communication standard, for example, through a wireless LAN (Local Area Network) compliant with the 802.11 series, short-range wireless communication, a telephone line, or the like, the medical image processing device 400 is externally connected to the medical image processing device 400. It has a function to connect to a network.

The internal bus 460 is connected to each component so that the medical image processing apparatus 400 is collectively controlled by the processing circuit 410.

In the second embodiment, the medical image processing apparatus 400 acquires a plurality of volume data from, for example, the image server 200 shown in FIG. 1 via the network interface 450 and stores them in the storage circuit 440. Each of the plurality of volume data is image data that can display a tomographic image as an image.

The medical image processing apparatus 400 uses the processing circuit 410 to obtain a first extraction function for extracting first volume data including a mark specified on the first image and a mark specified on the second image. A second extraction function that extracts the included second volume data, a generation function that collates the first volume data with the second volume data, and generates conversion data based on the difference, and the conversion data. Is provided with a conversion function for converting the second volume data to the position of the first volume data and aligning the positions.

In this case, the first image corresponds to the ultrasonic image of the first embodiment, and the second image corresponds to the reference image of the first embodiment, but the type of image. Is not limited to. Further, the first extraction function corresponds to the collection function of the first embodiment, the second extraction function corresponds to the extraction function of the first embodiment, but the first extraction function is the first. It has a function equivalent to the extraction function of the embodiment, that is, a function substantially equivalent to the second extraction function of the second embodiment.

In this case, neither the first image nor the second image of the second embodiment needs to be limited to the ultrasonic tomographic image, and if it is a tomographic image based on the volume data already taken, it is a medical image. It can be applied to the comparative interpretation of the processing device 400. Further, the medical image processing apparatus 400 can obtain volume data based on the first image and volume data based on the first image as long as the volume data constituting the first image and the volume data constituting the second image are acquired from the storage circuit 440. Since the conversion data of the volume data based on the image of 2 can be generated, more accurate and highly accurate alignment can be performed than in the conventional case.

According to at least one embodiment described above, more accurate and highly accurate alignment can be performed when displaying two images having a depth direction at the same time.

Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and variations thereof are included in the scope of the invention described in the claims and the equivalent scope thereof, as are included in the scope and gist of the invention.

10 ... Ultrasonic probe 20 ... Ultrasonic diagnostic device main body 21 ... Transmission / reception circuit 22 ... Image generation circuit 23 ... Image processing circuit 24 ... Volume data generation circuit 25 ... Processing circuit 26 ... Storage circuit 27 ... Input circuit 28 ... Display 29 ... Network Interface 30 ... Magnetic sensor 31 ... Magnetic generator 32 ... Position information collecting device 400 ... Medical image processing device 410 ... Processing circuit 420 ... Input circuit 430 ... Display 440 ... Storage circuit 450 ... Network interface

Claims (8)

An ultrasonic tomographic image is collected by transmitting and receiving ultrasonic waves, ultrasonic volume data is collected based on the ultrasonic tomographic image, and one vascular branch designated on the ultrasonic tomographic image is collected from the ultrasonic volume data. A collection unit that collects the first volume data indicating the range including the blood wave of the blood vessel branching portion centering on the unit, and the collection unit.
A second volume data different from the ultrasonic volume data, showing a range including a blood vessel of the blood vessel branch portion centered on one blood vessel branch portion designated on a tomographic image based on the other volume data. The extraction unit that extracts the volume data of
A generation unit that collates the first volume data with the second volume data and generates conversion data based on the difference.
Using the conversion data, the conversion unit that converts the second volume data to the position of the first volume data and aligns the position,
An ultrasonic diagnostic device equipped with. The generator is
The transformation is made by comparing the anatomical feature structure in the first volume data including the blood vessel bifurcation with the anatomical feature structure in the second volume data centering on the blood vessel bifurcation . The ultrasonic diagnostic apparatus according to claim 1, which generates data. The generator is
When the first volume data does not have the amount of data required for collation with the second volume data, the operator is informed that the first volume data of the ultrasonic tomographic image is insufficient. The ultrasonic diagnostic apparatus according to claim 1 or 2. The generator is
The ultrasonic diagnosis according to claim 3, wherein when the first volume data of the ultrasonic tomographic image is insufficient, the direction of the first volume data of the insufficient ultrasonic tomographic image is notified. Device. The first volume data and the second volume data are
The ultrasonic diagnostic apparatus according to any one of claims 1 to 4, which is volume data including an anatomical feature structure around the blood vessel bifurcation . The first volume data is
The ultrasonic diagnostic apparatus according to claim 1 , which is generated by the color Doppler method. The conversion unit
A claim that a tomographic image based on the other volume data that matches the ultrasonic tomographic image is displayed together with the ultrasonic tomographic image by following the inclination of the ultrasonic probe for generating the ultrasonic tomographic image. The ultrasonic diagnostic apparatus according to any one of 1 to 6 . With the first extraction unit that extracts the first volume data indicating the range including the blood vessel of the blood vessel branch portion centered on one blood vessel branch portion designated on the tomographic image based on the volume data. ,
A second volume data different from the volume data, showing a range including a blood vessel of the blood vessel bifurcation centering on one blood vessel bifurcation designated on the tomographic image based on the other volume data. A second extraction unit that extracts volume data,
A generation unit that collates the first volume data with the second volume data and generates conversion data based on the difference.
Using the conversion data, the conversion unit that converts the second volume data to the position of the first volume data and aligns the position,
A medical image processing device equipped with.

Images