JP2020120705A - Ultrasound diagnostic device, medical image processing device, and ultrasound image display program - Google Patents

Abstract

To effectively reflect display mode change operation performed on a medical image of a plurality of medical images displayed on the same screen in other medical images.SOLUTION: An ultrasound diagnostic device, according to an embodiment, capable of displaying a plurality of ultrasound images on the same screen of a display unit includes a reception unit, an identification unit, and a display control unit. The reception unit receives display mode change operation on a first ultrasound image, any of the plurality of ultrasound images displayed on the same screen. The identification unit identifies one or a plurality of second ultrasound images having an image type corresponding to an image type of the first ultrasound image of the other ultrasound images of the plurality of ultrasound images displayed on the same screen. The display control unit changes display modes of the first ultrasound image and the second ultrasound images of the plurality of ultrasound images displayed on the same screen, according to the display mode change operation.SELECTED DRAWING: Figure 2

Description

Embodiments of the present invention relate to an ultrasonic diagnostic apparatus, a medical image processing apparatus, and an ultrasonic image display program.

In the medical field, an ultrasonic diagnostic apparatus that images the inside of a subject by using ultrasonic waves generated by using a plurality of vibrators (piezoelectric vibrators) of an ultrasonic probe is used. The ultrasonic diagnostic apparatus causes an ultrasonic probe connected to the ultrasonic diagnostic apparatus to transmit an ultrasonic wave into the subject, generate an echo signal based on the reflected wave, and obtain a desired ultrasonic image by image processing.

The ultrasonic diagnostic apparatus has a function of displaying a plurality of ultrasonic images generated by the stress echo method or the like on the same screen. Further, the ultrasonic diagnostic apparatus can accept a change operation of the display mode for any of the plurality of ultrasonic images displayed on the same screen and change the display mode of the ultrasonic image. The operation of changing the display mode is, for example, a movement (Pan) operation or an enlargement (Zoom-IN) or reduction (Zoom-Out) operation.

Further, the ultrasonic diagnostic apparatus, the operation of changing the display mode performed in any one of the plurality of displayed ultrasonic images displayed on the same screen, to all other ultrasonic images. It can also be reflected against. As a result, it is possible to save the trouble of performing the same change operation as that performed on the ultrasonic image of the operation target on all other ultrasonic images.

JP, 2011-125568, A

The problem to be solved by the present invention is to effectively reflect a change operation of a display mode performed on a medical image among a plurality of medical images displayed on the same screen to other medical images. Is.

The ultrasonic diagnostic apparatus according to the embodiment capable of displaying a plurality of ultrasonic images on the same screen of the display unit includes a reception unit, a specification unit, and a display control unit. The reception unit receives an operation of changing the display mode of the first ultrasonic image, which is one of the plurality of ultrasonic images displayed on the same screen. The specifying unit, among the other ultrasonic images among the plurality of ultrasonic images displayed on the same screen, has one or more second ultrasonic images whose image type corresponds to the image type of the first ultrasonic image. Identify sound image. The display control unit changes the display mode of the first ultrasonic image and the second ultrasonic image among the plurality of ultrasonic images displayed on the same screen according to the display mode changing operation.

FIG. 1 is a schematic diagram showing a configuration of an ultrasonic diagnostic apparatus according to an embodiment. FIG. 2 is a block diagram showing functions of the ultrasonic diagnostic apparatus according to the embodiment. FIG. 3 is a view showing an operation of the ultrasonic diagnostic apparatus according to the embodiment as a flowchart. FIG. 4 is a diagram showing a first display example of a plurality of ultrasonic images on the same screen in the ultrasonic diagnostic apparatus according to the embodiment. FIG. 5 is a diagram showing a second display example of a plurality of ultrasonic images on the same screen in the ultrasonic diagnostic apparatus according to the embodiment. FIG. 6 is a diagram showing a third display example of a plurality of ultrasonic images on the same screen in the ultrasonic diagnostic apparatus according to the embodiment. FIG. 7: is a figure which shows the display screen which shows an example of the setting method of an interlocking mode in the ultrasonic diagnosing device which concerns on embodiment. FIG. 8 is a schematic diagram showing the configuration of the medical image processing apparatus according to the embodiment. FIG. 9 is a block diagram showing the functions of the medical image processing apparatus according to the embodiment.

Hereinafter, embodiments of an ultrasonic diagnostic apparatus, a medical image processing apparatus, and an ultrasonic image display program will be described in detail with reference to the drawings.

1. Ultrasonic Diagnostic Device FIG. 1 is a schematic diagram showing the configuration of the ultrasonic diagnostic device according to the embodiment.

FIG. 1 shows an ultrasonic diagnostic apparatus 10 according to the embodiment. Further, FIG. 1 shows an ultrasonic probe 20, an input interface 30, and a display 40. In addition, the ultrasonic diagnostic apparatus 10 to which at least one of the ultrasonic probe 20, the input interface 30, and the display 40 is added may be referred to as an ultrasonic diagnostic apparatus. In the following description, a case will be described where the ultrasonic probe 20, the input interface 30, and the display 40 are all provided outside the ultrasonic diagnostic apparatus 10.

The ultrasonic diagnostic apparatus 10 includes a transmission/reception circuit 11, a B-mode processing circuit 12, a Doppler processing circuit 13, an image generation circuit 14, an image memory 15, a network interface 16, a processing circuit 17, and a main memory 18. Equipped with. The circuits 11 to 14 are configured by an application specific integrated circuit (ASIC) or the like. However, the invention is not limited to this case, and all or part of the functions of the circuits 11 to 14 may be realized by the processing circuit 17 executing a program.

The transmission/reception circuit 11 has a transmission circuit and a reception circuit (not shown). Under the control of the processing circuit 17, the transmission/reception circuit 11 controls the transmission directivity and the reception directivity in ultrasonic wave transmission/reception. Although the case where the transmission/reception circuit 11 is provided in the ultrasonic diagnostic apparatus 10 will be described, the transmission/reception circuit 11 may be provided in the ultrasonic probe 20 or both the ultrasonic diagnostic apparatus 10 and the ultrasonic probe 20. It may be provided. The transmission/reception circuit 11 is an example of a transmission/reception unit.

The transmission circuit has a pulse generation circuit, a transmission delay circuit, a pulser circuit, and the like, and supplies a drive signal to the ultrasonic transducer. The pulse generation circuit repeatedly generates a rate pulse for forming a transmission ultrasonic wave at a predetermined rate frequency. The transmission delay circuit uses a pulse generation circuit to determine the delay time for each piezoelectric vibrator necessary for focusing the ultrasonic waves generated from the ultrasonic vibrator of the ultrasonic probe 20 into a beam shape and determining the transmission directivity. It is given for each rate pulse generated. Further, the pulser circuit applies the drive pulse to the ultrasonic transducer at the timing based on the rate pulse. The transmission delay circuit arbitrarily adjusts the transmission direction of the ultrasonic beam transmitted from the piezoelectric vibrator surface by changing the delay time given to each rate pulse.

The receiving circuit has an amplifier circuit, an A/D (Analog to Digital) converter, an adder, etc., receives an echo signal received by the ultrasonic transducer, and performs various processes on the echo signal to perform an echo. Generate data. The amplifier circuit amplifies the echo signal for each channel and performs gain correction processing. The A/D converter A/D-converts the gain-corrected echo signal and gives the digital data a delay time necessary for determining the reception directivity. The adder adds the echo signals processed by the A/D converter to generate echo data. By the addition processing of the adder, the reflection component from the direction corresponding to the reception directivity of the echo signal is emphasized.

Under the control of the processing circuit 17, the B-mode processing circuit 12 receives the echo data from the receiving circuit, performs logarithmic amplification, envelope detection processing, and the like, and the data in which the signal strength is expressed by the brightness of brightness ( 2D or 3D data) is generated. This data is generally called B-mode data. The B-mode processing circuit 12 is an example of a B-mode processing unit.

Note that the B-mode processing circuit 12 can change the frequency band to be imaged by changing the detection frequency by filtering. By using the filter processing function of the B-mode processing circuit 12, it is possible to execute harmonic imaging such as contrast harmonic imaging (CHI) and tissue harmonic imaging (THI). That is, the B-mode processing circuit 12 uses the reflected wave data of the subject injected with the contrast agent to obtain the reflected wave data (harmonic data or sub-frequency data) of the harmonic component having the contrast agent (microbubbles, bubbles) as the reflection source. ) And the reflected wave data (fundamental wave data) of the fundamental wave component whose reflection source is the tissue in the subject can be separated. The B-mode processing circuit 12 can also generate B-mode data for generating contrast image data from the reflected wave data (received signal) of the harmonic component, and the reflected wave data of the fundamental wave component (received signal). B-mode data for generating the fundamental wave (fundamental) image data can be generated from the signal.

Further, in THI by using the filter processing function of the B-mode processing circuit 12, it is possible to separate the harmonic wave data or the divided frequency data, which is the reflected wave data (received signal) of the harmonic component, from the reflected wave data of the subject. it can. Then, the B-mode processing circuit 12 can generate B-mode data for generating the tissue image data from which the noise component is removed from the reflected wave data (received signal) of the harmonic component.

Furthermore, when performing CHI or THI harmonic imaging, the B-mode processing circuit 12 can extract a harmonic component by a method different from the method using the above-described filter processing. In harmonic imaging, an amplitude modulation (AM: Amplitude Modulation) method, a phase modulation (PM: Phase Modulation) method, and an imaging method called an AMPM method, which is a combination of the AM method and the PM method, is performed. In the AM method, PM method, and AMPM method, ultrasonic waves with different amplitudes and phases are transmitted a plurality of times with respect to the same scanning line. As a result, the transmission/reception circuit 11 generates and outputs a plurality of reflected wave data (received signals) on each scanning line. Then, the B-mode processing circuit 12 extracts harmonic components by subjecting a plurality of reflected wave data (received signals) of each scanning line to addition/subtraction processing according to the modulation method. Then, the B-mode processing circuit 12 performs envelope detection processing or the like on the reflected wave data (received signal) of the harmonic component to generate B-mode data.

For example, when the PM method is performed, the transmission/reception circuit 11 scans ultrasonic waves of the same amplitude with inverted phase polarities such as (-1, 1) in each scan according to the scan sequence set by the processing circuit 17. Send the line twice. Then, the transmission/reception circuit 11 generates a reception signal by transmission of "-1" and a reception signal by transmission of "1", and the B-mode processing circuit 12 adds these two reception signals. As a result, the fundamental wave component is removed, and a signal in which the second harmonic component is mainly left is generated. Then, the B-mode processing circuit 12 performs envelope detection processing or the like on this signal to generate THI B-mode data or CHI B-mode data.

Alternatively, for example, in THI, a method of performing visualization using a second harmonic component and a difference sound component included in a received signal has been put into practical use. In the imaging method using the difference sound component, for example, transmission of a synthesized waveform in which a first fundamental wave having a center frequency of “f1” and a second fundamental wave having a center frequency of “f2” higher than “f1” are synthesized. The ultrasonic wave is transmitted from the ultrasonic probe 20. This synthesized waveform is a waveform obtained by synthesizing the waveform of the first fundamental wave and the waveform of the second fundamental wave whose phases are adjusted so that a difference tone component having the same polarity as the second harmonic component is generated. Is. The transmission/reception circuit 11 transmits the transmission ultrasonic wave of the synthetic waveform, for example, twice while inverting the phase. In such a case, for example, the B-mode processing circuit 12 adds the two received signals to remove the fundamental wave component, and after extracting the harmonic component in which the difference tone component and the second harmonic component remain mainly, Envelope detection processing is performed.

Under the control of the processing circuit 17, the Doppler processing circuit 13 frequency-analyzes the velocity information from the echo data from the receiving circuit, and extracts the movement information of the moving body such as average velocity, dispersion, and power at multiple points (2 3D data). This data is commonly referred to as Doppler data. Here, the moving body is, for example, blood flow, a tissue such as a heart wall, or a contrast agent. The Doppler processing circuit 13 is an example of the Doppler processing unit.

Under the control of the processing circuit 17, the image generation circuit 14 generates an ultrasonic image represented in a predetermined brightness range as image data based on the echo signal received by the ultrasonic probe 20. For example, the image generation circuit 14 generates, as an ultrasonic image, a B-mode image in which the intensity of the reflected wave is represented by the brightness from the two-dimensional B-mode data generated by the B-mode processing circuit 12. Further, the image generation circuit 14 uses, as an ultrasonic image, an average velocity image, a dispersion image, a power image, or a combination image thereof that represents the movement state information from the two-dimensional Doppler data generated by the Doppler processing circuit 13. Generate a color Doppler image. The image generation circuit 14 is an example of an image generation unit.

Here, the image generation circuit 14 generally converts a scanning line signal sequence of ultrasonic scanning into a scanning line signal sequence of a video format typified by a television or the like (scan conversion) to display ultrasonic waves. Generate image data. Specifically, the image generation circuit 14 generates ultrasonic image data for display by performing coordinate conversion according to the scanning form of ultrasonic waves by the ultrasonic probe 20. In addition to the scan conversion, the image generation circuit 14 uses various image processes such as an image process (smoothing process) for regenerating an average brightness image using a plurality of image frames after the scan conversion. , Image processing (edge enhancement processing) using a differential filter in the image, and the like. Further, the image generation circuit 14 combines the ultrasonic image data with character information of various parameters, scales, body marks, and the like.

That is, the B-mode data and the Doppler data are ultrasonic image data before the scan conversion process, and the data generated by the image generation circuit 14 is the ultrasonic image data for display after the scan conversion process. The B-mode data and the Doppler data are also called raw data. The image generation circuit 14 generates two-dimensional ultrasonic image data for display from the two-dimensional ultrasonic image data before the scan conversion process.

The image memory 15 includes a plurality of memory cells in one axis in two axis directions, and includes a two-dimensional memory which is a memory including a plurality of memory cells. The two-dimensional memory as the image memory 15 stores the ultrasonic image of one frame or a plurality of frames generated by the image generation circuit 14 as two-dimensional image data under the control of the processing circuit 17. The image memory 15 is an example of a storage unit.

Further, the image generation circuit 14 performs coordinate conversion on the three-dimensional B-mode data generated by the B-mode processing circuit 12 to generate three-dimensional B-mode image data. The image generation circuit 14 also performs coordinate conversion on the three-dimensional Doppler data generated by the Doppler processing circuit 13 to generate three-dimensional Doppler image data. The image generation circuit 14 generates “three-dimensional B-mode image data or three-dimensional Doppler image data” as “three-dimensional ultrasonic image data (volume data)”.

The image memory 15 may include a three-dimensional memory that is a memory including a plurality of memory cells in the three axis directions (X axis, Y axis, and Z axis directions). The three-dimensional memory as the image memory 15 stores the ultrasonic image generated by the image generation circuit 14 as volume data under the control of the processing circuit 17.

Then, the image generation circuit 14 performs a rendering process on the volume data in order to generate various two-dimensional image data for displaying the volume data stored in the three-dimensional memory on the display 40. The image generation circuit 14 performs, for example, a cross-section reconstruction method (MPR: Multi Planer Reconstruction) as rendering processing to generate MPR image data from volume data. Further, the image generation circuit 14 performs, for example, a volume rendering (VR) process that generates two-dimensional image data that reflects three-dimensional information, as the rendering process.

The network interface 16 implements various information communication protocols according to the form of the network. The network interface 16 connects the ultrasonic diagnostic apparatus 10 to other devices such as the external medical image management apparatus 60 and the medical image processing apparatus 70 according to the various protocols. An electrical connection or the like via an electronic network can be applied to this connection. Here, the electronic network refers to all information communication networks using telecommunications technology, such as wireless/wired hospital backbone LANs (Local Area Networks) and Internet networks, as well as telephone communication line networks and optical fiber communication networks. , Cable communication networks and satellite communication networks.

Further, the network interface 16 may implement various protocols for contactless wireless communication. In this case, the ultrasonic diagnostic apparatus 10 can directly transmit/receive data to/from the ultrasonic probe 20, for example, without going through a network. The network interface 16 is an example of a network connection unit.

The processing circuit 17 means a dedicated or general-purpose CPU (central processing unit), MPU (micro processor unit), or GPU (Graphics Processing Unit), as well as an ASIC and a programmable logic device. Examples of programmable logic devices include simple programmable logic devices (SPLDs), complex programmable logic devices (CPLDs), and field programmable gate arrays (FPGAs). Can be mentioned.

Further, the processing circuit 17 may be configured by a single circuit or may be configured by a combination of a plurality of independent circuit elements. In the latter case, the main memory 18 may be provided individually for each circuit element, or a single main memory 18 may store programs corresponding to the functions of a plurality of circuit elements. The processing circuit 17 is an example of a processing unit.

The main memory 18 is composed of a RAM (random access memory), a semiconductor memory device such as a flash memory, a hard disk, an optical disk, or the like. The main memory 18 may be composed of a portable media such as a USB (universal serial bus) memory and a DVD (digital video disk). The main memory 18 stores various processing programs used in the processing circuit 17 (including an OS (operating system) in addition to application programs) and data necessary for executing the programs. Further, the OS may include a GUI (graphical user interface) that uses graphics for displaying information on the display 40 to the operator and can perform basic operations by the input interface 30. The main memory 18 is an example of a storage unit.

The ultrasonic probe 20 includes a plurality of minute vibrators (piezoelectric elements) on the front surface thereof, and transmits/receives ultrasonic waves to/from a region including a scan target, for example, a region including a lumen body. Each transducer is an electroacoustic conversion element and has a function of converting an electric pulse into an ultrasonic pulse during transmission and converting a reflected wave into an electric signal (reception signal) during reception. The ultrasonic probe 20 has a small size and a light weight, and is connected to the ultrasonic diagnostic apparatus 10 via a cable (or wireless communication).

The ultrasonic probe 20 is classified into a linear type, a convex type, a sector type, and the like depending on the scanning method. The ultrasonic probe 20 includes a 1D array probe in which a plurality of transducers are arranged in a one-dimensional (1D) direction in the azimuth direction and a two-dimensional (2D in the elevation direction) in the azimuth direction and the elevation direction depending on the array arrangement dimension. 2D array probe in which a plurality of transducers are arranged. The 1D array probe includes a probe in which a small number of transducers are arranged in the elevation direction.

Here, when a 3D scan, that is, a volume scan is performed, a 2D array probe having a scanning method such as a linear type, a convex type, or a sector type is used as the ultrasonic probe 20. Alternatively, when a volume scan is executed, a 1D probe having a scanning method such as a linear type, a convex type, and a sector type as the ultrasonic probe 20 and a mechanism mechanically swinging in the elevation direction is used. To be done. The latter probe is also called a mechanical 4D probe.

The input interface 30 includes an input device that can be operated by an operator, and an input circuit that inputs a signal from the input device. The input device includes a trackball, a switch, a mouse, a keyboard, a touch pad that performs an input operation by touching an operation surface, a touch screen in which a display screen and a touch pad are unified, a non-contact input device using an optical sensor, And a voice input device or the like. When the operator operates the input device, the input circuit generates a signal corresponding to the operation and outputs the signal to the processing circuit 17. The input interface 30 is an example of an input unit.

The input interface 30 also includes an interlocking mode switching button described later, an image acquisition button, and the like. The switching button and the image acquisition button may be hardware-like or software buttons implemented by a GUI. In the latter case, the switch button is a switch button B1 (shown in FIG. 7) for switching to the first interlocking mode or a switch button B2 (shown in FIG. 7) for switching to the second interlocking mode on the screen. Alternatively, it is provided as a switching button B3 (shown in FIG. 7) for switching to the third interlocking mode. The image acquisition button is provided as a symbol “C” in FIG. 7.

The display 40 is configured by a general display output device such as a liquid crystal display or an OLED (Organic Light Emitting Diode) display. The display 40 displays various information under the control of the processing circuit 17. The display 40 is an example of a display unit.

Further, FIG. 1 shows a medical image management apparatus 60 and a medical image processing apparatus 70, which are external devices of the ultrasonic diagnostic apparatus 10. The medical image management apparatus 60 is, for example, a DICOM (Digital Imaging and Communications in Medicine) server, and is connected to devices such as the ultrasonic diagnostic apparatus 10 via the network N so that data can be transmitted and received. The medical image management apparatus 60 manages medical images such as ultrasonic images generated by the ultrasonic diagnostic apparatus 10 as DICOM files.

The medical image processing apparatus 70 is connected to devices such as the ultrasonic diagnostic apparatus 10 and the medical image management apparatus 60 so that data can be transmitted and received via the network N. Examples of the medical image processing apparatus 70 include a workstation that performs various types of image processing on the ultrasonic image generated by the ultrasonic diagnostic apparatus 10, a portable information processing terminal such as a tablet terminal, and the like. The medical image processing apparatus 70 may be an offline apparatus, and may be an apparatus capable of reading the ultrasonic image generated by the ultrasonic diagnostic apparatus 10 via a portable storage medium.

Next, the function of the ultrasonic diagnostic apparatus 10 will be described.

FIG. 2 is a block diagram showing the functions of the ultrasonic diagnostic apparatus 10.

The processing circuit 17 reads and executes a program stored in the main memory 18 or directly installed in the processing circuit 17 to execute an image collection function 171, a display control function 172, a reception function 173, and A specific function 174 and a setting function 175 are realized. Hereinafter, the case where the functions 171 to 175 function as software will be described as an example, but all or part of the functions 171 to 175 are provided in the ultrasonic diagnostic apparatus 10 as a circuit such as an ASIC. May be.

The image acquisition function 171 controls the transmission/reception circuit 11, the B-mode processing circuit 12, the Doppler processing circuit 13, the image generation circuit 14, and the like to execute a scan using the ultrasonic probe 20 to perform ultrasonic image data. Including the ability to collect. Specifically, the image collection function 171 collects M-mode image data, B-mode image data, Doppler image data, and the like as ultrasonic image data. The image collection function 171 is an example of an image collection unit.

The display control function 172 includes a function of displaying a plurality of ultrasonic image data generated by the image generation circuit 14 under the control of the image collecting function 171 as a plurality of ultrasonic images on the same screen of the display 40. For example, the display control function 172 causes a plurality of ultrasonic images to be displayed in parallel on the same screen of the display 40. The display control function 172 is an example of a display control unit.

The reception function 173 changes the display mode of an ultrasonic image (hereinafter, referred to as “operation target ultrasonic image”) that is one of a plurality of ultrasonic images displayed on the same screen under the control of the display control function 172. A function of receiving an operation from the input interface 30 is included. The display mode changing operation is at least one of a move (Pan) operation, an enlargement (Zoom-In) or reduction (Zoom-Out) operation, and a gain (brightness, brightness) adjustment operation. The reception function 173 is an example of a reception unit.

The specific function 174 corresponds to the image type of the operation target ultrasonic image among the other ultrasonic images in the plurality of ultrasonic images displayed on the same screen under the control of the display control function 172. It includes a function of specifying one or a plurality of ultrasonic images (hereinafter, referred to as “interlocked ultrasonic images”). The identification of the interlocked ultrasonic image by the identification function 174 may be performed after the changing operation by the reception function 173, or may be performed in advance when the display screen is set. The specific function 174 is an example of a specific unit.

The image type includes at least one of a view type, a phase type, an inspection mode type, a scan type, and a layout type. The type of view as an image type means, for example, a difference between a view at a cardiac base level of a short axis and a view of a four-chamber section. When the image type is the view type, it is set in advance that the ultrasonic image related to the view at the cardiac base level of the short axis and the ultrasonic image related to the view of the four-chamber cross section are the corresponding image types. The specific function 174 is an interlocked ultrasonic image corresponding to the ultrasonic image of the operation target related to the short-axis cardiac base-level view, and the ultrasonic image related to the same short-axis cardiac base-level view and the four-chamber cross-section. The ultrasound image related to the view is specified.

Further, the type of phase as an image type means, for example, a difference before and after loading. When the image type is the type of the pre-load and post-load phases, it is set in advance that the ultrasonic image before the load and the ultrasonic image after the load correspond to each other. The specific function 174 specifies the ultrasonic image before the same load and the ultrasonic image after the same load as the interlocked ultrasonic image corresponding to the ultrasonic image of the operation target before the load.

Furthermore, the type of phase as an image type means, for example, a difference between before and after surgery (the surgery may be performed multiple times). When the image type is the type of the pre-operative and post-operative phases, the pre-operative ultrasonic image and the post-operative ultrasonic image are set in advance as corresponding image types. The specifying function 174 specifies the same preoperative ultrasonic image and postoperative ultrasonic image as interlocked ultrasonic images corresponding to the preoperative ultrasonic image of the operation target.

Further, the types of inspection modes as image types mean, for example, differences between B mode, Doppler mode, M mode, and the like. When the image type is the type of the inspection mode, it is set in advance that the B mode image, the Doppler mode image, and the M mode image do not correspond to each other. The specifying function 174 specifies only the same B-mode image as the linked ultrasonic image corresponding to the B-mode image to be operated.

Further, the type of scan as an image type means a difference between 2D scan, 3D scan, and 4D scan, for example. When the image type is the scan type, it is set in advance that the 2D scan, the 3D scan, and the 4D scan do not correspond to each other. The specifying function 174 specifies only the ultrasonic image of the same 2D scan as the interlocked ultrasonic image corresponding to the ultrasonic image of the operation target of the 2D scan.

The type of layout as an image type means, for example, a difference between single-stage display and multiple-stage display (divided display). When the image type is the layout type, it is set in advance that the single-stage display and the multi-stage display do not correspond to each other. The specifying function 174 specifies only the ultrasonic image of the same single step display as the linked ultrasonic image corresponding to the ultrasonic image of the operation target of the single step display.

The above-described image type recognition may be performed by automatic recognition of ultrasonic image data, or may be performed based on information attached to DICOM data including ultrasonic image data. Good. Examples of the information incidental to the DICOM data include private information such as information indicating a view and information indicating an inspection mode, information indicating a layout, and information indicating a display instruction. The information indicating the layout includes information on split display of screen elements for displaying each ultrasonic image on the display screen.

As an alternative to the case where the image type is the view type, the image type may be the type of position information including the position and orientation of the cross section. When the image type is the type of position information, a sensor (not shown) that can detect the position and orientation of the ultrasonic probe 20 is provided. Thereby, the specifying function 174 can specify the scan section, that is, the position information of the ultrasonic image. The specifying function 174 specifies, as the linked ultrasonic image, position information whose position information is substantially the same as the position information of the operation target ultrasonic image. Here, “substantially the same” means that the position information is recognized as the same position information within a preset difference range of the position information.

Note that the specific function 174 may provide a priority when a plurality of the image types described above are arbitrarily combined. For example, if the inspection mode or the display layout as the image type is set to a high priority, the specific function 174 determines that the image type is the corresponding image type if the inspection mode or the display layout is the same. Further, for example, when the priority of the inspection mode as the image type is set to be high, the specific function 174 determines that the image types are the corresponding image types even if the views and the like are not the same in the same B-mode image.

The display control function 172 changes the display mode of the ultrasonic image of the operation target and the linked ultrasonic image among the plurality of ultrasonic images displayed on the same screen in accordance with the operation of changing the display mode by the reception function 173. Including the function to do.

The setting function 175 includes a function of setting any one of the first interlocking mode, the second interlocking mode, and the third interlocking mode according to an instruction from the input interface 30. The first interlocking mode is to change the display mode of only the ultrasonic image to be operated according to the operation of changing the display mode by the reception function 173. The second interlocking mode is to change all the display modes of a plurality of ultrasonic images under the control of the display control function 172 according to the operation of changing the display mode by the reception function 173. The third interlocking mode is to change the display mode of the ultrasonic image to be operated and the interlocked ultrasonic image according to the operation of changing the display mode by the reception function 173 (illustrated in FIG. 4C, etc.). ). The setting function 175 is an example of a setting unit. The specifying function 174 specifies the linked ultrasonic image as described above when the third linked mode is set.

Details of the functions 171 to 175 will be described with reference to FIGS.

Next, the operation of the ultrasonic diagnostic apparatus 10 will be described.

FIG. 3 is a diagram showing an operation of the ultrasonic diagnostic apparatus 10 as a flowchart. In FIG. 3, reference numerals in which “ST” is attached to numbers indicate respective steps of the flowchart.

The image acquisition function 171 controls the transmission/reception circuit 11, the B-mode processing circuit 12, the Doppler processing circuit 13, the image generation circuit 14, and the like to execute an ultrasonic scan using the ultrasonic probe 20 to perform a plurality of ultrasonic scans. The ultrasonic image data is collected and stored in the image memory 15 (step ST1). The display control function 172 reads out the plurality of ultrasonic image data stored in the image memory 15 in step ST1 and displays them as a plurality of ultrasonic images on the same screen of the display 40 (step ST2).

FIG. 4 is a diagram showing a first display example of a plurality of ultrasonic images on the same screen.

FIG. 4A shows four ultrasonic images displayed on the same screen in step ST2. The four ultrasonic images are B-mode images generated by the stress echo method. The upper left of FIG. 4(A) shows an ultrasound image showing a short-axis cardiac-base-level view in the phase “Rest”, and the upper-right of the same shows an ultrasonographic image showing a short-axis cardiac-base-level view in the phase “Post”. A sonic image is shown. The lower left of FIG. 4A shows an ultrasonic image showing a view of a four-chamber cross section in the phase “Rest”, and the lower right of the same shows an ultrasonic image showing a view of a four-chamber cross section in the phase “Post”. Show.

Each ultrasonic image may be displayed as a still image or a moving image. Further, when each ultrasonic image is displayed as a moving image, it may be displayed while being synchronized according to the cardiac phase.

Returning to the description of FIG. 3, the reception function 173 inputs an operation for changing the display mode of the ultrasonic image to be operated among the plurality of ultrasonic images displayed on the same screen in step ST2, for example, an enlargement operation. Received from 30 (step ST3). For example, in FIG. 2, the reception function 173 receives the enlargement operation for the ultrasonic image to be operated on the upper left of the four ultrasonic images on the same screen.

The specific function 174 includes one or more image types corresponding to the image type of the ultrasonic image of the operation target among other ultrasonic images among the plurality of ultrasonic images displayed on the same screen in step ST2. It is determined whether or not there is an interlocked ultrasonic image (step ST4). For example, in FIG. 2, the specific function 174 determines that among the four ultrasonic images on the same screen, the interlocked ultrasonic waves are included in the other three ultrasonic images excluding the ultrasonic image to be operated at the upper left. Determine if there is an image. The determination of the linked ultrasonic image in step ST4 may be performed after the changing operation in step ST3, but at the time of setting the display screen (for example, setting the display layout of the four images shown in FIG. 4). It may be performed in advance.

If the determination in step ST4 is YES, that is, if it is determined that there are interlocked ultrasonic images among the other ultrasonic images among the plurality of ultrasonic images displayed on the same screen, the display control function 172 changes the display mode of the ultrasonic image of the operation target and the linked ultrasonic image among the plurality of ultrasonic images displayed on the same screen in step ST2 in accordance with the operation of changing the display mode in step ST3. (Step ST5).

4(B) and 4(C) show the case where the display mode of the operation target ultrasonic image and the linked ultrasonic image among the four ultrasonic images shown in FIG. A display example is shown. The specifying function 174 specifies an image corresponding to the ultrasonic image of the operation target as a linked ultrasonic image. For example, the specifying function 174 specifies the ultrasonic image of the operation target as the phase or the image corresponding to the view as the linked ultrasonic image (illustrated in FIG. 4B) or the ultrasonic image of the operation target. The image corresponding to the view is specified as a linked ultrasonic image (illustrated in FIG. 4C).

FIG. 4B shows a display example in the case where the upper right ultrasonic image, the lower left ultrasonic image, and the lower right ultrasonic image on the same screen are all specified as linked ultrasonic images. .. As shown in FIG. 4(B), the display control function 172 selects the ultrasonic image of the operation target and the phase or the view of the ultrasonic images of the four ultrasonic images displayed on the same screen. The display mode with the three linked ultrasonic images corresponding to the sound image is enlarged according to the changing operation.

FIG. 4C shows a display example when only the upper right ultrasonic image on the same screen is specified as the linked ultrasonic image. As shown in FIG. 4C, the display control function 172 corresponds to the ultrasonic image of the operation target and the ultrasonic image of the operation target of the four ultrasonic images displayed on the same screen. The display mode with one interlocked ultrasonic image is enlarged according to the changing operation.

Returning to the description of FIG. 3, NO is determined in step ST4, that is, if there is no interlocked ultrasonic image among the other ultrasonic images among the plurality of ultrasonic images displayed on the same screen. When it is determined, the display control function 172 determines the display mode of only the ultrasonic image of the operation target among the plurality of ultrasonic images displayed on the same screen in step ST2 according to the display mode changing operation in step ST3. Change (step ST6).

The display control function 172 determines whether to end the display of the plurality of ultrasonic images started in step ST2 (step ST7). If NO in the determination in step ST7, that is, if it is determined that the display of the plurality of ultrasonic images is not ended, the process returns to step ST3.

On the other hand, if YES in the determination in step ST7, that is, if it is determined that the display of the plurality of ultrasonic images is to be ended, the ultrasonic diagnostic apparatus 10 ends the display of the plurality of ultrasonic images and ends the operation. ..

In addition, although the case where four ultrasonic images are displayed on the same screen has been described with reference to FIG. 4, it is needless to say that the present invention is not limited to this case.

FIG. 5 is a diagram showing a second display example of a plurality of ultrasonic images on the same screen. FIG. 5A shows two ultrasonic images displayed on the same screen in step ST2. The two ultrasonic images are B-mode images generated by the stress echo method. The left side of FIG. 5A shows an ultrasonic image in the phase “Rest”, and the right side thereof shows an ultrasonic image in the phase “Post”.

Each ultrasonic image may be displayed as a still image or a moving image. Further, when each ultrasonic image is displayed as a moving image, it may be displayed while being synchronized according to the cardiac phase.

FIGS. 5B and 5C show a case in which the ultrasonic image of the operation target among the two ultrasonic images shown in FIG. A display example is shown. The specifying function 174 specifies an image corresponding to the ultrasonic image of the operation target as a linked ultrasonic image. For example, the specifying function 174 specifies an operation target ultrasonic image and a phase or an image corresponding to an inspection mode as an interlocking ultrasonic image (illustrated in FIG. 5B) or an operation target ultrasonic image. The image corresponding to the phase is specified as the linked ultrasonic image (illustrated in FIG. 5C).

FIG. 5B shows a display example when the right ultrasonic image on the same screen is specified as a linked ultrasonic image. As shown in FIG. 5B, the display control function 172 selects the ultrasonic image of the operation target and the phase or the inspection mode of the operation target of the two ultrasonic images displayed on the same screen. The display mode with one linked ultrasonic image corresponding to the ultrasonic image is enlarged according to the changing operation.

FIG. 5C shows a display example when the right ultrasonic image on the same screen is not specified as a linked ultrasonic image. As shown in FIG. 5C, the display control function 172 expands the display mode of only the ultrasonic image of the operation target among the two ultrasonic images displayed on the same screen according to the changing operation.

FIG. 6 is a diagram showing a third display example of a plurality of ultrasonic images on the same screen.

FIG. 6 shows two ultrasonic images displayed on the same screen in step ST2. The two ultrasonic images are a B-mode image (upper row) and a Doppler image (lower row) generated by the stress echo method. The upper left of FIG. 6 shows the B-mode image in the phase “Rest”, and the upper right thereof shows the B-mode image in the phase “Post”. The lower left part of FIG. 6 shows the Doppler image in the phase “Rest”, and the lower right part thereof shows the Doppler image in the phase “Post”.

As shown in FIG. 6, the display control function 172 controls the B-mode image of the operation target and the one interlocking operation corresponding to the operation target of the inspection mode among the four ultrasonic images displayed on the same screen. The display mode of the B-mode image is enlarged according to the changing operation.

Each ultrasonic image may be displayed as a still image or a moving image. Further, when each ultrasonic image is displayed as a moving image, it may be displayed while being synchronized according to the cardiac phase.

According to the ultrasonic diagnostic apparatus 10, when a plurality of ultrasonic images are displayed on the same screen and an operation of changing the display mode of a certain ultrasonic image (for example, an enlarging operation) is performed, the ultrasonic image is displayed. In addition, only the ultrasonic image whose image type corresponds to the ultrasonic image can be expanded in association with each other. That is, among the plurality of ultrasonic images displayed on the same screen, only the display mode of the corresponding ultrasonic image is changed by synchronizing.

2. First Modification Here, the operation of the setting function 715 will be described. The setting function 715 is characterized by setting the interlocking mode in accordance with the operator's selection.

FIG. 7 is a diagram showing a display screen showing an example of a method of setting the interlocking mode.

FIG. 7 shows switching buttons B1 to B3 of the interlocking mode realized by the GUI, which are provided on the display screen of the display 40. The switching button B1 corresponds to the first interlocking mode in which the display mode of only the ultrasonic image to be operated is changed according to the operation of changing the display mode. The switching button B2 corresponds to the second change mode in which all the display modes of the plurality of ultrasonic images are changed according to the display mode changing operation. The switching button B3 corresponds to a third interlocking mode for changing the display mode of the operation target ultrasonic image and the interlocked ultrasonic image in accordance with the display mode changing operation.

When the operator clicks any one of the switching buttons B1 to B3 via the input interface 30, the setting function 715 switches to the corresponding interlocking mode. The specifying function 174 specifies the linked ultrasonic image as described above when the third linked mode is set.

As described above, according to the first modified example, in addition to the effects described above, the operator can arbitrarily switch the interlocking mode while displaying a plurality of ultrasonic images on the same screen.

3. Second Modification Here, an additional operation of the reception function 713 will be described. The reception function 713 receives selection of an ultrasonic image to be additionally displayed while a plurality of ultrasonic images are displayed on the same screen.

The reception function 713 can include a function of registering the content of the operation of changing the display mode of the operation target ultrasonic image in the main memory 18 as a change history. That is, the contents of the display mode changing operation are accumulated in the main memory 18. In that case, when there is a request to display an ultrasonic image that is not currently displayed on the same screen (hereinafter, referred to as “non-display ultrasonic image”), the display control function 172 displays a non-display ultrasonic image. By including the change history acquired from the main memory 18, a function of initially displaying a hidden ultrasonic image is included.

For example, when the operator uses the input interface 73 to click the image acquisition button C (illustrated in FIG. 7) realized by the GUI provided on the display screen of the display 40, the display control function 172 is displayed. For example, a thumbnail D (illustrated in FIG. 7) corresponding to a plurality of existing ultrasonic images and including hidden ultrasonic images of the same patient and/or the same examination is displayed. When the operator uses the input interface 73 to select a desired image from the thumbnails D including one or more hidden ultrasonic images (eg, drag and drop operation), the reception function 713 is selected. Receive a display request for an ultrasonic image.

When there is a display request for a hidden ultrasonic image, the specific function 174 determines whether or not the hidden ultrasonic image is a linked ultrasonic image. The display control function 172 reflects the content of the change history acquired from the main memory 18 on the hidden ultrasonic image when it is determined that the hidden ultrasonic image is the linked ultrasonic image. , Initially display the hidden ultrasonic image. When there are a plurality of past change operations, the display control function 172 may reflect only the change operation on the ultrasonic image corresponding to the image type on the hidden ultrasonic image. In that case, it is preferable that the reception function 713 register, in the main memory 18, a change history in which the image type is associated with the content of the change operation of the display mode of the operation target ultrasonic image.

As described above, according to the second modification, in addition to the above-described effects, an ultrasonic image in which a past movement operation is reflected is initially displayed while a plurality of ultrasonic images are displayed on the same screen. You can

4. Medical Image Processing Device FIG. 8 is a schematic diagram showing the configuration of the medical image processing device according to the embodiment.

FIG. 8 shows a medical image processing apparatus 70 according to the embodiment. The medical image processing apparatus 70 is a medical image management apparatus (image server), a workstation, a radiogram interpretation terminal, or the like, and is provided on a medical image system connected via a network. The medical image processing device 70 may be an offline device.

The medical image processing apparatus 70 includes a processing circuit 71, a memory 72, an input interface 73, a display 74, and a network interface 75. The processing circuit 71, the memory 72, the input interface 73, and the display 74 have the same configuration as the processing circuit 17, the main memory 18, the input interface 30, and the display 40 shown in FIGS. 1 and 2. The description is omitted.

The network interface 75 is composed of a connector according to a parallel connection specification or a serial connection specification. When the medical image processing apparatus 70 is provided on the medical image system, the network interface sends and receives information to and from an external device on the network. For example, the network interface receives medical image data such as ultrasonic image data, CT (Computed Tomography) image data, and MR (Magnetic Resonance) image data from an external device under the control of the processing circuit 71.

Next, the function of the medical image processing apparatus 70 will be described.

FIG. 9 is a block diagram showing the functions of the medical image processing apparatus 70.

The processing circuit 71 realizes the image acquisition function 711, the display control function 712, the reception function 713, the specific function 714, and the setting function 715 by executing the program stored in the memory 72. Hereinafter, the case where the functions 711 to 715 function as software will be described as an example. However, all or part of the functions 711 to 715 are provided in the medical image processing apparatus 70 as a circuit such as an ASIC. May be. Further, all or part of the functions 711 to 715 may be provided in another device such as the medical image management device 60.

The image acquisition function 711 includes a function of acquiring a plurality of medical image data from the medical image management apparatus 60 or the ultrasonic diagnostic apparatus 10 via the network interface 75. For example, the image acquisition function 711 acquires, as the plurality of medical image data, a plurality of ultrasonic image data of the same patient, a plurality of CT image data of the same patient, and a plurality of MR image data of the same patient. Including features. Further, for example, the image acquisition function 711 can also acquire a plurality of medical image data relating to the same patient, which is a combination of ultrasonic image data, CT image data, and MR image data. The image acquisition function 711 is an example of an image acquisition unit.

The display control function 712 includes a function equivalent to the display control function 172 shown in FIG. The display control function 712 includes a function of displaying a plurality of medical image data acquired by the image acquisition function 711 as a plurality of medical images on the same screen of the display 40. The display control function 712 is an example of a display control unit.

Reception function 713 includes a function equivalent to reception function 173 shown in FIG. A function of accepting, from the input interface 73, an operation of changing the display mode of a medical image (hereinafter, referred to as “operational medical image”) that is one of a plurality of medical images displayed on the same screen under the control of the display control function 712. including. The reception function 713 is an example of a reception unit.

The specific function 714 includes a function equivalent to the specific function 174 shown in FIG. The specific function 714 is one or more of the other medical images among the plurality of medical images displayed on the same screen under the control of the display control function 712, in which the image type corresponds to the image type of the medical image to be operated. Medical image (hereinafter, referred to as a “linked medical image”). The identification of the interlocked medical image by the identification function 714 may be performed after the change operation by the reception function 713, or may be performed in advance when the display screen is set. The specific function 714 is an example of a specific unit.

The display control function 712 has a function of changing the display mode of the medical image to be operated and the linked medical image among the plurality of medical images displayed on the same screen in accordance with the operation of changing the display mode by the reception function 713. Including.

The setting function 715 includes a function equivalent to the setting function 175 shown in FIG. The setting function 715 includes a function of setting any one of the first interlocking mode, the second interlocking mode, and the third interlocking mode according to an instruction from the input interface 73. The setting function 715 is an example of a setting unit.

Note that the main operation of the medical image processing apparatus 70 is the same as the operation of the ultrasonic diagnostic apparatus 10 shown in FIG.

According to the medical image processing apparatus 70, when a plurality of medical images are displayed on the same screen and an operation of changing the display mode of a certain medical image (for example, enlargement operation) is performed, Only the medical image whose image type corresponds to the medical image can be expanded in association with each other. That is, among the plurality of medical images displayed on the same screen, only the display mode of the corresponding medical image is synchronized and changed.

According to at least one embodiment described above, the operation of changing the display mode performed on a medical image among a plurality of medical images displayed on the same screen is effectively reflected on another medical image. can do.

The image collection function 171 is an example of an image collection unit. The display control functions 172 and 712 are an example of a display control unit. The reception functions 173 and 713 are examples of reception units. The specific functions 174 and 714 are an example of a specific unit. The setting functions 175 and 715 are examples of a setting unit. The image acquisition function 711 is an example of an image acquisition unit.

Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and modifications thereof are included in the scope and the gist of the invention, and are also included in the invention described in the claims and the scope equivalent thereto.

10 Ultrasonic Diagnostic Device 17 Processing Circuit 40 Display 70 Medical Image Processing Device 71 Processing Circuit 74 Display 171 Image Collection Function 172,712 Display Control Function 173,713 Reception Function 174,714 Specific Function 175,715 Setting Function 711 Image Acquisition Function

Claims (10)

An ultrasonic diagnostic apparatus capable of displaying a plurality of ultrasonic images on the same screen of a display unit,
A receiving unit that receives an operation of changing the display mode of the first ultrasonic image, which is one of the plurality of ultrasonic images displayed on the same screen;
Of the other ultrasonic images in the plurality of ultrasonic images displayed on the same screen, one or a plurality of second ultrasonic waves whose image type corresponds to the image type of the first ultrasonic image. A specific part that identifies the image,
A display control unit that changes a display mode of the first ultrasonic image and the second ultrasonic image among a plurality of ultrasonic images displayed on the same screen according to a change operation of the display mode,
An ultrasonic diagnostic apparatus having a. The display mode changing operation is at least one of a moving operation, an enlarging or reducing operation, and a gain adjusting operation.
The ultrasonic diagnostic apparatus according to claim 1. The image type includes at least one of a view type, a phase type, an inspection mode type, a scan type, and a layout type.
The ultrasonic diagnostic apparatus according to claim 1. The specifying unit provides a priority when a plurality of types of the view type, the phase type, the inspection mode type, the scan type, and the layout type are combined.
The ultrasonic diagnostic apparatus according to claim 3. A first mode in which a display mode of only the first ultrasonic image is changed according to a change operation of the display mode, and a second mode in which all display modes of the plurality of ultrasonic images are changed according to a change operation of the display mode And the third mode in which the display mode of the first ultrasonic image and the second ultrasonic image is changed according to the operation of changing the display mode, the operator can operate. Further has a setting unit, which is set by an instruction from the input unit,
The specifying unit specifies the second ultrasonic image when the third mode is set,
The ultrasonic diagnostic apparatus according to any one of claims 1 to 4. The reception unit registers the content of the change operation of the display mode of the first ultrasonic image as a change history in the storage unit,
When the display control unit receives a display request for the third ultrasonic image that is not displayed, the display control unit reflects the content of the change history acquired from the storage unit on the third ultrasonic image, thereby performing the third Initially display the ultrasonic image of
The ultrasonic diagnostic apparatus according to any one of claims 1 to 5. The reception unit registers, in the storage unit, the change history in which the image type is associated with the content of the change operation of the display mode of the first ultrasonic image.
The ultrasonic diagnostic apparatus according to claim 6. The display control unit causes the display unit to display the plurality of ultrasonic images in parallel.
The ultrasonic diagnostic apparatus according to any one of claims 1 to 7. A medical image processing apparatus capable of displaying a plurality of medical images on the same screen of a display unit,
A reception unit that receives an operation of changing the display mode of the first medical image that is one of the plurality of medical images displayed on the same screen;
Among other medical images among the plurality of medical images displayed on the same screen, one or a plurality of second medical images whose image type corresponds to the image type of the first medical image is specified. A specific part,
A display control unit that changes a display mode of the first medical image and the second medical image among a plurality of medical images displayed on the same screen according to a change operation of the display mode,
A medical image processing apparatus having a. On the computer,
A function to display multiple ultrasonic images on the same screen of the display unit,
A function of accepting an operation of changing a display mode of a first ultrasonic image, which is one of the plurality of ultrasonic images displayed on the same screen,
Of the other ultrasonic images in the plurality of ultrasonic images displayed on the same screen, one or a plurality of second ultrasonic waves whose image type corresponds to the image type of the first ultrasonic image. The ability to identify images,
A function of changing the display mode of the first ultrasonic image and the second ultrasonic image among the plurality of ultrasonic images displayed on the same screen according to the operation of changing the display mode,
Ultrasonic image display program to realize.