JP7545794B2 - Ultrasound diagnostic device, medical image processing device, and ultrasound image display program - Google Patents

Description

Embodiments of the present invention relate to an ultrasound diagnostic device, a medical image processing device, and an ultrasound image display program.

In the medical field, ultrasound diagnostic devices are used to image the inside of a subject using ultrasound generated by multiple transducers (piezoelectric transducers) in an ultrasound probe. The ultrasound diagnostic device transmits ultrasound into the subject from an ultrasound probe connected to the ultrasound diagnostic device, generates echo signals based on the reflected waves, and obtains the desired ultrasound image through image processing.

The ultrasound diagnostic device has a function of displaying multiple ultrasound images generated by a stress echo method or the like on the same screen. The ultrasound diagnostic device can also accept an operation to change the display mode of any of the multiple ultrasound images displayed on the same screen, and change the display mode of the ultrasound image. The operation to change the display mode is, for example, a movement (Pan) operation, or a zoom-in or zoom-out operation.

Furthermore, the ultrasound diagnostic device can reflect a change in the display mode made to any one of a plurality of ultrasound images displayed on the same screen to all other ultrasound images. This eliminates the need to make the same change to all other ultrasound images as was made to the ultrasound image being operated on.

JP 2011-125568 A

The problem that this invention aims to solve is to effectively reflect a change in the display mode made to one medical image among multiple medical images displayed on the same screen to the other medical images.

An ultrasound diagnostic device capable of displaying multiple ultrasound images on the same screen of a display unit according to an embodiment includes a reception unit, an identification unit, and a display control unit. The reception unit receives an operation to change the display mode of a first ultrasound image, which is one of the multiple ultrasound images displayed on the same screen. The identification unit identifies one or more second ultrasound images, of the other ultrasound images among the multiple ultrasound images displayed on the same screen, whose image type corresponds to the image type of the first ultrasound image. The display control unit changes the display mode of the first ultrasound image and the second ultrasound image among the multiple ultrasound images displayed on the same screen in accordance with the operation to change the display mode.

FIG. 1 is a schematic diagram showing the configuration of an ultrasonic diagnostic apparatus according to an embodiment. FIG. 2 is a block diagram showing the functions of the ultrasound diagnostic apparatus according to the embodiment. FIG. 3 is a flowchart showing the operation of the ultrasound diagnostic apparatus according to the embodiment. FIG. 4 is a diagram showing a first display example of a plurality of ultrasound images on the same screen in the ultrasound diagnostic apparatus according to the embodiment. FIG. 5 is a diagram showing a second display example of a plurality of ultrasound images on the same screen in the ultrasound diagnostic apparatus according to the embodiment. FIG. 6 is a view showing a third display example of a plurality of ultrasound images on the same screen in the ultrasound diagnostic apparatus according to the embodiment. FIG. 7 is a diagram showing a display screen illustrating an example of a method for setting a link mode in the ultrasound diagnostic apparatus according to the embodiment. FIG. 8 is a schematic diagram showing the configuration of a medical image processing apparatus according to an embodiment. FIG. 9 is a block diagram showing functions of the medical image processing apparatus according to the embodiment.

Below, we will explain in detail the embodiments of the ultrasound diagnostic device, medical image processing device, and ultrasound image display program with reference to the drawings.

1. Ultrasonic Diagnostic Apparatus Fig. 1 is a schematic diagram showing the configuration of an ultrasonic diagnostic apparatus according to an embodiment.

Figure 1 shows an ultrasound diagnostic device 10 according to an embodiment. Also, Figure 1 shows an ultrasound probe 20, an input interface 30, and a display 40. Note that an apparatus in which at least one of the ultrasound probe 20, the input interface 30, and the display 40 is added to the ultrasound diagnostic device 10 may be referred to as an ultrasound diagnostic device. In the following explanation, a case will be described in which the ultrasound probe 20, the input interface 30, and the display 40 are all provided outside the ultrasound diagnostic device 10.

The ultrasound diagnostic device 10 comprises a transmission/reception circuit 11, a B-mode processing circuit 12, a Doppler processing circuit 13, an image generation circuit 14, an image memory 15, a network interface 16, a processing circuit 17, and a main memory 18. The circuits 11 to 14 are configured using application specific integrated circuits (ASICs) or the like. However, this is not limited to this case, and all or part of the functions of the circuits 11 to 14 may be realized by the processing circuit 17 executing a program.

The transmission/reception circuit 11 has a transmission circuit and a reception circuit (not shown). The transmission/reception circuit 11 controls the transmission directivity and reception directivity in transmitting and receiving ultrasound under the control of the processing circuit 17. Note that, although a case where the transmission/reception circuit 11 is provided in the ultrasound diagnostic device 10 will be described, the transmission/reception circuit 11 may be provided in the ultrasound probe 20, or may be provided in both the ultrasound diagnostic device 10 and the ultrasound probe 20. Note that the transmission/reception circuit 11 is an example of a transmission/reception unit.

The transmission circuit has a pulse generation circuit, a transmission delay circuit, a pulsar circuit, etc., and supplies a drive signal to the ultrasonic transducer. The pulse generation circuit repeatedly generates rate pulses to form a transmission ultrasonic wave at a predetermined rate frequency. The transmission delay circuit provides each rate pulse generated by the pulse generation circuit with a delay time for each piezoelectric transducer required to focus the ultrasonic waves generated from the ultrasonic transducers of the ultrasonic probe 20 into a beam and determine the transmission directivity. In addition, the pulsar circuit applies a drive pulse to the ultrasonic transducer at a timing based on the rate pulse. The transmission delay circuit changes the delay time provided to each rate pulse to arbitrarily adjust the transmission direction of the ultrasonic beam transmitted from the piezoelectric transducer surface.

The receiving circuit has an amplifier circuit, an A/D (Analog to Digital) converter, an adder, etc., and receives the echo signal received by the ultrasonic transducer and performs various processes on this echo signal to generate echo data. The amplifier circuit amplifies the echo signal for each channel and performs gain correction processing. The A/D converter A/D converts the gain-corrected echo signal and gives the digital data a delay time required to determine the reception directivity. The adder performs addition processing of the echo signal processed by the A/D converter to generate echo data. The addition processing of the adder emphasizes the reflected components from the direction corresponding to the reception directivity of the echo signal.

Under the control of the processing circuit 17, the B-mode processing circuit 12 receives echo data from the receiving circuit and performs logarithmic amplification and envelope detection processing, etc., to generate data (two-dimensional or three-dimensional data) in which the signal strength is expressed as luminance brightness. This data is generally called B-mode data. The B-mode processing circuit 12 is an example of a B-mode processing unit.

The B-mode processing circuit 12 can change the frequency band to be visualized by changing the detection frequency through filter processing. By using the filter processing function of the B-mode processing circuit 12, it is possible to perform harmonic imaging such as contrast harmonic imaging (CHI) and tissue harmonic imaging (THI). That is, the B-mode processing circuit 12 can separate reflected wave data (harmonic data or sub-frequency data) of harmonic components whose reflection source is the contrast agent (microbubbles, bubbles) from reflected wave data of a subject into which a contrast agent has been injected, and reflected wave data (fundamental wave data) of fundamental components whose reflection source is tissue in the subject, from reflected wave data of the harmonic component (received signal). The B-mode processing circuit 12 can also generate B-mode data for generating contrast image data from reflected wave data of the harmonic component (received signal), and can also generate B-mode data for generating fundamental image data from reflected wave data of the fundamental component (received signal).

In addition, in THI, by using the filter processing function of the B-mode processing circuit 12, harmonic data or sub-frequency data, which is reflected wave data (received signal) of harmonic components, can be separated from the reflected wave data of the subject.The B-mode processing circuit 12 can then generate B-mode data for generating tissue image data from which noise components have been removed, from the reflected wave data (received signal) of harmonic components.

Furthermore, when performing harmonic imaging of CHI or THI, the B-mode processing circuit 12 can extract harmonic components by a method other than the above-mentioned method using filter processing. In harmonic imaging, an imaging method called the AMPM method, which is a combination of the AM method and the PM method, is performed. In the AM method, the PM method, and the AMPM method, ultrasonic waves with different amplitudes and phases are transmitted multiple times for the same scanning line. As a result, the transmission/reception circuit 11 generates and outputs multiple reflected wave data (received signals) for each scanning line. Then, the B-mode processing circuit 12 extracts harmonic components by performing addition and subtraction processing on the multiple reflected wave data (received signals) for each scanning line according to the modulation method. Then, the B-mode processing circuit 12 performs envelope detection processing or the like on the reflected wave data (received signals) of the harmonic components to generate B-mode data.

For example, when the PM method is used, the transmission/reception circuitry 11 transmits ultrasound waves of the same amplitude with inverted phase polarity, for example (-1, 1), twice on each scan line according to the scan sequence set by the processing circuitry 17. The transmission/reception circuitry 11 then generates a reception signal resulting from the transmission of "-1" and a reception signal resulting from the transmission of "1", and the B-mode processing circuitry 12 adds these two reception signals. This removes the fundamental wave component, generating a signal in which the second harmonic component remains primarily. The B-mode processing circuitry 12 then performs envelope detection processing and the like on this signal to generate B-mode data for THI and B-mode data for CHI.

Alternatively, for example, in THI, a method of imaging using the second harmonic component and the difference frequency component contained in the received signal has been put to practical use. In the imaging method using the difference frequency component, for example, a transmitted ultrasonic wave having a composite waveform obtained by combining a first fundamental wave having a center frequency of "f1" and a second fundamental wave having a center frequency of "f2" greater than "f1" is transmitted from the ultrasonic probe 20. This composite waveform is a waveform obtained by combining the waveform of the first fundamental wave and the waveform of the second fundamental wave, the phases of which are adjusted so that a difference frequency component having the same polarity as the second harmonic component is generated. The transmission/reception circuit 11 transmits the transmitted ultrasonic wave having the composite waveform, for example, twice while inverting the phase. In such a case, for example, the B-mode processing circuit 12 adds two received signals to remove the fundamental wave component, extracts the harmonic components in which the difference frequency component and the second harmonic component mainly remain, and then performs envelope detection processing, etc.

Under the control of the processing circuit 17, the Doppler processing circuit 13 performs frequency analysis of the velocity information from the echo data from the receiving circuit, and generates data (two-dimensional or three-dimensional data) that extracts the movement information of the moving object, such as the average velocity, variance, and power, for multiple points. This data is generally called Doppler data. Here, the moving object is, for example, blood flow, tissue such as the heart wall, or a contrast agent. The Doppler processing circuit 13 is an example of a Doppler processing unit.

Under the control of the processing circuit 17, the image generation circuit 14 generates an ultrasound image expressed in a predetermined brightness range as image data based on the echo signal received by the ultrasound probe 20. For example, the image generation circuit 14 generates a B-mode image in which the intensity of the reflected wave is expressed as brightness from the two-dimensional B-mode data generated by the B-mode processing circuit 12 as an ultrasound image. The image generation circuit 14 also generates an average velocity image, variance image, power image, or a color Doppler image as a combination of these images, which represent the locomotion information, from the two-dimensional Doppler data generated by the Doppler processing circuit 13 as an ultrasound image. The image generation circuit 14 is an example of an image generation unit.

Here, the image generating circuit 14 generally converts (scan converts) the scan line signal sequence of the ultrasound scan into a scan line signal sequence of a video format, such as that of a television, to generate ultrasound image data for display. Specifically, the image generating circuit 14 generates ultrasound image data for display by performing coordinate conversion according to the ultrasound scanning form of the ultrasound probe 20. In addition to scan conversion, the image generating circuit 14 also performs various image processing, such as image processing (smoothing processing) that regenerates an average brightness image using multiple image frames after scan conversion, and image processing (edge enhancement processing) that uses a differential filter within the image. The image generating circuit 14 also combines text information of various parameters, scales, body marks, etc. with the ultrasound image data.

That is, the B-mode data and Doppler data are ultrasound image data before the scan conversion process, and the data generated by the image generation circuit 14 is ultrasound image data for display after the scan conversion process. Note that the B-mode data and Doppler data are also called raw data. The image generation circuit 14 generates two-dimensional ultrasound image data for display from the two-dimensional ultrasound image data before the scan conversion process.

The image memory 15 includes a two-dimensional memory that has multiple memory cells in two axial directions per frame, the memory having multiple frames of such memory. The two-dimensional memory as the image memory 15 stores an ultrasound image relating to one frame or multiple frames generated by the image generation circuitry 14 as two-dimensional image data under the control of the processing circuitry 17. The image memory 15 is an example of a storage unit.

Furthermore, the image generation circuitry 14 generates three-dimensional B-mode image data by performing coordinate transformation on the three-dimensional B-mode data generated by the B-mode processing circuitry 12. The image generation circuitry 14 also generates three-dimensional Doppler image data by performing coordinate transformation on the three-dimensional Doppler data generated by the Doppler processing circuitry 13. The image generation circuitry 14 generates "three-dimensional B-mode image data or three-dimensional Doppler image data" as "three-dimensional ultrasound image data (volume data)."

The image memory 15 may also include a three-dimensional memory, which is a memory having multiple memory cells in three axial directions (X-axis, Y-axis, and Z-axis directions). The three-dimensional memory as the image memory 15 stores the ultrasound image generated by the image generation circuitry 14 as volume data under the control of the processing circuitry 17.

Then, the image generation circuit 14 performs rendering processing on the volume data to generate various types of two-dimensional image data for displaying the volume data stored in the three-dimensional memory on the display 40. As the rendering processing, the image generation circuit 14 performs, for example, multi-planar reconstruction (MPR) to generate MPR image data from the volume data. As the rendering processing, the image generation circuit 14 also performs, for example, volume rendering (VR) processing to generate two-dimensional image data reflecting three-dimensional information.

The network interface 16 implements various information communication protocols according to the type of network. The network interface 16 connects the ultrasound diagnostic device 10 to other devices such as an external medical image management device 60 and a medical image processing device 70 according to these various protocols. This connection can be an electrical connection via an electronic network. Here, the electronic network refers to a general information communication network that uses electrical communication technology, and includes not only wireless/wired hospital-based LANs (Local Area Networks) and Internet networks, but also telephone communication line networks, optical fiber communication networks, cable communication networks, and satellite communication networks.

The network interface 16 may also implement various protocols for non-contact wireless communication. In this case, the ultrasound diagnostic device 10 can transmit and receive data directly to, for example, the ultrasound probe 20 without going through a network. The network interface 16 is an example of a network connection unit.

The processing circuit 17 refers to a dedicated or general-purpose central processing unit (CPU), micro processor unit (MPU), or graphics processing unit (GPU), as well as an ASIC and a programmable logic device. Examples of programmable logic devices include a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA).

The processing circuit 17 may be formed by a single circuit, or may be formed by a combination of multiple independent circuit elements. In the latter case, the main memory 18 may be provided separately for each circuit element, or a single main memory 18 may store programs corresponding to the functions of multiple circuit elements. The processing circuit 17 is an example of a processing unit.

The main memory 18 is composed of semiconductor memory elements such as RAM (random access memory) and flash memory, a hard disk, an optical disk, etc. The main memory 18 may be composed of a portable medium such as a universal serial bus (USB) memory and a digital video disk (DVD). The main memory 18 stores various processing programs (including application programs and an operating system (OS)) used in the processing circuit 17 and data required for executing the programs. The OS can also include a graphical user interface (GUI) that makes extensive use of graphics to display information to the operator on the display 40 and allows basic operations to be performed by the input interface 30. The main memory 18 is an example of a storage unit.

The ultrasound probe 20 has multiple tiny transducers (piezoelectric elements) on the front surface, and transmits and receives ultrasound waves to and from the area including the object to be scanned, for example, the area including the tubular body. Each transducer is an electroacoustic conversion element, and has the function of converting an electrical pulse into an ultrasonic pulse during transmission, and converting a reflected wave into an electrical signal (received signal) during reception. The ultrasound probe 20 is small and lightweight, and is connected to the ultrasound diagnostic device 10 via a cable (or wireless communication).

The ultrasonic probe 20 is divided into types such as linear type, convex type, and sector type depending on the scanning method. In addition, the ultrasonic probe 20 is divided into types such as 1D array probes in which multiple transducers are arranged one-dimensionally (1D) in the azimuth direction and 2D array probes in which multiple transducers are arranged two-dimensionally (2D) in both the azimuth direction and the elevation direction depending on the array arrangement dimension. The 1D array probe includes a probe in which a small number of transducers are arranged in the elevation direction.

When a 3D scan, i.e., a volume scan, is performed, a 2D array probe equipped with a scanning method such as a linear type, a convex type, or a sector type is used as the ultrasound probe 20. Alternatively, when a volume scan is performed, a 1D probe equipped with a scanning method such as a linear type, a convex type, or a sector type and equipped with a mechanism for mechanically oscillating in the elevation direction is used as the ultrasound probe 20. The latter probe is also called a mechanical 4D probe.

The input interface 30 includes an input device that can be operated by an operator, and an input circuit that inputs signals from the input device. The input device can be a trackball, a switch, a mouse, a keyboard, a touchpad that performs input operations by touching the operation surface, a touchscreen that combines a display screen and a touchpad, a non-contact input device that uses an optical sensor, and a voice input device. When the operator operates the input device, the input circuit generates a signal corresponding to the operation and outputs it to the processing circuit 17. The input interface 30 is an example of an input unit.

The input interface 30 also includes a linkage mode switching button, which will be described later, and an image capture button. The switching button and image capture button may be hardware buttons, or may be software buttons realized by a GUI. In the latter case, the switching buttons are provided on the screen as a switching button B1 (shown in FIG. 7) for switching to the first linkage mode, a switching button B2 (shown in FIG. 7) for switching to the second linkage mode, and a switching button B3 (shown in FIG. 7) for switching to the third linkage mode. The image capture button is provided as the symbol "C" in FIG. 7.

The display 40 is configured with a general display output device such as a liquid crystal display or an OLED (Organic Light Emitting Diode) display. The display 40 displays various information according to the control of the processing circuit 17. The display 40 is an example of a display unit.

FIG. 1 also shows a medical image management device 60 and a medical image processing device 70, which are external devices of the ultrasound diagnostic device 10. The medical image management device 60 is, for example, a DICOM (Digital Imaging and Communications in Medicine) server, and is connected to devices such as the ultrasound diagnostic device 10 so as to be able to transmit and receive data via a network N. The medical image management device 60 manages medical images such as ultrasound images generated by the ultrasound diagnostic device 10 as DICOM files.

The medical image processing device 70 is connected to devices such as the ultrasound diagnostic device 10 and the medical image management device 60 via the network N so as to be able to transmit and receive data. Examples of the medical image processing device 70 include a workstation that performs various image processing on the ultrasound images generated by the ultrasound diagnostic device 10, and a portable information processing terminal such as a tablet terminal. Note that the medical image processing device 70 may be an offline device that can read out the ultrasound images generated by the ultrasound diagnostic device 10 via a portable storage medium.

Next, the functions of the ultrasound diagnostic device 10 will be explained.

Figure 2 is a block diagram showing the functions of the ultrasound diagnostic device 10.

The processing circuitry 17 realizes an image collection function 171, a display control function 172, a reception function 173, a specification function 174, and a setting function 175 by reading and executing a program stored in the main memory 18 or directly embedded in the processing circuitry 17. Below, an example will be described in which the functions 171 to 175 function as software, but all or part of the functions 171 to 175 may be provided in the ultrasound diagnostic device 10 as a circuit such as an ASIC.

The image collection function 171 includes a function of controlling the transmission/reception circuit 11, the B-mode processing circuit 12, the Doppler processing circuit 13, the image generation circuit 14, etc., to execute a scan using the ultrasound probe 20 and collect ultrasound image data. Specifically, the image collection function 171 collects M-mode image data, B-mode image data, Doppler image data, etc., as ultrasound image data. The image collection function 171 is an example of an image collection unit.

The display control function 172 includes a function for displaying multiple ultrasound image data generated by the image generation circuit 14 according to the control of the image collection function 171 as multiple ultrasound images on the same screen of the display 40. For example, the display control function 172 displays multiple ultrasound images in parallel on the same screen of the display 40. The display control function 172 is an example of a display control unit.

The reception function 173 includes a function for receiving, from the input interface 30, an operation for changing the display mode of an ultrasound image (hereinafter referred to as the "ultrasound image to be operated"), which is one of multiple ultrasound images displayed on the same screen under the control of the display control function 172. The operation for changing the display mode is at least one of a movement (Pan) operation, a zoom-in or zoom-out operation, and a gain (brightness, brightness) adjustment operation. The reception function 173 is an example of a reception unit.

The identification function 174 includes a function for identifying one or more ultrasound images (hereinafter referred to as "linked ultrasound images") whose image type corresponds to the image type of the ultrasound image to be operated, from among the other ultrasound images among the multiple ultrasound images displayed on the same screen under the control of the display control function 172. The identification of the linked ultrasound images by the identification function 174 may be performed after the change operation by the reception function 173, but may also be performed in advance at the time of setting the display screen. The identification function 174 is an example of an identification unit.

The image type includes at least one of the view type, phase type, examination mode type, scan type, and layout type. The view type as the image type means, for example, the difference between a short-axis base level view and a four-chamber section view. When the image type is the view type, an ultrasound image related to the short-axis base level view and an ultrasound image related to the four-chamber section view are set in advance as corresponding image types. The identification function 174 identifies an ultrasound image related to the same short-axis base level view and an ultrasound image related to the four-chamber section view as linked ultrasound images corresponding to the ultrasound image of the operation target related to the short-axis base level view.

The type of phase as an image type means, for example, the difference between pre-stress and post-stress. When the image type is the type of pre-stress and post-stress phase, the ultrasound image related to pre-stress and the ultrasound image related to post-stress are set in advance as corresponding image types. The identification function 174 identifies the same pre-stress ultrasound image and post-stress ultrasound image as linked ultrasound images corresponding to the pre-stress ultrasound image of the operation target.

Furthermore, the type of phase as an image type means, for example, the difference between preoperative and postoperative (surgery may be performed multiple times). When the image type is the type of preoperative and postoperative phase, the preoperative ultrasound image and the postoperative ultrasound image are set in advance as corresponding image types. The identification function 174 identifies the same preoperative ultrasound image and postoperative ultrasound image as linked ultrasound images corresponding to the preoperative ultrasound image of the operation target.

The type of examination mode as the image type means, for example, differences between B mode, Doppler mode, M mode, etc. When the image type is the type of examination mode, it is set in advance that the image type does not correspond to a B mode image, a Doppler mode image, or an M mode image. The identification function 174 identifies only the same B mode image as a linked ultrasound image corresponding to the B mode image to be operated.

Furthermore, the type of scan as the image type means, for example, the difference between 2D scan, 3D scan, and 4D scan. When the image type is the type of scan, it is set in advance that the 2D scan, 3D scan, and 4D scan are image types that do not correspond. The identification function 174 identifies only ultrasound images related to the same 2D scan as linked ultrasound images corresponding to the ultrasound image of the operation target related to the 2D scan.

The type of layout as an image type means, for example, the difference between a single-stage display and a multi-stage display (split display). When the image type is a layout type, it is set in advance as an image type that does not correspond to a single-stage display and a multi-stage display. The identification function 174 identifies only ultrasound images related to the same single-stage display as linked ultrasound images corresponding to the ultrasound image of the operation target related to the single-stage display.

The image type determination may be performed by automatic recognition of the ultrasound image data, or may be performed based on information attached to the DICOM data including the ultrasound image data. Examples of information attached to the DICOM data include private information such as information indicating the view and the examination mode, information indicating the layout, and information indicating display instructions. Information indicating the layout includes information on the divided display of screen elements that display each ultrasound image on the display screen.

As an alternative to when the image type is the type of view, the image type may be the type of position information consisting of the position and orientation of the cross section. When the image type is the type of position information, a sensor (not shown) capable of detecting the position and orientation of the ultrasound probe 20 is provided. This allows the identification function 174 to identify the scan cross section, i.e., the position information of the ultrasound image. The identification function 174 identifies an image whose position information is approximately the same as the position information of the ultrasound image to be operated as a linked ultrasound image. Here, approximately the same means that the position information is recognized as being the same within a preset range of difference in position information.

The specification function 174 may set priorities when multiple of the above image types are combined in any way. For example, when the specification function 174 sets the priority of the examination mode or display layout as an image type high, it determines that the image types correspond if the examination mode or display layout is the same. Also, for example, when the specification function 174 sets the priority of the examination mode as an image type high, it determines that the image types correspond if the same B-mode images are used, even if the views, etc. are not the same.

The display control function 172 includes a function for changing the display mode of the ultrasound image to be operated and the linked ultrasound image among multiple ultrasound images displayed on the same screen in accordance with a display mode change operation by the reception function 173.

The setting function 175 includes a function for setting one of the first linkage mode, the second linkage mode, and the third linkage mode in response to an instruction from the input interface 30. The first linkage mode is a mode in which the display mode of only the ultrasound image to be operated is changed in accordance with a change operation of the display mode by the reception function 173. The second linkage mode is a mode in which the display mode of all of the multiple ultrasound images is changed in accordance with a change operation of the display mode by the reception function 173 under the control of the display control function 172. The third linkage mode is a mode in which the display mode of the ultrasound image to be operated and the linked ultrasound image is changed in accordance with a change operation of the display mode by the reception function 173 (illustrated in FIG. 4(C) and the like). The setting function 175 is an example of a setting unit. When the third linkage mode is set, the identification function 174 identifies the linked ultrasound image as described above.

Details of functions 171 to 175 are explained using Figures 3 to 7.

Next, the operation of the ultrasound diagnostic device 10 will be described.

Figure 3 is a diagram showing the operation of the ultrasound diagnostic device 10 as a flowchart. In Figure 3, the symbols "ST" followed by numbers indicate each step of the flowchart.

The image collection function 171 controls the transmission/reception circuit 11, the B-mode processing circuit 12, the Doppler processing circuit 13, the image generation circuit 14, etc. to perform an ultrasound scan using the ultrasound probe 20, collect multiple ultrasound image data, and store them in the image memory 15 (step ST1). The display control function 172 reads out the multiple ultrasound image data stored in the image memory 15 in step ST1, and displays them as multiple ultrasound images on the same screen of the display 40 (step ST2).

Figure 4 shows a first example of displaying multiple ultrasound images on the same screen.

Figure 4(A) shows four ultrasound images displayed on the same screen by step ST2. The four ultrasound images are B-mode images generated by stress echo. The upper left of Figure 4(A) shows an ultrasound image representing a short axis view at the cardiac base level in the "Rest" phase, and the upper right shows an ultrasound image representing a short axis view at the cardiac base level in the "Post" phase. The lower left of Figure 4(A) shows an ultrasound image representing a four-chamber cross-section view in the "Rest" phase, and the lower right shows an ultrasound image representing a four-chamber cross-section view in the "Post" phase.

Each ultrasound image may be displayed as a still image or as a moving image. When each ultrasound image is displayed as a moving image, the images may be displayed in synchronization with the cardiac phase.

Returning to the explanation of FIG. 3, the reception function 173 receives, from the input interface 30, an operation to change the display mode of the target ultrasound image among the multiple ultrasound images displayed on the same screen in step ST2, for example, an enlargement operation (step ST3). For example, in FIG. 2, the reception function 173 receives an enlargement operation for the target ultrasound image at the top left among the four ultrasound images on the same screen.

The specific function 174 judges whether or not there are one or more linked ultrasound images whose image type corresponds to the image type of the ultrasound image to be operated among the other ultrasound images among the multiple ultrasound images displayed on the same screen by step ST2 (step ST4). For example, in FIG. 2, the specific function 174 judges whether or not there are linked ultrasound images among the other three ultrasound images, excluding the ultrasound image to be operated at the top left, among the four ultrasound images on the same screen. Note that the judgment of linked ultrasound images by step ST4 may be performed after the change operation by step ST3, but may also be performed in advance at the time of setting the display screen (for example, setting the display layout of four images shown in FIG. 4).

If the determination in step ST4 is YES, i.e., if it is determined that there is a linked ultrasound image among the multiple ultrasound images displayed on the same screen, the display control function 172 changes the display mode of the ultrasound image to be operated and the linked ultrasound image among the multiple ultrasound images displayed on the same screen in step ST2 in accordance with the display mode change operation in step ST3 (step ST5).

Figures 4 (B) and (C) show display examples when the display mode of the target ultrasound image and the linked ultrasound image among the four ultrasound images shown in Figure 4 (A) is changed according to an enlargement operation. The identification function 174 identifies an image corresponding to the target ultrasound image as the linked ultrasound image. For example, the identification function 174 identifies an image whose phase or view corresponds to the target ultrasound image as the linked ultrasound image (shown in Figure 4 (B)), or identifies an image whose view corresponds to the target ultrasound image as the linked ultrasound image (shown in Figure 4 (C)).

Figure 4 (B) shows a display example in which the upper right ultrasound image, the lower left ultrasound image, and the lower right ultrasound image on the same screen are all identified as linked ultrasound images. As shown in Figure 4 (B), the display control function 172 enlarges the display mode of the ultrasound image to be operated and the three linked ultrasound images whose phases or views correspond to the ultrasound image to be operated, among the four ultrasound images displayed on the same screen, in accordance with the change operation.

Fig. 4(C) shows a display example in which only the ultrasound image in the upper right corner on the same screen is identified as the linked ultrasound image. As shown in Fig. 4(C), the display control function 172 enlarges the display mode of the ultrasound image to be operated and one linked ultrasound image whose view corresponds to the ultrasound image to be operated, among four ultrasound images displayed on the same screen, in accordance with the change operation.

Returning to the explanation of FIG. 3, if the determination in step ST4 is NO, that is, if it is determined that there is no linked ultrasound image among the multiple ultrasound images displayed on the same screen, the display control function 172 changes the display mode of only the ultrasound image that is the target of the operation among the multiple ultrasound images displayed on the same screen in step ST2 in accordance with the display mode change operation in step ST3 (step ST6).

The display control function 172 determines whether or not to end the display of the multiple ultrasound images started in step ST2 (step ST7). If the determination in step ST7 is NO, that is, if it is determined that the display of the multiple ultrasound images is not to be ended, the operation returns to step ST3.

On the other hand, if the determination in step ST7 is YES, i.e., if it is determined that the display of multiple ultrasound images is to be terminated, the ultrasound diagnostic device 10 terminates the display of multiple ultrasound images and terminates operation.

Note that while Figure 4 has been used to explain the case where four ultrasound images are displayed on the same screen, it goes without saying that this is not limited to this case.

Figure 5 is a diagram showing a second display example of multiple ultrasound images on the same screen. Figure 5 (A) shows two ultrasound images displayed on the same screen in step ST2. The two ultrasound images are B-mode images generated by the stress echo method. The left side of Figure 5 (A) shows an ultrasound image in the "Rest" phase, and the right side of the same shows an ultrasound image in the "Post" phase.

Each ultrasound image may be displayed as a still image or as a moving image. When each ultrasound image is displayed as a moving image, the images may be displayed in synchronization with the cardiac phase.

Figures 5 (B) and (C) show display examples when the display modes of the target ultrasound image and the linked ultrasound image of the two ultrasound images shown in Figure 5 (A) are changed according to an enlargement operation. The identification function 174 identifies an image corresponding to the target ultrasound image as the linked ultrasound image. For example, the identification function 174 identifies an image whose phase or examination mode corresponds to the target ultrasound image as the linked ultrasound image (shown in Figure 5 (B)), or identifies an image whose phase corresponds to the target ultrasound image as the linked ultrasound image (shown in Figure 5 (C)).

Figure 5 (B) shows a display example when the ultrasound image on the right side on the same screen is identified as the linked ultrasound image. As shown in Figure 5 (B), the display control function 172 enlarges the display mode of the ultrasound image to be operated and one linked ultrasound image whose phase or examination mode corresponds to the ultrasound image to be operated, among two ultrasound images displayed on the same screen, in accordance with the change operation.

Figure 5 (C) shows a display example when the ultrasound image on the right side on the same screen is not identified as a linked ultrasound image. As shown in Figure 5 (C), the display control function 172 enlarges the display mode of only the ultrasound image that is the target of the operation among the two ultrasound images displayed on the same screen in accordance with the change operation.

Figure 6 shows a third example of displaying multiple ultrasound images on the same screen.

Figure 6 shows two ultrasound images displayed on the same screen by step ST2. The two ultrasound images are a B-mode image (top) and a Doppler image (bottom) generated by the stress echo method. The top left of Figure 6 shows a B-mode image in the "Rest" phase, and the top right shows a B-mode image in the "Post" phase. The bottom left of Figure 6 shows a Doppler image in the "Rest" phase, and the bottom right shows a Doppler image in the "Post" phase.

As shown in FIG. 6, the display control function 172 enlarges the display mode of the B-mode image of the operation target and one linked B-mode image whose examination mode corresponds to the operation target among four ultrasound images displayed on the same screen in accordance with the change operation.

Each ultrasound image may be displayed as a still image or as a moving image. When each ultrasound image is displayed as a moving image, the images may be displayed in synchronization with the cardiac phase.

According to the ultrasound diagnostic device 10, when multiple ultrasound images are displayed on the same screen, when an operation to change the display mode of a certain ultrasound image (e.g., an operation to enlarge) is performed, in addition to the ultrasound image, only ultrasound images whose image type corresponds to the ultrasound image can be enlarged in a linked manner. In other words, among multiple ultrasound images displayed on the same screen, only the display mode of the corresponding ultrasound images is changed in a synchronized manner.

2. First Modification Here, a description will be given of the operation of the setting function 715. The setting function 715 is characterized in that it sets the interlocking mode in accordance with the operator's selection.

Figure 7 shows a display screen showing an example of how to set the linked mode.

Figure 7 shows linkage mode switching buttons B1 to B3 realized by the GUI, which are provided on the display screen of the display 40. Switching button B1 corresponds to a first linkage mode in which the display mode of only the ultrasound image being operated is changed in accordance with a display mode change operation. Switching button B2 corresponds to a second change mode in which the display mode of all of the multiple ultrasound images is changed in accordance with a display mode change operation. Switching button B3 corresponds to a third linkage mode in which the display mode of the ultrasound image being operated and the linked ultrasound image is changed in accordance with a display mode change operation.

When the operator clicks one of the switching buttons B1 to B3 via the input interface 30, the setting function 715 switches to the corresponding interlocking mode. When the third interlocking mode is set, the identification function 174 identifies the interlocking ultrasound image as described above.

Thus, according to the first modified example, in addition to the above-mentioned effects, the operator can arbitrarily switch the linkage mode while multiple ultrasound images are displayed on the same screen.

3. Second Modification Here, a description will be given of the additional operation of the reception function 713. The reception function 713 receives the selection of an ultrasound image to be additionally displayed when a plurality of ultrasound images are displayed on the same screen.

The reception function 713 may include a function for registering the contents of the operation for changing the display mode of the ultrasound image to be operated as a change history in the main memory 18. In other words, the contents of the operation for changing the display mode are accumulated in the main memory 18. In this case, the display control function 172 includes a function for initially displaying an ultrasound image that is not currently displayed on the same screen (hereinafter, referred to as a "hidden ultrasound image") by reflecting the change history acquired from the main memory 18 in the hidden ultrasound image when there is a display request for the ultrasound image that is not currently displayed on the same screen (hereinafter, referred to as a "hidden ultrasound image").

For example, when the operator uses the input interface 73 to click an image acquisition button C (shown in FIG. 7) realized by a GUI provided on the display screen of the display 40, the display control function 172 displays thumbnails D (shown in FIG. 7) that correspond to the multiple ultrasound images being displayed, for example, thumbnails D including non-displayed ultrasound images relating to the same patient and/or the same examination. When the operator uses the input interface 73 to select a desired image from thumbnails D including one or more non-displayed ultrasound images (for example, by dragging and dropping), the reception function 713 receives a display request for the selected ultrasound image.

When a display request for a non-displayed ultrasound image is made, the identification function 174 judges whether the non-displayed ultrasound image is a linked ultrasound image. When the display control function 172 judges that the non-displayed ultrasound image is a linked ultrasound image, the display control function 172 reflects the contents of the change history acquired from the main memory 18 in the non-displayed ultrasound image, thereby initially displaying the non-displayed ultrasound image. Note that, when there are multiple past change operations, the display control function 172 only needs to reflect the change operation on the ultrasound image with the corresponding image type in the non-displayed ultrasound image. In that case, it is preferable that the reception function 713 registers in the main memory 18, as a change history, the contents of the change operation of the display mode of the ultrasound image to be operated being associated with the image type.

In this way, according to the second modified example, in addition to the above-mentioned effects, while multiple ultrasound images are being displayed on the same screen, it is possible to initially display an ultrasound image that reflects past movement operations.

4. Medical Image Processing Apparatus Fig. 8 is a schematic diagram showing the configuration of a medical image processing apparatus according to an embodiment.

Figure 8 shows a medical image processing device 70 according to an embodiment. The medical image processing device 70 is a medical image management device (image server), a workstation, an image interpretation terminal, etc., and is provided on a medical image system connected via a network. Note that the medical image processing device 70 may also be an offline device.

The medical image processing device 70 includes a processing circuit 71, a memory 72, an input interface 73, a display 74, and a network interface 75. The processing circuit 71, the memory 72, the input interface 73, and the display 74 have the same configuration as the processing circuit 17, the main memory 18, the input interface 30, and the display 40 shown in Figures 1 and 2, so their explanations are omitted.

The network interface 75 is composed of connectors conforming to parallel connection specifications or serial connection specifications. When the medical image processing device 70 is provided on a medical image system, the network interface transmits and receives information to and from external devices on the network. For example, under the control of the processing circuitry 71, the network interface receives medical image data such as ultrasound image data, CT (Computed Tomography) image data, and MR (Magnetic Resonance) image data from external devices.

Next, we will explain the functions of the medical image processing device 70.

Figure 9 is a block diagram showing the functions of the medical image processing device 70.

The processing circuitry 71 executes the programs stored in the memory 72 to realize an image acquisition function 711, a display control function 712, a reception function 713, a specification function 714, and a setting function 715. Below, an example will be described in which the functions 711 to 715 function as software, but all or part of the functions 711 to 715 may be provided in the medical image processing device 70 as a circuit such as an ASIC. In addition, all or part of the functions 711 to 715 may be provided in another device such as the medical image management device 60.

The image acquisition function 711 includes a function to acquire multiple medical image data from the medical image management device 60 or the ultrasound diagnostic device 10 via the network interface 75. For example, the image acquisition function 711 includes a function to acquire multiple ultrasound image data related to the same patient, multiple CT image data related to the same patient, or multiple MR image data related to the same patient as multiple medical image data. Furthermore, for example, the image acquisition function 711 can also acquire multiple medical image data related to the same patient that combines ultrasound image data, CT image data, and MR image data. The image acquisition function 711 is an example of an image acquisition unit.

The display control function 712 includes a function equivalent to the display control function 172 shown in FIG. 2. The display control function 712 includes a function for displaying multiple medical image data acquired by the image acquisition function 711 as multiple medical images on the same screen of the display 40. The display control function 712 is an example of a display control unit.

The reception function 713 includes a function equivalent to the reception function 173 shown in FIG. 2. It includes a function of receiving, from the input interface 73, an operation to change the display mode of a medical image (hereinafter, referred to as the "medical image to be operated") that is one of multiple medical images displayed on the same screen under the control of the display control function 712. The reception function 713 is an example of a reception unit.

The identification function 714 includes a function equivalent to the identification function 174 shown in FIG. 2. The identification function 714 includes a function to identify one or more medical images (hereinafter referred to as "linked medical images") whose image type corresponds to the image type of the medical image to be operated, among other medical images among multiple medical images displayed on the same screen under the control of the display control function 712. The identification of the linked medical images by the identification function 714 may be performed after a change operation by the reception function 713, but may also be performed in advance at the time of setting the display screen. The identification function 714 is an example of an identification unit.

The display control function 712 includes a function for changing the display mode of the medical image to be operated and the linked medical image among multiple medical images displayed on the same screen in accordance with a display mode change operation by the reception function 713.

The setting function 715 includes a function equivalent to the setting function 175 shown in FIG. 2. The setting function 715 includes a function to set one of the first linkage mode, the second linkage mode, and the third linkage mode in response to an instruction from the input interface 73. The setting function 715 is an example of a setting unit.

Note that the main operation of the medical image processing device 70 is the same as that of the ultrasound diagnostic device 10 shown in Figure 3, so a description of it will be omitted.

According to the medical image processing device 70, when multiple medical images are displayed on the same screen, when an operation to change the display mode of a certain medical image (for example, an operation to enlarge) is performed, in addition to the medical image, only medical images whose image type corresponds to the medical image can be enlarged in conjunction with the medical image. In other words, among multiple medical images displayed on the same screen, only the display mode of corresponding medical images is changed in a synchronized manner.

According to at least one of the embodiments described above, a change in the display mode made to one medical image among multiple medical images displayed on the same screen can be effectively reflected in the other medical images.

Note that the image collection function 171 is an example of an image collection unit. The display control functions 172 and 712 are an example of a display control unit. The reception functions 173 and 713 are an example of a reception unit. The identification functions 174 and 714 are an example of a identification unit. The setting functions 175 and 715 are an example of a setting unit. The image acquisition function 711 is an example of an image acquisition unit.

Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents as set forth in the claims.

10 Ultrasound diagnostic device 17 Processing circuit 40 Display 70 Medical image processing device 71 Processing circuit 74 Display 171 Image acquisition function 172, 712 Display control function 173, 713 Reception function 174, 714 Specific function 175, 715 Setting function 711 Image acquisition function

Claims (8)

An ultrasound diagnostic device capable of displaying a plurality of ultrasound images including an ultrasound image group corresponding to an image type including at least one of an examination mode type and a scan type in parallel on a single screen of a display unit,
a display control unit that, when a display mode of any one of the ultrasound images included in the plurality of ultrasound images displayed in parallel is changed in accordance with a user's operation, changes the display mode of the ultrasound images among the ultrasound images whose display mode has not been changed in response to the operation, while not changing the display mode of the ultrasound images included in the plurality of ultrasound images whose image type does not correspond;
An ultrasound diagnostic device having: The change in the display mode is at least one of movement, enlargement or reduction, and gain adjustment.
The ultrasonic diagnostic apparatus according to claim 1 . the image type includes at least one of the inspection mode type and the scan type, as well as at least one of a view type, a phase type, and a layout type;
3. The ultrasonic diagnostic apparatus according to claim 1. a setting unit that sets one of a first mode in which a display mode of only the one ultrasonic image among the plurality of ultrasonic images is changed according to a change operation of the display mode, a second mode in which a display mode of all of the plurality of ultrasonic images is changed according to the change operation of the display mode, and a third mode in which a display mode of the one ultrasonic image and an ultrasonic image corresponding to an image type of the one ultrasonic image is changed according to the change operation of the display mode, according to an instruction from an input unit that can be operated by an operator;
an identification unit that identifies an ultrasound image corresponding to an image type of the one ultrasound image when the third mode is set;
The ultrasonic diagnostic apparatus according to claim 1 , further comprising: a reception unit that registers the content of a change operation of a display mode of the one ultrasonic image in a storage unit as a change history,
the display control unit, when receiving a display request for an ultrasound image that is not being displayed, causes the ultrasound image that is not being displayed to be initially displayed by reflecting the content of the change history acquired from the storage unit on the ultrasound image that is not being displayed.
The ultrasonic diagnostic apparatus according to claim 1 . The reception unit registers, in the storage unit, the change history in which the image type is associated with the content of the change operation of the display mode of the one ultrasound image.
The ultrasonic diagnostic apparatus according to claim 5 . A medical image processing apparatus capable of displaying a plurality of medical images including a medical image group corresponding to an image type including at least one of an examination mode type and a scan type in parallel on a single screen of a display unit,
a display control unit that, when a display mode of any one of the medical images included in the plurality of medical images displayed in parallel is changed in accordance with a user's operation, changes the display mode of the medical images among the medical images whose display mode has not been changed in response to the operation, while not changing the display mode of the medical images included in the plurality of medical images whose image type does not correspond;
A medical image processing device having the following: On the computer,
A function of displaying a plurality of ultrasound images including an ultrasound image group corresponding to an image type including at least one of an examination mode type and a scan type in parallel on the same screen of a display unit;
a function of, when a display mode of any one of the ultrasound images included in the plurality of ultrasound images displayed in parallel is changed in accordance with a user's operation, changing the display mode of the ultrasound images in the ultrasound image group whose display mode has not been changed in response to the operation, while not changing the display mode of the ultrasound images included in the plurality of ultrasound images whose image type does not correspond;
An ultrasound image display program that makes this possible.

Images