JP2020175186A - Ultrasonic diagnostic device and program - Google Patents

Abstract

To provide an ultrasonic diagnostic device and program which can display a reference image corresponding to an image type of a live image.SOLUTION: An ultrasonic diagnostic device according to an embodiment includes a first display unit, an image type recognition unit, an extraction unit, and a second display unit. The first display unit displays an image expressed by data output from an ultrasonic probe as a live image. The image type recognition unit recognizes the image type of the live image. The extraction unit extracts data having at least a partial image type common to the image type recognized in the image type recognition unit from the past data collected before the live image. The second display unit displays the image expressed by the data extracted by the extraction unit on the same screen as the live image.SELECTED DRAWING: Figure 5

Description

Embodiments of the present invention relate to ultrasonic diagnostic equipment and programs.

Conventionally, in an ultrasonic diagnostic apparatus, for example, during follow-up after stress echo loading or after treatment such as subpuncture ablation, while referring to an ultrasonic image (reference image) obtained before the state changes. , A newly obtained ultrasonic image (live image) is displayed.

For example, conventionally, a technique for matching the brightness of a reference image and a live image has been proposed. Further, a technique has been proposed in which a live image is set to the same shooting position as the reference image by setting a shooting position of the live image based on display information such as ROI and a marker set for the reference image.

Japanese Patent No. 4807824 Japanese Patent No. 5095186

However, in the above-mentioned conventional technique, the brightness and shooting position of the reference image and the live image can be matched, but the identity of the image type such as the type of the image itself and the type of the layout in which the image is displayed can be matched. It has not been considered and there is room for further improvement in terms of convenience.

An object to be solved by the present invention is to provide an ultrasonic diagnostic apparatus and a program capable of displaying a reference image corresponding to an image type of a live image.

The ultrasonic diagnostic apparatus according to the embodiment includes a first display unit, an image type recognition unit, an extraction unit, and a second display unit. The first display unit displays an image represented by the data output from the ultrasonic probe as a live image. The image type recognition unit recognizes the image type of the live image. The extraction unit extracts data that is common to at least a part of the image types recognized by the image type recognition unit from the past data collected before the live image. The second display unit displays the image represented by the data extracted by the extraction unit on the same screen as the live image.

FIG. 1 is a diagram showing a configuration example of an ultrasonic diagnostic system according to an embodiment. FIG. 2 is a block diagram showing a configuration example of the ultrasonic diagnostic apparatus according to the embodiment. FIG. 3 is a diagram showing an example of a live image displayed by the first display function of the embodiment. FIG. 4 is a diagram showing an example of a live image displayed by the first display function of the embodiment. FIG. 5 is a diagram showing an example of a reference image displayed by the second display function of the embodiment. FIG. 6 is a diagram showing an example of a reference image displayed by the second display function of the embodiment. FIG. 7 is a diagram showing an example of a reference image displayed by the second display function of the embodiment. FIG. 8 is a flowchart showing an example of the first operation executed by the ultrasonic diagnostic apparatus of the embodiment. FIG. 9 is a flowchart showing an example of a second operation executed by the ultrasonic diagnostic apparatus of the embodiment.

Hereinafter, embodiments of the ultrasonic diagnostic apparatus and the program will be described with reference to the drawings.

FIG. 1 is a diagram showing a configuration example of an ultrasonic diagnostic system according to the present embodiment. As shown in FIG. 1, the ultrasonic diagnostic system 1 includes an ultrasonic diagnostic apparatus 100 and an image storage apparatus 200. The ultrasonic diagnostic apparatus 100 and the image storage apparatus 200 are in a state where they can communicate with each other from a network NW such as an in-hospital LAN (Local Area Network) installed in a hospital, for example. For example, when a PACS (Picture Archiving and Communication System) is introduced in the ultrasonic diagnostic system 1, each device transmits and receives medical data and the like to and from each other in accordance with the DICOM (Digital Imaging and Communications in Medicine) standard.

The ultrasonic diagnostic apparatus 100 acquires data capable of representing an ultrasonic image of an arbitrary cross section by transmitting ultrasonic waves to the body using an ultrasonic probe. Then, the ultrasonic diagnostic apparatus 100 transmits the acquired data to the image storage apparatus 200.

The image storage device 200 is a database for storing medical data. The image storage device 200 stores the data transmitted from the ultrasonic diagnostic device 100 in the storage circuit. The storage circuit is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, a hard disk, or an optical disk.

Here, the data stored in the image storage device 200 may be RAW data described later, or may be an ultrasonic image generated from the RAW data. In addition, the data includes the subject ID, which is the ID (Identifier) of the subject, the test ID, which is the ID of the test performed on the subject, and the device ID, which is the ID of the device used at the time of the test. It is stored in association with incidental information including image types described later.

FIG. 2 is a block diagram showing a configuration example of the ultrasonic diagnostic apparatus 100. As shown in FIG. 2, the ultrasonic diagnostic apparatus 100 includes an ultrasonic probe 101, an input interface 102, a display 103, an electrocardiograph 104, and an apparatus main body 105. The ultrasonic probe 101, the input interface 102, the display 103, and the electrocardiograph 104 are communicably connected to the apparatus main body 105.

The ultrasonic probe 101 has a plurality of oscillators, and these plurality of oscillators generate ultrasonic waves based on a drive signal supplied from a transmission / reception circuit 110 included in the apparatus main body 105. Further, the ultrasonic probe 101 receives the reflected wave from the subject P and converts it into an electric signal. The ultrasonic probe 101 is detachably connected to the device main body 105.

When ultrasonic waves are transmitted from the ultrasonic probe 101 to the subject P, the transmitted ultrasonic waves are reflected one after another on the discontinuity surface of the acoustic impedance in the body tissue of the subject P, and the ultrasonic probe is used as a reflected wave signal. It is received by a plurality of transducers included in 101. The amplitude of the received reflected wave signal depends on the difference in acoustic impedance on the discontinuity where the ultrasonic waves are reflected. When the transmitted ultrasonic pulse is reflected on the moving blood flow or the surface of the heart wall, etc., the reflected wave signal depends on the velocity component with respect to the ultrasonic transmission direction of the moving body due to the Doppler effect. Receives frequency shift.

The form of the ultrasonic probe 101 is not particularly limited, and any form of the ultrasonic probe may be used. For example, the ultrasonic probe 101 may be a 1D array probe that scans the subject P in two dimensions. Further, the ultrasonic probe 101 may be a mechanical 4D probe or a 2D array probe that scans the subject P in three dimensions.

The input interface 102 receives various instructions and information input operations from the operator. Specifically, the input interface 102 converts the input operation received from the operator into an electric signal and outputs it to the processing circuit 170 of the apparatus main body 105. For example, the input interface 102 includes a trackball, a switch button, a mouse, a keyboard, a touch pad for performing an input operation by touching an operation surface, a touch screen in which a display screen and a touch pad are integrated, and a non-optical sensor. It is realized by a contact input circuit, a voice input circuit, and the like. The input interface 102 is not limited to the one provided with physical operating parts such as a mouse and a keyboard. For example, an example of the input interface 102 includes an electric signal processing circuit that receives an electric signal corresponding to an input operation from an external input device provided separately from the device and outputs the electric signal to a control circuit.

The display 103 displays various information and images. Specifically, the display 103 converts the information and image data sent from the processing circuit 170 into an electric signal for display and outputs the data. For example, the display 103 is realized by a liquid crystal monitor, a CRT (Cathode Ray Tube) monitor, a touch panel, or the like. The output device included in the ultrasonic diagnostic apparatus 100 is not limited to the display 103, and may include, for example, a speaker. For example, the speaker outputs a predetermined sound such as a beep sound in order to notify the operator of the processing status of the device main body 105.

The electrocardiogram 104 acquires an electrocardiogram (ECG) of the subject P as a biological signal of the subject P. The electrocardiograph 104 transmits the acquired electrocardiographic waveform to the apparatus main body 105.

The device main body 105 is a device that generates an ultrasonic image based on the reflected wave signal received by the ultrasonic probe 101. For example, the apparatus main body 105 generates a two-dimensional ultrasonic image based on the two-dimensional reflected wave data received by the ultrasonic probe 101. Further, the apparatus main body 105 generates a three-dimensional ultrasonic image based on the three-dimensional reflected wave data received by the ultrasonic probe 101.

As shown in FIG. 2, the apparatus main body 105 includes a transmission / reception circuit 110, a signal processing circuit 120, an image generation circuit 130, an image memory 140, a storage circuit 150, a network (NW) interface 160, and a processing circuit 170. The transmission / reception circuit 110, the signal processing circuit 120, the image generation circuit 130, the image memory 140, the storage circuit 150, the NW interface 160, and the processing circuit 170 are communicably connected to each other.

The transmission / reception circuit 110 includes a pulse generator, a transmission delay unit, a pulsar, and the like, and supplies a drive signal to the ultrasonic probe 101. The pulse generator repeatedly generates rate pulses for forming transmitted ultrasonic waves at a predetermined rate frequency. In addition, the transmission delay unit focuses the ultrasonic waves generated from the ultrasonic probe 101 in a beam shape, and the pulse generator generates the delay time for each oscillator required to determine the transmission directivity. Give to rate pulse. Further, the pulsar applies a drive signal (drive pulse) to the ultrasonic probe 101 at a timing based on the rate pulse. That is, the transmission delay unit arbitrarily adjusts the transmission direction of the ultrasonic waves transmitted from the vibrator surface by changing the delay time given to each rate pulse.

Further, the transmission / reception circuit 110 includes a preamplifier, an A / D (Analog / Digital) converter, a reception delay unit, an adder, etc., and performs various processing on the reflected wave signal received by the ultrasonic probe 101 to reflect the signal. Generate wave data. The preamplifier amplifies the reflected wave signal for each channel. The A / D converter A / D converts the amplified reflected wave signal. The reception delay unit provides the delay time required to determine the reception directivity. The adder generates reflected wave data by performing addition processing of the reflected wave signal processed by the reception delay unit. The addition process of the adder emphasizes the reflected component from the direction corresponding to the reception directivity of the reflected wave signal, and the reception directivity and the transmission directivity form a comprehensive beam for ultrasonic transmission and reception.

Here, the form of the output signal from the transmission / reception circuit 110 may be various forms such as a signal including phase information called an RF (Radio Frequency) signal and an amplitude information after envelope detection processing. It is selectable.

The signal processing circuit 120 receives reflected wave data from the transmission / reception circuit 110, performs logarithmic amplification, envelope detection processing, and the like to generate data (B mode data) in which the signal strength is expressed by the brightness of the brightness. Further, the signal processing circuit 120 frequency-analyzes velocity information from the reflected wave data received from the transmission / reception circuit 110, extracts blood flow, tissue, and contrast agent echo components due to the Doppler effect, and moves objects such as velocity, dispersion, and power. Generate data (Doppler data) that extracts information from multiple points.

Further, the signal processing circuit 120 can process both two-dimensional reflected wave data and three-dimensional reflected wave data. That is, the signal processing circuit 120 generates two-dimensional B-mode data from the two-dimensional reflected wave data, and generates three-dimensional B-mode data from the three-dimensional reflected wave data. Further, the signal processing circuit 120 generates two-dimensional Doppler data from the two-dimensional reflected wave data, and generates three-dimensional Doppler data from the three-dimensional reflected wave data.

The image generation circuit 130 generates an ultrasonic image from the data generated by the signal processing circuit 120. For example, the image generation circuit 130 generates a two-dimensional B-mode image in which the intensity of the reflected wave is represented by brightness from the two-dimensional B-mode data generated by the signal processing circuit 120.

Further, for example, the image generation circuit 130 generates a two-dimensional Doppler image in which blood flow information is visualized from the two-dimensional Doppler data generated by the signal processing circuit 120. The two-dimensional Doppler image is velocity image data representing the average velocity of blood flow, distributed image data representing the dispersion value of blood flow, power image data representing the power of blood flow, or image data obtained by combining these. Further, the image generation circuit 130 generates a color Doppler image in which blood flow information such as average velocity, dispersion value, and power of blood flow is displayed in color as a Doppler image, or one blood flow information is in gray scale. Generate a Doppler image to be displayed.

Further, for example, the image generation circuit 130 can also generate an M mode image from the time series data of the B mode data on one scanning line generated by the signal processing circuit 120. Further, the image generation circuit 130 can also generate a Doppler waveform obtained by plotting blood flow and tissue velocity information in chronological order from the Doppler data generated by the signal processing circuit 120.

Here, the image generation circuit 130 generally converts (scan-converts) a scanning line signal string of ultrasonic scanning into a scanning line signal string of a video format typified by a television or the like, and ultrasonic waves for display. Generate an image. Specifically, the image generation circuit 130 generates an ultrasonic image for display by performing coordinate conversion according to the scanning form of ultrasonic waves by the ultrasonic probe 101. Further, the image generation circuit 130 uses various image processes other than the scan conversion, for example, an image process (smoothing process) for regenerating an average value image of brightness by using a plurality of image frames after the scan conversion. Image processing (edge enhancement processing) using a differential filter in the image is performed. Further, the image generation circuit 130 synthesizes character information, scales, body marks, and the like of various parameters with the ultrasonic image data.

That is, the B mode data and the Doppler data are the data before the scan conversion process, and the data generated by the image generation circuit 130 is the image data for display after the scan conversion process. Hereinafter, the data (B mode data and Doppler data) before the scan conversion process is also referred to as “RAW data”.

The image generation circuit 130 generates a two-dimensional B-mode image or a two-dimensional Doppler image, which is a two-dimensional ultrasonic image, from two-dimensional B-mode data or two-dimensional Doppler data, which is RAW data. The image generation circuit 130 can also generate, for example, a superimposed image in which a color Doppler image is superimposed on a two-dimensional B-mode image.

The image memory 140 is an example of a storage unit. The image memory 140 is a memory that stores an ultrasonic image generated by the image generation circuit 130. The image memory 140 can also store RAW data generated by the signal processing circuit 120. The RAW data stored in the image memory 140 can be called by the operator after diagnosis, for example, and can be displayed as an ultrasonic image via the image generation circuit 130. Further, the image generation circuit 130 associates the ultrasonic image with the time of the ultrasonic scanning (scan) performed to generate the ultrasonic image with the electrocardiographic waveform transmitted from the electrocardiograph 104. Is stored in the image memory 140.

The storage circuit 150 stores various data. For example, the storage circuit 150 stores various data such as a control program for performing ultrasonic transmission / reception, image processing, and display processing, diagnostic information (for example, patient ID, doctor's findings, etc.), diagnostic protocol, and various body marks. Remember. The storage circuit 150 is also used for storing ultrasonic images and RAW data stored in the image memory 140, if necessary. For example, the storage circuit 150 is realized by a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, a hard disk (HDD), an optical disk, or the like.

Further, the data stored in the storage circuit 150 can be transferred to an external device via the NW interface 160. The external device is, for example, a PC (Personal Computer) or tablet terminal used by a doctor who performs image diagnosis, an image storage device 200 for storing images, a printer, or the like.

The NW interface 160 controls the communication performed between the device main body 105 and the external device. Specifically, the NW interface 160 receives various information from an external device and outputs the received information to the processing circuit 170. For example, the NW interface 160 is realized by a network card, a network adapter, a NIC (Network Interface Controller), or the like.

In the present embodiment, the case where the ultrasonic diagnostic apparatus 100 is communicably connected to an external device (image storage device 200 or the like) via the network NW will be described, but the present invention is not limited to this. For example, the ultrasonic diagnostic apparatus 100 can exchange information with an external device via a storage medium, a removable storage device (external HDD device, etc.), or the like without going through the network NW. ..

The processing circuit 170 controls the entire processing of the ultrasonic diagnostic apparatus 100. Specifically, the processing circuit 170 is based on various setting requests input from the operator via the input interface 102, various control programs read from the storage circuit 150, and various data, and the transmission / reception circuit 110 and the signal processing circuit 120. , And control the processing of the image generation circuit 130. Further, the processing circuit 170 controls the display of the ultrasonic image.

Further, the processing circuit 170 executes the acquisition function 171 and the first display function 172, the image type recognition function 173, the extraction function 174, and the second display function 175. Here, the acquisition function 171 is an example of an acquisition unit. The first display function 172 is an example of the first display unit. The image type recognition function 173 is an example of the image type recognition unit. The extraction function 174 is an example of an extraction unit. The second display function 175 is an example of the second display unit.

For example, the acquisition function 171 which is a component of the processing circuit 170 shown in FIG. 1, the first display function 172, the image type recognition function 173, the extraction function 174, and each processing function executed by the second display function 175 are It is recorded in the storage circuit 150 in the form of a program that can be executed by a computer. The processing circuit 170 is a processor that realizes a function corresponding to each program by reading each program from the storage circuit 150 and executing the program. In other words, the processing circuit 170 in the state where each program is read out has each function shown in the processing circuit 170 of FIG.

In this embodiment, it is assumed that each processing function described below is realized by a single processing circuit 170. However, a processing circuit is configured by combining a plurality of independent processors, and each processor is used. May realize the function by executing the program.

The acquisition function 171 acquires the data output from the ultrasonic probe 101. For example, the ultrasonic diagnostic apparatus 100 collects reflected wave data by performing ultrasonic scanning on a specific part of the subject P. The ultrasonic diagnostic apparatus 100 (image generation circuit 130) generates a plurality of ultrasonic images (ultrasonic image group) for display arranged in a time series based on the collected reflected wave data. The generated plurality of ultrasonic images are stored in the image memory 140 for display. The acquisition function 171 reads out the ultrasonic images stored in the image memory 140 in chronological order.

The first display function 172 causes the display 103 to display the ultrasonic image acquired by the acquisition function 171 as a real-time live image. Specifically, the first display function 172 causes the display 103 to display a live image based on a preset display layout.

Here, the display layout defines the layout of the ultrasonic image to be displayed on the screen, and is stored in advance as setting information in the storage circuit 150 or the like. The display layout is prepared, for example, for each type of ultrasonic diagnosis and for each type of ultrasonic image generated by the image generation circuit 130.

The display layout used for displaying the live image may be configured to be automatically determined according to the operation via the input interface 102, the type of the ultrasonic image generated by the image generation circuit 130, and the like. , The configuration may be determined by the first display function 172.

FIG. 3 is a diagram showing an example of a live image displayed by the first display function 172. The display screen shown in FIG. 3 has two display areas A11 and A12 as a display layout. Here, for example, assuming that the display area A11 on the right side of the screen is a display area for displaying a live image and the display area A12 on the left side of the screen is a display area for displaying a reference image described later, the first The display function 172 of 1 causes the live image generated by the image generation circuit 130 to be displayed in the display area A11.

FIG. 3 shows an example in which a superimposed image in which a color Doppler image is superimposed on a two-dimensional B mode image is displayed as a live image in the display area A11. Further, below the display area A11, the electrocardiographic waveform collected by the electrocardiograph 104 is displayed.

Further, FIG. 4 is a diagram showing an example of a live image displayed by the first display function 172. The display screen shown in FIG. 4 has three display areas A21, A22, and A23 as a display layout. Here, for example, the display area A21 at the upper right of the screen and the display area A22 at the bottom of the screen are display areas for displaying a live image, and the display area A23 at the upper left of the screen is a display for displaying a reference image described later. Assuming that it is an area, the first display function 172 causes the display area A21 and the display area A22 to display the live image generated by the image generation circuit 130.

FIG. 4 shows an example of triplet display in which a live image (superimposed image) similar to that in FIG. 3 is displayed in the display area A21 and a two-dimensional pulse Doppler image is displayed as a live image in the display area A22. Further, the electrocardiographic waveform collected by the electrocardiograph 104 is displayed below the display area A22.

The display layout is not limited to the examples of FIGS. 3 and 4. In addition, the type of live image to be displayed in each display area can be arbitrarily set.

Returning to FIG. 2, the image type recognition function 173 recognizes the image type of the live image displayed by the first display function 172. Here, the image type is a concept including the type related to the display of the live image regardless of the type of the live image itself.

Specifically, the image type recognition function 173 cooperates with the signal processing circuit 120, the image generation circuit 130, and the like to determine the mode type of the live image (for example, B mode, M mode, color Doppler, pulse Doppler, etc.). Recognize as an image type. In addition, the image type recognition function 173 cooperates with the signal processing circuit 120, the image generation circuit 130, and the like to obtain an image of the number of dimensions (for example, two-dimensional, three-dimensional, etc.) of the ultrasonic image represented as a live image. Recognize as a species. Further, the image type recognition function 173 recognizes the type of the display layout related to the display of the live image as the image type by cooperating with the first display function 172 and the like. When the scan target is the heart, the image type recognition function 173 recognizes the shape of the structure shown in the live image to recognize the cross-sectional type of the cross section of the subject (for example, a short axis view). 4. Recognize 4 chamber views, etc. as image types.

For example, in the case of the live image shown in FIG. 3, the image type recognition function 173 indicates that the image type of the live image is a two-dimensional B-mode image, a two-dimensional color Doppler image, and these images. Recognize that it is a superposed image in which. Further, the image type recognition function 173 recognizes that the image type of the live image is a display layout in which the superimposed image is independently displayed.

Further, for example, in the case of the live image shown in FIG. 4, the image type recognition function 173 is a two-dimensional B-mode image, a two-dimensional color Doppler image, and 2) as the image type of the live image. Recognize that it is a dimensional pulse Doppler image. Further, the image type recognition function 173 recognizes that the image type of the live image is a display layout in which the superimposed image of the B mode image and the color Doppler image and the pulse Doppler image are arranged vertically.

The extraction function 174 extracts ultrasonic data having at least a part of the image type from the image storage device 200 based on the image type of the live image recognized by the image type recognition function 173.

Specifically, the extraction function 174 scans the same data as the live image among the data (hereinafter, also referred to as past data) stored in the image storage device 200 in association with the subject ID of the subject P to be scanned. Narrow down the past data of the part. Then, the extraction function 174 extracts the past data satisfying at least a part of the conditions of the image type recognized by the image type recognition function 173 from the narrowed-down past data. It should be noted that the past data to be extracted includes not only ultrasonic images but also RAW data. For example, when the image type of the live image is a two-dimensional B-mode image, the extraction function 174 extracts the two-dimensional B-mode data as RAW data satisfying the condition of the image type.

Here, the image type of the past data can be determined by, for example, the following method. Specifically, the extraction function 174 determines the scan mode, the number of dimensions, the cross-section type, and the like based on the information included in the incidental information (for example, the View mode stored in the tag information of DICOM). Further, when the past data is an ultrasonic image, the extraction function 174 determines the type of display layout from the contents of the ultrasonic image.

It is possible to arbitrarily set the condition setting such as which image type is an indispensable condition among the plurality of image types. For example, among the mode type, the number of dimensions, the display layout, and the cross-sectional type, it may be an essential condition that the mode type and the number of dimensions match the live image. Such condition setting is stored in the storage circuit 150 as setting information, for example.

Further, the timing at which the extraction function 174 starts the extraction of the ultrasonic image data is not particularly limited, and the extraction can be started at any timing. For example, the extraction function 174 may be in the form of starting extraction from the data acquired before the stress load at the time of scanning after the stress (exercise or dobutamine) load when the execution of the stress echo test is instructed. .. Further, for example, the extraction function 174 may be in a form of starting extraction from the data acquired before the treatment at the time of scanning after the treatment such as subpuncture ablation is performed.

The second display function 175 displays an ultrasonic image based on the past data extracted by the extraction function 174 on the same screen as the live image as a reference image. Specifically, the second display function 175 causes the reference image to be displayed in the display layout in which the live image is displayed. Here, the second display function 175 switches the display method of the reference image according to whether the past data extracted by the extraction function 174 is the ultrasonic image or the RAW data.

For example, when the extracted past data is an ultrasonic image of the same image type as the live image, the second display function 175 displays the ultrasonic image as it is as a reference image. In this case, the displayed reference image represents the same image type as the live image. Further, for example, when the extracted past data is an ultrasonic image satisfying only a part of the conditions of the image type of the live image, the second display function 175 uses the ultrasonic image as a reference image as it is. Display it.

Further, for example, when the extracted past data is RAW data, the second display function 175 cooperates with the image generation circuit 130 or the like to obtain ultrasonic waves of the same image type as the live image from the RAW data. Generate an image. Then, the second display function 175 displays the ultrasonic image generated from the RAW data on the display 103 as a reference image. As an example, when the live image is a superimposed image of a two-dimensional B-mode image and a color Doppler image, a superimposed image similar to the live image is generated from the two-dimensional B-mode data and Doppler data extracted as RAW data. be able to.

Here, FIGS. 5 to 7 are diagrams showing an example of a reference image displayed by the second display function 175. 5 and 7 correspond to the display screen of FIG. 3, and FIG. 6 corresponds to the display screen of FIG.

For example, when an ultrasonic image of the same image type as the live image shown in FIG. 3 is extracted as past data, the second display function 175 refers to the extracted ultrasonic image as a reference image as shown in FIG. Is displayed in the display area A12. In this case, the displayed reference image represents the same image type as the live image.

Further, for example, when the RAW data in which the live image shown in FIG. 4 and some image types (mode types) are common is extracted as past data, the second display function 175 is set as shown in FIG. An ultrasonic image of the same image type as the live image generated from the extracted RAW data is displayed in the third display area A23 as a reference image. In this case, the displayed reference image represents the same image type as the live image.

Further, for example, when an ultrasonic image having a common image type (mode type) with the live image shown in FIG. 3 is extracted as past data, the second display function 175 is as shown in FIG. , The extracted past data is displayed in the display area A12 as a reference image as it is. In this case, the displayed reference image is different from the live image in some image types.

In this way, the ultrasonic diagnostic apparatus 100 displays the live image as well as the reference image in which the image type of the live image and a part or all of the image types are common. As a result, the ultrasonic diagnostic apparatus 100 can display a reference image corresponding to the image type of the live image, so that the ease of comparison between the live image and the reference image can be improved. Further, in the display modes described with reference to FIGS. 5 and 6, since the live image and the reference image can be displayed in the same display layout, the position where the same type of ultrasonic image is displayed can be determined from the positional relationship of the display layout. It can be grasped intuitively, and convenience can be improved.

In the above-described example, an example in which the second display function 175 displays the reference image after the live image is displayed by the first display function 172 has been described, but the display order is not limited to this. For example, if the image type of the live image can be obtained before the live image is displayed, the reference image may be displayed prior to the display of the live image.

Next, an operation example of the above-mentioned ultrasonic diagnostic apparatus 100 will be described with reference to FIGS. 8 and 9. Hereinafter, the operation of the ultrasonic diagnostic apparatus 100 will be described separately as a first operation and a second operation. The first operation corresponds to, for example, an operation for collecting an in-vivo image of the subject P before stress is applied or before treatment such as subpuncture ablation is performed. In addition, the second operation corresponds to the operation for collecting an in-vivo image of the subject P, for example, during follow-up observation performed after stress is applied or after treatment such as subpuncture ablation.

FIG. 8 is a flowchart showing an example of the first operation executed by the ultrasonic diagnostic apparatus 100. First, when the subject P is photographed using the ultrasonic probe 101, the image generation circuit 130 generates an ultrasonic image based on the data output from the ultrasonic probe 101.

The acquisition function 171 acquires an ultrasonic image generated by the image generation circuit 130 (step S11). Next, the first display function 172 displays the ultrasonic image acquired by the acquisition function 171 on the display 103 as a live image (step S12). Further, the image type recognition function 173 recognizes the image type of the displayed live image (step S13).

Then, when the ultrasonic image or the RAW data related to the generation of the ultrasonic image is saved, the processing circuit 170 uses the ultrasonic image or the RAW data collected in the current photographing as the image recognized in step S13. It is stored in the image storage device 200 in association with the information indicating the species (step S14).

Here, the image type to be saved is not particularly limited, and in addition to the image type (mode type, number of dimensions, cross-sectional type) directly related to the imaging of the subject P, the display layout may be included and saved. .. By storing the collected diagnosis result data in association with the image type of the diagnosis result data, it is possible to efficiently perform the process of extracting the reference data from the image storage device 200.

Further, the processing circuit 170 also stores the subject ID, the inspection ID and the device ID of the subject P, the information representing the imaging target portion, and the like in association with the reference image. Further, when the image type is changed in the middle of the first operation, for example, when the scan mode is changed or the display layout is changed, the reference images before and after the change are saved as separate data. ..

FIG. 9 is a flowchart showing an example of the second operation executed by the ultrasonic diagnostic apparatus 100. Here, the second operation is performed when the same subject P and the imaging site as the first operation are photographed. Since steps S21 to S23 are the same as steps S11 to S13 of the first operation, the description thereof will be omitted.

When the image type of the live image is recognized in step S23, the extraction function 174 searches the image storage device 200 for past data having at least a part in common with the image type (step S24). Here, if the corresponding past data does not exist (step S25; No), the second display function 175 ends this process without displaying the reference image.

On the other hand, when there is past data satisfying the condition (step S25; Yes), the extraction function 174 extracts the corresponding ultrasonic data from the image storage device 200 (step S26). Next, the second display function 175 determines whether or not the extracted past data is an ultrasonic image of the same image type as the live image (step S27). When the extracted past data is an ultrasonic image of the same image type as the live image (step S27; Yes), the second display function 175 displays the extracted past data as a reference image (step S28). , End this process.

When the extracted past data is RAW data (step S27; No → step S29; Yes), the second display function 175 produces an ultrasonic image of the same image type as the live image generated from the RAW data. It is displayed as a reference image (step S30), and this process is terminated.

Further, when the extracted past data is an ultrasonic image in which the live image and some image types are common (step S27; No → step S29; No), the second display function 175 uses the extracted ultrasonic image. The ultrasonic data is displayed as a reference image in the state at the time of saving (step S31), and this process is completed.

When the live image collected in the second operation is stored in the image storage device 200, the processing circuit 170 executes the same process as in step S14 described in the first operation.

As described above, the ultrasonic diagnostic apparatus 100 according to the present embodiment recognizes various image types related to the live image, and uses the past data that is at least partially common to the image type as a reference image together with the live image. Display it. Therefore, the ultrasonic diagnostic apparatus 100 can easily compare the live image with the reference image. Further, since the live image and the reference image can be displayed in the same display layout, it is possible to easily compare the live image and the reference image. Thereby, for example, the ultrasonic diagnostic apparatus 100 can be newly obtained by referring to the reference image obtained before the state changes at the time of follow-up after stress echo loading or after treatment such as subpuncture ablation. When displaying a live image, the convenience can be improved.

The above-described embodiment can be appropriately modified and implemented by changing a part of the configuration or function of the ultrasonic diagnostic apparatus 100. Therefore, in the following, some modifications according to the above-described embodiment will be described as other embodiments. In the following, points different from the above-described embodiment will be mainly described, and detailed description of points common to the contents already described will be omitted. Further, the modifications described below may be carried out individually or in combination as appropriate.

(Modification example 1)
In the above-described embodiment, when an ultrasonic image in which the image type of the live image and some image types are common is extracted as the past data, a mode in which the ultrasonic image is displayed as a reference image in the state at the time of storage has been described. It is not limited to.

For example, when a part of the ultrasonic image extracted as past data represents an image type of a live image, the second display function 175 may display a part of the ultrasonic image as a reference image. For example, when the live image and the past data are ultrasonic images displayed in the display areas A11 and A12 of FIG. 7, the second display function 175 uses the same image type as the live image included in the past data. A partial image representing the part is extracted by cutting out or enlarging the part to be represented, that is, the part of the superimposed image of the two-dimensional B mode image and the color Doppler image. Then, the second display function 175 may display the extracted partial image as a reference image in the display area A12.

As a result, since the live image and the reference image can be the same image type, the live image and the reference image can be easily compared, and the same effect as that of the above-described embodiment can be obtained. ..

(Modification 2)
In the above-described embodiment, a mode of displaying a reference image that is at least partially common to the image type is described based on the image type of the live image. However, the display method of the reference image is not limited to this, and further narrowing conditions and image processing may be applied.

For example, when the brightness of the live image and the reference image are different, the second display function 175 may change the brightness of the reference image according to the live image and display the changed reference image. Good. Here, when the past data corresponding to the reference image is RAW data, the second display function 175 adjusts the gain of the RAW data to display the reference image according to the brightness of the live image. Can be done.

As a result, the appearance of the live image and the reference image can be made the same, so that the convenience of comparing the live image and the reference image can be improved.

(Modification 3)
In the above-described embodiment, the past data is extracted from the data stored in the image storage device 200. However, the extraction destination of the past data is not limited to the image storage device 200, and may be the storage circuit 150 of the ultrasonic diagnostic device 100 or the like.

(Modification example 4)
In the above-described embodiment, a mode type, a number of dimensions, a layout, and a cross-sectional type are recognized as image types of a live image, and an ultrasonic image common to some image types is extracted as past data. However, the condition of the past data extracted by the extraction function is not limited to the above image types, and the time phase represented by the live image may be used as a further extraction condition.

For example, in the case of ultrasonic diagnosis using a contrast medium, the image can be divided into three phases, an arterial phase, a portal vein phase, and a delayed phase, according to the elapsed time after the injection of the contrast medium. In this case, the extraction function 174 discriminates whether the time phase represented in the live image is an arterial phase, a portal vein phase, or a delayed phase, and extracts past data showing the same type of time phase. Further, for example, when diagnosing the heart by ultrasonic waves, the extraction function 174 extracts past data showing the same type of time phase as the heartbeat time phase such as systole and end diastole shown in the live image. ..

The extraction function 174 may determine the time phase (heartbeat time phase, etc.) represented in the live image based on the sensing result of the electrocardiogram, the pulse pressure measuring device, or the like. Further, the second display function 175 is assumed to display an ultrasonic image based on the past data extracted by the extraction function 174 in synchronization with the time phase represented by the live image.

As a result, the ultrasonic diagnostic apparatus 100 can display a reference image showing the same type of time phase as the live image, so that the ease of comparison between the live image and the reference image can be improved. Further, since the sound wave diagnostic apparatus 100 can display the live image and the reference image in a state where the time phases are synchronized, it is possible to improve the convenience when comparing the two images.

(Modification 5)
In the above-described embodiment, the embodiment in which the acquired ultrasonic image of the acquisition function 171 is displayed as a real-time live image together with the reference image has been described. However, depending on the environment in which the ultrasonic diagnostic apparatus 100 is used, only the real-time live image is displayed during the ultrasonic scanning of the subject P, and after the ultrasonic scanning is completed, the previous live image for confirmation is displayed. It is also assumed that the image and the reference image will be displayed together.

Therefore, for example, the extraction function 174 and the second display function 175 may be in a form in which the extraction of past data and the display of the reference image are suppressed while the ultrasonic scanning is performed by the ultrasonic probe 101. In this case, the acquisition function 171 also functions as a storage function, and stores the live image data acquired by ultrasonic scanning in the image memory 140. Further, the acquisition function 171 acquires the data of the live image acquired by the previous ultrasonic scanning as an ultrasonic image from the image memory 140 automatically or in response to the operation of the operator after the ultrasonic scanning is completed. In addition, the first display function 172 causes the display 103 to display the ultrasonic image acquired by the acquisition function 171. Then, the extraction function 174 and the second display function 175 extract past data and display a reference image in accordance with the display of the ultrasonic image by the first display function 172.

As a result, the ultrasonic diagnostic apparatus 100 displays a real-time ultrasonic image (live image) while the ultrasonic scanning of the subject P is being performed, and after the ultrasonic scanning is completed, the ultrasonic scanning is performed. The acquired live image can be displayed together with the reference image. Therefore, since the ultrasonic diagnostic apparatus 100 can suppress the display of the reference image while the ultrasonic scanning is being performed, it is possible to cope with the case where the display of the reference image interferes with the ultrasonic scanning. In addition, the ultrasonic diagnostic apparatus 100 can easily compare the ultrasonic image generated by the ultrasonic scanning with the reference image at the time of confirmation after the ultrasonic scanning, thereby improving the convenience. be able to.

The presence or absence of the display of the reference image during ultrasonic scanning may be switched by, for example, an operation via the input interface 102. When the display of the reference image is enabled, the extraction function 174 and the second display function 175 extract the past data and display the reference image even while the ultrasonic scanning is performed. Further, the extraction function 174 and the second display function 175 suppress the extraction of past data and the display of the reference image while the ultrasonic scanning is performed when the display of the reference image is invalidated. Further, for example, when the switching operation is performed while the ultrasonic scanning is being performed, the extraction function 174 and the second display function 175 operate according to the setting after the switching at the timing when the switching operation is performed. I do.

In the above-described embodiment, the acquisition unit, the first display unit, the image type recognition unit, the extraction unit, and the second display unit in the present specification are the acquisition functions 171 and the first of the processing circuit 170, respectively. An example of the case where the display function 172, the image type recognition function 173, the extraction function 174, and the second display function 175 are used has been described, but the embodiment is not limited to this. For example, the same function may be realized only by hardware or by mixing hardware and software.

Further, the word "processor" used in the above description means, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an integrated circuit for a specific application (Application Specific Integrated Circuit: ASIC), or a programmable logic device. (For example, it means a circuit such as a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)). The processor realizes the function by reading and executing the program stored in the storage circuit 150. Instead of storing the program in the storage circuit 150, the program may be directly incorporated in the circuit of the processor. In this case, the processor realizes the function by reading and executing the program embedded in the circuit. Further, the processor of the present embodiment is not limited to the case where it is configured as a single circuit, and a plurality of independent circuits may be combined to be configured as one processor to realize its function.

Here, the program executed by the processor is provided by being incorporated in a ROM (Read Only Memory), a storage circuit, or the like in advance. This program is a file in a format that can be installed or executed on these devices, such as CD (Compact Disk) -ROM, FD (Flexible Disk), CD-R (Recordable), DVD (Digital Versatile Disk), etc. It may be recorded and provided on a computer-readable storage medium. Further, this program may be provided or distributed by being stored on a computer connected to a network such as the Internet and downloaded via the network. For example, this program is composed of modules including the above-mentioned functional parts. In actual hardware, the CPU reads a program from a storage medium such as a ROM and executes it, so that each module is loaded on the main storage device and generated on the main storage device.

According to at least one embodiment described above, it is possible to display a reference image corresponding to the image type of the live image.

Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, as well as in the scope of the invention described in the claims and the equivalent scope thereof.

1 Ultrasonic diagnostic system 100 Ultrasonic diagnostic device 200 Image storage device 171 Acquisition function 172 First display function 173 Image type recognition function 174 Extraction function 175 Second display function

Claims (12)

The first display unit that displays the image represented by the data output from the ultrasonic probe as a live image, and
An image type recognition unit that recognizes the image type of the live image,
An extraction unit that extracts data common to at least a part of the image types recognized by the image type recognition unit from the past data collected before the live image.
A second display unit that displays the image represented by the data extracted by the extraction unit on the same screen as the live image, and
An ultrasonic diagnostic device equipped with. The ultrasonic diagnostic apparatus according to claim 1, wherein the image type recognition unit recognizes a mode type of the live image as an image type of the live image. The ultrasonic diagnostic apparatus according to claim 1 or 2, wherein the image type recognition unit recognizes the number of dimensions of the live image as an image type of the live image. The ultrasonic diagnostic apparatus according to any one of claims 1 to 3, wherein the image type recognition unit recognizes the type of display layout related to the display of the live image as the image type of the live image. The ultrasonic diagnostic apparatus according to any one of claims 1 to 4, wherein the image type recognition unit recognizes a cross-sectional type of a cross section of a subject represented by the live image as an image type of the live image. The extraction unit extracts data in which at least a part of the image types are common to the image type recognized by the image type recognition unit and the time phase is the same as the time phase shown in the live image. The ultrasonic diagnostic apparatus according to claim 1. The ultrasonic diagnostic apparatus according to claim 1, wherein the second display unit displays the ultrasonic image on the same screen as the live image when the ultrasonic image is extracted as the data. When RAW data capable of generating the same ultrasonic image as the image type of the live image is extracted as the data, the second display unit uses the ultrasonic image based on the RAW data for the live image. The ultrasonic diagnostic apparatus according to claim 1, which is displayed on the same screen as the image. The second display unit requests that a part of the ultrasonic image be displayed on the same screen as the live image when a part of the ultrasonic image extracted as the data represents an image type of the live image. Item 1. The ultrasonic diagnostic apparatus according to Item 1. The first display unit that displays the image represented by the data output from the ultrasonic probe as a live image, and
A storage unit that stores the live image and
An image type recognition unit that recognizes the image type of the live image,
An extraction unit that extracts data common to at least a part of the image types recognized by the image type recognition unit from the past data collected before the live image.
A second display unit that displays an image represented by the data extracted by the extraction unit on the same screen as the live image in accordance with the display of the live image stored in the storage unit.
An ultrasonic diagnostic device equipped with. Computer of ultrasonic diagnostic equipment,
The first display function that displays the image represented by the data output from the ultrasonic probe as a live image,
An image type recognition function that recognizes the image type of the live image and
An extraction function that extracts data that is common to at least a part of the image types recognized by the image type recognition function from the past data collected before the live image.
A second display function for displaying the image represented by the data extracted by the extraction function on the same screen as the live image, and
A program to make it work. Computer of ultrasonic diagnostic equipment,
The first display function that displays the image represented by the data output from the ultrasonic probe as a live image,
A storage function that stores the live image in the storage unit,
An image type recognition function that recognizes the image type of the live image and
An extraction function that extracts data that is common to at least a part of the image types recognized by the image type recognition function from the past data collected before the live image.
A second display function for displaying the image represented by the data extracted by the extraction function on the same screen as the live image in accordance with the display of the live image stored in the storage unit.
A program to make it work.