JP2021126430A - Medical information processing device - Google Patents

Abstract

To improve operability on image display.SOLUTION: An ultrasonic diagnostic device 1 includes an image generation function 552, a calculation function 553, a setting function 554, and a display 3. The image generation function 552 generates three-dimensional image data from data collected by transmitting/receiving an ultrasonic wave to/from a subject. The calculation function 553 calculates a spectrum indicating relationships between brightness information and position information, or a histogram indicating the brightness information on the basis of the brightness information on a two-dimensional image that constitutes three-dimensional image data. The setting function 554 sets a brightness value by receiving a brightness value designation operation to the spectrum or the histogram. The display 3 displays a GUI for executing settings for displaying a rendering image.SELECTED DRAWING: Figure 1

Description

The embodiments disclosed in the present specification and the like relate to a medical information processing device.

Conventionally, ultrasonic diagnosis is performed by a technician or a doctor operating an ultrasonic probe on the body surface of a subject to obtain information on the tissue structure inside the human body, blood flow, and the like. For example, a technician or a doctor operates an ultrasonic probe that transmits and receives ultrasonic waves on the body surface according to the diagnosis site and the diagnosis content to scan the inside of the subject with ultrasonic waves to show the tissue structure. Collect images and ultrasonic images showing information such as blood flow. In such ultrasonic diagnosis, the diagnosis may be performed by observing a two-dimensional B-mode image and a three-dimensional rendered image.

Japanese Unexamined Patent Publication No. 2013-176552 Japanese Unexamined Patent Publication No. 2008-142327

One of the problems to be solved by the embodiment disclosed in the present specification and the like is to improve the operability related to the image display. However, the problems solved by the embodiments disclosed in the present specification and the like are not limited to the above problems. The problem corresponding to each effect of each configuration shown in the embodiment described later can be positioned as another problem to be solved by the embodiment disclosed in the present specification and the like.

The medical information processing device of the embodiment includes an acquisition unit, a calculation unit, a setting unit, and a display control unit. The acquisition unit acquires three-dimensional image data collected by transmitting and receiving ultrasonic waves to the subject. The calculation unit calculates a spectrum showing the relationship between the brightness information and the position information or a histogram showing the brightness information based on the brightness information on the two-dimensional image constituting the three-dimensional image data. The setting unit sets the luminance value by accepting the operation of specifying the luminance value for the spectrum or the histogram. The display control unit changes the display of the rendered image generated from the three-dimensional image data based on the brightness value set by the setting unit.

FIG. 1 is a block diagram showing an example of the configuration of the ultrasonic diagnostic apparatus according to the first embodiment. FIG. 2 is a diagram showing an example of display by the control function according to the first embodiment. FIG. 3 is a diagram for explaining processing by the calculation function according to the first embodiment. FIG. 4 is a diagram showing an example of a display controlled by the control function according to the first embodiment. FIG. 5 is a diagram showing an example of a display controlled by the control function according to the first embodiment. FIG. 6 is a diagram showing an example of a display controlled by the control function according to the first embodiment. FIG. 7 is a diagram showing an example of a display controlled by the control function according to the first embodiment. FIG. 8 is a diagram showing an example of a display controlled by the control function according to the first embodiment. FIG. 9 is a flowchart for explaining a procedure for processing the ultrasonic diagnostic apparatus according to the third embodiment. FIG. 10 is a block diagram showing an example of the configuration of the medical information processing device according to another embodiment.

Hereinafter, embodiments of the medical information processing apparatus according to the present application will be described in detail with reference to the accompanying drawings. The medical information processing device according to the present application is not limited to the embodiments shown below. Further, in the following description, common reference numerals will be given to similar components, and duplicate description will be omitted.

(First Embodiment)
The medical information processing apparatus according to the present application may be realized by a computer such as a workstation, or may be realized by being incorporated in an ultrasonic diagnostic apparatus. In the first embodiment, an ultrasonic diagnostic apparatus to which the medical information processing apparatus of the present application is applied will be described as an example. FIG. 1 is a block diagram showing an example of the configuration of the ultrasonic diagnostic apparatus 1 according to the first embodiment. As shown in FIG. 1, the ultrasonic diagnostic apparatus 1 according to the present embodiment includes an ultrasonic probe 2, a display 3, an input interface 4, and an apparatus main body 5, and includes an ultrasonic probe 2 and a display 3. And the input interface 4 are connected to the device main body 5 so as to be able to communicate with each other.

The ultrasonic probe 2 is connected to a transmission / reception circuit 51 included in the apparatus main body 5. The ultrasonic probe 2 has, for example, a plurality of piezoelectric vibrators in the probe body, and these plurality of piezoelectric vibrators generate ultrasonic waves based on a drive signal supplied from the transmission / reception circuit 51. Further, the ultrasonic probe 2 receives the reflected wave from the subject P and converts it into an electric signal. Further, the ultrasonic probe 2 has a matching layer provided on the piezoelectric vibrator and a backing material for preventing the propagation of ultrasonic waves from the piezoelectric vibrator to the rear in the probe main body. The ultrasonic probe 2 is detachably connected to the device main body 5. For example, the ultrasonic probe 2 is a sector type, linear type, convex type or the like ultrasonic probe.

When ultrasonic waves are transmitted from the ultrasonic probe 2 to the subject P, the transmitted ultrasonic waves are reflected one after another on the discontinuity surface of the acoustic impedance in the body tissue of the subject P, and the ultrasonic probe is used as a reflected wave signal. It is received by a plurality of piezoelectric vibrators of 2. The amplitude of the received reflected wave signal depends on the difference in acoustic impedance on the discontinuity where the ultrasonic waves are reflected. The reflected wave signal when the transmitted ultrasonic pulse is reflected by the moving blood flow or the surface of the heart wall or the like depends on the velocity component of the moving body with respect to the ultrasonic transmission direction due to the Doppler effect. And undergo frequency shift.

Here, the ultrasonic probe 2 according to the present embodiment is an ultrasonic probe capable of scanning a subject in three dimensions. In this embodiment, an ultrasonic probe 2 that mechanically swings a plurality of piezoelectric vibrators of a one-dimensional ultrasonic probe and a two-dimensional ultrasonic probe in which a plurality of piezoelectric vibrators are arranged in a grid pattern in two dimensions. The ultrasonic probe 2 is applicable even when the subject is scanned in three dimensions.

The display 3 displays a GUI (Graphical User Interface) for the operator of the ultrasonic diagnostic apparatus 1 to input various setting requests using the input interface 4, and displays an ultrasonic image or the like generated by the apparatus main body 5. To display. Further, the display 3 displays various messages and display information in order to notify the operator of the processing status and the processing result of the device main body 5. Further, the display 3 has a speaker and can output sound. For example, the display 3 displays a GUI for making settings for displaying a rendered image. This GUI will be described in detail later.

The input interface 4 includes a trackball for making various settings, a switch button, a mouse, a keyboard, a touch pad for performing input operations by touching the operation surface, and a touch monitor in which a display screen and a touch pad are integrated. It is realized by a non-contact input circuit using an optical sensor, a voice input circuit, and the like. The input interface 4 is connected to a processing circuit 55, which will be described later, and converts an input operation received from the operator into an electric signal and outputs the input operation to the processing circuit 55. In the present specification, the input interface 4 is not limited to the one provided with physical operating parts such as a mouse and a keyboard. For example, an example of an input interface includes an electric signal processing circuit that receives an electric signal corresponding to an input operation from an external input device provided separately from the device and outputs the electric signal to the processing circuit 55.

The apparatus main body 5 includes a transmission / reception circuit 51, a B-mode processing circuit 52, a Doppler processing circuit 53, a memory 54, and a processing circuit 55. In the ultrasonic diagnostic apparatus 1 shown in FIG. 1, each processing function is stored in the memory 54 in the form of a program that can be executed by a computer. The transmission / reception circuit 51, the B-mode processing circuit 52, the Doppler processing circuit 53, and the processing circuit 55 are processors that realize functions corresponding to each program by reading a program from the memory 54 and executing the program. In other words, each circuit in the state where each program is read has a function corresponding to the read program.

The transmission / reception circuit 51 includes a pulse generator, a transmission delay circuit, a pulsar, and the like, and supplies a drive signal to the ultrasonic probe 2. The pulse generator repeatedly generates rate pulses for forming transmitted ultrasonic waves at a predetermined rate frequency. Further, in the transmission delay circuit, the pulse generator generates the delay time for each piezoelectric vibrator required for focusing the ultrasonic waves generated from the ultrasonic probe 2 in a beam shape and determining the transmission directivity. Give for each rate pulse. Further, the pulsar applies a drive signal (drive pulse) to the ultrasonic probe 2 at a timing based on the rate pulse. That is, the transmission delay circuit arbitrarily adjusts the transmission direction of the ultrasonic waves transmitted from the piezoelectric vibrator surface by changing the delay time given to each rate pulse.

The transmission / reception circuit 51 has a function of instantaneously changing the transmission frequency, transmission drive voltage, and the like in order to execute a predetermined scan sequence based on the instruction of the processing circuit 55 described later. In particular, the change of the transmission drive voltage is realized by a linear amplifier type transmission circuit capable of instantaneously switching the value, or a mechanism for electrically switching a plurality of power supply units.

Further, the transmission / reception circuit 51 includes a preamplifier, an A / D (Analog / Digital) converter, a reception delay circuit, an adder, etc., and performs various processes on the reflected wave signal received by the ultrasonic probe 2 to reflect the signal. Generate wave data. The preamplifier amplifies the reflected wave signal for each channel. The A / D converter A / D converts the amplified reflected wave signal. The reception delay circuit provides the delay time required to determine the reception directivity. The adder generates reflected wave data by performing addition processing of the reflected wave signal processed by the reception delay circuit. The addition process of the adder emphasizes the reflected component from the direction corresponding to the reception directivity of the reflected wave signal, and the reception directivity and the transmission directivity form a comprehensive beam for ultrasonic transmission and reception.

The B-mode processing circuit 52 receives reflected wave data from the transmission / reception circuit 51, performs logarithmic amplification, envelope detection processing, and the like to generate data (B-mode data) in which the signal intensity is expressed by the brightness of the brightness. ..

The Doppler processing circuit 53 frequency-analyzes velocity information from the reflected wave data received from the transmission / reception circuit 51, extracts blood flow, tissue, and contrast agent echo components due to the Doppler effect, and extracts moving body information such as velocity, dispersion, and power. Generate data (Doppler data) extracted for multiple points. For example, a moving body is a fluid such as blood flowing in a blood vessel or lymph fluid flowing in a lymph vessel.

The B-mode processing circuit 52 and the Doppler processing circuit 53 can process both two-dimensional reflected wave data and three-dimensional reflected wave data. That is, the B-mode processing circuit 52 generates two-dimensional B-mode data from the two-dimensional reflected wave data, and generates three-dimensional B-mode data from the three-dimensional reflected wave data. Further, the Doppler processing circuit 53 generates two-dimensional Doppler data from the two-dimensional reflected wave data and generates three-dimensional Doppler data from the three-dimensional reflected wave data. The three-dimensional B-mode data is data to which a luminance value is assigned according to the reflection intensity of a reflection source located at each of a plurality of points (sample points) set on each scanning line in the three-dimensional scanning range. Further, in the three-dimensional Doppler data, a brightness value corresponding to the value of blood flow information (velocity, dispersion, power) is assigned to each of a plurality of points (sample points) set on each scanning line in the three-dimensional scanning range. It becomes the obtained data.

The memory 54 stores image data for display generated by the processing circuit 55. The memory 54 can also store the data generated by the B-mode processing circuit 52 and the Doppler processing circuit 53. Further, the memory 54 stores various data such as a control program for performing ultrasonic transmission / reception, image processing, and display processing, diagnostic information (for example, patient ID, doctor's findings, etc.), diagnostic protocol, and various body marks. do.

The processing circuit 55 controls the entire processing of the ultrasonic diagnostic apparatus 1. Specifically, the processing circuit 55 performs various processes by reading a program corresponding to the control function 551, the image generation function 552, the calculation function 553, and the setting function 554 shown in FIG. 1 from the memory 54 and executing the program. .. Here, the control function 551 is an example of an acquisition unit and a display control unit. The calculation function 553 is an example of a calculation unit. The setting function 554 is an example of a setting unit.

For example, the control function 551 is based on various setting requests input from the operator via the input interface 4, various control programs read from the memory 54, and various data, and the transmission / reception circuit 51, the B mode processing circuit 52, and the Doppler Controls the processing of the processing circuit 53. Further, the control function 551 controls the display 3 to display the ultrasonic image data for display (hereinafter, also referred to as an ultrasonic image) stored in the memory 54. Further, the control function 551 controls so that the processing result is displayed on the display 3. Further, the control function 551 displays a GUI for setting to display the rendered image on the display 3, and this point will be described in detail later.

The image generation function 552 generates ultrasonic image data from the data generated by the B mode processing circuit 52 and the Doppler processing circuit 53. That is, the image generation function 552 generates B-mode image data in which the intensity of the reflected wave is represented by the brightness from the two-dimensional B-mode data generated by the B-mode processing circuit 52. The B-mode image data is data in which the tissue shape in the ultrasonically scanned region is depicted. Further, the image generation function 552 generates Doppler image data representing mobile information from the two-dimensional Doppler data generated by the Doppler processing circuit 53. The Doppler image data is speed image data, distributed image data, power image data, or image data in which these are combined. The Doppler image data is data showing fluid information about a fluid flowing in an ultrasonically scanned region.

Here, the image generation function 552 generally converts (scan-converts) a scanning line signal string of ultrasonic scanning into a scanning line signal string of a video format typified by a television or the like, and ultrasonic waves for display. Generate image data. Specifically, the image generation function 552 generates ultrasonic image data for display by performing coordinate conversion according to the scanning form of ultrasonic waves by the ultrasonic probe 2. Further, the image generation function 552 is used as various image processing other than scan conversion, for example, image processing (smoothing processing) for regenerating an average value image of brightness by using a plurality of image frames after scan conversion. Image processing (edge enhancement processing) using a differential filter in the image is performed. In addition, the image generation function 552 synthesizes character information, scales, body marks, and the like of various parameters with the ultrasonic image data.

That is, the B mode data and the Doppler data are ultrasonic image data before the scan conversion process, and the data generated by the image generation function 552 is the ultrasonic image data for display after the scan conversion process. The B-mode data and Doppler data are also referred to as raw data (Raw Data).

Further, the image generation function 552 generates three-dimensional B-mode image data by performing coordinate conversion on the three-dimensional B-mode data generated by the B-mode processing circuit 52. Further, the image generation function 552 generates three-dimensional Doppler image data by performing coordinate conversion on the three-dimensional Doppler data generated by the Doppler processing circuit 53. That is, the three-dimensional B-mode data and the three-dimensional Doppler data are the volume data before the scan conversion process, and the three-dimensional B-mode image data and the three-dimensional Doppler image data are the volume data after the scan conversion. ..

Further, the image generation function 552 can perform rendering processing on the volume data in order to generate various two-dimensional image data for displaying the volume data on the display 3. The rendering process performed by the image generation function 552 includes, for example, a process of performing a cross-section reconstruction method (MPR: Multi Planer Reconstruction) to generate MPR image data from volume data. Further, as the rendering process performed by the image generation function 552, there is a process of performing "Curved MPR" on the volume data and a process of performing "Maximum Intensity Projection" on the volume data. Further, as a rendering process performed by the image generation function 552, there is a volume rendering (VR) process for generating two-dimensional image data reflecting three-dimensional information.

The calculation function 553 calculates reference information when making settings related to the display of a three-dimensional rendered image. Specifically, the calculation function 553 calculates the luminance information at the designated position of the B mode image. The luminance information calculated by the calculation function 553 will be described in detail later.

The setting function 554 sets the brightness value at the time of displaying the rendered image according to the input operated on the GUI displayed by the control of the control function 551. Specifically, the setting function 554 sets a voxel luminance value (threshold value) that is a boundary to be displayed in the rendered image in each voxel luminance value in the volume data. The voxel luminance value set by the setting function 554 will be described in detail later.

The overall configuration of the ultrasonic diagnostic apparatus 1 according to the first embodiment has been described above. Under such a configuration, the ultrasonic diagnostic apparatus 1 according to the first embodiment makes it possible to improve the operability related to image display. As described above, in ultrasonic diagnosis, a two-dimensional B-mode image and a three-dimensional rendered image may be compared and displayed, and the diagnosis may be performed by observing these. Here, the voxel brightness value in the volume data is set based on the brightness information (for example, the maximum value) in the data (two-dimensional B mode image) constituting the volume data. That is, the voxel luminance value corresponds to the pixel luminance value in the two-dimensional B-mode image constituting the volume data.

Since the display of the rendered image depends on the setting of which voxel brightness value is displayed / hidden, the display state of the displayed rendered image changes depending on the setting of the voxel brightness value. That is, in the rendered image, which voxel of the voxels overlapping in the depth direction is displayed is determined by setting the voxel brightness value. Therefore, depending on the setting of this voxel luminance value, a dimensional difference may occur between the two-dimensional B mode image and the rendered image. For example, when a blood vessel is displayed as a two-dimensional B-mode image, the blood vessel diameter is a constant value, but when the image is reconstructed by rendering and displayed, the outer shape of the blood vessel depends on the setting of the voxel brightness value described above. May be buried and the blood vessel diameter may change.

Even in a two-dimensional B-mode image, the display changes depending on the gain adjustment, but the gain adjustment adjusts how bright each pixel brightness value is to be displayed, and which pixel value is used. It does not set whether to show or hide. Therefore, in adjusting the gain of the two-dimensional B-mode image, the operator can easily determine, for example, the blood vessel diameter by visual recognition.

As described above, in the three-dimensional rendered image, the dimensions in the displayed image change depending on the setting of the voxel luminance value, so that the operator needs to make this setting accurately. Normally, when this setting is made, the operator sets the voxel luminance value (threshold value) which is the boundary to be displayed in the rendered image while observing the B mode image and the rendered image.

For example, the operator first sets a cross section for setting in the volume data, and hides an area other than the set cross section. That is, the operator hides the area on one side surface of the set cross section and the area on the other side surface. Then, the operator displays the two-dimensional B-mode image and the rendered image of the set cross section, and sets the voxel brightness value (threshold) of the rendered image so as to match the dimensions in the two-dimensional B-mode image. .. For example, the operator sets a voxel brightness value (threshold value), measures the rendered image displayed at the set voxel brightness value (threshold value), and confirms that the dimensions match the dimensions in the two-dimensional B-mode image. Check if it is not. The operator performs measurement many times while changing the voxel brightness value (threshold value) to be set, and makes an accurate setting.

When this setting is completed, the operator redisplays the hidden area. As a result, the dimensions in the two-dimensional B-mode image and the dimensions in the three-dimensional rendered image are matched. As described above, it takes time and effort to display the three-dimensional rendered image. Therefore, in the ultrasonic diagnostic apparatus 1 according to the present embodiment, the operability in such an image display is improved, and the labor of the operator is reduced.

Hereinafter, the details of the processing in the ultrasonic diagnostic apparatus 1 will be described. In the ultrasonic diagnostic apparatus 1 according to the first embodiment, first, the calculation function 553 shows the relationship between the luminance information and the positional information based on the luminance information on the two-dimensional image constituting the three-dimensional image data. Calculate a histogram showing spectrum or luminance information. Specifically, the calculation function 553 acquires the luminance information of the position specified on the two-dimensional image, and shows the relationship between the acquired luminance information and the acquired position of the luminance information, or the acquired luminance. Calculate a histogram showing the information.

For example, when the volume data is collected and the operation for starting the setting of the voxel luminance value (threshold value) is received from the operator via the input interface 4, the control function 551 first calculates the spectrum or the histogram. Information for designating is displayed on the display 3. FIG. 2 is a diagram showing an example of display by the control function 551 according to the first embodiment. As shown in FIG. 2, for example, the control function 551 causes the display 3 to display a two-dimensional B-mode image and a three-dimensional rendered image corresponding to the collected volume data.

As an example, as shown in FIG. 2, the control function 551 causes the display 3 to display a B-mode image (image I1, image I2, image I3) having three orthogonal cross sections and a rendered image (image I4).

The operator executes an operation of designating a position with respect to the image displayed on the display 3. For example, the operator observes the B-mode image displayed on the display 3 and executes an operation of designating a position with respect to any of the B-mode images having three orthogonal cross sections. As an example, the operator specifies a position including a part to be measured in the B mode image.

The calculation function 553 acquires the luminance information of the position designated by the operator, and calculates the spectrum or the histogram using the acquired luminance information. FIG. 3 is a diagram for explaining the process by the calculation function 553 according to the first embodiment. Here, FIG. 3 shows a case where the calculation function 553 calculates the spectrum.

For example, as shown in the upper part of FIG. 3, when the position indicated by the arrow 61 is specified with respect to the B mode image, the calculation function 553 calculates the spectrum shown in the lower part of FIG. That is, the calculation function 553 calculates a spectrum showing the relationship between the pixel luminance value of the pixels included in the designated position (arrow 61) and the position (distance in FIG. 3).

When the spectrum is calculated by the calculation function 553, the control function 551 displays the calculated spectrum on the display 3. For example, in the control function 551, as shown in the lower part of FIG. 3, one axis (horizontal axis in FIG. 3) is set to "distance [%, mm]" and the other axis (vertical axis in FIG. 3) is set. The spectrum set as the "luminance value" is displayed on the display 3.

The operator sets the voxel luminance value (threshold value) by designating the luminance value for the spectrum displayed on the display 3. That is, the operator refers to the spectrum and determines which pixel luminance value the voxel luminance value corresponds to as the threshold value. As shown in FIG. 3, the spectrum shows the pixel luminance value for each position. The operator sets the voxel brightness value (threshold value) by designating the brightness value corresponding to the measurement position on the B mode image.

For example, in FIG. 3, the distance of the black portion at the position indicated by the arrow 61 is the measurement target. Therefore, the operator sets the pixel luminance value corresponding to the boundary between black and gray on one side of the arrow 61 and the boundary between black and gray on the other side in the spectrum calculated for the arrow 61.

The setting function 554 sets the luminance value by accepting the operation of specifying the luminance value for the spectrum or the histogram. That is, the setting function 554 sets the voxel brightness value corresponding to the pixel brightness value specified by the operation of specifying the brightness value for the spectrum or the histogram received from the operator as the threshold value.

The control function 551 changes the display of the rendered image generated from the three-dimensional image data based on the brightness value set by the setting function 554. FIG. 4 shows an example of a display controlled by the control function 551 according to the first embodiment. For example, as shown in FIG. 4, the control function 551 displays a B-mode image (upper left in the figure), a rendered image at the position of the B-mode image (upper right in the figure), and a spectrum (lower left in the figure) on the display 3. Display it. In the rendered image in FIG. 4, the areas on both sides other than the corresponding positions are hidden according to the positions of the B mode images.

Then, for example, as shown in the upper part of FIG. 4, when the luminance value “a” is specified for the spectrum, the control function 551 uses the voxel luminance value corresponding to the luminance value “a” as the threshold value for the rendered image. Is displayed. The operator sets the pixel luminance value by, for example, moving the line (dotted line in the figure) indicating the luminance value shown in the spectrum of FIG. 4 up and down. The pixel luminance value can be set not only by moving the line, but also by inputting a numerical value, specifying a position by a point, or specifying a position by a click operation.

For example, as shown in the lower part of FIG. 4, when the operator moves the dotted line to the position of the luminance value “b”, the control function 551 displays the voxel luminance value corresponding to the luminance value “b” as a threshold value. To change the rendered image. In this way, the ultrasonic diagnostic apparatus 1 according to the first embodiment displays the GUI for setting the voxel luminance value (threshold value), follows the designated operation for the GUI, and uses the threshold value corresponding to the designated operation. Display the rendered image. As a result, the operator can easily set the threshold value of the rendered image.

Here, the control function 551 can display various information. For example, the control function 551 can display a position corresponding to the indicated pixel luminance value on the ultrasonic image. Specifically, the control function 551 indicates a first position information indicating a position designated on the two-dimensional image and a second position indicating a position corresponding to the brightness value specified in the spectrum in the first position information. The position information of is displayed on the two-dimensional image, and the second position information is changed according to the operation of specifying the brightness value with respect to the spectrum.

FIG. 5 is a diagram showing an example of a display controlled by the control function 551 according to the first embodiment. For example, the control function 551 displays the spectrum at the position specified by the arrow 61, as shown in the upper part of FIG. After that, as shown in the lower part of FIG. 5, when the luminance value "b" is specified by the operator, the rendered image is changed to the rendered image with the voxel luminance value corresponding to the luminance value "b" as the threshold value.

Here, as shown in the lower part of FIG. 5, the control function 551 first uses the arrow 61 for designating the position on the ultrasonic image and the position corresponding to the designated pixel luminance value “b”. The arrow 62 indicating the above is displayed on the ultrasonic image so as to be distinguishable. That is, the control function 551 displays on the ultrasonic image an arrow 62 connecting each position on the ultrasonic image corresponding to the two intersections of the spectrum and the dotted line indicating the luminance value “b”. As a result, the operator can confirm at a glance which position on the ultrasonic image the luminance value specified on the spectrum corresponds to, and the luminance value can be easily specified.

As shown in FIG. 5, the control function 551 can display the arrow 61 and the arrow 62 at the same time, but controls so that only one of them is displayed according to the switching operation by the operator. be able to.

Further, the control function 551 can further display the distance information measured at the position corresponding to the designated luminance value. For example, the control function 551 can display the distance information indicating the distance of the arrow 62 shown in FIG. 5 on the display 3, as shown in the lower right portion of FIG.

Further, the control function 551 can also display the corresponding position in the spectrum or the ultrasonic image when the position is specified in the other. Specifically, when the designated operation is received for one of the two-dimensional image and the spectrum, the control function 551 displays the other position corresponding to the position where the designated operation is received in an identifiable manner.

FIG. 6 is a diagram showing an example of a display controlled by the control function 551 according to the first embodiment. For example, the control function 551 displays the spectrum at the position specified by the arrow 61, as shown in the upper part of FIG. After that, as shown in the lower part of FIG. 6, when the point 63 is designated on the spectrum by the operator, the point 64 indicating the position on the ultrasonic image corresponding to the point 63 is displayed. As a result, the operator can confirm the brightness value for each position on the ultrasonic image, and can specify the brightness value more accurately.

Although the case where the point is designated with respect to the spectrum has been described with reference to FIG. 6, the embodiment is not limited to this, and the case where the point is designated with respect to the ultrasonic image may be used. That is, when the operator places a point on the ultrasonic image, the control function 551 displays a point indicating a position on the spectrum corresponding to the placed point.

The control function 551 can also display an image based on a position designated on the ultrasonic image. Specifically, the control function 551 causes the display 3 to display a cross-sectional image corresponding to a position designated on the two-dimensional image. FIG. 7 is a diagram showing an example of a display controlled by the control function 551 according to the first embodiment. Here, in FIG. 7, the B mode image is shown on the upper left, the rendered image is shown on the upper right, the spectrum is shown on the lower left, and the image based on the position specified on the ultrasonic image is shown on the lower right.

For example, the control function 551 displays an oblique cross section showing a cross section parallel to the arrow 61, as shown in the lower right of FIG. In such a case, the image generation function 552 specifies the position of the arrow 61 designated on the B-mode image in the volume data. Then, the image generation function 552 generates an oblique cross-sectional image based on the specified position. The control function 551 displays the generated oblique cross-sectional image on the display 3.

Here, the control function 551 can display a position corresponding to a position designated on the two-dimensional image on the cross-sectional image. For example, the control function 551 causes an arrow 61 to be displayed on the oblique cross-sectional image as shown in the lower right of FIG.

As described above, the ultrasonic diagnostic apparatus 1 according to the first embodiment displays a spectrum showing a pixel luminance value at a position specified on a two-dimensional B-mode image, and a pixel luminance value with respect to the displayed spectrum. By accepting the specified operation of, the voxel brightness value of the rendered image is set.

Here, in the above-described embodiment, a case where a spectrum showing a pixel luminance value at a designated position on a two-dimensional B-mode image is displayed has been described. Hereinafter, a case where a histogram showing the pixel luminance value of the designated position on the two-dimensional B-mode image is displayed will be described.

In such a case, the calculation function 553 acquires the pixel luminance value of the position designated on the B mode image and generates a histogram showing the frequency distribution of the acquired pixel luminance value. Then, the control function 551 displays the generated histogram on the display 3.

FIG. 8 is a diagram showing an example of a display controlled by the control function 551 according to the first embodiment. For example, as shown in the upper part of FIG. 8, when the position indicated by the arrow 61 is specified with respect to the B mode image, the calculation function 553 calculates the histogram shown in the lower part of FIG. That is, the calculation function 553 calculates a histogram showing the frequency distribution of the pixel luminance values of the pixels included in the designated position (arrow 61).

When the histogram is calculated by the calculation function 553, the control function 551 displays the calculated histogram on the display 3. For example, in the control function 551, as shown in the lower part of FIG. 8, one axis (horizontal axis in FIG. 8) is defined as “luminance value” and the other axis (vertical axis in FIG. 8) is defined as “frequency”. The histogram is displayed on the display 3.

The operator sets the voxel brightness value (threshold value) by designating the brightness value for the histogram displayed on the display 3. That is, the operator refers to the histogram and determines which pixel brightness value corresponds to the voxel brightness value to be used as the threshold value. As shown in FIG. 8, when the position (arrow 61) is specified so as to include the part to be measured, the pixel corresponding to the arrow 61 is the pixel corresponding to the part to be measured (black in FIG. 8). Pixels) and pixels (gray pixels in FIG. 8) corresponding to parts that are not measurement targets are included.

Therefore, the histogram at this position frequently includes the pixel luminance value corresponding to the portion to be measured and the pixel luminance value corresponding to the portion not to be measured. For example, at the position indicated by the arrow 61 in FIG. 8, a histogram is obtained in which black pixels having a low luminance value and gray pixels having a high luminance value are frequently included. Here, for example, as shown in the B mode image of FIG. 8, when the pixel luminance value of the portion of the arrow 61 that is not the measurement target on one side and the portion that is not the measurement target on the other side are different, the histogram is shown in FIG. As shown in, two peaks are shown on the high luminance side.

Then, the operator sets the voxel brightness value (threshold value) by designating the brightness value corresponding to the measurement position on the B mode image with reference to the histogram. For example, as shown in FIG. 8, the operator specifies a pixel luminance value near the rising edge of the peak on the high luminance side. Here, as shown in FIG. 8, when the histogram contains two peaks, the operator can see the pixel brightness value near the rising edge of the peak on the lower brightness value side so that the boundaries on both sides are drawn in the rendered image. To specify. If a pixel brightness value near the rising edge of the peak on the higher brightness value side is specified, the voxel brightness value corresponding to the pixel brightness value lower than the specified pixel brightness value is hidden, so that the rendered image is displayed. The corresponding part will not be displayed.

When the designation operation for the histogram is executed in this way, the setting function 554 accepts the designation operation for the luminance value for the histogram and sets the voxel luminance value (threshold value).

Next, the process of the ultrasonic diagnostic apparatus 1 according to the first embodiment will be described with reference to FIG. FIG. 9 is a flowchart for explaining a procedure for processing the ultrasonic diagnostic apparatus 1 according to the first embodiment. Note that FIG. 9 shows a processing procedure when displaying the spectrum.

Here, steps S101 to S103 shown in FIG. 4 are steps in which the processing circuit 55 reads a program corresponding to the control function 551 from the memory 54 and executes the program. Further, step S104 is a step in which the processing circuit 55 reads a program corresponding to the control function 551 and the calculation function 553 from the memory 54 and executes the program. Steps S105 to S107 are steps in which the processing circuit 55 reads a program corresponding to the control function 551 and the setting function 554 from the memory 54 and executes the program.

In the ultrasonic diagnostic apparatus 1 according to the first embodiment, the processing circuit 55 collects volume data (step S101) and displays a B-mode image (step S102). Then, the processing circuit 55 determines whether or not the position is specified with respect to the B mode image to be displayed (step S103).

Here, when the position is specified (step S103 affirmative), the processing circuit 55 displays the spectrum of the specified position (step S104) and determines whether or not the designated operation for the spectrum has been accepted (step). S105). The processing circuit 55 is in a standby state (denial in step S103) until the position is specified in the B mode image.

When the designated operation is accepted in the determination in step S105 (affirmation in step S105), the processing circuit 55 causes the display 3 to display the rendered image corresponding to the designated luminance value (step S106). The processing circuit 55 is in a standby state (denial in step S105) until the designated operation is executed for the spectrum.

Then, the processing circuit 55 determines whether or not the operation of changing the pixel luminance value with respect to the spectrum has been accepted (step S107). Here, when the change operation is accepted (affirmation in step S107), the processing circuit 55 returns to step S106 and continues the processing. On the other hand, when the change operation is not accepted (denial in step S107), the processing circuit 55 ends the process of setting the voxel luminance value (threshold value).

As described above, according to the first embodiment, the control function 551 acquires the three-dimensional image data collected by transmitting and receiving ultrasonic waves to the subject. The calculation function 553 calculates a spectrum showing the relationship between the brightness information and the position information or a histogram showing the brightness information based on the brightness information on the two-dimensional image constituting the three-dimensional image data. The setting function 554 sets the luminance value by accepting the operation of specifying the luminance value for the spectrum or the histogram. The control function 551 changes the display of the rendered image generated from the three-dimensional image data based on the brightness value set by the setting function 554. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment can easily set a threshold value for displaying a rendered image, and can improve operability related to image display.

For example, when the ultrasonic diagnostic apparatus 1 according to the present embodiment is used, the operator presses the switch of the function equipped with the algorithm of the present application after collecting the volume data. Then, the operator displays, for example, a B-mode image to be a target for measurement or the like, and specifies a target position (range). After that, the operator specifies the pixel brightness value for the spectrum or histogram displayed on the ultrasonic diagnostic apparatus 1, so that the dimensions in the two-dimensional B-mode image and the dimensions in the three-dimensional rendered image match. Expression will be performed.

As described above, by using the ultrasonic diagnostic apparatus 1 according to the present embodiment, the operability related to the display of the rendered image can be improved. As a result, the ultrasonic diagnostic apparatus 1 can improve the diagnostic efficiency.

Further, according to the first embodiment, the calculation function 553 acquires the luminance information of the position designated on the two-dimensional image, and the spectrum showing the relationship between the acquired luminance information and the acquired position of the luminance information. Or, a histogram showing the acquired luminance information is calculated. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment can set the threshold value using the pixel luminance value at the position desired by the operator, and enables accurate setting.

Further, according to the first embodiment, the calculation function 553 calculates the spectrum based on the luminance information of the position designated on the two-dimensional image. The setting function 554 sets the luminance value by accepting the operation of specifying the luminance value for the spectrum. The control function 551 provides the first position information indicating the position specified on the two-dimensional image and the second position information indicating the position corresponding to the brightness value specified in the spectrum in the first position information. It is displayed on a two-dimensional image, and the second position information is changed according to the operation of specifying the brightness value with respect to the spectrum. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment can make settings while confirming the second position information, and makes it possible to make more accurate settings.

Further, according to the first embodiment, when the designated operation is received for one of the two-dimensional image and the spectrum, the control function 551 can identify the other position corresponding to the position where the designated operation is received. To display. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment can more accurately grasp the corresponding positional relationship between the spectrum and the B-mode image, and makes it possible to make more accurate settings.

Further, according to the first embodiment, the control function 551 displays the distance information of the position indicated by the second position information. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment makes it possible to confirm the success or failure of the designation of the target position. For example, a distance different from the expected distance may be displayed when an erroneous position is specified in the position specification on the B mode image. Based on this distance information, the operator can execute the subsequent operation after confirming that there is no error in the position specified by himself / herself on the B mode image.

Further, according to the first embodiment, the control function 551 causes the display 3 to display a cross-sectional image corresponding to a position designated on the two-dimensional image. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment makes it possible to confirm the position specified on the B-mode image on the cross-sectional image.

Further, according to the first embodiment, the control function 551 causes the position corresponding to the position designated on the two-dimensional image to be displayed on the cross-sectional image. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment makes it possible to accurately grasp the correspondence between the position on the B mode image and the position on the cross-sectional image.

Further, according to the first embodiment, the control function 551 changes the display of the rendered image in accordance with the acceptance of the operation of specifying the luminance value with respect to the spectrum or the histogram. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment makes it possible to provide a GUI with high operability.

Further, according to the first embodiment, the control function 551 causes the display unit to display at least one of a two-dimensional image, a spectrum or a histogram, and a rendered image. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment makes it possible to provide a GUI with high operability.

Further, according to the first embodiment, the setting function 554 accepts an operation of designating a luminance value for a spectrum or a histogram by an input operation including a numerical input, a line input, and a click operation. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment can set the threshold value by various operations, and makes it possible to further improve the operability.

(Other embodiments)
By the way, although the first embodiment has been described so far, it may be implemented in various different forms other than the above-mentioned first embodiment.

In the above-described embodiment, the case where the designation operation is directly performed on the spectrum or the histogram has been described. However, the embodiment is not limited to this, and for example, a designation operation for the spectrum may be indirectly executed by designating the B mode image.

As described above, the B-mode image and the spectrum have a positional relationship, and when a position is specified for one, it is reflected for the other. Therefore, the operator displays the spectrum by designating the position (measurement target) for the B-mode image, and then further specifies the position on the B-mode image, and the position corresponding to the designated position. Is displayed on the spectrum to execute the specified operation for the spectrum. It should be noted that the above-mentioned designation for the image can be performed not only for the B mode image but also for the oblique cross-sectional image.

Further, in the above-described embodiment, the case where either the spectrum or the histogram is displayed has been described. However, the embodiment is not limited to this, and both may be displayed.

Further, in the above-described embodiment, the case where the ultrasonic diagnostic apparatus 1 executes various processes has been described. However, the embodiment is not limited to this, and may be implemented by, for example, a medical information processing device. FIG. 10 is a block diagram showing an example of the configuration of the medical information processing apparatus 100 according to another embodiment. As shown in FIG. 10, the medical information processing apparatus 100 includes a communication interface 11, a storage circuit 12, an input interface 13, a display 14, and a processing circuit 15. The medical information processing device 100 is, for example, an information processing device such as a tablet terminal or a workstation.

The communication interface 11 is connected to the processing circuit 15 and transmits various data to and from a medical image diagnostic device (for example, ultrasonic diagnostic device 1 or the like) connected via a network, an image storage device, or the like. Control communication. For example, the communication interface 11 is realized by a network card, a network adapter, a NIC (Network Interface Controller), or the like.

The storage circuit 12 is connected to the processing circuit 15 and stores various data. For example, the storage circuit 12 is realized by a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, a hard disk, an optical disk, or the like. In the present embodiment, the storage circuit 12 stores the medical image received from the medical image diagnostic apparatus. For example, the storage circuit 12 stores an ultrasonic image or the like. Further, the storage circuit 12 stores various information used for the processing of the processing circuit 15, the processing result of the processing circuit 15, and the like.

The input interface 13 includes a trackball for making various settings, a switch button, a mouse, a keyboard, a touch pad for performing input operations by touching the operation surface, and a touch monitor in which a display screen and a touch pad are integrated. It is realized by a non-contact input circuit using an optical sensor, a voice input circuit, and the like.

The input interface 13 is connected to the processing circuit 35, converts the input operation received from the operator into an electric signal, and outputs the input operation to the processing circuit 15. In the present specification, the input interface 13 is not limited to the one provided with physical operating parts such as a mouse and a keyboard. For example, an example of an input interface includes a processing circuit that receives an electric signal corresponding to an input operation from an external input device provided separately from the device and outputs the electric signal to a control circuit.

The display 14 is connected to the processing circuit 15 and displays various information and various images output from the processing circuit 15. For example, the display 14 is realized by a liquid crystal monitor, a CRT (Cathode Ray Tube) monitor, a touch monitor, or the like. For example, the display 14 displays a GUI for receiving an operator's instruction, various images, and various processing results by the processing circuit 15.

The processing circuit 15 controls each component of the medical information processing apparatus 100 in response to an input operation received from the operator via the input interface 13. For example, the processing circuit 15 is realized by a processor. In the present embodiment, the processing circuit 15 stores the medical image output from the communication interface 11 in the storage circuit 12. Further, the processing circuit 15 reads a medical image from the storage circuit 12, executes processing on the read medical image, and displays it on the display 14.

As shown in FIG. 10, the processing circuit 15 executes, for example, a control function 151, an image generation function 152, a calculation function 153, and a setting function 154. Here, for example, each processing function executed by the control function 151, the image generation function 152, the calculation function 153, and the setting function 154, which are the components of the processing circuit 15 shown in FIG. 10, is in the form of a program that can be executed by a computer. It is recorded in the storage circuit 12. The processing circuit 15 is, for example, a processor, and realizes a function corresponding to each read program by reading and executing each program from the storage circuit 12. In other words, the processing circuit 15 in the state where each program is read has each function shown in the processing circuit 15 of FIG.

The control function 151 controls the entire medical information processing apparatus 100. Further, the control function 151 executes the same processing as the above-mentioned control function 551 with respect to the voxel luminance value (threshold value). The image generation function 152 executes the same processing as the image generation function 552 described above with respect to the voxel brightness value (threshold value). The calculation function 153 executes the same processing as the above-mentioned calculation function 553 with respect to the voxel luminance value (threshold value). The setting function 154 executes the same processing as the setting function 554 described above with respect to the voxel brightness value (threshold value).

In the above-described embodiment, an example in which each processing function is realized by a single processing circuit (processing circuit 55 and processing circuit 15) has been described, but the embodiment is not limited to this. For example, the processing circuit 55 (and the processing circuit 15) may be configured by combining a plurality of independent processors, and each processor may execute each program to realize each processing function. Further, each processing function of the processing circuit 55 (and the processing circuit 15) may be appropriately distributed or integrated into a single or a plurality of processing circuits.

The word "processor" used in the above description is, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an integrated circuit for a specific application (Application Specific Integrated Circuit: ASIC), or a programmable logic device (ASIC). For example, it means a circuit such as a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA). The processor realizes the function by reading and executing the program stored in the memory. Instead of storing the program in the memory, the program may be directly embedded in the circuit of the processor. In this case, the processor realizes the function by reading and executing the program embedded in the circuit. It should be noted that each processor of the present embodiment is not limited to the case where each processor is configured as a single circuit, and a plurality of independent circuits may be combined to form one processor to realize its function. good.

It should be noted that each component of each device shown in the description of the above-described embodiment is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of the device is functionally or physically dispersed / physically distributed in arbitrary units according to various loads and usage conditions. Can be integrated and configured. Further, each processing function performed by each device may be realized by a CPU and a program analyzed and executed by the CPU, or may be realized as hardware by wired logic.

Further, the processing method described in the above-described embodiment can be realized by executing a processing program prepared in advance on a computer such as a personal computer or a workstation. This processing program can be distributed via a network such as the Internet. Further, this processing program is recorded on a computer-readable non-temporary recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, an MO, a DVD, a USB memory, and a flash memory such as an SD card memory. It can also be performed by being read from a non-temporary recording medium by a computer.

As described above, according to the embodiment, it is possible to improve the operability related to the image display.

Although some embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other embodiments, and various omissions, replacements, changes, and combinations of embodiments can be made without departing from the gist of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, as well as in the scope of the invention described in the claims and the equivalent scope thereof.

1 Ultrasonic diagnostic device 15, 55 Processing circuit 151, 551 Control function 152, 552 Image generation function 153, 535 Calculation function 154, 554 Setting function

Claims (10)

An acquisition unit that acquires 3D image data collected by transmitting and receiving ultrasonic waves to the subject,
A calculation unit that calculates a spectrum showing the relationship between the brightness information and the position information or a histogram showing the brightness information based on the brightness information on the two-dimensional image constituting the three-dimensional image data.
A setting unit that sets the luminance value by accepting the operation of specifying the luminance value for the spectrum or the histogram.
A display control unit that changes the display of the rendered image generated from the three-dimensional image data based on the brightness value set by the setting unit.
A medical information processing device equipped with. The calculation unit acquires the luminance information of the position specified on the two-dimensional image, and a spectrum showing the relationship between the acquired luminance information and the acquired position of the luminance information, or a histogram showing the acquired luminance information. The medical information processing apparatus according to claim 1, wherein the information processing apparatus is calculated. The calculation unit calculates the spectrum based on the luminance information of the position specified on the two-dimensional image.
The setting unit sets the luminance value by accepting the operation of specifying the luminance value for the spectrum.
The display control unit has a first position information indicating a position designated on the two-dimensional image and a second position indicating a position corresponding to a brightness value specified in the spectrum in the first position information. The medical information processing apparatus according to claim 2, wherein the position information is displayed on the two-dimensional image, and the second position information is changed according to an operation of designating a brightness value with respect to the spectrum. 2. The display control unit identifiablely displays the other position corresponding to the position where the designated operation is received when the designated operation is received for one of the two-dimensional image and the spectrum. Or the medical information processing apparatus according to 3. The medical information processing device according to claim 3, wherein the display control unit displays distance information of the position indicated by the second position information. The medical information processing device according to any one of claims 2 to 5, wherein the display control unit displays a cross-sectional image corresponding to a position designated on the two-dimensional image on the display unit. The medical information processing device according to claim 6, wherein the display control unit displays a position corresponding to a position designated on the two-dimensional image on the cross-sectional image. The medical information processing according to any one of claims 1 to 7, wherein the display control unit displays at least one of the two-dimensional image, the spectrum or the histogram, and the rendered image on the display unit. Device. The medical information processing apparatus according to any one of claims 1 to 8, wherein the display control unit changes the display of the rendered image in accordance with acceptance of an operation for designating a luminance value with respect to the spectrum or the histogram. .. The medical information processing apparatus according to any one of claims 1 to 9, wherein the setting unit accepts an operation of designating a luminance value for the spectrum or the histogram by an input operation including a numerical input, a line input, and a click operation. ..

Images