JP7387482B2 - Medical information processing equipment - Google Patents

Description

Embodiments disclosed in this specification and the like relate to a medical information processing device.

Conventionally, ultrasound diagnosis is performed by a technician or doctor operating an ultrasound probe on the body surface of a subject to obtain information on tissue structure, blood flow, etc. inside the human body. For example, a technician or doctor scans the inside of the subject with ultrasound by operating an ultrasound probe that transmits and receives ultrasound on the body surface, depending on the diagnosis site and diagnosis content, and uses ultrasound to show the tissue structure. Images and ultrasound images showing information such as blood flow are collected. In such ultrasonic diagnosis, diagnosis may be performed by observing a two-dimensional B-mode image and a three-dimensional rendered image.

Japanese Patent Application Publication No. 2013-176552 Japanese Patent Application Publication No. 2008-142327

One of the problems that the embodiments disclosed in this specification and the like aim to solve is to improve the operability related to image display. However, the problems solved by the embodiments disclosed in this specification and the like are not limited to the above problems. Problems corresponding to the effects of each configuration shown in the embodiments described later can also be positioned as other problems to be solved by the embodiments disclosed in this specification and the like.

The medical information processing device of the embodiment includes an acquisition section, a calculation section, a setting section, and a display control section. The acquisition unit acquires three-dimensional image data collected by transmitting and receiving ultrasound waves to and from the subject. The calculation unit calculates a spectrum representing a relationship between the brightness information and position information or a histogram representing the brightness information, based on brightness information on a two-dimensional image constituting the three-dimensional image data. The setting unit sets a brightness value by accepting an operation for specifying a brightness value for the spectrum or the histogram. The display control section changes the display of the rendered image generated from the three-dimensional image data based on the brightness value set by the setting section.

FIG. 1 is a block diagram showing an example of the configuration of an ultrasound diagnostic apparatus according to the first embodiment. FIG. 2 is a diagram showing an example of a display by the control function according to the first embodiment. FIG. 3 is a diagram for explaining processing by the calculation function according to the first embodiment. FIG. 4 is a diagram showing an example of a display controlled by the control function according to the first embodiment. FIG. 5 is a diagram showing an example of a display controlled by the control function according to the first embodiment. FIG. 6 is a diagram illustrating an example of a display controlled by the control function according to the first embodiment. FIG. 7 is a diagram showing an example of a display controlled by the control function according to the first embodiment. FIG. 8 is a diagram showing an example of a display controlled by the control function according to the first embodiment. FIG. 9 is a flowchart for explaining the processing procedure of the ultrasonic diagnostic apparatus according to the third embodiment. FIG. 10 is a block diagram illustrating an example of the configuration of a medical information processing apparatus according to another embodiment.

DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments of a medical information processing apparatus according to the present application will be described in detail with reference to the accompanying drawings. Note that the medical information processing apparatus according to the present application is not limited to the embodiments described below. Furthermore, in the following description, similar components are given common reference numerals, and redundant description will be omitted.

(First embodiment)
The medical information processing apparatus according to the present application may be realized by a computer such as a workstation, or may be realized by being incorporated into an ultrasound diagnostic apparatus. In the first embodiment, an ultrasonic diagnostic apparatus to which the medical information processing apparatus of the present application is applied will be described as an example. FIG. 1 is a block diagram showing an example of the configuration of an ultrasound diagnostic apparatus 1 according to the first embodiment. As shown in FIG. 1, an ultrasonic diagnostic apparatus 1 according to the present embodiment includes an ultrasonic probe 2, a display 3, an input interface 4, and an apparatus main body 5. and an input interface 4 are communicably connected to the device main body 5.

The ultrasonic probe 2 is connected to a transmitting/receiving circuit 51 included in the main body 5 of the apparatus. The ultrasonic probe 2 has, for example, a plurality of piezoelectric vibrators in the probe body, and these piezoelectric vibrators generate ultrasonic waves based on drive signals supplied from the transmitting/receiving circuit 51. Further, the ultrasound probe 2 receives reflected waves from the subject P and converts them into electrical signals. Further, the ultrasonic probe 2 includes, in the probe body, a matching layer provided on the piezoelectric vibrator and a backing material that prevents propagation of ultrasonic waves backward from the piezoelectric vibrator. Note that the ultrasonic probe 2 is detachably connected to the device main body 5. For example, the ultrasound probe 2 is a sector-type, linear-type, or convex-type ultrasound probe.

When ultrasonic waves are transmitted from the ultrasonic probe 2 to the subject P, the transmitted ultrasonic waves are successively reflected by discontinuous surfaces of acoustic impedance in the body tissues of the subject P, and are transmitted to the ultrasound probe as reflected wave signals. 2 is received by a plurality of piezoelectric vibrators included in the device. The amplitude of the received reflected wave signal depends on the difference in acoustic impedance at the discontinuity surface from which the ultrasound wave is reflected. Note that when a transmitted ultrasound pulse is reflected from a moving bloodstream or a surface such as a heart wall, the reflected wave signal depends on the velocity component of the moving object in the ultrasound transmission direction due to the Doppler effect. and undergo a frequency shift.

Here, the ultrasound probe 2 according to this embodiment is an ultrasound probe that can scan a subject in three dimensions. Note that this embodiment describes an ultrasonic probe 2 that mechanically swings a plurality of piezoelectric transducers of a one-dimensional ultrasonic probe, and a two-dimensional ultrasonic probe in which a plurality of piezoelectric transducers are two-dimensionally arranged in a grid pattern. The present invention is applicable even when a subject is scanned in three dimensions using the ultrasonic probe 2 .

The display 3 displays a GUI (Graphical User Interface) for the operator of the ultrasound diagnostic device 1 to input various setting requests using the input interface 4, and displays ultrasound images generated in the device body 5. display it. Further, the display 3 displays various messages and display information in order to notify the operator of the processing status and processing results of the apparatus main body 5. The display 3 also has a speaker and can output audio. For example, the display 3 displays a GUI for making settings for displaying rendered images. Note that this GUI will be detailed later.

The input interface 4 includes a trackball, a switch button, a mouse, a keyboard for performing various settings, a touchpad for performing input operations by touching the operation surface, a touch monitor in which the display screen and the touchpad are integrated, This is realized by a non-contact input circuit using an optical sensor, a voice input circuit, etc. The input interface 4 is connected to a processing circuit 55 to be described later, converts an input operation received from an operator into an electrical signal, and outputs the electrical signal to the processing circuit 55. Note that in this specification, the input interface 4 is not limited to one that includes physical operation parts such as a mouse and a keyboard. For example, an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs this electrical signal to the processing circuit 55 is also included in the input interface example.

The device main body 5 includes a transmitting/receiving circuit 51, a B-mode processing circuit 52, a Doppler processing circuit 53, a memory 54, and a processing circuit 55. In the ultrasonic diagnostic apparatus 1 shown in FIG. 1, each processing function is stored in the memory 54 in the form of a computer-executable program. The transmitting/receiving circuit 51, the B-mode processing circuit 52, the Doppler processing circuit 53, and the processing circuit 55 are processors that read programs from the memory 54 and execute them to implement functions corresponding to each program. In other words, each circuit in a state where each program is read has a function corresponding to the read program.

The transmission/reception circuit 51 includes a pulse generator, a transmission delay circuit, a pulser, etc., and supplies a drive signal to the ultrasound probe 2. The pulse generator repeatedly generates rate pulses to form transmitted ultrasound waves at a predetermined rate frequency. In addition, in the transmission delay circuit, a pulse generator generates a delay time for each piezoelectric vibrator necessary for focusing the ultrasound generated from the ultrasound probe 2 into a beam shape and determining the transmission directivity. Give for each rate pulse. Further, the pulser applies a drive signal (drive pulse) to the ultrasound probe 2 at a timing based on the rate pulse. That is, the transmission delay circuit arbitrarily adjusts the transmission direction of the ultrasonic waves transmitted from the piezoelectric vibrator surface by changing the delay time given to each rate pulse.

Note that the transmitting/receiving circuit 51 has a function that can instantly change the transmitting frequency, transmitting drive voltage, etc. in order to execute a predetermined scan sequence based on instructions from a processing circuit 55, which will be described later. In particular, changing the transmission drive voltage is realized by a linear amplifier-type oscillation circuit that can instantly switch its value, or by a mechanism that electrically switches multiple power supply units.

The transmitting/receiving circuit 51 includes a preamplifier, an A/D (Analog/Digital) converter, a receiving delay circuit, an adder, etc., and performs various processing on the reflected wave signal received by the ultrasound probe 2 to reflect the reflected wave signal. Generate wave data. The preamplifier amplifies the reflected wave signal for each channel. The A/D converter performs A/D conversion on the amplified reflected wave signal. The reception delay circuit provides the delay time necessary to determine the reception directivity. The adder performs addition processing of the reflected wave signals processed by the reception delay circuit to generate reflected wave data. By the addition process of the adder, the reflected component from the direction corresponding to the receiving directivity of the reflected wave signal is emphasized, and a comprehensive beam of ultrasonic transmission and reception is formed by the receiving directivity and the transmitting directivity.

The B-mode processing circuit 52 receives reflected wave data from the transmitting/receiving circuit 51, performs logarithmic amplification, envelope detection processing, etc., and generates data (B-mode data) in which signal strength is expressed by brightness of luminance. .

The Doppler processing circuit 53 performs frequency analysis on velocity information from the reflected wave data received from the transmitting/receiving circuit 51, extracts blood flow, tissue, and contrast agent echo components due to the Doppler effect, and extracts moving body information such as velocity, dispersion, and power. Generate data extracted from multiple points (Doppler data). For example, the moving body is a fluid such as blood flowing in a blood vessel or lymph fluid flowing in a lymphatic vessel.

Note that the B-mode processing circuit 52 and the Doppler processing circuit 53 are capable of processing both two-dimensional reflected wave data and three-dimensional reflected wave data. That is, the B-mode processing circuit 52 generates two-dimensional B-mode data from two-dimensional reflected wave data, and generates three-dimensional B-mode data from three-dimensional reflected wave data. Further, the Doppler processing circuit 53 generates two-dimensional Doppler data from two-dimensional reflected wave data, and generates three-dimensional Doppler data from three-dimensional reflected wave data. The three-dimensional B-mode data is data to which a luminance value is assigned according to the reflection intensity of the reflection source located at each of a plurality of points (sample points) set on each scanning line in the three-dimensional scanning range. In addition, in 3D Doppler data, a brightness value is assigned to each of multiple points (sample points) set on each scanning line in the 3D scanning range according to the value of blood flow information (velocity, dispersion, power). The data will be

The memory 54 stores image data for display generated by the processing circuit 55. Further, the memory 54 can also store data generated by the B-mode processing circuit 52 and the Doppler processing circuit 53. The memory 54 also stores various data such as control programs for transmitting and receiving ultrasound waves, image processing, and display processing, diagnostic information (e.g., patient ID, doctor's findings, etc.), diagnostic protocols, and various body marks. do.

The processing circuit 55 controls the entire processing of the ultrasound diagnostic apparatus 1. Specifically, the processing circuit 55 performs various processes by reading out and executing programs corresponding to the control function 551, image generation function 552, calculation function 553, and setting function 554 shown in FIG. 1 from the memory 54. . Here, the control function 551 is an example of an acquisition unit and a display control unit. Further, the calculation function 553 is an example of a calculation unit. Furthermore, the setting function 554 is an example of a setting section.

For example, the control function 551 controls the transmission/reception circuit 51, the B-mode processing circuit 52, and the Controls the processing of the processing circuit 53. The control function 551 also controls the display 3 to display ultrasonic image data for display (hereinafter also referred to as an ultrasonic image) stored in the memory 54 . Further, the control function 551 controls the display 3 to display the processing results. The control function 551 also causes the display 3 to display a GUI for making settings for displaying a rendered image, which will be described in detail later.

The image generation function 552 generates ultrasound image data from the data generated by the B-mode processing circuit 52 and the Doppler processing circuit 53. That is, the image generation function 552 generates B-mode image data in which the intensity of the reflected wave is expressed by luminance from the two-dimensional B-mode data generated by the B-mode processing circuit 52. The B-mode image data is data depicting the tissue shape within the area scanned by the ultrasound. Further, the image generation function 552 generates Doppler image data representing moving body information from the two-dimensional Doppler data generated by the Doppler processing circuit 53. The Doppler image data is velocity image data, dispersion image data, power image data, or image data that is a combination of these. The Doppler image data is data indicating fluid information regarding the fluid flowing within the region scanned by the ultrasound.

Here, the image generation function 552 generally converts (scan convert) a scanning line signal sequence of ultrasonic scanning into a scanning line signal sequence of a video format typified by television etc. Generate image data. Specifically, the image generation function 552 generates ultrasound image data for display by performing coordinate transformation according to the scanning form of ultrasound by the ultrasound probe 2. In addition to scan conversion, the image generation function 552 performs various image processing, such as image processing (smoothing processing) that regenerates an average luminance image using a plurality of image frames after scan conversion; Performs image processing (edge enhancement processing), etc. using a differential filter within the image. Furthermore, the image generation function 552 combines text information of various parameters, scales, body marks, etc. with the ultrasound image data.

That is, the B-mode data and Doppler data are ultrasound image data before scan conversion processing, and the data generated by the image generation function 552 is ultrasound image data for display after scan conversion processing. Note that B-mode data and Doppler data are also called raw data.

Furthermore, the image generation function 552 generates three-dimensional B-mode image data by performing coordinate transformation on the three-dimensional B-mode data generated by the B-mode processing circuit 52. Further, the image generation function 552 generates three-dimensional Doppler image data by performing coordinate transformation on the three-dimensional Doppler data generated by the Doppler processing circuit 53. That is, the three-dimensional B-mode data and three-dimensional Doppler data are volume data before scan conversion processing, and the three-dimensional B-mode image data and three-dimensional Doppler image data are volume data after scan conversion. .

Further, the image generation function 552 can perform rendering processing on the volume data in order to generate various types of two-dimensional image data for displaying the volume data on the display 3. The rendering process performed by the image generation function 552 includes, for example, a process of performing Multi Planer Reconstruction (MPR) to generate MPR image data from volume data. Furthermore, the rendering processing performed by the image generation function 552 includes a process of performing "Curved MPR" on volume data and a process of performing "Maximum Intensity Projection" on volume data. Furthermore, the rendering processing performed by the image generation function 552 includes volume rendering (VR) processing that generates two-dimensional image data that reflects three-dimensional information.

The calculation function 553 calculates reference information when performing settings regarding display of a three-dimensional rendered image. Specifically, the calculation function 553 calculates brightness information at a designated position of the B-mode image. Note that the brightness information calculated by the calculation function 553 will be described in detail later.

The setting function 554 sets a brightness value when displaying a rendered image in accordance with an input operated on the GUI displayed under the control of the control function 551. Specifically, the setting function 554 sets a voxel brightness value (threshold value) that becomes a boundary to be displayed in a rendered image for each voxel brightness value in the volume data. Note that the voxel brightness values set by the setting function 554 will be described in detail later.

The overall configuration of the ultrasound diagnostic apparatus 1 according to the first embodiment has been described above. With this configuration, the ultrasonic diagnostic apparatus 1 according to the first embodiment makes it possible to improve the operability related to image display. As described above, in ultrasonic diagnosis, a two-dimensional B-mode image and a three-dimensional rendered image are displayed for comparison, and the diagnosis is sometimes performed by observing these images. Here, the voxel brightness value in the volume data is set based on brightness information (for example, maximum value) in the data (two-dimensional B-mode image) constituting the volume data. That is, the voxel brightness value is associated with the pixel brightness value in the two-dimensional B-mode image that constitutes the volume data.

Since the display of the rendered image depends on the setting of which voxel brightness values are to be displayed or hidden, the display state of the rendered image to be displayed changes depending on the setting of the voxel brightness values. That is, in the rendered image, which voxel of the voxels that overlap in the depth direction is displayed is determined by the setting of the voxel brightness value. Therefore, depending on the setting of this voxel brightness value, a dimensional difference may occur between the two-dimensional B-mode image and the rendered image. For example, when a blood vessel is displayed as a two-dimensional B-mode image, the diameter of the blood vessel is a constant value, but when that image is reconstructed by rendering and displayed, the outer shape of the blood vessel changes depending on the voxel brightness value settings described above. This may cause the blood vessel diameter to change.

Note that even in a two-dimensional B-mode image, the display changes by adjusting the gain, but the gain adjustment is to adjust how bright each pixel brightness value is displayed, and which pixel value is displayed. It does not set whether to display or hide. Therefore, when adjusting the gain of a two-dimensional B-mode image, the operator can easily determine the blood vessel diameter by visual recognition, for example.

In this way, in a three-dimensional rendered image, the dimensions within the displayed image change depending on the setting of the voxel brightness values, so the operator needs to make these settings accurately. Normally, when making this setting, the operator sets a voxel brightness value (threshold value) that becomes the boundary to be displayed in the rendered image while observing the B-mode image and the rendered image.

For example, the operator first sets a cross section for setting within the volume data, and hides areas other than the set cross section. That is, the operator hides an area on one side of the set cross section and an area on the other side. Then, the operator displays the two-dimensional B-mode image of the set cross section and the rendered image, and sets the voxel brightness value (threshold) of the rendered image so that it matches the dimensions in the two-dimensional B-mode image. . For example, the operator sets a voxel brightness value (threshold value), measures the rendered image displayed with the set voxel brightness value (threshold value), and checks whether the dimensions match the dimensions of the two-dimensional B-mode image. Check whether or not. The operator performs measurements many times while changing the voxel brightness value (threshold value) to make accurate settings.

When this setting is completed, the operator redisplays the hidden area. As a result, the dimensions of the two-dimensional B-mode image match the dimensions of the three-dimensional rendered image. In this way, displaying a three-dimensional rendered image takes time and effort. Therefore, in the ultrasonic diagnostic apparatus 1 according to the present embodiment, the operability in displaying such an image is improved and the effort of the operator is reduced.

The details of the processing in the ultrasound diagnostic apparatus 1 will be described below. In the ultrasound diagnostic apparatus 1 according to the first embodiment, first, the calculation function 553 indicates a relationship between brightness information and position information based on brightness information on a two-dimensional image that constitutes three-dimensional image data. Calculate a histogram showing spectrum or brightness information. Specifically, the calculation function 553 acquires brightness information at a specified position on the two-dimensional image, and calculates a spectrum indicating the relationship between the acquired brightness information and the position where the brightness information was acquired, or the acquired brightness. Calculate a histogram that shows information.

For example, when volume data is collected and an operation to start setting voxel brightness values (thresholds) is received from the operator via the input interface 4, the control function 551 first determines the position at which the spectrum or histogram is to be calculated. The information for specifying is displayed on the display 3. FIG. 2 is a diagram showing an example of a display by the control function 551 according to the first embodiment. As shown in FIG. 2, for example, the control function 551 causes the display 3 to display a two-dimensional B-mode image and a three-dimensional rendered image corresponding to the collected volume data.

For example, as shown in FIG. 2, the control function 551 causes the display 3 to display B-mode images (image I1, image I2, image I3) of three orthogonal cross sections and a rendered image (image I4).

The operator performs an operation to designate a position on the image displayed on the display 3. For example, the operator observes the B-mode image displayed on the display 3 and performs an operation to designate a position with respect to any of the B-mode images of three orthogonal sections. For example, the operator specifies a position in the B-mode image that includes the part to be measured.

The calculation function 553 acquires brightness information at a position specified by the operator, and calculates a spectrum or histogram using the acquired brightness information. FIG. 3 is a diagram for explaining processing by the calculation function 553 according to the first embodiment. Here, FIG. 3 shows a case where the calculation function 553 calculates a spectrum.

For example, as shown in the upper part of FIG. 3, when the position shown by the arrow 61 is specified for the B-mode image, the calculation function 553 calculates the spectrum shown in the lower part of FIG. That is, the calculation function 553 calculates a spectrum indicating the relationship between the pixel brightness value of the pixel included in the designated position (arrow 61) and the position (distance in FIG. 3).

When the spectrum is calculated by the calculation function 553, the control function 551 causes the display 3 to display the calculated spectrum. For example, as shown in the lower part of FIG. 3, the control function 551 sets one axis (horizontal axis in FIG. 3) as "distance [%, mm]" and the other axis (vertical axis in FIG. 3). A spectrum defined as a "luminance value" is displayed on the display 3.

The operator sets a voxel brightness value (threshold value) by specifying a brightness value for the spectrum displayed on the display 3. That is, the operator refers to the spectrum and determines which pixel brightness value corresponds to the voxel brightness value to be used as the threshold value. As shown in FIG. 3, the spectrum shows pixel brightness values for each location. The operator sets the voxel brightness value (threshold value) by specifying the brightness value corresponding to the measurement position on the B-mode image.

For example, in FIG. 3, the distance of the black part at the position indicated by the arrow 61 is the distance to be measured. Therefore, the operator sets pixel luminance values corresponding to the boundary between black and gray on one side of the arrow 61 and the boundary between black and gray on the other side in the spectrum calculated with the arrow 61 as the target.

The setting function 554 sets a brightness value by accepting a brightness value designation operation for a spectrum or a histogram. That is, the setting function 554 sets the voxel brightness value corresponding to the pixel brightness value specified by the brightness value designation operation for the spectrum or histogram received from the operator as the threshold value.

The control function 551 changes the display of the rendered image generated from the three-dimensional image data based on the brightness value set by the setting function 554. FIG. 4 shows an example of a display controlled by the control function 551 according to the first embodiment. For example, as shown in FIG. 4, the control function 551 displays a B-mode image (upper left in the figure), a rendered image at the position of the B-mode image (upper right in the figure), and a spectrum (lower left in the figure) on the display 3. Display. Note that in the rendered image in FIG. 4, areas on both sides other than the corresponding position are hidden in accordance with the position of the B-mode image.

For example, as shown in the upper part of FIG. 4, when a brightness value "a" is specified for the spectrum, the control function 551 generates a rendered image using the voxel brightness value corresponding to the brightness value "a" as a threshold value. Display. The operator sets the pixel brightness value, for example, by moving up and down the line (dotted line in the figure) indicating the brightness value shown in the spectrum of FIG. Note that the pixel brightness value can be set not only by moving a line, but also by inputting a numerical value, specifying a position by a point, or specifying a position by a click operation, for example.

For example, as shown in the lower part of FIG. 4, when the operator moves the dotted line to the position of the brightness value "b", the control function 551 displays the voxel brightness value corresponding to the brightness value "b" as the threshold value. , change the rendered image. In this way, the ultrasound diagnostic apparatus 1 according to the first embodiment displays the GUI for setting the voxel brightness value (threshold value), and follows the specified operation on the GUI to set the threshold value according to the specified operation. Display the rendered image. Thereby, the operator can easily set the threshold value of the rendered image.

Here, the control function 551 can display various information. For example, the control function 551 may cause a location corresponding to the indicated pixel intensity value to be displayed on the ultrasound image. Specifically, the control function 551 generates first position information indicating a specified position on the two-dimensional image, and second position information indicating a position corresponding to a brightness value specified in the spectrum in the first position information. The second position information is displayed on the two-dimensional image, and the second position information is changed in accordance with the operation of specifying the brightness value for the spectrum.

FIG. 5 is a diagram showing an example of a display controlled by the control function 551 according to the first embodiment. For example, the control function 551 displays the spectrum at the position specified by the arrow 61, as shown in the upper part of FIG. Thereafter, as shown in the lower part of FIG. 5, when the brightness value "b" is designated by the operator, the rendered image is changed to a rendered image using the voxel brightness value corresponding to the brightness value "b" as a threshold.

Here, the control function 551, as shown in the lower part of FIG. An arrow 62 indicating . That is, the control function 551 displays on the ultrasound image an arrow 62 connecting each position on the ultrasound image corresponding to the two intersections of the spectrum and the dotted line indicating the brightness value "b". This allows the operator to confirm at a glance to which position on the ultrasound image the brightness value specified on the spectrum corresponds, and allows the operator to easily specify the brightness value.

Note that, as shown in FIG. 5, the control function 551 can display the arrow 61 and the arrow 62 at the same time, but controls so that only one of them is displayed according to a switching operation by the operator. be able to.

Furthermore, the control function 551 can further display distance information measured at a position corresponding to a designated brightness value. For example, the control function 551 can cause the display 3 to display distance information indicating the distance of the arrow 62 shown in FIG. 5, as shown in the lower right corner of FIG.

Furthermore, when a position is specified in either the spectrum or the ultrasound image, the control function 551 can display the corresponding position in the other. Specifically, when the control function 551 receives a designation operation for one of the two-dimensional image and the spectrum, it identifiably displays the position of the other corresponding to the position at which the designation operation was received.

FIG. 6 is a diagram showing an example of a display controlled by the control function 551 according to the first embodiment. For example, the control function 551 displays the spectrum at the position specified by the arrow 61, as shown in the upper part of FIG. Thereafter, as shown in the lower part of FIG. 6, when the operator specifies a point 63 on the spectrum, a point 64 indicating the position on the ultrasound image corresponding to the point 63 is displayed. This allows the operator to check the brightness value for each position on the ultrasound image, and allows the operator to designate the brightness value more accurately.

Note that although FIG. 6 describes a case in which points are specified on a spectrum, the embodiment is not limited to this, and points may be specified on an ultrasound image. That is, when the operator places a point on the ultrasound image, the control function 551 displays a point indicating the position on the spectrum corresponding to the placed point.

Further, the control function 551 can also display an image based on a specified position on the ultrasound image. Specifically, the control function 551 causes the display 3 to display a cross-sectional image corresponding to the specified position on the two-dimensional image. FIG. 7 is a diagram showing an example of a display controlled by the control function 551 according to the first embodiment. Here, in FIG. 7, the top left shows a B-mode image, the top right shows a rendered image, the bottom left shows a spectrum, and the bottom right shows an image based on a specified position on the ultrasound image.

For example, the control function 551 displays an oblique section parallel to the arrow 61, as shown on the lower right side of FIG. In such a case, the image generation function 552 identifies the position in the volume data of the arrow 61 specified on the B-mode image. The image generation function 552 then generates an oblique cross-sectional image based on the specified position. The control function 551 causes the display 3 to display the generated oblique cross-sectional image.

Here, the control function 551 can display a position corresponding to a specified position on the two-dimensional image on the cross-sectional image. For example, the control function 551 causes an arrow 61 to be displayed on the oblique cross-sectional image, as shown in the lower right of FIG.

As described above, the ultrasound diagnostic apparatus 1 according to the first embodiment displays a spectrum indicating the pixel brightness value at a specified position on a two-dimensional B-mode image, and determines the pixel brightness value for the displayed spectrum. By accepting the specified operation, the voxel brightness value of the rendered image is set.

Here, in the embodiment described above, a case has been described in which a spectrum indicating a pixel luminance value at a specified position on a two-dimensional B-mode image is displayed. In the following, a case will be described in which a histogram indicating pixel brightness values at a designated position on a two-dimensional B-mode image is displayed.

In such a case, the calculation function 553 acquires the pixel brightness value at the specified position on the B-mode image, and generates a histogram showing the frequency distribution of the acquired pixel brightness values. The control function 551 then displays the generated histogram on the display 3.

FIG. 8 is a diagram showing an example of a display controlled by the control function 551 according to the first embodiment. For example, as shown in the upper part of FIG. 8, when the position indicated by the arrow 61 is specified for the B-mode image, the calculation function 553 calculates the histogram shown in the lower part of FIG. That is, the calculation function 553 calculates a histogram showing the frequency distribution of pixel brightness values of pixels included in the designated position (arrow 61).

When the calculation function 553 calculates the histogram, the control function 551 causes the display 3 to display the calculated histogram. For example, as shown in the lower part of FIG. 8, the control function 551 sets one axis (horizontal axis in FIG. 8) as "luminance value" and the other axis (vertical axis in FIG. 8) as "frequency". The histogram obtained is displayed on the display 3.

The operator sets a voxel brightness value (threshold value) by specifying a brightness value for the histogram displayed on the display 3. That is, the operator refers to the histogram and determines which pixel brightness value corresponds to the voxel brightness value to be used as the threshold value. As shown in FIG. 8, when a position (arrow 61) is specified to include the part to be measured, the pixel corresponding to the arrow 61 is the pixel corresponding to the part to be measured (in FIG. 8, black pixels) and pixels corresponding to parts that are not measurement targets (gray pixels in FIG. 8).

Therefore, the histogram at this position frequently includes pixel brightness values corresponding to the part to be measured and pixel brightness values corresponding to parts not to be measured. For example, at the position indicated by the arrow 61 in FIG. 8, the histogram becomes a histogram that frequently includes black pixels with low luminance values and gray pixels with high luminance values. Here, for example, as shown in the B-mode image of FIG. 8, if the pixel luminance values of a part that is not a measurement target on one side of the arrow 61 and a part that is not a measurement target on the other side are different, the histogram will be as shown in FIG. As shown in the figure, two peaks are shown on the high luminance side.

Then, the operator sets the voxel brightness value (threshold value) by referring to the histogram and specifying the brightness value corresponding to the measurement position on the B-mode image. For example, as shown in FIG. 8, the operator specifies a pixel brightness value near the rise of the peak on the high brightness side. Here, as shown in FIG. 8, if the histogram includes two peaks, the operator should select the pixel brightness value near the rise of the peak with the lower brightness value so that the boundaries on both sides are depicted in the rendered image. Specify. Note that if a pixel brightness value near the rise of the peak on the higher side of the brightness value is specified, the voxel brightness value corresponding to the pixel brightness value lower than the specified pixel brightness value will be hidden, so it will not be displayed in the rendered image. The corresponding part will not be displayed.

In this manner, when the operation for specifying the histogram is executed, the setting function 554 receives the operation for specifying the brightness value for the histogram, and sets the voxel brightness value (threshold value).

Next, the processing of the ultrasonic diagnostic apparatus 1 according to the first embodiment will be described using FIG. 9. FIG. 9 is a flowchart for explaining the processing procedure of the ultrasound diagnostic apparatus 1 according to the first embodiment. Note that FIG. 9 shows a processing procedure when displaying a spectrum.

Here, steps S101 to S103 shown in FIG. 4 are steps in which the processing circuit 55 reads out a program corresponding to the control function 551 from the memory 54 and executes it. Further, step S104 is a step in which the processing circuit 55 reads out programs corresponding to the control function 551 and the calculation function 553 from the memory 54 and executes them. Steps S105 to S107 are steps in which the processing circuit 55 reads out programs corresponding to the control function 551 and the setting function 554 from the memory 54 and executes them.

In the ultrasound diagnostic apparatus 1 according to the first embodiment, the processing circuit 55 collects volume data (step S101) and displays a B-mode image (step S102). Then, the processing circuit 55 determines whether a position has been designated for the B-mode image to be displayed (step S103).

Here, if a position has been specified (Yes at step S103), the processing circuit 55 displays the spectrum at the specified position (step S104), and determines whether or not a specifying operation for the spectrum has been received (step S103). S105). Note that the processing circuit 55 remains in a standby state until a position is specified in the B-mode image (No in step S103).

If the designation operation is accepted in the determination at step S105 (Yes at step S105), the processing circuit 55 causes the display 3 to display a rendered image according to the designated brightness value (step S106). Note that the processing circuit 55 is in a standby state until the specifying operation is performed on the spectrum (No in step S105).

Then, the processing circuit 55 determines whether an operation for changing the pixel brightness value on the spectrum has been received (step S107). Here, if the change operation is accepted (Yes at step S107), the processing circuit 55 returns to step S106 and continues the process. On the other hand, if the changing operation is not accepted (No in step S107), the processing circuit 55 ends the voxel brightness value (threshold value) setting process.

As described above, according to the first embodiment, the control function 551 acquires three-dimensional image data collected by transmitting and receiving ultrasound to and from the subject. The calculation function 553 calculates a spectrum indicating the relationship between the luminance information and position information or a histogram indicating the luminance information, based on the luminance information on the two-dimensional image constituting the three-dimensional image data. The setting function 554 sets a brightness value by accepting an operation for specifying a brightness value for a spectrum or a histogram. The control function 551 changes the display of the rendered image generated from the three-dimensional image data based on the brightness value set by the setting function 554. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment can easily set a threshold value for displaying a rendered image, and can improve the operability related to image display.

For example, when using the ultrasound diagnostic apparatus 1 according to the present embodiment, the operator presses a switch for a function equipped with the algorithm of the present application after collecting volume data. Then, the operator displays, for example, a B-mode image to be measured, and specifies a target position (range). Thereafter, the operator specifies pixel brightness values for the spectrum or histogram displayed on the ultrasound diagnostic device 1, so that the dimensions in the two-dimensional B-mode image match the dimensions in the three-dimensional rendered image. expressions will be performed.

In this way, by using the ultrasound diagnostic apparatus 1 according to the present embodiment, it is possible to improve the operability related to displaying rendered images. As a result, the ultrasound diagnostic apparatus 1 can improve diagnostic efficiency.

Further, according to the first embodiment, the calculation function 553 acquires luminance information at a specified position on the two-dimensional image, and generates a spectrum indicating the relationship between the acquired luminance information and the position where the luminance information is acquired. Alternatively, a histogram indicating the acquired luminance information is calculated. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment allows the operator to set the threshold value using the pixel brightness value at the desired position, making it possible to perform accurate setting.

Further, according to the first embodiment, the calculation function 553 calculates the spectrum based on the luminance information at the specified position on the two-dimensional image. The setting function 554 sets a brightness value by accepting an operation for specifying a brightness value for a spectrum. The control function 551 provides first position information indicating a specified position on the two-dimensional image and second position information indicating a position corresponding to the brightness value specified in the spectrum in the first position information. , on a two-dimensional image, and change the second position information in accordance with an operation for specifying a brightness value for the spectrum. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment can perform settings while checking the second position information, making it possible to perform more accurate settings.

Further, according to the first embodiment, when a specified operation is received for one of the two-dimensional image and the spectrum, the control function 551 is capable of identifying the position of the other corresponding to the position at which the specified operation is received. to be displayed. Therefore, the ultrasound diagnostic apparatus 1 according to the first embodiment can more accurately grasp the corresponding positional relationship between the spectrum and the B-mode image, and can perform more accurate settings.

Further, according to the first embodiment, the control function 551 displays distance information of the position indicated by the second position information. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment makes it possible to confirm whether or not the target position has been specified. For example, if a wrong position is designated on the B-mode image, a distance different from the expected distance may be displayed. Based on this distance information, the operator can perform subsequent operations after confirming that there is no error in the position he/she specified on the B-mode image.

Further, according to the first embodiment, the control function 551 causes the display 3 to display a cross-sectional image corresponding to a specified position on the two-dimensional image. Therefore, the ultrasound diagnostic apparatus 1 according to the first embodiment makes it possible to confirm a specified position on a B-mode image using a cross-sectional image.

Further, according to the first embodiment, the control function 551 causes a position corresponding to a specified position on the two-dimensional image to be displayed on the cross-sectional image. Therefore, the ultrasound diagnostic apparatus 1 according to the first embodiment makes it possible to accurately grasp the correspondence between the position on the B-mode image and the position on the cross-sectional image.

Further, according to the first embodiment, the control function 551 changes the display of the rendered image in accordance with the reception of an operation for specifying a brightness value for a spectrum or a histogram. Therefore, the ultrasound diagnostic apparatus 1 according to the first embodiment makes it possible to provide a GUI with high operability.

Further, according to the first embodiment, the control function 551 causes the display unit to display at least one of a two-dimensional image, a spectrum or a histogram, and a rendered image. Therefore, the ultrasound diagnostic apparatus 1 according to the first embodiment makes it possible to provide a GUI with high operability.

Further, according to the first embodiment, the setting function 554 accepts an operation for specifying a brightness value for a spectrum or a histogram through an input operation including a numerical value input, a line input, and a click operation. Therefore, the ultrasonic diagnostic apparatus 1 according to the first embodiment can set the threshold value through various operations, making it possible to further improve the operability.

(Other embodiments)
Now, although the first embodiment has been described so far, it may be implemented in various different forms other than the first embodiment described above.

In the above-described embodiment, a case has been described in which a direct designation operation is performed on a spectrum or a histogram. However, the embodiment is not limited to this, and for example, the specification operation may be performed indirectly on the spectrum by specifying the B-mode image.

As described above, the B-mode image and the spectrum have a corresponding positional relationship, and when a position is specified for one, it is reflected on the other. Therefore, the operator displays the spectrum by specifying the position (to be measured) on the B-mode image, and then specifies the position on the B-mode image, and then selects the position corresponding to the specified position. Execute specified operations on the spectrum by displaying on the spectrum. Note that the above-mentioned image designation can be made not only for B-mode images but also for oblique cross-sectional images.

Furthermore, in the embodiments described above, the case where either a spectrum or a histogram is displayed has been described. However, the embodiment is not limited to this, and both may be displayed.

Furthermore, in the embodiment described above, a case has been described in which the ultrasound diagnostic apparatus 1 executes various processes. However, the embodiment is not limited to this, and may be implemented by a medical information processing device, for example. FIG. 10 is a block diagram illustrating an example of the configuration of a medical information processing apparatus 100 according to another embodiment. As shown in FIG. 10, the medical information processing apparatus 100 includes a communication interface 11, a storage circuit 12, an input interface 13, a display 14, and a processing circuit 15. Note that the medical information processing device 100 is, for example, an information processing device such as a tablet terminal or a workstation.

The communication interface 11 is connected to the processing circuit 15 and is used to transmit and transmit various data between medical image diagnostic equipment (for example, ultrasound diagnostic equipment 1, etc.), image storage equipment, etc. connected via a network. Control communications. For example, the communication interface 11 is realized by a network card, network adapter, NIC (Network Interface Controller), or the like.

The storage circuit 12 is connected to the processing circuit 15 and stores various data. For example, the memory circuit 12 is realized by a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, a hard disk, an optical disk, or the like. In this embodiment, the storage circuit 12 stores medical images received from a medical image diagnostic apparatus. For example, the storage circuit 12 stores ultrasound images and the like. Further, the storage circuit 12 stores various information used in processing by the processing circuit 15, processing results by the processing circuit 15, and the like.

The input interface 13 includes a trackball, a switch button, a mouse, a keyboard for performing various settings, a touchpad for performing input operations by touching the operation surface, a touch monitor in which the display screen and the touchpad are integrated, This is realized by a non-contact input circuit using an optical sensor, a voice input circuit, etc.

The input interface 13 is connected to the processing circuit 35 , converts input operations received from the operator into electrical signals, and outputs the electrical signals to the processing circuit 15 . Note that in this specification, the input interface 13 is not limited to one that includes physical operation components such as a mouse and a keyboard. For example, examples of the input interface include a processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs this electrical signal to a control circuit.

The display 14 is connected to the processing circuit 15 and displays various information and various images output from the processing circuit 15. For example, the display 14 is realized by a liquid crystal monitor, a CRT (cathode ray tube) monitor, a touch monitor, or the like. For example, the display 14 displays a GUI for receiving instructions from an operator, various images, and various processing results by the processing circuit 15.

The processing circuit 15 controls each component included in the medical information processing apparatus 100 according to input operations received from the operator via the input interface 13. For example, the processing circuit 15 is implemented by a processor. In this embodiment, the processing circuit 15 causes the storage circuit 12 to store the medical image output from the communication interface 11 . Further, the processing circuit 15 reads a medical image from the storage circuit 12, performs processing on the read medical image, or displays the medical image on the display 14.

As shown in FIG. 10, the processing circuit 15 executes, for example, a control function 151, an image generation function 152, a calculation function 153, and a setting function 154. Here, for example, each processing function executed by the control function 151, image generation function 152, calculation function 153, and setting function 154, which are the components of the processing circuit 15 shown in FIG. 10, is in the form of a program executable by a computer. It is recorded in the memory circuit 12. The processing circuit 15 is, for example, a processor, and implements functions corresponding to the read programs by reading each program from the storage circuit 12 and executing them. In other words, the processing circuit 15 in a state where each program has been read has each function shown in the processing circuit 15 of FIG.

The control function 151 controls the entire medical information processing apparatus 100. Furthermore, the control function 151 executes the same processing as the control function 551 described above regarding voxel brightness values (threshold values). The image generation function 152 executes the same processing as the image generation function 552 described above regarding voxel brightness values (threshold values). The calculation function 153 executes the same process as the calculation function 553 described above regarding the voxel brightness value (threshold value). The setting function 154 executes the same processing as the setting function 554 described above regarding voxel brightness values (threshold values).

In the embodiment described above, an example has been described in which each processing function is realized by a single processing circuit (the processing circuit 55 and the processing circuit 15), but the embodiment is not limited to this. For example, the processing circuit 55 (and the processing circuit 15) may be configured by combining a plurality of independent processors, and each processor may implement each processing function by executing each program. Further, each processing function of the processing circuit 55 (and the processing circuit 15) may be realized by being appropriately distributed or integrated into a single or multiple processing circuits.

Note that the term "processor" used in the above description refers to, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), a programmable logic device ( For example, it refers to circuits such as a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA). A processor implements functions by reading and executing programs stored in memory. Note that instead of storing the program in the memory, the program may be directly incorporated into the circuit of the processor. In this case, the processor realizes its functions by reading and executing a program built into the circuit. Note that each processor in this embodiment is not limited to being configured as a single circuit for each processor, but may also be configured as a single processor by combining multiple independent circuits to realize its functions. good.

Note that each component of each device illustrated in the description of the above embodiments is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distributing and integrating each device is not limited to what is shown in the diagram, and all or part of the devices can be functionally or physically distributed or integrated in arbitrary units depending on various loads, usage conditions, etc. Can be integrated and configured. Furthermore, all or any part of each processing function performed by each device can be realized by a CPU and a program that is analyzed and executed by the CPU, or can be realized as hardware using wired logic.

Further, the processing method described in the above embodiment can be realized by executing a processing program prepared in advance on a computer such as a personal computer or a workstation. This processing program can be distributed via a network such as the Internet. Further, this processing program is recorded on a computer-readable non-temporary recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, an MO, a DVD, a flash memory such as a USB memory, and an SD card memory. It can also be executed by being read from a non-transitory storage medium by a computer.

As described above, according to the embodiment, it is possible to improve the operability related to image display.

Although several embodiments have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, changes, and combinations of embodiments can be made without departing from the gist of the invention. These embodiments and their modifications are included within the scope and gist of the invention as well as within the scope of the invention described in the claims and its equivalents.

1 Ultrasonic diagnostic device 15, 55 Processing circuit 151, 551 Control function 152, 552 Image generation function 153, 553 Calculation function 154, 554 Setting function

Claims (10)

an acquisition unit that acquires three-dimensional image data collected by transmitting and receiving ultrasound to and from the subject;
a calculation unit that acquires brightness information at a specified position on the two-dimensional image constituting the three-dimensional image data and calculates a spectrum indicating a relationship between the acquired brightness information and the position where the brightness information is acquired ; ,
a setting unit configured to set a brightness value by accepting a brightness value designation operation for the spectrum ;
a display control unit that changes the display of a rendered image generated from the three-dimensional image data based on the brightness value set by the setting unit;
A medical information processing device comprising: The calculation unit further calculates a histogram indicating the acquired luminance information ,
The medical information processing apparatus according to claim 1 , wherein the setting unit further sets a brightness value by accepting an operation for specifying a brightness value for the histogram . The calculation unit calculates the spectrum based on brightness information at a specified position on the two-dimensional image,
The setting unit sets a brightness value by accepting a brightness value designation operation for the spectrum,
The display control unit includes first position information indicating a specified position on the two-dimensional image, and second position information indicating a position corresponding to a brightness value specified in the spectrum in the first position information. 2. The medical information processing apparatus according to claim 1 , wherein position information is displayed on the two-dimensional image, and the second position information is changed in accordance with an operation for specifying a brightness value for the spectrum. 1 . The display control unit, when a designation operation is received for one of the two-dimensional image and the spectrum, causes the other position corresponding to the position at which the designation operation is received to be identifiably displayed. Or the medical information processing device according to 3. The medical information processing apparatus according to claim 3, wherein the display control unit displays distance information of the position indicated by the second position information. The medical information processing apparatus according to claim 1 , wherein the display control section causes a display section to display a cross-sectional image corresponding to a specified position on the two-dimensional image. The medical information processing apparatus according to claim 6, wherein the display control unit displays a position corresponding to a specified position on the two-dimensional image on the cross-sectional image. The medical information processing apparatus according to claim 1, wherein the display control section causes a display section to display at least one of the two-dimensional image, the spectrum, and the rendered image. The medical information processing apparatus according to any one of claims 1 to 8, wherein the display control unit changes the display of the rendered image in accordance with acceptance of an operation for specifying a brightness value for the spectrum . The medical information processing apparatus according to any one of claims 1 to 9, wherein the setting unit accepts an operation for specifying a brightness value for the spectrum through an input operation including a numerical value input, a line input, and a click operation.

Images