JP2019093140A - Optical ultrasonic diagnostic apparatus, medical image processing apparatus, medical image processing program, and ultrasonic diagnostic apparatus - Google Patents

Abstract

To easily visualize a vascular structure.SOLUTION: An optical ultrasonic diagnostic apparatus according to an embodiment includes an irradiation unit, a reception unit, an image generation unit, an estimation unit, and an output control unit. The irradiation unit applies light having a preset wavelength. The reception unit receives an optical ultrasonic wave generated in a subject by the application of the light. The image generation unit generates blood cell image data in which red blood cells are drawn on the basis of the optical ultrasonic wave. The estimation unit estimates a vascular structure of the subject on the basis of the blood cell image data generated over a predetermined period of time. The output control unit outputs information regarding the vascular structure.SELECTED DRAWING: Figure 1

Description

  Embodiments of the present invention relate to an optical ultrasonic diagnostic apparatus, a medical image processing apparatus, a medical image processing program, and an ultrasonic diagnostic apparatus.

  Photoacoustic imaging (PAI: Photoacoustic Imaging) is known as a technique for imaging a light absorber in a subject. Photoacoustic imaging utilizes the generation of a photoacoustic wave (also referred to as photoacoustic wave) from a light absorber due to the photoacoustic effect when light is irradiated to a subject, and converts the distribution of the light absorber into image information It is a technology.

  For example, as a device for performing photoacoustic imaging, development of an optical ultrasonic diagnostic device (also referred to as a photoacoustic device) is in progress. The optical ultrasonic diagnostic apparatus can image red blood cells present in a subject by using, for example, hemoglobin contained in red blood cells as a light absorber.

JP, 2015-205136, A

  The problem to be solved by the present invention is to provide an optical ultrasonic diagnostic apparatus, a medical image processing apparatus, a medical image processing program, and an ultrasonic diagnostic apparatus that can easily visualize a blood vessel structure.

  The optical ultrasonic diagnostic apparatus according to the embodiment includes an irradiation unit, a reception unit, an image generation unit, an estimation unit, and an output control unit. The irradiating unit irradiates light having a preset wavelength. The receiving unit receives the light ultrasonic waves generated in the subject by the irradiation of the light. The image generation unit generates blood cell image data in which red blood cells are drawn based on the light ultrasonic waves. The estimation unit estimates the blood vessel structure of the subject based on the blood cell image data generated over a predetermined period. The output control unit outputs information on the blood vessel structure.

FIG. 1 is a block diagram showing a configuration example of the optical ultrasonic diagnostic apparatus according to the first embodiment. FIG. 2 is a flowchart showing a processing procedure of processing in the optical ultrasonic diagnostic apparatus according to the first embodiment. FIG. 3 is a diagram for explaining the processing of the estimation function according to the first embodiment. FIG. 4 is a diagram for explaining the process of the calculation function according to the first embodiment. FIG. 5 is a flowchart showing the processing procedure of the optical ultrasonic diagnostic apparatus according to the second embodiment. FIG. 6 is a diagram for explaining the process of the estimation function according to the second embodiment. FIG. 7 is a flowchart showing the processing procedure of the optical ultrasonic diagnostic apparatus according to the third embodiment. FIG. 8 is a diagram for explaining the process of the calculation function according to the third embodiment. FIG. 9 is a diagram for explaining the processing of the calculation function according to the third embodiment. FIG. 10 is a diagram for explaining the processing of the output control function according to the third embodiment. FIG. 11 is a diagram for explaining processing of an output control function according to the third embodiment. FIG. 12 is a diagram for explaining processing of the optical ultrasonic diagnostic apparatus according to the fourth embodiment. FIG. 13 is a block diagram showing a configuration example of an optical ultrasonic diagnostic apparatus according to the fifth embodiment. FIG. 14 is a diagram for explaining the processing of the alignment function according to the fifth embodiment. FIG. 15 is a block diagram showing a configuration example of an ultrasonic diagnostic apparatus according to the sixth embodiment. FIG. 16 is a flowchart of the procedure of the process in the ultrasonic diagnostic apparatus according to the sixth embodiment. FIG. 17 is a diagram for explaining the process of the calculation function according to the sixth embodiment. FIG. 18 is a diagram for explaining the process of the calculation function according to the sixth embodiment. FIG. 19 is a diagram for explaining the process of the calculation function according to the sixth embodiment. FIG. 20 is a block diagram showing a configuration example of a medical image processing apparatus according to another embodiment.

  Hereinafter, with reference to the drawings, an optical ultrasonic diagnostic device, a medical image processing device, a medical image processing program, and an ultrasonic diagnostic device according to an embodiment will be described. The following embodiments are not limited to the following description. Also, the embodiment can be combined with other embodiments or the prior art as long as no contradiction occurs in the processing content.

  The optical ultrasonic diagnostic apparatus is an apparatus for imaging a light absorber in a subject by photoacoustic imaging (PAI), and for example, light having a high resolution capable of identifying individual red blood cells. It is an acoustic microscope. However, the optical ultrasonic diagnostic apparatus is not limited to the photoacoustic microscope, and may have, for example, a resolution (resolution) that can distinguish individual red blood cells.

  Moreover, although the following embodiment demonstrates the case where the technique of an indication is applied to an optical ultrasound diagnostic apparatus, embodiment is not limited to this. For example, the disclosed technology is not limited to the optical ultrasonic diagnostic apparatus, and is also applicable to a medical image processing apparatus having a function of processing a medical image. As a medical image processing apparatus, for example, a workstation, a PACS (Picture Archiving Communication System) viewer, or the like can be applied.

First Embodiment
FIG. 1 is a block diagram showing a configuration example of the optical ultrasonic diagnostic apparatus 1 according to the first embodiment. As shown in FIG. 1, the optical ultrasonic diagnostic apparatus 1 according to the first embodiment includes an apparatus main body 100, an ultrasonic probe 102, a light irradiation unit 101, an input interface 103, and a display 104. The ultrasonic probe 102, the light irradiation unit 101, the input interface 103, and the display 104 are communicably connected to the apparatus main body 100. The subject P is not included in the configuration of the optical ultrasonic diagnostic apparatus 1.

  The light irradiation part 101 is comprised by optical systems (light propagation member), such as an optical fiber and a lens. The light irradiator 101 irradiates the subject P with light (pulsed light) generated by a light source 110 described later. For example, it is preferable that the light irradiation unit 101 irradiates pulsed light to a site with less movement, such as the finger of the subject P, limbs, and a breast. The irradiated pulsed light propagates and diffuses in the subject P and is absorbed by the substance present in the subject P. A substance (a light absorber) that absorbs such light absorbs the energy of pulsed light of each wavelength to generate an optical ultrasonic wave. That is, the light irradiation part 101 is an example of the irradiation part which irradiates the light which has a preset wavelength.

  Examples of the light absorber include substances contained in the living body such as hemoglobin and glucose (blood sugar). Each light absorber absorbs the energy of pulsed light having a specific wavelength to generate light ultrasonic waves. The generated optical ultrasonic waves propagate in the subject P and are received by a plurality of transducers provided in an ultrasonic probe 102 described later. In addition, as a light absorber, not only the said substance but all substances which can absorb the energy of pulsed light are applicable. For example, melanin present on the body surface is also included in the light absorber. In addition to the in vivo substance, for example, pigments such as methylene blue and indosinian green, gold fine particles, and substances (or drugs) obtained by accumulating or chemically modifying them are also administered into the subject P. Can be used as a light absorber.

  The light irradiation unit 101 according to the first embodiment irradiates pulsed light whose beam diameter is converged in order to improve resolution. In other words, the light irradiation unit 101 sequentially irradiates the pulsed light focused on each position included in the target area of the PAI. The target area of the PAI may be a two-dimensional area (corresponding to a cross section in the object P) or a three-dimensional area. The present invention is not limited to this, and the light irradiation unit 101 can also expand the beam diameter and perform irradiation within a range in which the resolution capable of identifying the individual red blood cells can be maintained.

  The ultrasonic probe 102 is a probe having a plurality of transducers (for example, piezoelectric transducers), a preamplifier, an A / D (Analog / Digital) converter, and the like. The plurality of transducers receive the optical ultrasonic waves generated in the subject P. The preamplifier amplifies the received optical ultrasound for each channel. The A / D converter performs A / D conversion on the amplified optical ultrasonic wave and outputs a digital electric signal. The ultrasound probe 102 transmits a digital electrical signal output by the A / D converter to a receiving circuit 120 described later.

  The optical ultrasonic wave receiving surface of the ultrasonic probe 102 may be a flat surface or may be a curved surface along the body surface of the subject P. As an example, the plurality of transducers are linearly arranged at predetermined intervals on a plane. As another example, the plurality of transducers are arranged in a two-dimensional array (lattice) or concentrically. The optical ultrasonic wave receiving surface may be formed into a hemispherical shape, and a plurality of transducers may be arranged concentrically or spirally on the hemispherical curved surface. A hemispherical optical ultrasound receiving surface is suitable for imaging a breast. The optical ultrasonic wave receiving surface may be formed in a cylindrical or semi-cylindrical shape, and a plurality of transducers may be arranged on this surface. The cylindrical or semi-cylindrical optical ultrasonic receiving surface is suitable for imaging of the limbs.

  The ultrasonic probe 102 according to the first embodiment is preferably configured to be able to receive optical ultrasonic waves of high frequency in order to improve resolution. For example, the ultrasound probe 102 is configured to be able to receive a frequency that can realize the resolution that can distinguish individual red blood cells.

  The input interface 103 corresponds to a mouse, a keyboard, a button, a panel switch, a touch command screen, a foot switch, a track ball, a joystick, and the like. For example, the input interface 103 receives various setting requests from the operator of the optical ultrasonic diagnostic apparatus 1, and transfers the received various setting requests to the apparatus main body 100.

  The display 104 displays a graphical user interface (GUI) for the operator of the optical ultrasonic diagnostic apparatus 1 to input various setting requests using the input interface 103, or displays image data and the like generated in the apparatus main body 100. Display.

  The apparatus body 100 is an apparatus for generating image data based on the optical ultrasonic waves received by the ultrasonic probe 102, and as shown in FIG. 1, the light source 110, the receiving circuit 120, the signal processing circuit 130, and the image A generation circuit 140, a storage circuit 150, and a processing circuit 160 are included. The light source 110, the receiving circuit 120, the signal processing circuit 130, the image generating circuit 140, the storage circuit 150, and the processing circuit 160 are communicably connected to each other.

  The light source 110 emits light (pulsed light) having a preset wavelength. For example, the light source 110 is a laser light source that generates light of high output. Examples of the laser light source include solid-state lasers, gas lasers, dye lasers, semiconductor lasers and the like. As the light source 110, a light source capable of emitting light of an arbitrary wavelength can be appropriately used according to the type of light absorber to be subjected to PAI. In addition, the light source 110 can adjust the light irradiation timing, the pulse width, the intensity, and the like under the control of the processing circuit 160 described later.

  Although it is preferable that the light source 110 has a strong output and can change the wavelength continuously, it may be configured by a plurality of single wavelength lasers having different wavelengths. Further, the light source 110 is not limited to the laser light source, and may be configured by a light emitting diode, a flash lamp or the like. In addition, the light source 110 may be provided, for example, in a separate housing installed outside the device main body 100 or may be provided inside the light irradiation unit 101.

  The reception circuit 120 includes a reception delay unit, an adder, and the like, performs various processes on the digital electrical signal transmitted from the ultrasonic probe 102, and generates reception data. The reception delay unit gives a delay time necessary for determining reception directivity to the digital electric signal. The adder performs addition processing of the electrical signal processed by the reception delay unit to generate reception data. The reception circuit 120 transmits the generated reception data to the signal processing circuit 130. That is, the receiving circuit 120 is an example of a receiving unit that receives the optical ultrasonic waves generated in the subject by the irradiation of light.

  The signal processing circuit 130 generates distribution data of characteristic values in the subject P using the reception data received from the reception circuit 120. For example, the signal processing circuit 130 corresponds to each position on the spatial coordinates of the target area (two-dimensional or three-dimensional area) of PAI by performing image reconstruction using time-series received data for each channel. Find distribution data of characteristic values. As the image reconstruction method, a known reconstruction method can be appropriately used.

  The image generation circuit 140 generates image data from the distribution data generated by the signal processing circuit 130. For example, the image generation circuit 140 generates, from the distribution data generated by the signal processing circuit 130, image data in which the intensity of the optical ultrasonic wave is represented by luminance. The image generation circuit 140 generates two-dimensional image data when the target area of PAI is a two-dimensional area, and generates three-dimensional image data when the target area is a three-dimensional area. The image generation circuit 140 is an example of an image generation unit.

  The image generation circuit 140 according to the first embodiment generates image data (blood cell image data) in which red blood cells are visualized based on light ultrasonic waves generated in a subject by irradiation of light having a preset wavelength. Generate Specifically, the image generation circuit 140 generates a plurality of blood cell image data based on the light ultrasonic waves obtained by receiving a plurality of times over a predetermined period. Erythrocytes generate light ultrasonic waves by exciting hemoglobin with laser light having a wavelength of about 400 to 700 nm. For example, the image generation circuit 140 generates blood cell image data based on the distribution data of light ultrasonic waves generated from individual red blood cells.

  Further, the image generation circuit 140 can execute various types of image processing on the generated image data. For example, the image generation circuit 140 executes various types of image processing such as smoothing processing and edge enhancement processing according to the operator's request. Further, the image generation circuit 140 adds incidental information (text information of various parameters, a scale, a body mark, etc.) to the image data and stores the incidental information in the storage circuit 150.

  The storage circuit 150 stores various data such as PAI, control programs for performing various image processing, display processing, etc., diagnostic information (for example, patient ID, doctor's findings etc.), diagnostic protocol, various body marks, etc. Do. The storage circuit 150 also stores the image data generated by the image generation circuit 140 together with the accompanying information. Further, data stored in the storage circuit 150 can be transferred to an external device via a communication interface (not shown).

  The processing circuit 160 controls the entire processing of the optical ultrasonic diagnostic apparatus 1. For example, the processing circuit 160 uses the light source 110, the receiving circuit 120, and the signal processing circuit based on various setting requests input from the operator via the input interface 103, various control programs and various data read from the storage circuit 150. 130 and control the processing of the image generation circuit 140. The processing circuit 160 also causes the display 104 to display the image data stored in the storage circuit 150.

  Further, as shown in FIG. 1, the processing circuit 160 executes an estimation function 161, a calculation function 162, and an output control function 163. Here, the estimation function 161 is an example of an estimation unit. The calculation function 162 is an example of a calculation unit. The output control function 163 is an example of an output control unit.

  Here, for example, each processing function executed by the estimation function 161, the calculation function 162, and the output control function 163 which are components of the processing circuit 160 shown in FIG. 1 is an optical ultrasonic wave in the form of a program executable by a computer. It is recorded in the storage device (for example, storage circuit 150) of the diagnostic device 1. The processing circuit 160 is a processor that implements functions corresponding to each program by reading each program from the storage device and executing the program. In other words, the processing circuit 160 in the state of reading out each program has each function shown in the processing circuit 160 of FIG. The processing functions performed by the estimation function 161, the calculation function 162, and the output control function 163 will be described later.

  The configuration of the photoacoustic imaging apparatus 1 according to the first embodiment has been described above. Based on this configuration, the optical ultrasonic diagnostic apparatus 1 according to the first embodiment executes the following processing functions to easily visualize the blood vessel structure.

  That is, in the optical ultrasonic diagnostic apparatus 1 according to the first embodiment, the image generation circuit 140 draws red blood cells based on the optical ultrasonic waves generated in the subject by the irradiation of the light having the preset wavelength. Generate blood cell image data. Further, the estimation function 161 estimates the blood vessel structure of the subject P based on blood cell image data generated over a predetermined period. The output control function 163 outputs information on the blood vessel structure.

  The process in the optical ultrasonic diagnostic apparatus 1 according to the first embodiment will be specifically described with reference to FIG. FIG. 2 is a flowchart showing a processing procedure of processing in the optical ultrasonic diagnostic apparatus 1 according to the first embodiment. The processing procedure shown in FIG. 2 is started, for example, when an input (instruction) to measure the blood vessel volume is received from the operator. FIG. 2 will be described with reference to FIGS. 3 and 4. FIG. 3 is a diagram for explaining the process of the estimation function 161 according to the first embodiment. FIG. 4 is a diagram for explaining the process of the calculation function 162 according to the first embodiment.

  In step S101, the processing circuit 160 determines whether it is processing timing or not. For example, the operator uses the input interface 103 to make an input to measure the blood vessel volume. The input interface 103 outputs, to the processing circuit 160, information for measuring the blood vessel volume input by the operator. When the processing circuit 160 receives information to measure the blood vessel volume from the input interface 103, the processing circuit 160 determines that the input to measure the blood vessel volume is received (Yes at step S101), and starts the process after step S102. . Note that the processing circuit 160 is in a standby state without starting the processing after step S102 until it receives an input to measure the blood vessel volume (No at step S101).

  In step S102, the processing circuit 160 reads out a plurality of blood cell image data. For example, the processing circuit 160 reads a plurality of blood cell image data from the storage circuit 150. Here, the plurality of blood cell image data is a plurality of pieces of image data arranged in time series. For example, a plurality of blood cell image data are image data continuously captured over a plurality of frames from the same target area.

  In step S103, the estimation function 161 estimates a blood vessel structure by superimposing a plurality of blood cell image data. For example, the estimation function 161 superimposes a plurality of blood cell image data generated at different timings from the same target area so that their positions coincide with each other. Then, the estimation function 161 specifies a position where red blood cells are present in the superimposed blood cell image data as a blood vessel position.

  The process of the estimation function 161 will be described with reference to FIG. FIG. 3 exemplifies blood cell image data 10 and blood vessel structure image data 20 for the first to N-th frames. In FIG. 3, a plurality of red blood cells 13 are depicted in the enlarged image 12 obtained by enlarging the region 11 of each blood cell image data 10.

  As shown in FIG. 3, a plurality of red blood cells 13 are depicted in each blood cell image data 10 from the first frame to the N-th frame. In each blood cell image data 10, the plurality of red blood cells 13 are drawn discretely to an individually distinguishable degree.

  Here, the estimation function 161 generates blood vessel structure image data 20 by superimposing a plurality of blood cell image data 10 from the 1st to Nth frames. In the blood vessel structure image data 20, a plurality of red blood cells 13 are drawn continuously. Specifically, in the enlarged image 22 obtained by enlarging the region 21 of the blood vessel structure image data 20, the respective red blood cells 13 are drawn in succession to one another. As a result, the estimation function 161 specifies the position of the red blood cells 13 drawn in succession as the blood vessel position. That is, the estimation function 161 superimposes a plurality of blood cell image data to generate blood vessel structure image data in which the blood vessel structure is depicted, and estimates the blood vessel structure based on the blood vessel structure image data.

  As described above, the estimation function 161 generates blood vessel structure image data 20 in which a blood vessel structure representing a traveling state or a branch position of a blood vessel is depicted by superimposing a plurality of blood cell image data 10. That is, the estimation function 161 estimates a three-dimensional blood vessel structure based on three-dimensional blood cell image data in which the distribution of red blood cells in the three-dimensional region of the subject P is depicted. In addition, although the case where the image data which piled up the blood cell image data 10 of several sheets was produced | generated as blood-vessel structure image data 20 was demonstrated here, it is not limited to this. For example, the estimation function 161 may perform processing of smoothing an outline on image data in which a plurality of blood cell image data 10 is superimposed, and may be used as the blood vessel structure image data 20. Thereby, the estimation function 161 can smooth the surface of the vascular structure to be drawn.

  Further, the number of blood cell image data 10 to be superimposed to generate the blood vessel structure image data 20 can be arbitrarily set. Further, the number of sheets to be superimposed may be determined in advance before imaging, or the operator may select arbitrary image data from among a plurality of blood cell image data 10 stored after imaging.

  In step S104, the output control function 163 causes the blood vessel structure image data 20 to be displayed. For example, the output control function 163 causes the display 104 to display the blood vessel structure image data 20 generated by the estimation function 161.

  In step S105, the calculation function 162 receives an operation for specifying an analysis range. Here, the analysis range indicates a range of the blood vessel structure estimated by the estimation function 161 as a target for measuring a blood vessel volume. For example, as shown in FIG. 4, the operator sets a marker 23 indicating an analysis range on the blood vessel structure image data 20. The operator can arbitrarily set the position, shape, size, direction, and the like of the marker 23.

  In step S106, the calculation function 162 calculates the blood vessel volume in the analysis range. For example, the calculation function 162 calculates the volume (blood vessel volume) of the blood vessel included in the range designated by the operator in the blood vessel structure. Specifically, when the operator performs an operation to determine the position, shape, size, direction, and the like of the marker 23, the calculation function 162 calculates the volume of the blood vessel included in the determined marker 23. More specifically, the calculation function 162 specifies pixel positions of a plurality of red blood cells 13 included in the marker 23, and calculates a volume according to the number of specified pixels as a blood vessel volume.

  In step S107, the output control function 163 causes the blood vessel volume to be displayed. For example, the output control function 163 causes the display 104 to display the blood vessel volume calculated by the calculation function 162.

  Thus, the optical ultrasonic diagnostic apparatus 1 according to the first embodiment generates the blood vessel structure image data 20 and calculates the blood vessel volume. The optical ultrasonic diagnostic apparatus 1 not only displays the blood vessel structure image data 20 and the blood vessel volume, but also stores it in the storage circuit 150 or a portable storage medium, or transmits it to a predetermined external device via a network. can do.

  Further, the calculation function 162 can execute not only the blood vessel volume, but also the calculation process of calculating the number of red blood cells and the hematocrit value. For example, the calculation function 162 counts the number of red blood cells included in the analysis range from blood cell image data at an arbitrary timing (temporal phase). Specifically, the calculation function 162 identifies each red blood cell within the analysis range by shape recognition of red blood cells, and counts the number of red blood cells specified. Also, the mass (and volume) per red blood cell is known. Therefore, the calculation function 162 can calculate the hematocrit value from the blood vessel volume and the red blood cell mass in the analysis range.

  In addition, the process sequence shown in FIG. 2 is an example to the last, and is not limited to the illustrated order. For example, the illustrated processing procedure can be arbitrarily changed as long as no contradiction occurs in the processing content.

  As described above, in the optical ultrasonic diagnostic apparatus 1 according to the first embodiment, the image generation circuit 140 is based on the optical ultrasonic waves generated in the subject by the irradiation of the light having the preset wavelength. , Generates image data in which red blood cells are drawn. The estimation function 161 also estimates the blood vessel structure of the subject P based on the image data generated over a predetermined period. The output control function 163 outputs information on the blood vessel structure. Thereby, the photoacoustic imaging apparatus 1 according to the first embodiment can easily visualize the blood vessel structure.

  For example, in the case of a photoacoustic microscope, it is possible to image blood cell image data 10 having a resolution sufficient to distinguish individual red blood cells. However, in the blood cell image data 10, a plurality of red blood cells are discretely drawn, and it is not possible to draw the blood vessel itself in which the red blood cells are originally present. Therefore, the optical ultrasonic diagnostic apparatus 1 according to the first embodiment generates blood vessel structure image data 20 by superimposing a plurality of blood cell image data 10 captured at different timings in the same target region. In the blood vessel structure image data 20, the respective red blood cells are drawn in succession. As a result, the photoacoustic imaging apparatus 1 according to the first embodiment can easily visualize the blood vessel structure by specifying the positions of the red blood cells drawn in succession as the blood vessel position.

  Also, in general, when measuring red blood cell concentration, blood collection is performed. For example, blood is collected from the subject P, and the blood is centrifuged to separate red blood cells from others. Then, the mass of the separated red blood cells is measured, and the hematocrit value is calculated from the volume of the centrifuged blood and the mass of the red blood cells. However, in blood collection, it is difficult to collect blood several times a day because the burden on the patient (subject) is large. In addition, since there is a risk of infection or the like in blood collection, the injection needle and the blood collection tube are disposable, and a sterilization operation is required, which increases the running cost. In addition, blood collection has to be done by a qualified person such as a nurse, which also costs labor costs.

  On the other hand, the ultrasonic diagnostic apparatus 1 according to the first embodiment enables anyone to easily measure the red blood cell concentration. For example, in the optical ultrasonic diagnostic apparatus 1, since laser light is emitted from the body surface, it is non-invasive and can render red blood cells with high resolution. Therefore, the optical ultrasonic diagnostic apparatus 1 reduces the burden on the patient and reduces the risk of infection and the like. Further, in the optical ultrasonic diagnostic apparatus 1, measurement can be performed regardless of the skill of the measurement engineer, and the cost of labor cost can also be reduced.

Second Embodiment
In the first embodiment, the case where only red blood cells are depicted in blood cell image data has been described, but the embodiment is not limited thereto. For example, when a light absorber such as melanin or a tumor whose absorption wavelength overlaps with that of red blood cells is included in the target area of PAI, these light absorbers are drawn in blood cell image data as a background. Thus, in the second embodiment, a process for reducing the mixture of backgrounds will be described.

  The optical ultrasonic diagnostic apparatus 1 according to the second embodiment has the same configuration as that of the optical ultrasonic diagnostic apparatus 1 illustrated in FIG. 1, and part of the processing of the estimation function 161 and the output control function 163 is different. In the second embodiment, therefore, differences from the first embodiment will be mainly described, and descriptions of points having the same functions as the configurations described in the first embodiment will be omitted.

  The process in the optical ultrasonic diagnostic apparatus 1 according to the second embodiment will be specifically described with reference to FIG. FIG. 5 is a flowchart showing the processing procedure of the optical ultrasonic diagnostic apparatus 1 according to the second embodiment. The processing procedure illustrated in FIG. 5 is started, for example, when an input (instruction) to estimate a blood vessel structure is received from the operator. FIG. 5 will be described with reference to FIG. FIG. 6 is a diagram for explaining the process of the estimation function 161 according to the second embodiment.

  In step S201, the processing circuit 160 determines whether it is processing timing. For example, the operator uses the input interface 103 to make an input for estimating the blood vessel structure. The input interface 103 outputs, to the processing circuit 160, information for estimating the blood vessel structure input by the operator. When the processing circuit 160 receives information to estimate the blood vessel structure from the input interface 103, the processing circuit 160 determines that the input to estimate the blood vessel structure is received (Yes at step S201), and starts the process after step S202. . Note that the processing circuit 160 is in a standby state without starting processing of step S202 and subsequent steps until it receives an input to estimate a blood vessel structure (No at step S201).

  In step S202, the processing circuit 160 reads out a plurality of blood cell image data. Note that this process is the same as the process of step S102 shown in FIG.

  In step S203, the estimation function 161 identifies a dynamic part and a static part by comparing a plurality of blood cell image data. For example, as illustrated in FIG. 6, the estimation function 161 determines, for each position (pixel) included in the blood cell image data 30, whether or not the variation (dispersion value) of the pixel value in the time direction is equal to or greater than a threshold. . Here, the position where the variance value is equal to or more than the threshold is considered to be a dynamic part, for example, a part where red blood cells are drawn. On the other hand, the position where the dispersion value is less than the threshold is a static part, and is considered to be, for example, a part where the light absorber 31 as a background, such as melanin or a tumor, is drawn.

  As described above, the estimation function 161 determines whether or not the variation (dispersion value) of the pixel value in the time direction is equal to or greater than the threshold value for each position (pixel) included in the blood cell image data 30. An area corresponding to the first part and an area corresponding to the static part are identified.

  In step S204, the estimation function 161 estimates blood vessel structure by superimposing a plurality of blood cell image data. This process is the same as the process of step S103 shown in FIG.

  In step S205, the output control function 163 causes the blood vessel structure image data to be displayed. This process is the same as the process of step S104 shown in FIG.

  In step S206, the output control function 163 highlights the dynamic part. For example, as shown in the lower left of FIG. 6, the output control function 163 causes the display 104 to display the image data 40 in which the dynamic part is highlighted. Thereby, the operator can easily grasp the blood vessel structure even when the light absorber as the background is mixed.

  The output control function 163 may display not only a dynamic part but a static part. For example, as shown in the lower right of FIG. 6, the output control function 163 causes the display 104 to display the image data 50 depicting the static part. Thus, the operator can clearly understand the position of the light absorber as the background.

  The output control function 163 can also display image data depicting not only one of the dynamic part and the static part but also both. That is, the output control function 163 displays image data indicating at least one of a dynamic part and a static part.

  In addition, the process sequence shown in FIG. 5 is an example to the last, and is not limited to the illustrated order. For example, the illustrated processing procedure can be arbitrarily changed as long as no contradiction occurs in the processing content.

Third Embodiment
Although the embodiment described above describes the case where PAI is performed using red blood cells as a light absorber, the embodiments are not limited thereto. Not limited to red blood cells, for example, by administering a dye such as methylene blue or indosinian green, gold fine particles, and a substance (labeled substance) obtained by accumulating or chemically modifying (labeling) them into the subject P, It can be used as a light absorber.

  The optical ultrasonic diagnostic apparatus 1 according to the third embodiment has the same configuration as that of the optical ultrasonic diagnostic apparatus 1 illustrated in FIG. 1, and part of the processing of the calculation function 162 and the output control function 163 is different. Thus, in the third embodiment, differences from the first embodiment will be mainly described, and descriptions of points having the same functions as the configurations described in the first embodiment will be omitted.

  The process in the optical ultrasonic diagnostic apparatus 1 according to the third embodiment will be specifically described with reference to FIG. FIG. 7 is a flowchart showing the processing procedure of the optical ultrasonic diagnostic apparatus 1 according to the third embodiment. The processing procedure shown in FIG. 7 is started, for example, when an input (instruction) for calculating the blood concentration of the labeled substance is received from the operator. FIG. 7 will be described with reference to FIGS. 8 and 9 are diagrams for explaining the process of the calculation function 162 according to the third embodiment. 10 and 11 are diagrams for explaining the process of the output control function 163 according to the third embodiment.

  In step S301, the processing circuit 160 determines whether it is processing timing. For example, the operator uses the input interface 103 to input that the blood concentration of the labeled substance is to be calculated. The input interface 103 outputs, to the processing circuit 160, information for calculating the blood concentration of the labeled substance input by the operator. When the processing circuit 160 receives, from the input interface 103, information indicating that the blood concentration of the labeled substance is to be calculated, it determines that an input indicating that the blood concentration of the labeled substance is calculated has been received (Yes at step S301) The processing after step S302 is started. Note that the processing circuit 160 is in a standby state without starting the processing after step S302 until it receives an input to calculate the blood concentration of the labeled substance (No at step S301).

  In step S302, the processing circuit 160 reads out a plurality of blood cell image data and labeled substance image data. For example, the processing circuit 160 reads out a plurality of blood cell image data and labeled substance image data from the storage circuit 150. Here, the labeled substance image data is image data imaged by PAI in which the labeled substance is a light absorber. The labeled substance image data is image data obtained by imaging the same target area as the blood cell image data at the absorption wavelength for the labeled substance. The labeled substance image data is generated in advance by the image generation circuit 140 and stored in the storage circuit 150. That is, the image generation circuit 140 generates labeled substance image data in which the labeled substance is drawn for the same target area as the target area of the blood cell image data.

  In step S303, the estimation function 161 estimates a blood vessel structure by superimposing a plurality of blood cell image data. This process is the same as the process of step S103 shown in FIG.

  In step S304, the output control function 163 causes the blood vessel structure image data 20 to be displayed. This process is the same as the process of step S104 shown in FIG.

  In step S305, the calculation function 162 receives an operation for specifying an analysis range. Here, the operator may set a marker indicating the analysis range on the blood vessel structure image data 20 or may set it on the labeled substance image data. That is, the operator may set the marker 24 on the blood vessel structure image data 20 shown in FIG. 8 or may set the marker 61 on the labeled substance image data 60 shown in FIG. The positions and shapes of the markers 24 and the markers 61 are associated with each other, and the setting for one is configured to be reflected in the other. The enlarged image 25 is an enlarged image of the area indicated by the marker 24.

  In step S306, the calculation function 162 calculates the blood vessel volume in the analysis range. For example, the calculation function 162 calculates the blood vessel volume included in the marker 24 in the blood vessel structure.

  In step S307, the calculation function 162 counts labeled substances in the analysis range. For example, as shown in FIG. 9, the calculation function 162 counts the number of labeled substances 63 contained in the enlarged image 62 of the marker 61.

In step S308, the calculation function 162 calculates the blood concentration of the labeled substance in the analysis range. For example, the calculation function 162 calculates the concentration of the labeling substance 63 in the blood vessel based on the number of the labeling substance 63 depicted in the labeling substance image data 60 and the blood vessel volume. Specifically, the calculation function 162 divides the mass of the labeled substance 63 in the marker 61 by the blood vessel volume in the marker 24 to calculate the blood concentration [kg / m ³ ] of the labeled substance 63. The mass of the labeling substance 63 can be calculated from the number of the labeling substances 63 in the marker 61 since the mass per labeling substance 63 is known. When the volume per labeling substance 63 is known, the calculation function 162 may calculate the blood concentration as the volume ratio [%].

  In step S309, the output control function 163 causes the blood concentration of the labeled substance to be displayed. For example, the output control function 163 causes the display 104 to display the blood concentration of the labeling substance calculated by the calculation function 162.

  For example, as shown in FIG. 10, the output control function 163 causes the blood concentration value for each analysis range to be displayed on the blood vessel structure image data 20. In the illustrated example, the blood concentration in the analysis range A is 50%, the blood concentration in the analysis range B is 30%, and the blood concentration in the analysis range C is 50%. In addition to this, as shown in FIG. 11, the output control function 163 may generate and display blood concentration image data 70 to which a pixel value (tone) according to the blood concentration is assigned.

  Thus, the optical ultrasonic diagnostic apparatus 1 can be used as a light absorber by administering the labeling substance into the subject P. The optical ultrasonic diagnostic apparatus 1 can also calculate the concentration of blood glucose (blood sugar) as a light absorber in a living body.

  The processing procedure shown in FIG. 7 is merely an example, and the present invention is not limited to the illustrated order. For example, the illustrated processing procedure can be arbitrarily changed as long as no contradiction occurs in the processing content.

  Moreover, although the case where the number of labeled substances was calculated | required from the label substance image data 60 of 1 sheet was demonstrated in 3rd Embodiment, embodiment is not limited to this. For example, when a plurality of labeled substance image data 60 is obtained, the number of labeled substances in each labeled substance image data 60 may be determined, and the blood concentration may be calculated using the average value thereof. This is expected to improve the blood concentration accuracy.

Fourth Embodiment
Although the embodiment described above describes the case where one blood vessel volume measurement is performed, the embodiment is also applicable to the case where a plurality of blood vessel volume measurements are performed. In this case, by storing the position information of the analysis range measured at the first time, it is possible to measure the blood vessel volume of the same analysis range as the first time even in the second and subsequent blood vessel volume measurement.

  FIG. 12 is a diagram for explaining the process of the optical ultrasonic diagnostic apparatus 1 according to the fourth embodiment. As shown in FIG. 12, in the first blood vessel volume measurement, the output control function 163 extracts at least one feature site existing around the marker 23 indicating the analysis range in the blood vessel structure. In the illustrated example, the output control function 163 extracts the feature portions 26, 27, 28. Here, the characteristic portions 26, 27, 28 correspond to branch points or curved portions included in the blood vessel structure.

  Subsequently, the output control function 163 stores the position information of the analysis range represented by the positional relationship with the extracted feature part in the storage circuit 150. For example, the output control function 163 generates positional information of the analysis range by a combination of the distance and direction from the feature portion 26, the distance and direction from the feature portion 27, and the distance and direction from the feature portion 28. Then, the output control function 163 stores the position information of the marker 23 indicating the generated analysis range in the storage circuit 150.

  Then, when new blood vessel structure image data different from the first blood vessel structure image data 20 is generated, the calculation function 162 generates a new blood vessel based on the position information of the analysis range stored in the storage circuit 150. The position of the analysis range in structural image data is specified. For example, new blood vessel structure image data 80 is generated in the second blood vessel volume measurement. Here, the calculation function 162 reads from the storage circuit 150 the position information of the analysis range stored in the storage circuit 150 in the first blood vessel volume measurement. Then, the calculation function 162 extracts the characteristic portions 81, 82, 83 from the blood vessel structure image data 80. Here, the characteristic portion 81 corresponds to the characteristic portion 26 in the blood vessel structure image data 20. In addition, the characteristic portion 82 corresponds to the characteristic portion 27 in the blood vessel structure image data 20. In addition, the characteristic portion 83 corresponds to the characteristic portion 28 in the blood vessel structure image data 20. Then, the calculation function 162 specifies the position of the marker 84 indicating the analysis range, based on the distance and direction from the characteristic part 81, the distance and direction from the characteristic part 82, and the distance and direction from the characteristic part 83.

  Thus, the calculation function 162 specifies the position of the marker 84 indicating the analysis range corresponding to the marker 23 indicating the analysis range. Thereby, the optical ultrasonic diagnostic apparatus 1 can measure the blood vessel volume in the same analysis range as the first time even in the second and subsequent blood vessel volume measurements.

Fifth Embodiment
In addition, the optical ultrasonic diagnostic apparatus 1 can realize various functions by aligning the generated blood vessel structure image data with medical image data captured by another medical image diagnostic apparatus (modality). is there.

  FIG. 13 is a block diagram showing an example of the configuration of the optical ultrasonic diagnostic apparatus 1 according to the fifth embodiment. The optical ultrasonic diagnostic apparatus 1 according to the fifth embodiment has a configuration similar to that of the optical ultrasonic diagnostic apparatus 1 illustrated in FIG. 1, and the processing circuit 160 further includes an alignment function 164, and a calculation function 162. And a part of the processing of the output control function 163 is different. In the fifth embodiment, therefore, differences from the first embodiment will be mainly described, and the same function as that of the configuration described in the first embodiment is identical to that of FIG. The code is attached and the description is omitted.

  The alignment function 164 according to the fifth embodiment aligns the blood vessel structure image data 20 with medical image data captured by another medical image diagnostic apparatus. For example, the alignment function 164 aligns, as medical image data, CT image data captured by an X-ray CT (Computed Tomography) apparatus.

  For example, the alignment function 164 performs alignment by pattern matching between the blood vessel structure image data 20 and the CT image data. Specifically, the alignment function 164 extracts a characteristic area (feature portion) from each of the blood vessel structure image data 20 and the CT image data, and searches for an area similar to the extracted area. Alignment of structural image data 20 and CT image data is performed. The alignment function 164 is not limited to pattern matching, and alignment may be performed using any conventional technique. Further, the alignment function 164 can execute alignment with medical image data captured by any modality as well as CT image data. The alignment function 164 is an example of an alignment unit.

  FIG. 14 is a diagram for explaining the processing of the alignment function according to the fifth embodiment. FIG. 14 illustrates the case where the blood vessel structure image data 20 and the CT image data 90 are aligned.

  As shown in FIG. 14, the alignment function 164 has a feature portion 91 having the same features as the feature portions (branch points or curved portions included in the blood vessel structure) 26, 27, 28 included in the blood vessel structure image data 20, 92 and 93 are extracted from the CT image data 90. Here, the feature site 91 corresponds to the feature site 26 in the blood vessel structure image data 20. In addition, the characteristic portion 92 corresponds to the characteristic portion 27 in the blood vessel structure image data 20. In addition, the characteristic portion 93 corresponds to the characteristic portion 28 in the blood vessel structure image data 20. Then, the alignment function 164 performs alignment of the blood vessel structure image data 20 and the CT image data 90 using the positions of the corresponding characteristic parts.

  Then, the output control function 163 superimposes and displays the blood vessel structure image data 20 and the CT image data 90 after alignment. For example, when a structure (such as a lesion) other than a blood vessel is depicted in the CT image data 90, the output control function 163 generates the blood vessel structure image data 20 (or blood cell image data 10) on the CT image data 90. Display superimposed. Thus, the output control function 163 can present the state of red blood cells around the lesion to the operator.

  When contrast image data imaged using a contrast agent is used as the CT image data 90, the output control function 163 generates the blood vessel structure image data 20 (or the CT image data 90 which is the contrast image data). The blood cell image data 10) is superimposed and displayed. Since the blood vessel structure image data 20 can visualize a blood vessel finer than the contrast image data, the output control function 163 can simultaneously display various blood vessels in the subject P by superimposing. .

  In addition, the calculation function 162 selects a blood vessel volume included in an analysis range designated by the operator on the blood vessel structure image data 20 as CT image data based on the blood vessel structure image data 20 and the CT image data 90 after alignment. Calculated from 90. For example, the calculation function 162 specifies a marker 94 indicating an analysis range on the CT image data 90 based on the blood vessel structure image data 20 and the CT image data 90 after alignment. Here, the marker 94 indicating the analysis range corresponds to the marker 23 indicating the analysis range set on the blood vessel structure image data 20. Then, the calculation function 162 specifies the pixel position of the blood vessel included in the marker 94 indicating the analysis range, and calculates the volume according to the number of specified pixels as the blood vessel volume. Thereby, the calculation function 162 can calculate the blood vessel volume based on the CT image data 90 with high reliability of the form information. The calculation function 162 can use the blood vessel volume calculated based on the CT image data 90 to calculate the hematocrit value and the blood concentration.

Sixth Embodiment
The estimation process of the blood vessel structure described above can also be applied to an ultrasonic diagnostic apparatus.

  For example, ultrasound diagnostic devices are used in drug delivery systems. The drug delivery system is a technology for injecting a drug into a specific tissue (target site) using microbubbles in which the drug is enclosed and ultrasound. Therefore, together with this technology, by using an ultrasonic diagnostic device that can execute the above-described process of estimating the blood vessel structure, the blood vessel structure around the target site is depicted, and the blood concentration and injection ratio of the microbubbles are analyzed. It is possible to The microbubbles are also referred to as "contrast bubbles" or simply "bubbles".

  FIG. 15 is a block diagram showing a configuration example of an ultrasonic diagnostic apparatus 2 according to the sixth embodiment. As shown in FIG. 15, the ultrasonic diagnostic apparatus 2 according to the sixth embodiment has an apparatus main body 300, an ultrasonic probe 102, an input interface 103, and a display 104. The configurations of the ultrasonic probe 102, the input interface 103, and the display 104 are basically the same as the configurations of the ultrasonic probe 102, the input interface 103, and the display 104 shown in FIG. The subject P is not included in the configuration of the optical ultrasonic diagnostic apparatus 1. In addition, the ultrasonic diagnostic apparatus 2 may be the same apparatus as the ultrasonic diagnostic apparatus for injecting a drug by a drug delivery system, or may be a separate apparatus.

  The apparatus main body 300 is an apparatus for generating image data based on the ultrasonic waves received by the ultrasonic probe 102, and as shown in FIG. 15, the transmission / reception circuit 310, the signal processing circuit 130, and the image generation circuit 140 The memory circuit 150 and the processing circuit 320 are included. The transmission / reception circuit 310, the signal processing circuit 130, the image generation circuit 140, the storage circuit 150, and the processing circuit 320 are communicably connected to each other.

  The transmitting and receiving circuit 310 has a configuration as a transmitting circuit for transmitting an ultrasonic wave in addition to the configuration as the receiving circuit 120 for receiving an ultrasonic wave (optical ultrasonic wave). That is, the transmission / reception circuit 310 includes a rate pulser generation circuit, a transmission delay circuit, and a transmission pulser, and supplies a drive signal to the ultrasonic probe 102. Thereby, the transmission / reception circuit 310 causes the ultrasonic probe 102 to transmit an ultrasonic beam for scanning a two-dimensional or three-dimensional area.

  The reflected wave of the ultrasonic wave transmitted by the ultrasonic probe 102 is received by the ultrasonic probe 102, amplified and A / D converted, and input to the transmission / reception circuit 310 as a digital electric signal. The transmission / reception circuit 310 performs various processes on the digital electric signal transmitted from the ultrasonic probe 102 to generate reception data (reflected wave data). The process of generating the reception data is the same as the process of the reception circuit 120 shown in FIG. That is, the transmission / reception circuit 310 performs ultrasonic scanning on the subject into which the contrast bubble has been injected, and collects reflected wave data from the subject P. The transmission / reception circuit 310 is an example of a transmission / reception unit.

  The configurations of the signal processing circuit 130, the image generation circuit 140, and the storage circuit 150 are basically the same as the configurations of the signal processing circuit 130, the image generation circuit 140, and the storage circuit 150 shown in FIG. The difference is that processing on the reflected wave data generated by 310 can be performed.

  The signal processing circuit 130 generates distribution data of characteristic values in the object P using the reflected wave data received from the transmitting and receiving circuit 310. Specifically, the signal processing circuit 130 performs logarithmic amplification, envelope detection processing, etc. on the reflected wave data, and data (signal intensity (amplitude intensity)) for each sample point is represented by the brightness of luminance ( B mode data) is generated. Further, the signal processing circuit 130 can change the frequency band to be imaged by changing the detection frequency. By using this function, the signal processing circuit 130 can perform contrast harmonic imaging (CHI) imaging the non-linear signal from the contrast bubble. For example, the signal processing circuit 130 can generate B-mode data that is the source of contrast image data.

  The signal processing circuit 130 also analyzes the frequency of the reflected wave data to extract motion information of a moving body (blood flow, tissue, contrast agent echo component, etc.) based on the Doppler effect, and data indicating the extracted motion information. Generate (Doppler data). For example, the signal processing circuit 130 extracts an average velocity, an average dispersion value, an average power value, and the like over multiple points as motion information of the moving object, and generates Doppler data indicating motion information of the extracted moving object.

  The image generation circuit 140 generates ultrasound image data from data generated based on the reflected wave data. For example, the image generation circuit 140 generates, from the B mode data generated by the signal processing circuit 130, B mode image data in which the intensity of the reflected wave is represented by luminance. Further, when performing the CHI, the image generation circuit 140 generates contrast image data obtained by visualizing the non-linear signal from the contrast bubble from the B mode data generated by the signal processing circuit 130. Further, the image generation circuit 140 generates Doppler image data in which blood flow information is visualized from the Doppler data generated by the signal processing circuit 130. The Doppler image data is velocity image data, dispersed image data, power image data, or image data combining these. That is, the image generation circuit 140 generates contrast image data representing the distribution of the signal intensity of the reflected wave with the contrast bubble as the reflection source, based on the reflected wave data.

  The storage circuit 150 stores ultrasound image data generated by the image generation circuit 140 together with accompanying information.

  The processing circuit 320 controls the entire processing of the ultrasound diagnostic apparatus 2. For example, the processing circuit 320 is based on various setting requests input from the operator via the input interface 103, various control programs and various data read from the storage circuit 150, and the transmission / reception circuit 310, the signal processing circuit 130, and The processing of the image generation circuit 140 is controlled. Further, the processing circuit 320 causes the display 104 to display ultrasound image data stored in the storage circuit 150.

  Further, as shown in FIG. 15, the processing circuit 320 executes an estimation function 321, a calculation function 322, and an output control function 323. The processes of the estimation function 321, the calculation function 322, and the output control function 323 are basically the same as the processes of the estimation function 161, the calculation function 162, and the output control function 163 shown in FIG. The difference is that processing on the generated ultrasound image data can be performed.

  The process in the ultrasonic diagnostic apparatus 2 according to the sixth embodiment will be specifically described with reference to FIG. FIG. 16 is a flowchart showing a processing procedure of processing in the ultrasonic diagnostic apparatus 2 according to the sixth embodiment. The processing procedure illustrated in FIG. 16 is started, for example, when an input (instruction) to display a blood vessel structure is received from the operator. FIG. 16 will be described with reference to FIG. 17, FIG. 18 and FIG. FIG. 17, FIG. 18 and FIG. 19 are diagrams for explaining the process of the calculation function 322 according to the sixth embodiment.

  In step S401, the processing circuit 320 determines whether processing timing has come. This process is basically the same as the process of step S101 shown in FIG.

  In step S402, the processing circuit 160 reads out a plurality of contrast image data. This process is basically the same as the process of step S102 shown in FIG. 2 except that the process object is “contrast image data”, and thus the description thereof is omitted. The contrast image data to be processed is three-dimensional image data captured when the drug delivery system performs injection of a drug. Note that the processing circuit 160 may read the contrast image data generated by the image generation circuit 140 in real time during imaging (ultrasound examination) or may read it after imaging (for example, after a predetermined time has elapsed). It is possible. Note that "real time" means that each process is immediately performed each time each data to be processed is generated. That is, real time is a concept including a delay due to the processing time of each process.

  In step S403, the estimation function 321 estimates a blood vessel structure by superimposing a plurality of contrast image data. For example, as illustrated in FIG. 17, the estimation function 321 generates blood vessel structure image data 330 by superimposing a plurality of contrast image data from the 1st to Nth frames. That is, the estimation function 321 estimates the blood vessel structure of the subject P based on the contrast image data generated over a predetermined period. This process (estimation process of the blood vessel structure) is basically the same as the process of step S103 shown in FIG. 2 except that the process target is “contrast image data”, and thus detailed description will be omitted.

  In step S404, the output control function 323 displays blood vessel structure image data. For example, as shown in FIG. 17, the output control function 323 causes the blood vessel structure image data 330 to be displayed. Since this process is basically the same as the process of step S104 shown in FIG. 2, the detailed description will be omitted.

  In step S405, the calculation function 322 receives an operation for specifying an analysis range. For example, as shown in FIG. 17, the operator sets a marker 331 indicating an analysis range on the blood vessel structure image data 330. The operator can arbitrarily set the position, shape, size, direction, and the like of the marker 331. The enlarged image 332 shown in FIG. 17 is an enlarged image of the area included in the marker 331. Since this process is basically the same as the process of step S105 shown in FIG. 2, detailed description will be omitted.

  In step S406, the calculation function 322 calculates the blood concentration of the contrast agent. That is, the calculation function 322 calculates the density of the contrast bubble included in the range (analysis range) designated by the operator in the blood vessel structure.

  As shown in FIG. 17, the calculation function 322 first calculates the volume (blood vessel volume) of the blood vessel included in the range (analysis range) designated by the operator in the blood vessel structure. Specifically, when the operator performs an operation to determine the position, shape, size, direction, and the like of the marker 331, the calculation function 322 calculates the volume of the blood vessel included in the determined marker 331. More specifically, the calculation function 322 specifies pixel positions of a plurality of contrast bubbles included in the marker 331, and calculates a volume according to the number of specified pixels as a blood vessel volume. The volume per pixel is defined by the apparatus configuration of the ultrasonic diagnostic apparatus 2 and the ultrasonic probe 102.

  Subsequently, the calculation function 322 measures the bubble amount included in the analysis range in the contrast image data of the Nth frame. The enlarged image 340 shown in FIG. 17 is an image of a region corresponding to the enlarged image 332 in the contrast image data of the Nth frame. For example, the calculation function 322 specifies the pixel positions of a plurality of contrast bubbles included in the analysis range (that is, the area of the enlarged image 340) in the contrast image data of the Nth frame, and the bubble is determined according to the number of specified pixels. Measure the quantity. In addition, since the volume per bubble is known information for each contrast bubble, the bubble amount can be calculated by combining with the volume per pixel.

  Then, the calculation function 322 calculates the blood concentration of the bubble by dividing the volume of the contrast bubble included in the analysis range in the contrast image data of the predetermined frame by the volume of the blood vessel corresponding to the analysis range. In the example shown in FIG. 19, the blood vessel volume is “V” and the bubble amount is “A1”. In this case, the calculation function 322 calculates the blood concentration "C1 = A1 / V" of the bubble.

  In addition, said description content is an example to the last, It is not limited to said description content. For example, although FIG. 17 illustrates the case where the blood concentration at the Nth frame is calculated, the present invention is not limited to this, and the blood concentration in any frame can be calculated.

  In step S407, the calculation function 322 calculates the injection amount of the medicine. That is, the calculation function 322 calculates the injection ratio of the drug into the tissue in the range designated by the operator in the blood vessel structure.

  As shown in FIG. 18, the calculation function 322 first calculates the volume (blood vessel volume) of the blood vessel included in the range (analysis range) designated by the operator in the blood vessel structure. The process of calculating the blood vessel volume is the same as the process of step S406, and thus the description thereof is omitted.

  Then, at the M-th frame, the operator disrupts the contrast bubble (microbubble) with the sound pressure of the ultrasonic wave, and injects the drug into the tissue. As a result, the contrast bubble disappears in the contrast image data 341 of the Mth frame. The enlarged image 341 shown in FIG. 18 is an image of a region corresponding to the enlarged image 332 in the contrast image data of the M-th frame. In the magnified image 332, a circle surrounded by a broken line indicates a collapsed contrast bubble. In the example of FIG. 18, all contrast bubbles in the analysis range at the M-th frame completely disappear, but may not completely disappear. Here, M is an integer of 1 or more.

  Then, the calculation function 322 measures the bubble amount included in the analysis range in the contrast image data of the (M + 1) th frame. The bubble amount measured here corresponds to the "remaining bubble amount" remaining without collapse. The enlarged image 342 shown in FIG. 18 is an image of a region corresponding to the enlarged image 332 in the contrast image data of the (M + 1) th frame. For example, the calculation function 322 specifies the pixel positions of a plurality of contrast bubbles included in the analysis range (that is, the area of the enlarged image 342) in the contrast image data of the M + 1th frame, and remaining according to the number of specified pixels. Measure the amount of bubbles. The process of measuring the bubble amount is the same as the process of step S406, and thus the description thereof is omitted.

  The calculation function 322 sets a value obtained by subtracting the amount of contrast bubble in the contrast image data of the frame after the collapse of the contrast bubble from the amount of contrast bubble in the contrast image data of the frame before the collapse of the contrast bubble in the analysis range. The infusion rate is calculated by dividing by the volume of the corresponding blood vessel. In the example shown in FIG. 19, the remaining bubble amount is “A2”. In this case, the calculation function 322 calculates the collapse rate “R1 = A2 / A1” of the bubble. In addition, the calculation function 322 calculates the injection amount of medicine “A3 = A1-A2”. In addition, the calculation function 322 calculates the injection ratio “R2 = A3 / V” of the medicine.

  In addition, said description content is an example to the last, It is not limited to said description content. For example, although FIG. 18 illustrates the case where the residual bubble amount is calculated from contrast image data “one frame later” from the M-th frame, it may be calculated from contrast image data “some frames later”.

  Although FIG. 19 illustrates the case where the blood concentration of the bubble, the decay rate of the bubble, the injection amount of the drug, and the injection ratio of the drug are calculated, the present invention is not limited thereto. For example, the calculation function 322 can calculate only arbitrary parameters among the blood concentration of the bubble, the decay rate of the bubble, the injection amount of the drug, and the injection ratio of the drug. Further, the calculation function 322 can calculate any parameter that can be calculated by four arithmetic operations of any combination of the blood vessel volume “V”, the bubble amount “A1”, and the remaining bubble amount “A2”.

  In step S408, the output control function 323 displays the calculation result. For example, the output control function 323 causes the display 104 to display arbitrary parameters such as the blood concentration of the bubble calculated by the calculation function 322, the disintegration rate of the bubble, the injection amount of the drug, and the injection ratio of the drug.

  The processing procedure shown in FIG. 16 is merely an example, and the present invention is not limited to the illustrated order. For example, the illustrated processing procedure can be arbitrarily changed as long as no contradiction occurs in the processing content. For example, among the illustrated processing procedures, one of the processing of step S406 and step S407 may not be performed.

  As described above, the ultrasonic diagnostic apparatus 2 according to the sixth embodiment can execute the estimation process of the blood vessel structure using the contrast image data. As a result, the ultrasound diagnostic apparatus 2 can calculate various parameters related to the drug delivery system and can provide them to the operator (doctor).

  In the case of imaging a contrast image for the purpose of imaging blood vessels in a general ultrasonic diagnostic apparatus, a sufficient amount of contrast bubbles are injected so that the contrast bubbles are continuously drawn, so that the blood vessel structure is visualized. Be done. However, in the drug delivery system, since the injection amount of the contrast bubble is determined based on the dose of the drug to the patient (subject), the sufficient amount of contrast bubble is not necessarily injected, and the blood vessel structure It may not be depicted. On the other hand, the ultrasonic diagnostic apparatus 2 according to the sixth embodiment estimates a blood vessel structure by overlapping a plurality of contrast images even if the contrast bubbles are not drawn continuously. Therefore, the ultrasonic diagnostic apparatus 2 according to the sixth embodiment can estimate the blood vessel structure around the target site where drug injection is performed by the drug delivery system.

  The ultrasonic diagnostic apparatus 2 according to the sixth embodiment is useful not only when the drug delivery system is used, but also when the drug delivery system is not used. For example, even in a general CHI, microbubbles are gradually disintegrated by performing ultrasonic scanning. For this reason, if ultrasound scanning is performed for a fixed period or more, the contrast bubble may collapse and the contrast bubble may not be drawn continuously. Also in such a case, the estimation process of the blood vessel structure by the ultrasonic diagnostic apparatus 2 is useful.

  Also, for example, when the blood vessel is thin, the contrast bubble may not sufficiently enter the blood vessel, and the contrast bubble may not be drawn continuously. Also in such a case, the estimation process of the blood vessel structure by the ultrasonic diagnostic apparatus 2 is useful.

  Also, for example, even when the imaging site is apart from the injection site of the contrast bubble, a sufficient amount of contrast bubbles may not reach the imaging site, and the contrast bubbles may not be drawn continuously. Also in such a case, the estimation process of the blood vessel structure by the ultrasonic diagnostic apparatus 2 is useful.

  Also, in the Doppler mode, in general, when the blood flow velocity is slow, the imaging ability is reduced. On the other hand, the ultrasonic diagnostic apparatus 2 according to the sixth embodiment can visualize the blood vessel structure even if the blood flow velocity is low.

  The configuration of the ultrasonic diagnostic apparatus 2 described above is merely an example, and the present invention is not limited to the content of FIG. For example, the ultrasound diagnostic apparatus 2 may further include a configuration (for example, the light irradiation unit 101, the light source 110, and the like) that can execute PAI.

(Other embodiments)
The present invention may be embodied in various different forms other than the above-described embodiment.

(Imaging of blood vessel structure image data by receiving light ultrasound once)
In the above embodiment, the blood vessel structure image data 20 is generated by superposing a plurality of blood cell image data 10, but the embodiment is not limited to this. For example, the optical ultrasound diagnostic apparatus 1 can also image the blood vessel structure image data 20 by receiving the optical ultrasound once.

  For example, the image generation circuit 140 generates one piece of image data in which the trajectory of red blood cells is drawn based on the light ultrasonic waves obtained by one reception over a predetermined period. That is, the ultrasonic probe 102 continues to receive the optical ultrasonic waves for a predetermined period (for example, several milliseconds), and thereby receives the optical ultrasonic waves emitted while the individual red blood cells move. In the image data generated by the light ultrasonic waves, a trajectory of red blood cells moved during a predetermined period is depicted.

  Therefore, the estimation function 161 estimates the blood vessel structure based on the trajectory of red blood cells depicted in the image data. Specifically, in the image data generated by the image generation circuit 140, the trajectories of a plurality of red blood cells are depicted in an overlapping manner. Therefore, the estimating function 161 estimates the blood vessel structure by specifying the trajectories of all the drawn red blood cells as the blood vessel position. As a result, the photoacoustic imaging apparatus 1 can image the blood vessel structure image data 20 by receiving the photoacoustic waves once.

(Use of 2D image data)
In the above embodiment, the blood vessel volume is calculated using three-dimensional image data (blood cell image data, contrast image data), but the embodiment is not limited to this. For example, even when two-dimensional image data (tomographic image) is used, the blood vessel volume can be calculated. For example, the estimation function 161 estimates a two-dimensional blood vessel structure by superimposing a plurality of two-dimensional blood cell image data. Then, the calculation function 162 can calculate, as the blood vessel volume, the volume of the rotating body whose rotation axis is the core line of the blood vessel included in the analysis range. The calculation function 162 can also estimate the blood concentration from the presence ratio of blood cells (or contrast agent) in the tomographic image.

(Application to medical image processing device)
The processing described in the above-described embodiment can be similarly realized in a medical image processing apparatus.

  FIG. 20 is a block diagram showing a configuration example of a medical image processing apparatus 200 according to another embodiment. The medical image processing apparatus 200 corresponds to, for example, an information processing apparatus such as a personal computer or a workstation, or a control apparatus of a medical image diagnostic apparatus such as a console apparatus included in an X-ray CT apparatus.

  As shown in FIG. 20, the medical image processing apparatus 200 includes an input interface 201, a display 202, a storage circuit 210, and a processing circuit 220. The input interface 201, the display 202, the storage circuit 210, and the processing circuit 220 are communicably connected to one another.

  The input interface 201 is an input device for receiving various instructions and setting requests from the operator, such as a mouse, a keyboard, and a touch panel. The display 202 is a display device that displays a medical image, or displays a GUI for the operator to input various setting requests using the input interface 201.

  The memory circuit 210 is, for example, a NAND (Not AND) type flash memory or an HDD (Hard Disk Drive), and stores various programs for displaying medical image data and a GUI, and information used by the programs.

  The processing circuit 220 is an electronic device (processor) that controls the entire processing in the medical image processing apparatus 200. The processing circuit 220 executes an estimation function 221, a calculation function 222, and an output control function 223. Each processing function executed by the processing circuit 220 is, for example, stored in the storage circuit 210 in the form of a program executable by a computer. The processing circuit 220 reads out each program and executes it to realize a function corresponding to each read program.

  The processing circuit 220 can execute basically the same processing as the processing circuit 160 shown in FIG. The processing circuit 220 reads out a plurality of blood cell image data. That is, the processing circuit 220 as an acquisition unit is image data generated based on light ultrasonic waves generated in the subject by irradiation of light having a preset wavelength, and image data in which red blood cells are drawn To get

  Further, the estimation function 221 can execute basically the same processing as the estimation function 161 shown in FIG. That is, the estimation function 221 estimates the blood vessel structure of the subject based on the image data generated over a predetermined period.

  Also, the calculation function 222 can execute basically the same processing as the calculation function 162 shown in FIG. That is, the calculation function 222 calculates the blood vessel volume included in the range designated by the operator in the blood vessel structure.

  Also, the output control function 223 can execute basically the same processing as the output control function 163 shown in FIG. That is, the output control function 223 outputs information on the blood vessel structure. According to this, the medical image processing apparatus 200 can easily visualize the blood vessel structure.

  In the embodiment described above, each processing function is realized by a single processing circuit 160. However, a plurality of independent processors are combined to form a processing circuit, and each processor generates a program. The function may be realized by executing the function.

  The word “processor” used in the above description is, for example, a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a programmable logic device (for example, It means circuits such as Simple Programmable Logic Device (SPLD), Complex Programmable Logic Device (CPLD), and Field Programmable Gate Array (FPGA). The processor implements a function by reading and executing a program stored in the memory circuit 150. Note that instead of storing the program in the memory circuit 150, the program may be directly incorporated in the circuit of the processor. In this case, the processor implements the function by reading and executing a program embedded in the circuit. Each processor according to the present embodiment is not limited to being configured as a single circuit for each processor, and may be configured as one processor by combining a plurality of independent circuits to realize the function. Good. Furthermore, multiple components in each figure may be integrated into one processor to realize its function.

  Further, each component of each device illustrated is functionally conceptual, and does not necessarily have to be physically configured as illustrated. That is, the specific form of the dispersion and integration of each device is not limited to that shown in the drawings, and all or a part thereof is functionally or physically dispersed in any unit depending on various loads, usage conditions, etc. It can be integrated and configured. Furthermore, all or any part of each processing function performed in each device may be realized by a CPU and a program analyzed and executed by the CPU, or may be realized as wired logic hardware.

  Further, among the processes described in the above embodiment, all or part of the process described as being automatically performed may be manually performed, or the process described as being manually performed. All or part of can be performed automatically by known methods. In addition to the above, the processing procedures, control procedures, specific names, and information including various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified.

  In addition, the medical image processing method described in the above embodiment can be realized by executing a medical image processing program prepared in advance by a computer such as a personal computer or a workstation. The medical image processing program can be distributed via a network such as the Internet. In addition, the medical image processing program may be recorded on a computer-readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, an MO, and a DVD, and may be executed by being read from the recording medium by a computer. it can.

  According to at least one embodiment described above, the blood vessel structure can be easily depicted.

  While certain embodiments of the present invention have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the invention. These embodiments can be implemented in other various forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the invention described in the claims and the equivalents thereof as well as included in the scope and the gist of the invention.

DESCRIPTION OF SYMBOLS 1 Optical ultrasonic diagnostic equipment 160 Processing circuit 161 Estimation function 162 Calculation function 163 Output control function

Claims (17)

An irradiation unit for irradiating light having a preset wavelength;
A receiver configured to receive optical ultrasonic waves generated in the subject by the irradiation of the light;
An image generation unit that generates blood cell image data in which red blood cells are drawn based on the light ultrasonic waves;
An estimation unit configured to estimate the blood vessel structure of the subject based on the blood cell image data generated over a predetermined period;
An output control unit that outputs information related to the blood vessel structure. The image generation unit generates a plurality of blood cell image data over the predetermined period, based on light ultrasonic waves obtained by the plurality of receptions over the predetermined period.
The estimation unit generates blood vessel structure image data in which the blood vessel structure is depicted by superimposing the plurality of generated blood cell image data, and estimates the blood vessel structure based on the blood vessel structure image data.
An optical ultrasonic diagnostic apparatus according to claim 1. The estimation unit identifies each of a dynamic part and a static part in the blood vessel structure image data by comparing the plurality of blood cell image data with each other,
The output control unit displays image data indicating at least one of the dynamic part and the static part.
The optical ultrasonic diagnostic device according to claim 2. The image generation unit generates one blood cell image data in which the trajectory of the red blood cell is drawn, based on the light ultrasonic waves obtained by one reception over the predetermined period.
The estimation unit generates blood vessel structure image data in which the blood vessel structure is drawn based on a locus of the red blood cells drawn in the image data, and estimates the blood vessel structure based on the blood vessel structure image data.
An optical ultrasonic diagnostic apparatus according to claim 1. Further comprising a calculation unit that performs calculation processing;
The image generation unit generates three-dimensional blood cell image data based on the light ultrasonic waves generated in the three-dimensional region of the subject.
The estimation unit estimates a three-dimensional blood vessel structure based on the three-dimensional blood cell image data,
The calculation unit calculates the volume of the blood vessel included in the range designated by the operator in the three-dimensional blood vessel structure,
The output control unit outputs the volume.
The photoacoustic imaging apparatus according to any one of claims 1 to 4. The image generation unit generates labeled substance image data in which a labeled substance is drawn for the same target area as the target area of the three-dimensional blood cell image data;
The calculation unit calculates the concentration of the labeled substance in the blood vessel based on the number of the labeled substance depicted in the labeled substance image data and the volume of the blood vessel.
The optical ultrasonic diagnostic device according to claim 5. The output control unit extracts at least one feature site existing around the range in the blood vessel structure, and stores, in a memory circuit, position information of the range represented by a positional relationship with the extracted feature site. And
The calculation unit is configured to generate the new blood vessel structure image data different from the blood vessel structure image data in which the blood vessel structure is drawn, based on the position information of the range stored in the storage circuit. Identifying the location of the range in various blood vessel structure image data,
An optical ultrasonic diagnostic apparatus according to claim 5 or 6. The apparatus further comprises an alignment unit that aligns the blood vessel structure image data in which the blood vessel structure is depicted with medical image data captured by another medical image diagnostic apparatus.
The optical ultrasonic diagnostic device according to any one of claims 1 to 7. The output control unit superimposes and displays the blood vessel structure image data and the medical image data after the alignment.
The optical ultrasonic diagnostic device according to claim 8. The blood vessel structure further includes a calculator configured to calculate the volume of the blood vessel included in the range designated by the operator in the blood vessel structure,
The calculation unit further determines the volume of the blood vessel included in a range designated by the operator on the blood vessel structure image data based on the blood vessel structure image data after the alignment and the medical image data. Calculated from medical image data
The optical ultrasonic diagnostic device according to claim 8. An acquisition unit configured to acquire blood cell image data in which red blood cells are drawn, which is blood cell image data generated based on light ultrasonic waves generated in a subject by irradiation of light having a preset wavelength;
An estimation unit configured to estimate the blood vessel structure of the subject based on the blood cell image data generated over a predetermined period;
An output control unit configured to output information on the blood vessel structure. Blood cell image data generated based on light ultrasonic waves generated in a subject by irradiation of light having a preset wavelength, which is blood cell image data in which red blood cells are drawn,
Estimating a blood vessel structure of the subject based on the blood cell image data generated over a predetermined period;
A medical image processing program that causes a computer to execute each process for outputting information related to the blood vessel structure. A transmitting / receiving unit that performs ultrasonic scanning on a subject into which a contrast bubble has been injected, and collects reflected wave data from the subject;
An image generation unit configured to generate contrast image data representing a distribution of signal intensity of a reflected wave having the contrast bubble as a reflection source based on the reflected wave data;
An estimation unit configured to estimate the blood vessel structure of the subject based on the contrast image data generated over a predetermined period;
A calculation unit that calculates the concentration of the contrast bubble included in the range designated by the operator in the blood vessel structure;
And an output control unit that outputs the result calculated by the calculation unit. The calculation unit calculates the concentration by dividing an amount of a contrast bubble included in the range in the contrast image data of a predetermined frame by a volume of a blood vessel corresponding to the range.
The ultrasonic diagnostic apparatus according to claim 13. The contrast bubble is sealed with a drug.
The calculation unit calculates an injection ratio of the medicine into the tissue in a range designated by the operator in the blood vessel structure.
The ultrasonic diagnostic apparatus according to claim 13. The calculation unit may calculate a value obtained by subtracting the amount of the contrast bubble in the contrast image data of the frame after the collapse of the contrast bubble from the amount of the contrast bubble in the contrast image data of the frame before the collapse of the contrast bubble. The injection rate is calculated by dividing by the volume of the blood vessel corresponding to the range.
The ultrasonic diagnostic apparatus according to claim 15. A transmitting / receiving unit that performs ultrasonic scanning on a subject into which a contrast bubble containing a drug is injected into the subject and collects reflected wave data from the subject;
An image generation unit configured to generate contrast image data representing a distribution of signal intensity of a reflected wave having the contrast bubble as a reflection source based on the reflected wave data;
An estimation unit configured to estimate the blood vessel structure of the subject based on the contrast image data generated over a predetermined period;
A calculator configured to calculate an injection ratio of the medicine into the tissue in a range designated by the operator in the blood vessel structure;
And an output control unit that outputs the result calculated by the calculation unit.

Images