JP6490171B2 - Data processing apparatus and data processing method - Google Patents

Description

  The present invention relates to a technique for displaying image data in a subject information acquisition apparatus.

  Many proposals have been made so far regarding techniques for non-invasive imaging of tomographic images inside a subject. One of them is Photoacoustic Tomography (PAT: Photoacoustic Tomography) that acquires biological function information using light and ultrasonic waves.

Photoacoustic tomography receives and analyzes acoustic waves (typically ultrasonic waves) generated by irradiating a subject with pulsed light generated by a light source and absorbing the light within the subject. This is a technique for imaging tissue. Visualization of information related to optical characteristics such as absorption coefficient inside the subject by detecting changes in the received acoustic wave over time at multiple locations and mathematically analyzing and reconstructing the resulting signal be able to.
Near-infrared light is easy to transmit water that constitutes the majority of living organisms and is easily absorbed by hemoglobin in blood, so blood vessel images can be acquired by using near-infrared light as pulsed light. Can do. Furthermore, by comparing blood vessel images acquired with pulsed light of different wavelengths, it is possible to measure oxygen saturation in blood, which is functional information. Since blood around malignant tumors is thought to have lower oxygen saturation than blood around benign tumors, it is expected to be able to distinguish between good and bad tumors by knowing oxygen saturation .

For example, Non-Patent Document 1 is known as a related technique.
In Non-Patent Document 1, based on the measured absorption coefficient in a subject, a signal portion, that is, a portion in which the presence of blood is estimated is distinguished from a background portion that is another portion, and oxygen saturation of the signal portion is determined. A photoacoustic tomography apparatus that creates and displays only a degree distribution is disclosed.

Xueding Wang, et al., “Noninvasive imaging of hemoglobin concentration and oxygenation in the rat brain using high-resolution photoacoustic tomography”, Journal of Biomedical Optics 11 (2), 024015, Mar / Apr 2006

When the main light absorbers in the subject are oxygenated hemoglobin and reduced hemoglobin, the oxygen saturation is calculated as follows.
The absorption coefficient μ _a (λ) in the subject obtained by measurement using light of wavelength λ is the product of the absorption coefficient ε _ox (λ) of oxyhemoglobin and the abundance ratio C _ox of oxyhemoglobin and the reduced hemoglobin. It is the sum of products of the absorption coefficient ε _de (λ) and the abundance ratio C _de of reduced hemoglobin. That is, μ _a (λ) can be expressed by Equation 1.

[epsilon] _ox ([lambda]) and [epsilon] _de ([lambda]) are physical properties having fixed values, and are measured in advance by other methods. Unknowns in Equation 1, since it is two C _ox and C _de, by performing at least twice measured using light of different wavelengths, it is possible to calculate the C _ox and C _de by simultaneous equations. Further in the case of performing measurements many wavelengths, it is possible to obtain a C _ox and C _de by fitting by least square method.
The oxygen saturation level SO ₂ is the ratio of oxyhemoglobin to total hemoglobin.
Can be calculated.

When measurement is performed at _two wavelengths λ ₁ and λ ₂ , by substituting C _ox and C _de obtained by solving the simultaneous equations of Equation 1 into Equation 2, the oxygen saturation SO ₂ can be obtained from Equation 3. And can be further transformed as shown in Equation 4.

  Here, the oxygen saturation distribution is a two-dimensional or three-dimensional representation of the value of oxygen saturation in the subject, and is an image showing the value of oxygen saturation in color or brightness. .

  In photoacoustic tomography, the deeper the depth of the measurement target region, the smaller the amount of light that reaches the deep part of the subject, and the weaker the generated acoustic wave. That is, the deeper the region to be measured, the worse the SN ratio of the measured absorption coefficient, and the greater the measurement error. When the S / N ratio of the absorption coefficient is poor, the calculated oxygen saturation varies greatly when the denominator term of the absorption coefficient ratio varies. In other words, since the error in the oxygen saturation distribution becomes large, there is a problem that it is difficult to determine a portion to be observed, that is, a portion where blood is present.

  In the photoacoustic tomography apparatus described in Non-Patent Document 1, the distribution of oxygen saturation is generated and displayed by distinguishing the signal portion and the background portion using the measured absorption coefficient. However, as the measurement target location is deeper in the subject, the error of the absorption coefficient increases, and as the measurement target location becomes deeper, it becomes difficult to accurately determine the signal portion and the background portion. . Therefore, the technique described in Non-Patent Document 1 cannot solve the problem of accurately discriminating a portion where blood is present.

The oxygen saturation distribution in a portion with a poor S / N ratio, such as the deep part of the subject, does not have a uniform value, but has a variable value. By visually observing the oxygen saturation distribution, its properties (approximate values) It is also difficult to read the properties of the distribution such as error and continuity. Furthermore, when the oxygen saturation distribution is three-dimensional, since the distribution in the three-dimensional space is displayed on the display as a two-dimensional image, it is difficult to grasp the distribution at a glance, and it becomes more difficult to read the oxygen saturation value. .

  In order to solve this problem, it is necessary to be able to accurately read the properties of the oxygen saturation distribution at the target location even when measurement is performed on a location with a poor S / N ratio.

  The present invention has been made on the basis of such problem recognition, and an object of the present invention is to provide a subject information acquisition apparatus capable of accurately evaluating the distribution of oxygen saturation.

In order to solve the above problems, a data processing apparatus according to the present invention provides:
First image data representing the spatial distribution of the content or content of the substance constituting the subject, and second image data representing the spatial distribution of information relating to the subject that is different from the content or content an image data acquisition means for acquiring, the first region of interest setting means for setting a region of interest for image data, statistical information acquisition means for acquiring the statistical information of the first image data corresponding to the previous SL Seki heart region Display control means for displaying an image based on the second image data on a display means, and the region of interest includes a first region of interest and a second region of interest different from each other, The region-of-interest setting unit automatically sets a region corresponding to the entire region of the first image data as the first region of interest for the first image data, and the second image is displayed on the display unit. Day A region corresponding to a part of the second image data designated by the operator when the image based on the image is displayed is set as the second region of interest for the first image data, and The statistical information acquisition means includes first statistical information of the first image data corresponding to the first region of interest, and second statistical information of the first image data corresponding to the second region of interest. acquires information as the statistical information, wherein the display control unit, the image including the first statistical information and the second statistical information, wherein the benzalkonium is displayed on the display means.

The data processing method according to the present invention includes:
First image data representing the spatial distribution of the content or content of the substance constituting the subject, and second image data representing the spatial distribution of information relating to the subject that is different from the content or content a data processing method processes data processing apparatus executes to set a region of interest with respect to the first image data, and obtains the statistics of the first image data corresponding to the previous SL Seki heart region, the An image based on the second image data is displayed on the display means, and the region of interest includes a first region of interest and a second region of interest different from each other, and corresponds to the entire region of the first image data. An area is automatically set as the first region of interest for the first image data, and is designated by the operator when an image based on the second image data is displayed on the display means Previous A region corresponding to a part of the second image data is set as the second region of interest for the first image data, and a first of the first image data corresponding to the first region of interest is set. Statistical information and second statistical information of the first image data corresponding to the second region of interest is acquired as the statistical information, and includes the first statistical information and the second statistical information characterized in that to display an image on the display means.

  According to the present invention, it is possible to provide an object information acquiring apparatus that can accurately evaluate the distribution of oxygen saturation.

It is a figure which shows the system configuration | structure of the photoacoustic diagnostic apparatus which concerns on 1st embodiment. It is a figure which shows the example of a display of the photoacoustic diagnostic apparatus which concerns on 1st embodiment. It is a process flowchart figure of the photoacoustic diagnostic apparatus which concerns on 1st embodiment. It is a figure which shows the system configuration | structure of the photoacoustic diagnostic apparatus which concerns on 2nd embodiment. It is a figure which shows the example of a display of the photoacoustic diagnostic apparatus which concerns on 2nd embodiment. It is a figure which shows the example of a display which concerns on an Example.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In principle, the same components are denoted by the same reference numerals, and description thereof is omitted.

(First embodiment)
The photoacoustic diagnostic apparatus according to the first embodiment of the present invention irradiates the subject with measurement light, and analyzes the photoacoustic wave generated due to the measurement light, so that oxygen inside the living body as the subject is analyzed. This is an apparatus for imaging the distribution of saturation. Specifically, as shown in FIGS. 2 (A) to 2 (D), the oxygen saturation distribution is displayed as an image, and the statistics in the set region of interest are displayed. First, the components are described, then the processing method is described, and finally the effects are described.
Oxygen saturation, absorption coefficient, and the like can be said to be subject information representing characteristic information within the subject. That is, the photoacoustic diagnostic apparatus according to the embodiment can also be called a subject information acquisition apparatus.

<System configuration>
First, the configuration of the photoacoustic diagnostic apparatus according to the first embodiment will be described with reference to FIG. The photoacoustic diagnostic apparatus according to the first embodiment includes a first light source 1, a second light source 2, a light irradiation device 3, a subject 4, an acoustic detector 5, an electric signal processing device 6, a data processing device 7, and a region of interest. It consists of a setting device 12 and a display device 14. The data processing device 7 includes an image reconstruction unit 8, a light distribution correction unit 9, a comparison calculation unit 10, a statistic calculation unit 11, and an image generation unit 13.

<< Light source 1, 2 >>
The first light source 1 and the second light source 2 are devices that generate pulsed light. Each light source is preferably a laser light source in order to obtain a large output, but may be a light emitting diode or the like. In order to generate photoacoustic waves effectively, light must be irradiated in a sufficiently short time according to the thermal characteristics of the subject. When the subject is a living body, the pulse width of the pulsed light generated from the light source is preferably set to several tens of nanoseconds or less. The wavelength of the pulsed light is preferably about 700 nm to 1200 nm. Since light in this region can reach a relatively deep part of the living body and information on the deep part can be obtained, it is called a living body window. Further, it is desirable that the wavelength of the pulsed light has a high absorption coefficient with respect to the observation target.

The wavelength of the pulsed light emitted from the first light source 1 and the wavelength of the pulsed light emitted from the second light source 2 are different from each other. The wavelengths used by both light sources are preferably such that the absorption coefficients of oxyhemoglobin and reduced hemoglobin differ greatly from each other. Thereby, the error propagation to the oxygen saturation can be reduced, and the measurement accuracy of the oxygen saturation can be improved.
Moreover, it is preferable that the irradiation timing of the pulsed light by the first light source 1 and the irradiation timing of the pulsed light by the second light source 2 are different timings. This is because the absorption coefficient must be measured individually for each wavelength.
In the present embodiment, two light sources are used. However, when the light source is a wavelength tunable laser, a single light source serving as both the first light source and the second light source may be used.

<< Light irradiation device 3 >>
The light irradiation device 3 is a device that guides the pulsed light generated by the first light source 1 and the second light source 2 to the subject 4. Specifically, it is an optical device including an optical fiber, a lens, a mirror, a diffusion plate, and the like. By using these optical devices, irradiation conditions such as the irradiation shape of pulsed light, light density, and irradiation direction of the subject can be set arbitrarily. In addition, the optical apparatus which comprises the light irradiation apparatus 3 is not limited only to what was mention | raise | lifted here, What kind of thing may be used if it satisfies the above functions.
The 1st light source 1, the 2nd light source 2, and the light irradiation means 3 are the light irradiation means in this invention.

<< Subject 4 >>
The subject 4 does not constitute the present invention, but will be described here.
The subject 4 is a measurement object. The subject 4 is typically a living body, but may be a phantom that simulates the acoustic characteristics and optical characteristics of the living body. In the photoacoustic diagnostic apparatus, a light absorber having a large light absorption coefficient existing inside the subject 4 can be imaged. When the subject is a living body, imaging targets are hemoglobin, water, melanin, collagen, lipid, and the like. When the object is a phantom, a substance simulating the optical characteristics of the substance described above is enclosed inside as an alternative to the light absorber. Furthermore, a contrast agent, a molecular probe, or the like may be injected into a living body or phantom that is a subject.

<< Acoustic detector 5 >>
The acoustic detector 5 is means for converting an acoustic wave generated inside the subject 4 into an analog electric signal. The acoustic detector 5 may consist of a single acoustic detector or a plurality of acoustic detectors. Further, the acoustic detector 5 needs to be installed so as to be acoustically coupled to the subject 4 in order to eliminate the influence of reflection and attenuation of the acoustic wave. For example, it is desirable to provide an acoustic matching material such as an acoustic matching gel, water, or oil between the acoustic detector 5 and the subject 4.
Moreover, the acoustic detector 5 is desirable to have a high sensitivity and a wide frequency band. Specific examples include PZT (piezoelectric ceramics), PVDF (polyvinylidene fluoride resin), cMUT (capacitive micromachined ultrasonic transducer), and those using a Fabry-Perot interferometer. However, the present invention is not limited to those listed here, and may be anything as long as it satisfies the functions.

  In order to acquire a wide range of data, the light irradiation device 3 and the acoustic detector 5 are configured to be movable, and the measurement is continuously performed while sequentially changing the irradiation position of the pulsed light on the subject surface. Also good.

<< Electric signal processor 6 >>
The electric signal processing device 6 is means for amplifying the analog electric signal obtained by the acoustic detector 5 and converting it into a digital signal. Specifically, the electric signal processing device 6 is an amplifier made of an electric circuit, an analog-digital converter (ADC), or the like. In order to acquire data efficiently, it is desirable to provide as many amplifiers and ADCs as the number of receiving elements of the acoustic detector 5, but the amplifiers and ADCs prepared one by one may be sequentially connected and used. .
The acoustic detector 5 and the electrical signal processing device 6 are acoustic wave receiving means in the present invention.

<< Data processing device 7 >>
The data processing device 7 is a means for processing a digitized signal or numerical data and generating an image to be displayed on the display device 14. The data processing device 7 includes an image reconstruction unit 8, a light distribution correction unit 9, a comparison calculation unit 10, a statistic calculation unit 11, and an image generation unit 13.
The data processing device 7 is a computer including a CPU and DRAM (not shown), a nonvolatile memory, and a control port. Each module is controlled by the CPU executing a program stored in the nonvolatile memory. In the present embodiment, the data processing device 7 is a computer, but it may be hardware designed exclusively.

  The image reconstruction unit 8 is means for reconstructing a digitized signal and generating an image showing the distribution of the initial sound pressure at the sound source. An image showing the initial sound pressure distribution is generated for each wavelength of the light source. As the reconstruction processing method, the universal back projection method is preferred in which the differentially processed signal is propagated back from the position where the signal is obtained and superimposed, but any method can be used as long as it can construct an image from the signal. May be.

The light distribution correction unit 9 is a means for generating the absorption coefficient distribution of the absorber by calculating the attenuation of the light incident on the subject and dividing the initial sound pressure distribution by the light distribution. The initial sound pressure p of the photoacoustic wave depends on the light intensity φ as represented by the relationship of Equation 5. Here, Γ is a Grueneisen constant, and μ _a is an absorption coefficient.

When light enters the subject, the light is scattered and absorbed in the subject, and the light intensity decreases exponentially according to the propagation distance. Therefore, the distribution of the light intensity φ in the subject can be estimated from the intensity distribution of the light irradiated to the subject and the shape of the subject. In addition, the Grueneisen constant can be considered constant in the case of a living body. Therefore, the absorption coefficient distribution is obtained by dividing the initial sound pressure distribution by the light intensity distribution and the Gruneisen constant Γ. If only the relative value of the absorption coefficient distribution is obtained, it can be obtained without dividing by the Grueneisen constant.
Since the light intensity distribution in the subject varies depending on the wavelength of light, the absorption coefficient distribution is calculated for each wavelength. In the present embodiment, the absorption coefficient distribution corresponding to the wavelength of the first light source is referred to as a first absorption coefficient distribution, and the absorption coefficient distribution corresponding to the wavelength of the second light source is referred to as a second absorption coefficient distribution.
The calculated absorption coefficient is the light absorption information in the present invention, and the image reconstruction unit 8 and the light distribution correction unit 9 are the light absorption information calculation means in the present invention.

The comparison calculation unit 10 is a means for generating an oxygen saturation distribution by comparing the first absorption coefficient distribution and the second absorption coefficient distribution. Since the calculation of the oxygen saturation needs to start after all the absorption coefficient distributions corresponding to a plurality of wavelengths are prepared, the comparison calculation unit 10 is obtaining the absorption coefficient distribution corresponding to another wavelength. , Temporarily store the absorption coefficient distribution obtained before that.
As described above, the oxygen saturation distribution can be obtained by substituting the obtained absorption coefficient distribution into Equation 3. When three or more light sources are used, the oxygen saturation distribution can be obtained by obtaining C _ox and C _de by the least square method and substituting them into Equation 2.
The comparison calculation unit 10 is characteristic information calculation means in the present invention, and the generated oxygen saturation distribution is the characteristic distribution in the present invention.

The statistic calculation unit 11 is a means for calculating the statistic of the oxygen saturation distribution in the region of interest set by the region-of-interest setting device 12 described later. A statistic is information representing the nature of oxygen saturation. The statistic calculated by the statistic calculator 11 may be a single statistic or a plurality of types. Details of the statistics and the calculation method will be described later.
It is desirable to calculate the statistics using the oxygen saturation value for each pixel, but use the representative value of a certain range of pixels and the value at the interpolation point obtained by interpolating the pixels. May be. In this embodiment, a statistic is calculated using a value for each pixel.
The statistic calculator 11 is a statistic calculator in the present invention.

The image generation unit 13 is a unit that generates an image to be presented to the operator. Specific examples of images generated by the image generation unit 13 are shown in FIGS. The image generated by the image generation unit 13 includes an oxygen saturation distribution, a region of interest, and a calculated statistic. By including such information in the same image, the operator can easily know the nature of the oxygen saturation and can interactively confirm the change in the statistic with respect to the region of interest. . That is, it becomes easy to make a diagnosis.
Note that the generated images may be displayed on the same display device, and it is not always necessary to include all the images in the same image. For example, a first image for displaying the oxygen saturation distribution in the main window and a second image for displaying the statistics in the sub window may be generated.
The image generation unit 13 is an image generation unit in the present invention, and an image generated by the image generation unit 13 is image information in the present invention.

<< Region of Interest Setting Device 12 >>
The region-of-interest setting device 12 is means for setting a range for calculating a statistic for the oxygen saturation distribution generated by the comparison calculation unit 10. The region-of-interest setting device 12 is specifically a computer equipped with an input interface such as a keyboard, a mouse, a touch pen, and a touch panel, or a display.
Since the region of interest is the region that the operator is paying attention to, it is desirable to set it manually, but if the region of interest is the same as the previous measurement or if it can be set based on a certain rule, it is The locations and laws of the above may be stored in advance and set automatically. Further, rough setting may be performed by manual setting, and detailed setting may be performed automatically. Or vice versa. Manual setting and automatic setting can be combined.
The region of interest setting device 12 is a region of interest setting means in the present invention.

  When the region of interest is manually set, the oxygen saturation distribution is displayed on the display device 14, and the operator performs the setting using the input interface such as a mouse while viewing the image. The setting is preferably performed by drawing a closed curve that is a boundary of the region of interest on the image by freehand. This makes it possible to set a region of interest as intended by the operator. Alternatively, a closed curve having a predetermined shape such as a geometric shape may be arranged, and the scale, angle, aspect ratio, position, and the like may be changed. Thereby, the region of interest can be easily set. Further, the coordinates of the closed curve may be set by a numerical value or a function using a keyboard or the like. By setting the range of the region of interest numerically, the setting reproducibility can be obtained.

  When the oxygen saturation distribution is three-dimensional data, a three-dimensional region of interest may be set. When the oxygen saturation distribution is three-dimensional data, the oxygen saturation is displayed on the display device 14 by volume rendering or three-section display. The region of interest may be set by inputting desired coordinates while rotating the displayed solid. In this way, it is possible to set the region of interest while confirming the position in the space. In addition, a region of interest may be set by arranging a predetermined three-dimensional shape in the space and changing the scale, angle, aspect ratio, position, and the like.

  Further, the region of interest may be set using a dedicated interface that can read the coordinates in the three-dimensional space. Further, when the oxygen saturation distribution is displayed in a three-section display, a region of interest may be set for each cross section to set a three-dimensional region of interest. By doing so, the region of interest can be directly drawn on each cross section, and interactive setting can be performed.

  A plurality of regions of interest may be set. For example, a first region of interest including the entire region of the oxygen saturation distribution and a second region of interest including only the point of interest may be set. At this time, the first region of interest may be automatically set, and the second region of interest may be set manually. Thus, by setting a plurality of regions of interest, it is possible to compare statistics and to compare the properties of oxygen saturation distributions.

<< Display device 14 >>
The display device 14 is a means for displaying the image generated by the image generation unit 13, and is typically a display device. The display device 14 can also be used as an output interface when a region of interest is specified. The display device 14 is not an essential component of the present invention.

<Statistics calculation example>
Next, the statistic amount output by the statistic calculation unit 11 will be exemplified and a method for calculating each will be described.

  The statistic output from the statistic calculator 11 is preferably a histogram representing the number of pixels in the region of interest for each oxygen saturation. As a result, the nature of the oxygen saturation in the region of interest can be intuitively read.

Further, the statistic output from the statistic calculator 11 may be a value indicating unimodality or multimodality in the histogram.
For example, the value can be calculated by differentiating the histogram and counting the number of places where the sign of the differential value is inverted. If multiple types of absorbers with different oxygen saturation levels exist in the region of interest, the histogram will be multimodal.If only a single type of absorber exists in the region of interest, the histogram will be unimodal. Become.
Therefore, it is possible to determine whether there are a plurality of types or a single type of absorption bands in the region of interest by calculating the values representing the monomodality and multimodality of the histogram as statistics. When the histogram is multimodal, it is desirable to calculate a statistic for each peak.
Thus, a statistic represented by a numerical value is referred to as a summary statistic.

The statistic output from the statistic calculator 11 may be a value representing an average value, median value, mode value, etc. of oxygen saturation values in the region of interest. As a result, the representative value of oxygen saturation can be understood. If the oxygen saturation value of the i-th pixel in the region of interest is x _i and the number of pixels included in the region of interest is N, the average value of oxygen saturation can be calculated by Equation 6. Further, the median value is obtained as the N / 2th oxygen saturation value when the oxygen saturation values of all the pixels in the region of interest are arranged in order of increasing or decreasing value. The mode value is an oxygen saturation value that has the highest frequency when the histogram is generated.

Further, the statistic output by the statistic calculator 11 may be the variance of the oxygen saturation value in the region of interest, the standard deviation, the difference between the maximum value and the minimum value, or the like. As a result, it is possible to obtain a variation in oxygen saturation in the region of interest.
For example, if the oxygen saturation varies in a region where the change in oxygen saturation should be small, such as a region where the region of interest is narrow and a single type of absorber is expected to exist, the measurement error is large. I understand. That is, the measurement reliability can be obtained by obtaining the variation in oxygen saturation.
The standard deviation is calculated by Equation 7, and the variance is calculated by the square of the standard deviation. Further, the difference between the maximum value and the minimum value is obtained by calculating the difference between the maximum value and the minimum value among the oxygen saturation values of all the pixels in the region of interest.

Further, the statistic output by the statistic calculator 11 may be the skewness or kurtosis of the histogram. Thereby, the success or failure of the measurement can be determined. The skewness S _s can be calculated using Equation 8 and the kurtosis S _k can be calculated using Equation 9.

  In addition, the statistic output by the statistic calculator 11 is not limited to the one illustrated above, but may be any value as long as it is a value representing the property of oxygen saturation. For example, higher-order statistics other than the primary statistics described above may be used. By calculating higher-order statistics, it is possible to quantitatively know the characteristics of the oxygen saturation distribution image, and to reduce misrecognition due to optical illusions and illusions. Examples of higher-order statistics include correlation, spatial frequency, spatial phase, density co-occurrence matrix, density difference matrix, and the like.

<Display example of statistics>
Next, an example of imaging various statistics calculated by the statistics calculation unit 11 will be described with reference to FIG.
FIG. 2 shows an example of an image generated by the image generation unit 13 and output to the display device 14. 2A to 2D are examples of an image in which the calculated oxygen saturation is expressed as a luminance value and various statistics superimposed on the image.

In the oxygen saturation distribution in the image shown in FIG. 2, a signal portion (L-shaped portion inverted up and down) and a background portion (blacked portion) are separated. This is realized by the image generation unit 13 separating the signal portion and the background portion by referring to the absorption coefficient and generating an image representing only the oxygen saturation of the signal portion.
The signal portion is a portion considered to be an image of the absorber, and the background portion is a portion considered not to be an image of the absorber. The distinction between the two may be performed by providing a threshold value in the absorption coefficient distribution as in Non-Patent Document 1, or the signal likelihood is calculated from the shape of the signal of the absorption coefficient distribution or the initial sound pressure distribution, and the threshold value is set to the threshold value. You may carry out by providing.
In addition, as the absorption coefficient distribution and the initial sound pressure distribution used at this time, it is desirable to use the absorption coefficient distribution and the initial sound pressure distribution of a light source having a wavelength close to the absorption coefficients of oxyhemoglobin and reduced hemoglobin. When calculating the signal likelihood, a signal probability calculation unit may be provided in the data processing device 7 and processed there. In this embodiment, the signal portion and the background portion are separated to generate an image, but the separation is not necessarily performed.

  The ellipse shown in FIG. 2 is the boundary line of the region of interest set in the signal portion. The region of interest may be specified by drawing a boundary line, or may be specified by changing the color tone inside the region of interest. When a plurality of regions of interest are set, the closed curve indicating each region and the color of the region may be changed for each region. Further, the display and non-display of the region of interest may be changeable by the operator.

  FIG. 2A shows an example in which the average value and standard deviation of oxygen saturation are displayed as statistics. Here, the average value and standard deviation of the oxygen saturation in the region of interest are displayed as a representative value and an error of the oxygen saturation, respectively. By performing such display, the operator can directly know the nature of the oxygen saturation distribution.

  FIG. 2B shows an example in which a histogram is displayed as a statistic. The histogram includes all information of the primary statistics. Therefore, various considerations can be made by the operator reading the characteristics of the oxygen saturation distribution from the histogram. If the histogram is multimodal, summary statistics for each peak may be displayed. In this case, detection of each peak may be performed automatically, or an operator may specify manually.

  FIG. 2C shows an example in which, in addition to the histogram, an average value, a standard deviation, a probability that the distribution is unimodal, and a probability that is multimodal are displayed. By performing such display, the histogram can be easily considered. Further, the reliability of the measurement may be calculated from these statistics and displayed, or the success or failure of the measurement may be displayed by determining a reliability threshold value in advance.

  FIG. 2D shows an example in which the oxygen saturation distribution in the three-dimensional region and the region of interest are displayed by volume rendering, and summary statistics in the region of interest are displayed. Although the three-dimensional oxygen saturation distribution is more difficult to read than the two-dimensional oxygen saturation distribution, such a display makes it possible to intuitively understand the properties of the oxygen saturation.

  Further, the statistic display unit does not necessarily have to be provided at a location adjacent to the oxygen saturation distribution, as shown in FIGS. For example, the image may be displayed in a translucent manner in an oxygen saturation distribution image. Moreover, when displaying a histogram and summary statistics, they may be displayed side by side or may be displayed superimposed. In addition, display or non-display of the statistic display unit may be switched using an interface such as a mouse. Thereby, the display space can be used effectively.

When a plurality of regions of interest are set, it is desirable to display the statistics for each region at the same time so that the statistics for each region can be compared. Further, when displaying a histogram, comparison is facilitated by superimposing and displaying the graph color corresponding to the color of each region.
Also, the images shown in FIGS. 2A to 2D are examples. The image generation unit 13 can generate an image by combining arbitrary statistics as long as the statistics can be calculated by the statistics calculation unit 11.

<Process flowchart>
Processing performed by the photoacoustic apparatus according to the first embodiment will be described with reference to FIG. 3 which is a processing flowchart.
First, in step S1, the first light source 1 irradiates the subject with pulsed light.
In step S2, the acoustic detector 5 receives the acoustic wave generated from the subject, and in step S3, the electrical signal processing device 6 converts the acoustic wave into a digital signal. Then, the image reconstruction unit 8 generates an initial sound pressure distribution from the digital signal, and the light distribution correction unit 9 generates a first absorption coefficient distribution. The generated first absorption coefficient distribution is transmitted to the comparison calculation unit 10 and the image generation unit 13.

Steps S4 to S6 are steps of generating a second absorption coefficient distribution by irradiating the subject with pulsed light using the second light source. Since this step is the same as steps S1 to S3, detailed description thereof is omitted.
Next, in step S7, the comparison operation unit 10 generates an oxygen saturation distribution using the obtained first and second absorption coefficient distributions. The generated oxygen saturation distribution is transmitted to the statistic calculation unit 11 and the image generation unit 13.
In step S <b> 8, the image generation unit 13 separates the signal portion and the background portion from the oxygen saturation received from the comparison calculation unit 10 using the absorption coefficient distribution received from the light distribution correction unit 9. . Then, an image composed of the oxygen saturation distribution of only the signal portion is generated and output to the display device 14. At this time, the statistic is not superimposed on the image displayed on the display device 14. When step S8 is processed, the operator can designate a region of interest.

In step S9, the region-of-interest setting device 12 acquires information on the region of interest designated by the operator. The acquired information on the region of interest is transmitted to the statistic calculation unit 11.
In step S 10, the statistic calculation unit 11 calculates the statistic inside the region of interest using the oxygen saturation distribution received from the comparison calculation unit 10 and the information on the region of interest received from the region of interest setting device 12. To do. The calculated statistic is transmitted to the image generation unit 13.
In step S11, the image generation unit 13 updates the display image using the received statistics. Specifically, graphic information or character information representing the received statistics is generated and superimposed on the image generated in step S8 to generate a new image. The generated image is transmitted to the display device 14. Thereby, both the oxygen saturation distribution and the statistics inside the region of interest are presented to the operator.

  When the region of interest is reset by the operator, it is preferable to repeat the regeneration of statistics and the regeneration of images (steps S10 to S11). By doing so, it becomes possible to observe the change in the statistic in real time, so it becomes easy to know the local properties of the oxygen saturation distribution.

  As described above, the photoacoustic diagnostic apparatus according to the first embodiment visualizes the statistics inside the region of interest together with the oxygen saturation distribution in the subject and presents them to the operator. Thereby, the operator can know the nature of the oxygen saturation distribution, which cannot be understood only by observing the oxygen saturation distribution with an image.

(Second embodiment)
The second embodiment is an embodiment that presents not the oxygen saturation distribution but the absorption coefficient distribution to the operator.
The system configuration of the photoacoustic diagnostic apparatus according to the second embodiment is shown in FIG. The system configuration of the photoacoustic diagnostic apparatus according to the second embodiment is different from the first embodiment only in that the oxygen saturation distribution is not transmitted from the comparison calculation unit 10 to the image generation unit 13.

Moreover, the process of the photoacoustic diagnostic apparatus which concerns on 2nd embodiment differs only in step S7-S8 compared with 1st embodiment.
In the second embodiment, in step S7, the comparison calculation unit 10 generates an oxygen saturation distribution using the obtained first and second absorption coefficient distributions. The generated oxygen saturation distribution is transmitted only to the statistic calculator 11.
In step S <b> 8, the image generation unit 13 generates an image representing the absorption coefficient distribution using the absorption coefficient distribution received from the light distribution correction unit 9. As a result, only an image representing the absorption coefficient distribution is presented to the operator.
That is, the region of interest acquired by the region-of-interest setting device 12 in step S9 is set based on the absorption coefficient distribution. Since the absorption coefficient distribution and the oxygen saturation distribution are in the same coordinate system, the region of interest set while looking at the absorption coefficient distribution can be used as the region of interest for the oxygen saturation distribution.
In steps S10 and S11, similarly to the first embodiment, the statistic calculation unit 11 calculates the statistic of the oxygen saturation distribution in the region of interest, and the image generation unit 13 selects an image including the statistic. Generate and output to the display device 14. Any statistics can be used as in the first embodiment.

Thus, in the second embodiment, the operator is presented with the absorption coefficient distribution to set the region of interest for the subject. As a result, the obtained display image is as shown in FIG. The absorption coefficient distribution and the region of interest set for it are displayed, and the summary statistics of oxygen saturation calculated based on the region of interest are displayed. The statistics may include a histogram.
In the present embodiment, only the absorption coefficient distribution is displayed, but either the oxygen saturation distribution or the absorption coefficient distribution may be selectively displayed. Further, the absorption coefficient distribution to be displayed may be the first absorption coefficient distribution or the second absorption coefficient distribution.

  In the first embodiment, when there are many errors in the absorption coefficient distribution and the signal portion and the background portion of the oxygen saturation distribution cannot be separated, it is difficult to estimate on the image the region where blood will be present. The region of interest could not be set properly. On the other hand, in the second embodiment, since the absorption coefficient distribution can be displayed on the screen, even if the signal portion of the oxygen saturation distribution is unknown, the operator looks at the absorption coefficient distribution to see the signal portion. Can be judged.

(Example)
The effect of the present invention was confirmed by experiments. In this example, a hemispherical phantom was used as the subject. The acoustic characteristics and optical characteristics of the phantom base material were close to those of a living body, and a light absorber was installed inside the phantom at a position 25 mm from the subject surface. The light absorption coefficient of the light absorber was about 5 times that of the phantom base material. The light absorber is uniform and the average oxygen saturation is 80.3%.
Further, both sides of the phantom were sandwiched between two holding plates made of polymethylpentene having a thickness of 10 mm, and a 1 mm oil layer was provided on the other side of the holding plate on one side, and the acoustic detector was brought into close contact through the oil layer.

Castor oil was used for the oil layer, and PZT having a receiving portion diameter of 2 mm, a center frequency of 1 MHz and a bandwidth of 80% was used as an element of the acoustic detector. Then, 15 × 23 elements are arranged in the plane direction to form one acoustic detector.
In addition, the acoustic detector is connected to an XY stage so that scanning can be performed in the same plane direction as the surface of the acoustic detector.
Further, TiS lasers were used for the first and second light sources, the wavelength of the first light source was 756 nm, and the wavelength of the second light source was 797 nm. The subject was irradiated with pulsed light of nanosecond order by this light source simultaneously from the same surface as the acoustic detector and the opposite surface across the subject.

In the measurement, irradiation with pulsed light, collection of acoustic wave signals, and scanning were repeated for each light source to obtain all signal data. A signal conversion A / D converter having a sampling frequency of 20 MHz and a resolution of 12 bits was used.
Then, image reconstruction, light distribution correction, and oxygen saturation calculation were performed using back projection, and initial sound pressure distribution, absorption coefficient distribution, and oxygen saturation distribution of three-dimensional data were obtained.
The second absorption coefficient distribution was used to separate the signal portion and the background portion, and the region of interest was set by displaying the oxygen saturation distribution of the signal portion.

As a result, the obtained display screen is shown in FIG. In FIG. 6, the region of interest is drawn on the oxygen saturation distribution, and the histogram, average value, and standard deviation of the oxygen saturation in the region of interest are displayed on the right side. By displaying the histogram, the distribution of oxygen saturation in the region of interest can be confirmed in detail, and by displaying the average value and standard deviation, it has been confirmed that diagnosis by quantitative information can be performed. .

(Modification)
The description of each embodiment is an exemplification for explaining the present invention, and the present invention can be implemented with appropriate modifications or combinations without departing from the spirit of the invention. The present invention can be implemented as a method for controlling the subject information acquisition apparatus including at least a part of the above-described processing, or can be implemented as a program for causing the subject information acquisition apparatus to execute these methods. The above processes and means can be freely combined and implemented as long as no technical contradiction occurs.

For example, in the description of the embodiment, the region of interest is set, and the statistic corresponding to the inside of the region of interest is calculated and displayed. However, the setting of the region of interest is omitted, and the statistic is calculated for the entire region extracted as the signal portion. May be generated.
In each embodiment, two light sources are used. However, light sources having different wavelengths may be further added to use three or more light sources.

A method of examining the content of a substance using a plurality of wavelengths as exemplified in each embodiment is called spectroscopy. The measurement of oxygen saturation is one of spectroscopic techniques. In the description of the embodiment, the method for calculating the oxygen saturation is described, but the detection target may be another substance. For example, even if it is water, melanin, collagen, lipid, etc., the content rate can be calculated by the same method by using a wavelength having a high absorption rate for the substance.
In addition, as long as the calculation method is the same, the problem of the present invention is not unique to oxygen saturation but is common to content calculation technology using spectroscopy. Therefore, the scope of the present invention is not limited only to oxygen saturation, but may include the content of other substances using spectroscopy. The oxygen saturation in the description of the present invention can be read as the content of other substances.

DESCRIPTION OF SYMBOLS 1 ... 1st light source, 2 ... 2nd light source, 3 ... Light irradiation apparatus, 4 ... Subject, 5 ... Acoustic detector, 6 ... Electrical signal processing apparatus, 7 ··· Data processing device, 8 ... image reconstruction unit, 9 ... light distribution correction unit, 10 ... comparison operation unit, 11 ... statistic calculation unit, 12 ... region of interest setting device, 13: Image generation unit

Claims (27)

First image data representing the spatial distribution of the content or content of the substance constituting the subject, and second image data representing the spatial distribution of information relating to the subject that is different from the content or content Image data acquisition means for acquiring;
A region of interest setting means for setting a region of interest for the first image data ;
And statistical information obtaining means for obtaining the statistical information of the first image data corresponding to the previous SL Seki heart region,
Display control means for causing the display means to display an image based on the second image data;
Have
The region of interest includes a first region of interest and a second region of interest different from each other,
The region of interest setting means includes
An area corresponding to the entire area of the first image data is automatically set as the first region of interest for the first image data,
An area corresponding to a part of the second image data designated by an operator when an image based on the second image data is displayed on the display means is the first image data corresponding to the first image data. Set it as the second area of interest,
The statistical information acquisition means includes first statistical information of the first image data corresponding to the first region of interest, and second of the first image data corresponding to the second region of interest. Obtain statistical information as the statistical information,
Wherein the display control unit, Ru an image including said first statistical information and the second statistical information to be displayed on said display means
It characterized the this, the data processing device. The display control means may be displayed the second image data, the second front Symbol Seki heart region superimposed on the image data, and an image including the statistical information on the display means, wherein Item 4. The data processing device according to Item 1 . The statistical information acquisition means includes a first histogram of the first image data corresponding to the first region of interest and a second histogram of the first image data corresponding to the second region of interest. Produces
  The display control means displays the color of the image indicating the first region of interest in association with the color of the image indicating the first histogram, and displays the color of the image indicating the second region of interest and the first color. Display the color of the image showing the second histogram in association with each other
  The data processing apparatus according to claim 2. The statistical information acquisition means includes
Included before Symbol Seki heart region, and, and obtains the statistics of the image data portion to that before Symbol first association of an image of the absorber, any one of claims 1 to 3 of 1 The data processing device according to item. 5. The data according to claim 4 , wherein the statistical information acquisition unit determines the first image data corresponding to the image portion of the absorber based on the second image data. Processing equipment. The image data acquisition means acquires the three-dimensional first image data and the three-dimensional second image data,
The region of interest setting means, and setting the pre-Symbol function heart region of the three-dimensional data processing device according to any one of claims 1 to 5. The first image data, the water, characterized in that image data representing melanin, collagen, and the spatial distribution of at least one content or content of the lipid, any one of claims 1 6 The data processing apparatus described in 1. Said second image data is characterized in that image data representing the spatial distribution of the absorption coefficient, the data processing device according to any one of claims 1 to 7.   The statistical information acquisition means generates a histogram of the first image data corresponding to the region of interest, and represents monomodality or multimodality based on the number of locations where the positive / negative of the differential value of the histogram is inverted. Acquire information as the statistical information
  The data processing apparatus according to claim 1, wherein the data processing apparatus is a data processing apparatus.   The statistical information acquisition unit generates a histogram of the first image data corresponding to the region of interest, and acquires the statistical information of the first image data corresponding to the peak of the histogram.
  The data processing apparatus according to claim 1, wherein the data processing apparatus is a data processing apparatus. The statistics, wherein the pre-SL is information representing at least one representative value and the variation of the first image data corresponding to the related heart region, in any one of claims 1 10 The data processing apparatus described. The representative value includes an average value, a median value, or a mode value,
The data processing apparatus according to claim 11, wherein the variation includes variance, standard deviation, or a difference between a maximum value and a minimum value. The data processing apparatus according to any one of claims 1 to 12, wherein the display control unit displays a text image of the statistical information on the display unit. First image data representing the spatial distribution of the content or content of the substance constituting the subject, and second image data representing the spatial distribution of information relating to the subject that is different from the content or content A data processing method executed by a data processing apparatus to process ,
Setting a region of interest for the first image data ;
Acquiring the statistical information of the first image data corresponding to the previous SL Seki heart region,
Displaying an image based on the second image data on the display means;
The region of interest includes a first region of interest and a second region of interest different from each other,
An area corresponding to the entire area of the first image data is automatically set as the first region of interest for the first image data,
An area corresponding to a part of the second image data designated by an operator when an image based on the second image data is displayed on the display means is the first image data corresponding to the first image data. Set it as the second area of interest,
The first statistical information of the first image data corresponding to the first region of interest and the second statistical information of the first image data corresponding to the second region of interest are used as the statistical information. Acquired,
Characterized in that to display an image including a said the first statistics second statistics on the display unit, the data processing method. And wherein the displaying the second image data, the second the first region of interest is superimposed on the image data, and an image including the statistical information on the display unit, according to claim 1 4 Data processing method. Generating a first histogram of the first image data corresponding to the first region of interest and a second histogram of the first image data corresponding to the second region of interest;
  The color of the image showing the first region of interest and the color of the image showing the first histogram are displayed in association with each other, and the color of the image showing the second region of interest and the image showing the second histogram are displayed. Display the colors in association with each other
  The data processing method according to claim 15, wherein: It included before Symbol Seki heart region, and obtaining the statistical information of the image data portion to that before Symbol first association of an image of the absorber, characterized in, any one of claims 14 1 6 The data processing method according to item 1. In the acquisition of the statistical information, on the basis of the second image data, corresponding to the portion of the image of the absorbent body, and determines the first image data, according to claim 17 Data processing method. Obtaining the three-dimensional first image data and the three-dimensional second image data;
And sets the previous SL Seki heart region of the three-dimensional data processing method according to any one of claims 14 to 18. The first image data is image data representing a spatial distribution of the content or content of at least one of water, melanin, collagen, and lipid. 21. The data processing method described in 1. Said second image data is characterized in that image data representing the spatial distribution of the absorption coefficient, the data processing method according to any one of claims 14 to 20. A histogram of the first image data corresponding to the region of interest is generated, and information representing unimodality or multimodality is acquired as the statistical information based on the number of places where the positive / negative of the differential value of the histogram is inverted Do
  The data processing method according to any one of claims 14 to 21, wherein: Generate a histogram of the first image data corresponding to the region of interest, and obtain the statistical information of the first image data corresponding to the peak of the histogram
  The data processing method according to any one of claims 14 to 21, wherein: The statistics, wherein the pre-SL is a representative value and information representing at least one of the variations of the first image data corresponding to the related heart region, in any one of claims 14 23 The data processing method described. The representative value includes an average value, a median value, or a mode value,
The data processing method according to claim 24, wherein the variation includes variance, standard deviation, or a difference between a maximum value and a minimum value. The data processing method according to any one of claims 14 to 25, wherein a text image of the statistical information is displayed on the display means.   A program that causes a computer to execute the data processing method according to any one of claims 14 to 26.

Images