WO2020040172A1 - 画像処理装置、画像処理方法、プログラム - Google Patents

画像処理装置、画像処理方法、プログラム Download PDF

Info

Publication number
WO2020040172A1
WO2020040172A1 PCT/JP2019/032560 JP2019032560W WO2020040172A1 WO 2020040172 A1 WO2020040172 A1 WO 2020040172A1 JP 2019032560 W JP2019032560 W JP 2019032560W WO 2020040172 A1 WO2020040172 A1 WO 2020040172A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
dimensional
dimensional image
image data
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2019/032560
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
大樹 梶田
宣晶 今西
貞和 相磯
長永　兼一
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Keio University
Original Assignee
Canon Inc
Keio University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc, Keio University filed Critical Canon Inc
Publication of WO2020040172A1 publication Critical patent/WO2020040172A1/ja
Priority to US17/180,928 priority Critical patent/US12114961B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0033—Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0093—Detecting, measuring or recording by applying one single type of energy and measuring its conversion into another type of energy
    • A61B5/0095—Detecting, measuring or recording by applying one single type of energy and measuring its conversion into another type of energy by applying light and detecting acoustic waves, i.e. photoacoustic measurements
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/41—Detecting, measuring or recording for evaluating the immune or lymphatic systems
    • A61B5/414—Evaluating particular organs or parts of the immune or lymphatic systems
    • A61B5/418—Evaluating particular organs or parts of the immune or lymphatic systems lymph vessels, ducts or nodes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4887—Locating particular structures in or on the body
    • A61B5/489—Blood vessels
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/13—Tomography
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0204—Acoustic sensors
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2576/00—Medical imaging apparatus involving image processing or analysis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/026—Measuring blood flow
    • A61B5/0275—Measuring blood flow using tracers, e.g. dye dilution

Definitions

  • the present invention relates to information processing used in a system for generating an image by photoacoustic imaging.
  • Patent Literature 1 discloses a photoacoustic image generation device that evaluates a contrast agent used for imaging lymph nodes, lymph vessels, and the like, and emits light having a wavelength that generates a photoacoustic wave when the contrast agent is absorbed. Is described.
  • photoacoustic imaging generally has a problem that the data amount is large.
  • an object of the present invention is to provide a technique capable of reducing the amount of data in photoacoustic imaging as compared with the related art.
  • One aspect of the present invention is An image processing apparatus that processes three-dimensional image data generated based on received signal data of a photoacoustic wave generated from within the subject by irradiating the subject with light, A first three-dimensional image obtaining unit that obtains first three-dimensional image data obtained by extracting a first region corresponding to a first substance from the three-dimensional image data; A second three-dimensional image acquisition unit configured to acquire second three-dimensional image data obtained by extracting a second region corresponding to a second substance from the three-dimensional image data; First two-dimensional image acquisition means for acquiring, from the first three-dimensional image data, first two-dimensional image data in which three-dimensional position information of the first region is associated; A second two-dimensional image acquisition unit configured to acquire, from the second three-dimensional image data, second two-dimensional image data in which three-dimensional position information of the second region is associated; An image processing apparatus comprising: Another aspect of the present invention is: An image processing method for processing three-dimensional image data generated based on received signal data of a photoacoustic wave
  • FIG. 1 is a block diagram of a system according to an embodiment of the present invention.
  • FIG. 2 is a block diagram showing a specific example of an image processing apparatus according to an embodiment of the present invention and its peripheral configuration.
  • FIG. 3 is a detailed block diagram of the photoacoustic apparatus according to one embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a probe according to one embodiment of the present invention.
  • FIG. 5 is a flowchart of an image processing method according to an embodiment of the present invention.
  • 6A to 6C are schematic diagrams when acquiring a three-dimensional lymph image and a three-dimensional blood vessel image.
  • 7A and 7B are schematic diagrams when acquiring a two-dimensional lymph image, a two-dimensional blood vessel image, and depth information.
  • FIGS. 8A to 8C are schematic diagrams showing the display of a two-dimensional image reflecting the depth information.
  • 9A to 9D are contour graphs of the calculated value of the equation (1) corresponding to the contrast agent when the combination of wavelengths is changed.
  • FIG. 10 is a line graph showing the calculated values of Expression (1) corresponding to the contrast agent when the concentration of ICG is changed.
  • FIG. 11 is a graph showing a molar absorption coefficient spectrum of oxyhemoglobin and deoxyhemoglobin.
  • FIG. 12 is a diagram showing a GUI according to an embodiment of the present invention.
  • FIG. 13A and FIG. 13B are spectral images on the right forearm extension side when the concentration of ICG is changed.
  • 14A and 14B are spectral images of the left forearm extension when the ICG density is changed.
  • 15A and 15B are spectral images of the inside of the right lower leg and the inside of the left lower leg when the concentration of ICG is changed.
  • the photoacoustic image obtained by the system according to the present invention reflects the absorption amount and absorption rate of light energy.
  • the photoacoustic image represents a spatial distribution of at least one piece of subject information such as a generated sound pressure (initial sound pressure) of the photoacoustic wave, a light absorption energy density, and a light absorption coefficient.
  • the photoacoustic image may be an image representing a two-dimensional spatial distribution or an image (volume data) representing a three-dimensional spatial distribution.
  • the system according to the present embodiment generates a photoacoustic image by photographing a subject into which a contrast agent has been introduced.
  • the photoacoustic image may represent an image representing a two-dimensional spatial distribution in a depth direction from the subject surface or a three-dimensional spatial distribution.
  • the system according to the present invention can generate a spectral image of the subject using a plurality of photoacoustic images corresponding to a plurality of wavelengths.
  • the spectral image of the present invention is generated using photoacoustic signals corresponding to each of a plurality of wavelengths based on photoacoustic waves generated by irradiating a subject with light having a plurality of different wavelengths.
  • the spectral image may indicate the concentration of the specific substance in the subject, which is generated using the photoacoustic signals corresponding to each of the plurality of wavelengths.
  • the image value of the contrast agent in the spectral image and the image value of the specific substance in the spectral image are different. Therefore, the region of the contrast agent and the region of the specific substance can be distinguished according to the image value of the spectral image.
  • the specific substance is a substance that constitutes the subject, such as hemoglobin, glucose, collagen, melanin, fat, and water. Also in this case, a contrast agent having a light absorption spectrum different from the light absorption coefficient spectrum of the specific substance is selected. Further, the spectral image may be calculated by a different calculation method according to the type of the specific substance.
  • a spectral image having an image value calculated using the oxygen saturation calculation formula (1) will be described.
  • the present inventors have calculated the optical saturation of blood hemoglobin based on the photoacoustic signal corresponding to each of the plurality of wavelengths (or an index having a correlation with the oxygen saturation).
  • I (r) of a photoacoustic signal obtained with a contrast agent whose wavelength dependence of the absorption coefficient is different from that of oxyhemoglobin and deoxyhemoglobin is substituted, the numerical range in which the oxygen saturation of hemoglobin can be taken From the calculated value Is (r).
  • Is (r) is a measurement value based on a photoacoustic wave generated by light irradiation of the first wavelength ⁇ 1
  • I ⁇ 2 (r) is generated by light irradiation of the second wavelength ⁇ 2 This is a measurement value based on a photoacoustic wave.
  • ⁇ Hb ⁇ 1 is a molar absorption coefficient of deoxyhemoglobin corresponding to the first wavelength ⁇ 1 [mm ⁇ 1 mol ⁇ 1 ]
  • ⁇ Hb ⁇ 2 is a molar absorption coefficient of deoxy hemoglobin corresponding to the second wavelength ⁇ 2 [ mm -1 mol -1 ].
  • ⁇ HbO ⁇ 1 is the molar absorption coefficient of oxyhemoglobin corresponding to the first wavelength ⁇ 1 [mm ⁇ 1 mol ⁇ 1 ]
  • ⁇ HbO ⁇ 2 is the molar absorption coefficient of oxyhemoglobin corresponding to the second wavelength ⁇ 2 [ mm -1 mol -1 ].
  • r is a position.
  • the measured values I ⁇ 1 (r) and I ⁇ 2 (r) may be absorption coefficients ⁇ a ⁇ 1 (r) and ⁇ a ⁇ 2 (r), or the initial sound pressure P 0 ⁇ 1 (R) and P 0 ⁇ 2 (r).
  • the numerical value of the molar absorption coefficient of hemoglobin may be used as it is in Expression (1).
  • the region where the hemoglobin exists blood vessel
  • the region where the contrast agent exists for example, lymph vessels
  • the image value of the spectral image is calculated using Expression (1) for calculating the oxygen saturation.
  • Expression (1) for calculating the oxygen saturation.
  • an index other than the oxygen saturation is calculated as the image value of the spectral image
  • the expression A calculation method other than (1) may be used.
  • the index and its calculation method known ones can be used, and therefore detailed description is omitted.
  • the spectral image, photoacoustic waves generated by light irradiation of the first photoacoustic image and the second wavelength lambda 2, based on the photoacoustic wave generated by light irradiation of the first wavelength lambda 1 May be an image indicating the ratio of the second photoacoustic image based on the image.
  • the image may be based on the ratio of the images.
  • an image generated according to the modified expression of Expression (1) can also be expressed by the ratio between the first photoacoustic image and the second photoacoustic image.
  • Image (spectral image) can also be expressed by the ratio between the first photoacoustic image and the second photoacoustic image.
  • the spectral image may represent an image representing a two-dimensional spatial distribution in a depth direction from the subject surface or a three-dimensional spatial distribution.
  • FIG. 1 is a block diagram illustrating a configuration of a system according to the present embodiment.
  • the system according to the present embodiment includes a photoacoustic device 1100, a storage device 1200, an image processing device 1300, a display device 1400, and an input device 1500. Transmission and reception of data between the devices may be performed by wire or wirelessly.
  • the photoacoustic apparatus 1100 generates a photoacoustic image by capturing an image of a subject into which a contrast agent is introduced, and outputs the photoacoustic image to the storage device 1200.
  • the photoacoustic apparatus 1100 generates information of characteristic values corresponding to each of a plurality of positions in the subject using reception signal data obtained by receiving a photoacoustic wave generated by light irradiation. That is, the photoacoustic apparatus 1100 generates the spatial distribution of the characteristic value information derived from the photoacoustic wave as medical image data (photoacoustic image).
  • the storage device 1200 may be a storage medium such as a ROM (Read Only Memory), a magnetic disk, or a flash memory. Further, the storage device 1200 may be a storage server via a network such as a PACS (Picture Archiving and Communication System).
  • a storage medium such as a ROM (Read Only Memory), a magnetic disk, or a flash memory. Further, the storage device 1200 may be a storage server via a network such as a PACS (Picture Archiving and Communication System).
  • PACS Picture Archiving and Communication System
  • the image processing device 1300 processes information such as a photoacoustic image and incidental information of the photoacoustic image stored in the storage device 1200.
  • a unit having an arithmetic function of the image processing apparatus 1300 can be configured by an arithmetic circuit such as a CPU, a processor such as a GPU (Graphics Processing Unit), or an FPGA (Field Programmable Gate Array) chip. These units may be configured not only from a single processor or arithmetic circuit, but also from a plurality of processors or arithmetic circuits.
  • a unit having a storage function of the image processing apparatus 1300 can be configured by a non-temporary storage medium such as a ROM (Read Only Memory), a magnetic disk, or a flash memory.
  • the unit having the storage function may be a volatile medium such as a RAM (Random Access Memory).
  • the storage medium on which the program is stored is a non-temporary storage medium.
  • the unit having the storage function is not limited to a single storage medium, and may be configured from a plurality of storage media.
  • a unit having a control function of the image processing apparatus 1300 is configured by an arithmetic element such as a CPU.
  • a unit having a control function controls the operation of each component of the system.
  • the unit having the control function may control each component of the system in response to an instruction signal from various operations such as the start of measurement from the input unit. Further, the unit having the control function may read out the program code stored in the computer 150 and control the operation of each component of the system.
  • the display device 1400 is a liquid crystal display, an organic EL (Electro Luminescence) display, or the like.
  • the display device 1400 may display an image or a GUI for operating the device.
  • the input device 1500 is, for example, an operation console that can be operated by a user and includes a mouse, a keyboard, and the like. Further, the display device 1400 may be configured with a touch panel, and the display device 1400 may be used as the input device 1500.
  • FIG. 2 shows a specific configuration example of the image processing apparatus 1300 according to the present embodiment.
  • the image processing apparatus 1300 according to the present embodiment includes a CPU 1310, a GPU 1320, a RAM 1330, a ROM 1340, and an external storage device 1350.
  • a liquid crystal display 1410 as a display device 1400, a mouse 1510 as an input device 1500, and a keyboard 1520 are connected to the image processing device 1300.
  • the image processing apparatus 1300 is connected to an image server 1210 as a storage device 1200 such as a PACS (Picture Archiving and Communication System).
  • the image data can be stored on the image server 1210 or the image data on the image server 1210 can be displayed on the liquid crystal display 1410.
  • FIG. 3 is a schematic block diagram of devices included in the system according to the present embodiment.
  • the photoacoustic apparatus 1100 includes a drive unit 130, a signal collection unit 140, a computer 150, a probe 180, and an introduction unit 190.
  • the probe 180 has a light irradiation unit 110 and a reception unit 120.
  • FIG. 4 is a schematic diagram of the probe 180 according to the present embodiment.
  • the measurement target is the subject 100 into which the contrast agent has been introduced by the introduction unit 190.
  • the drive unit 130 drives the light irradiation unit 110 and the reception unit 120 to perform mechanical scanning.
  • the light irradiation unit 110 irradiates the subject 100 with light, and an acoustic wave is generated in the subject 100.
  • An acoustic wave generated by the photoacoustic effect due to light is also called a photoacoustic wave.
  • the receiving unit 120 outputs an electric signal (photoacoustic signal) as an analog signal by receiving the photoacoustic wave.
  • the signal collecting unit 140 converts the analog signal output from the receiving unit 120 into a digital signal, and outputs the digital signal to the computer 150.
  • the computer 150 stores the digital signal output from the signal collection unit 140 as signal data derived from a photoacoustic wave.
  • the computer 150 generates a photoacoustic image by performing signal processing on the stored digital signal.
  • the computer 150 outputs the photoacoustic image to the display unit 160 after performing image processing on the obtained photoacoustic image.
  • the display unit 160 displays an image based on the photoacoustic image.
  • the display image is stored in a memory in the computer 150 or a storage device 1200 such as a data management system connected to the modality via a network based on a storage instruction from the user or the computer 150.
  • the computer 150 also performs drive control of components included in the photoacoustic device.
  • the display unit 160 may display a GUI or the like in addition to the image generated by the computer 150.
  • the input unit 170 is configured to allow a user to input information. Using the input unit 170, the user can operate the start and end of measurement, an instruction to save a created image, and the like.
  • details of each configuration of the photoacoustic apparatus 1100 according to the present embodiment will be described.
  • the light irradiation unit 110 includes a light source 111 that emits light, and an optical system 112 that guides light emitted from the light source 111 to the subject 100.
  • the light includes pulse light such as a so-called rectangular wave and a triangular wave.
  • the pulse width of the light emitted from the light source 111 is preferably 100 ns or less in consideration of the thermal confinement condition and the stress confinement condition. Further, the wavelength of the light may be in the range of about 400 nm to 1600 nm. When imaging a blood vessel with high resolution, a wavelength (400 nm or more and 700 nm or less) at which absorption in the blood vessel is large may be used. When imaging a deep part of a living body, light having a wavelength (700 nm or more and 1100 nm or less) that typically absorbs little in a background tissue (water or fat) of the living body may be used.
  • the light source 111 is a laser, a light emitting diode, or the like.
  • a light source whose wavelength can be changed may be used.
  • a plurality of light sources are used, they are collectively expressed as a light source.
  • Various lasers such as a solid-state laser, a gas laser, a dye laser, and a semiconductor laser can be used as the laser.
  • a pulsed laser such as an Nd: YAG laser or an alexandrite laser may be used as a light source.
  • a Ti: sa laser using Nd: YAG laser light as excitation light or an OPO (Optical Parametric Oscillators) laser may be used as a light source.
  • a flash lamp or a light emitting diode may be used as the light source 111.
  • a microwave source may be used as the light source 111.
  • Optical elements such as lenses, mirrors, and optical fibers can be used for the optical system 112.
  • the light emitting unit of the optical system may be configured with a diffusion plate or the like that diffuses light in order to irradiate the pulsed light with a wider beam diameter.
  • the light emitting portion of the optical system 112 may be configured by a lens or the like, and the beam may be focused and irradiated.
  • the light irradiating unit 110 may directly irradiate the subject 100 with light from the light source 111 without including the optical system 112.
  • the receiving unit 120 includes a transducer 121 that outputs an electric signal by receiving an acoustic wave, and a support 122 that supports the transducer 121. Further, the transducer 121 may be a transmitting unit that transmits an acoustic wave.
  • the transducer as the receiving means and the transducer as the transmitting means may be a single (common) transducer or may have different configurations.
  • a piezoelectric ceramic material represented by PZT lead zirconate titanate
  • a polymer piezoelectric film material represented by PVDF polyvinylidene fluoride
  • an element other than the piezoelectric element may be used.
  • a transducer using a capacitance type micro-machined Ultrasonic Transducers (CMUT) can be used. Note that any transducer may be employed as long as an electrical signal can be output by receiving an acoustic wave. The signal obtained by the transducer is a time-resolved signal.
  • the amplitude of the signal obtained by the transducer represents a value based on the sound pressure received by the transducer at each time (for example, a value proportional to the sound pressure).
  • the frequency component constituting the photoacoustic wave is typically 100 KHz to 100 MHz, and a transducer that can detect these frequencies may be employed as the transducer 121.
  • the support 122 may be made of a metal material having high mechanical strength. In order to cause a large amount of irradiation light to enter the subject, the surface of the support 122 on the subject 100 side may be subjected to mirror finishing or light scattering.
  • the support 122 has a hemispherical shell shape, and is configured to be able to support the plurality of transducers 121 on the hemispherical shell. In this case, the directional axes of the transducers 121 disposed on the support body 122 gather near the center of curvature of the hemisphere. Then, when an image is formed using the signals output from the plurality of transducers 121, the image quality near the center of curvature becomes high.
  • the support 122 may have any configuration as long as it can support the transducer 121.
  • the support 122 may arrange a plurality of transducers in a plane or a curved surface such as a 1D array, a 1.5D array, a 1.75D array, and a 2D array.
  • the plurality of transducers 121 correspond to a plurality of receiving units.
  • the support 122 may function as a container for storing the acoustic matching material. That is, the support 122 may be a container for disposing the acoustic matching material between the transducer 121 and the subject 100.
  • the receiving unit 120 may include an amplifier that amplifies a time-series analog signal output from the transducer 121. Further, the receiving unit 120 may include an A / D converter that converts a time-series analog signal output from the transducer 121 into a time-series digital signal. That is, the receiving unit 120 may include a signal collecting unit 140 described later.
  • the space between the receiving unit 120 and the subject 100 is filled with a medium through which a photoacoustic wave can propagate.
  • This medium is a material through which an acoustic wave can propagate, acoustic characteristics are matched at the interface with the subject 100 and the transducer 121, and the transmittance of the photoacoustic wave is as high as possible.
  • the medium is water, an ultrasonic gel, or the like.
  • FIG. 4 shows a side view of the probe 180.
  • the probe 180 according to the present embodiment has a receiving unit 120 in which a plurality of transducers 121 are three-dimensionally arranged on a hemispherical support body 122 having an opening.
  • a light emitting portion of the optical system 112 is disposed at the bottom of the support 122.
  • the shape of the subject 100 is held by contacting the holding unit 200.
  • the space between the receiving unit 120 and the holding unit 200 is filled with a medium through which a photoacoustic wave can propagate.
  • This medium is a material through which a photoacoustic wave can propagate, acoustic characteristics are matched at the interface with the subject 100 and the transducer 121, and the transmissivity of the photoacoustic wave is as high as possible.
  • the medium is water, an ultrasonic gel, or the like.
  • the holding unit 200 as a holding unit holds the shape of the subject 100 during measurement. By holding the subject 100 by the holding unit 200, the movement of the subject 100 can be suppressed and the position of the subject 100 can be kept in the holding unit 200.
  • a resin material such as polycarbonate, polyethylene, or polyethylene terephthalate can be used as the material of the holding section 200.
  • the holding unit 200 is attached to the attachment unit 201.
  • the attachment unit 201 may be configured so that a plurality of types of holding units 200 can be exchanged according to the size of the subject.
  • the mounting portion 201 may be configured to be exchangeable with a different holding portion such as a radius of curvature or a center of curvature.
  • the driving unit 130 changes the relative position between the subject 100 and the receiving unit 120.
  • the driving unit 130 includes a motor such as a stepping motor that generates a driving force, a driving mechanism that transmits the driving force, and a position sensor that detects position information of the receiving unit 120.
  • the driving mechanism is a lead screw mechanism, a link mechanism, a gear mechanism, a hydraulic mechanism, or the like.
  • the position sensor is a potentiometer using an encoder, a variable resistor, a linear scale, a magnetic sensor, an infrared sensor, an ultrasonic sensor, or the like.
  • the driving unit 130 is not limited to changing the relative position between the subject 100 and the receiving unit 120 in the XY directions (two-dimensional), and may change the relative position to one-dimensional or three-dimensional.
  • the drive unit 130 may fix the receiving unit 120 and move the subject 100 as long as the relative position between the subject 100 and the receiving unit 120 can be changed.
  • the drive unit 130 may move the relative position continuously, or may move the relative position by step and repeat.
  • the drive unit 130 may be an electric stage that moves along a programmed trajectory, or may be a manual stage.
  • the driving unit 130 scans by simultaneously driving the light irradiation unit 110 and the reception unit 120.
  • the drive unit 130 drives only the light irradiation unit 110 or drives only the reception unit 120. You may.
  • the photoacoustic device 1100 may not include the driving unit 130.
  • the signal collection unit 140 includes an amplifier that amplifies an electric signal that is an analog signal output from the transducer 121, and an A / D converter that converts an analog signal output from the amplifier into a digital signal.
  • the digital signal output from the signal collection unit 140 is stored in the computer 150.
  • the signal collection unit 140 is also called a Data Acquisition System (DAS).
  • DAS Data Acquisition System
  • the electric signal is a concept including both an analog signal and a digital signal.
  • a light detection sensor such as a photodiode may detect light emission from the light irradiation unit 110, and the signal collection unit 140 may start the above process in synchronization with the detection result in response to a trigger.
  • the computer 150 as the information processing device is configured by the same hardware as the image processing device 1300. That is, the unit having the arithmetic function of the computer 150 can be configured by an arithmetic circuit such as a processor such as a CPU or a GPU (Graphics Processing Unit) or an FPGA (Field Programmable Gate Array) chip. These units may be configured not only from a single processor or arithmetic circuit, but also from a plurality of processors or arithmetic circuits.
  • the unit that performs the storage function of the computer 150 may be a volatile medium such as a RAM (Random Access Memory).
  • the storage medium on which the program is stored is a non-temporary storage medium. It should be noted that the unit having the storage function of the computer 150 may not only be constituted by one storage medium, but also constituted by a plurality of storage media.
  • the unit that performs the control function of the computer 150 is composed of an arithmetic element such as a CPU.
  • a unit having a control function of the computer 150 controls the operation of each component of the photoacoustic apparatus.
  • a unit having a control function of the computer 150 may control each component of the photoacoustic apparatus by receiving an instruction signal from the input unit 170 through various operations such as a start of measurement. Further, the unit having the control function of the computer 150 reads out the program code stored in the unit having the storage function, and controls the operation of each component of the photoacoustic apparatus. That is, the computer 150 can function as a control device of the system according to the present embodiment.
  • the computer 150 and the image processing device 1300 may be configured by the same hardware.
  • One piece of hardware may perform the functions of both the computer 150 and the image processing device 1300. That is, the computer 150 may perform the function of the image processing apparatus 1300. Further, the image processing device 1300 may have the function of the computer 150 as the information processing device.
  • the display unit 160 is a liquid crystal display, an organic EL (Electro Luminescence) display, or the like.
  • the display unit 160 may display an image or a GUI for operating the apparatus. Note that the display unit 160 and the display device 1400 may be the same display. That is, one display may perform the functions of both the display unit 160 and the display device 1400.
  • the input unit 170 is, for example, an operation console that can be operated by a user and includes a mouse, a keyboard, and the like. Further, the display unit 160 may be configured by a touch panel, and the display unit 160 may be used as the input unit 170. Note that the input unit 170 and the input device 1500 may be the same device. That is, one device may perform both functions of the input unit 170 and the input device 1500.
  • the introduction unit 190 is configured to be able to introduce a contrast agent from outside the subject 100 into the inside of the subject 100.
  • the introducer 190 can include a container for the contrast agent and a needle for piercing the subject.
  • the invention is not limited to this, and the introduction unit 190 may be of various types as long as the contrast agent can be introduced into the subject 100.
  • the introduction unit 190 may be, for example, a known injection system, an injector, or the like.
  • the contrast agent may be introduced into the subject 100 by controlling the operation of the introduction unit 190 by the computer 150 as a control device. Further, the contrast agent may be introduced into the subject 100 by operating the introduction unit 190 by the user.
  • the subject 100 does not constitute a system, but will be described below.
  • the system according to the present embodiment can be used for the purpose of diagnosing malignant tumors and vascular diseases of humans and animals, monitoring the progress of chemotherapy and the like. Therefore, the subject 100 is assumed to be a body to be diagnosed, specifically, a living body, specifically, a breast or each organ of a human body or an animal, a vascular network, a head, a neck, an abdomen, a limb including a finger or a toe. You.
  • the target of the light absorber is oxyhemoglobin or deoxyhemoglobin, a blood vessel containing many of them, or a new blood vessel formed near a tumor.
  • the target of the light absorber may be plaque on the wall of the carotid artery, melanin, collagen, lipids and the like contained in the skin and the like.
  • the contrast agent introduced into the subject 100 can be a light absorber.
  • the contrast agent used for photoacoustic imaging is a dye such as indocyanine green (ICG) or methylene blue (MB), fine gold particles, a mixture thereof, or a substance which is integrated or chemically modified and externally introduced.
  • the subject 100 may be a phantom imitating a living body.
  • Each configuration of the photoacoustic device may be configured as a separate device, or may be configured as one integrated device. Further, at least a part of the configuration of the photoacoustic apparatus may be configured as one integrated apparatus.
  • Each device constituting the system according to the present embodiment may be constituted by separate hardware, or all devices may be constituted by one piece of hardware. The function of the system according to the present embodiment may be configured by any hardware.
  • the flowchart shown in FIG. 5 includes a step indicating the operation of the system according to the present embodiment and a step indicating the operation of a user such as a doctor.
  • the computer 150 of the photoacoustic apparatus 1100 acquires information related to the inspection.
  • the computer 150 obtains examination order information transmitted from an in-hospital information system such as a Hospital Information System (HIS) or a Radiology Information System (RIS).
  • the examination order information includes information such as the type of the modality used for the examination and the contrast agent used for the examination.
  • the inspection order information includes information on light to be irradiated.
  • the main embodiment of the present invention is to acquire the subject information by irradiating the subject with at least a single wavelength of light irradiation, and to irradiate the subject with each light of a plurality of wavelengths when acquiring spectral information
  • the information on light can include the pulse length, repetition frequency, intensity, and the like of light for each wavelength.
  • a spectral image having an image value according to the equation (1) is generated, and an image corresponding to an actual oxygen saturation is obtained for a blood vessel region in the spectral image. While the value is calculated, an image value in a region where the contrast agent exists in the spectral image (hereinafter also referred to as a region of the contrast agent) greatly changes depending on a wavelength to be used and an absorption coefficient spectrum of the contrast agent. It is preferable to take this into consideration. That is, in order to facilitate understanding of the three-dimensional distribution of the contrast agent, a wavelength is used so that the image value of the region of the contrast agent in the spectral image can be distinguished from the image value of the region of the blood vessel.
  • contrast enhancement in the spectral image is performed using the fact that the oxygen saturation of the artery and vein generally falls within the range of 60% to 100% in percent display. It is preferable to use two wavelengths such that the calculated value of the formula (1) corresponding to the agent is smaller than 60% (for example, a negative value) or larger than 100%. Also, the computer 150 determines two wavelengths based on the information on the contrast agent such that the signs of the image values of the region corresponding to the contrast agent in the spectral image and the image values of the other regions are reversed. Is also good.
  • ICG when used as a contrast agent, two wavelengths of 700 nm or more and less than 820 nm and two wavelengths of 820 nm or more and 1020 nm or less are selected, and a spectral image is generated by Expression (1), thereby obtaining a region of the contrast agent. And a blood vessel region can be distinguished well.
  • the user may use the input unit 170 to instruct the type of the modality used for the inspection, information on light when the modality is photoacoustic imaging, the type of the contrast agent used for the inspection, and the concentration of the contrast agent.
  • the computer 150 can acquire the inspection information via the input unit 170.
  • the computer 150 may store information on a plurality of contrast agents in advance, and acquire information on the contrast agent set by default from the information.
  • FIG. 12 shows an example of a GUI displayed on the display unit 160.
  • examination order information such as a patient ID, an examination ID, and an imaging date and time is displayed.
  • the item 2500 may have a display function of displaying inspection order information acquired from an external device such as a HIS or RIS, or an input function of allowing a user to input inspection order information using the input unit 170.
  • the GUI item 2600 displays information on the contrast agent such as the type of the contrast agent and the concentration of the contrast agent.
  • the item 2600 may have a display function of displaying information on a contrast agent acquired from an external device such as an HIS or RIS, or an input function that allows a user to input information on a contrast agent using the input unit 170. Good.
  • information on the contrast agent such as the type and concentration of the contrast agent may be input from a plurality of options by a method such as pull-down. Note that the GUI shown in FIG. 12 may be displayed on the display device 1400.
  • the information on the contrast agent set by default may be acquired from the information on the plurality of contrast agents.
  • ICG is set as the type of the contrast agent
  • 1.0 mg / mL is set as the concentration of the contrast agent by default.
  • the type and density of the contrast agent set by default are displayed in the item 2600 of the GUI, but the information on the contrast agent may not be set by default. In this case, the information about the contrast agent may not be displayed on the GUI item 2600 on the initial screen.
  • the introduction unit 190 introduces a contrast agent into the subject.
  • the user operates the input unit 170 to send a signal indicating that the contrast agent has been introduced from the input unit 170 to the control device. It may be transmitted to the computer 150. Further, the introduction unit 190 may transmit a signal indicating that the contrast agent has been introduced into the subject 100 to the computer 150.
  • the contrast agent may be administered to the subject without using the introduction unit 190.
  • the contrast medium may be administered by aspirating the sprayed contrast medium onto a living body as a subject.
  • the subsequent processing may be executed after a certain period of time until the contrast agent reaches the contrast target in the subject 100.
  • FIGS. 13 to 15 show spectral images obtained by photographing when the ICG is introduced while changing the density.
  • 0.1 mL of ICG was introduced subcutaneously or intradermally on the hand or foot at each location.
  • the ICG introduced subcutaneously or intradermally is selectively taken up by the lymphatic vessels, so that the lumen of the lymphatic vessels is imaged.
  • the images were taken within 5 to 60 minutes after the introduction of ICG.
  • Each of the spectral images was generated from a photoacoustic image obtained by irradiating a living body with light having a wavelength of 797 nm and light having a wavelength of 835 nm.
  • FIG. 13A shows a spectral image on the right forearm extension side when ICG is not introduced.
  • FIG. 13B shows a spectral image on the right forearm extension side when ICG having a concentration of 2.5 mg / mL was introduced. Lymph vessels are depicted in the area indicated by the broken line and the arrow in FIG. 13B.
  • FIG. 14A shows a spectral image of the left forearm extension when ICG having a concentration of 1.0 mg / mL is introduced.
  • FIG. 14B shows a spectral image of the left forearm extension on introduction of ICG at a concentration of 5.0 mg / mL. Lymph vessels are depicted in the area indicated by the broken line and the arrow in FIG. 14B.
  • FIG. 15A shows a spectral image of the inside of the right lower leg when ICG having a concentration of 0.5 mg / mL is introduced.
  • FIG. 15B shows a spectral image of the inside of the left lower leg when ICG having a concentration of 5.0 mg / mL is introduced.
  • the lymphatic vessels are depicted in the area indicated by the broken line and the arrow in FIG. 15B.
  • the visibility of the lymphatic vessels in the spectral images is improved when the concentration of ICG is increased.
  • the lymph vessels can be favorably depicted when the concentration of ICG is 2.5 mg / mL or more. That is, when the concentration of ICG is 2.5 mg / mL or more, the lymph vessels on the line can be clearly recognized. Therefore, when ICG is used as a contrast agent, the concentration may be 2.5 mg / mL or more. In consideration of the dilution of ICG in a living body, the concentration of ICG may be higher than 5.0 mg / mL. However, in view of the solubility of Diagno Green, it is difficult to dissolve it in an aqueous solution at a concentration of 10.0 mg / mL or more.
  • the concentration of ICG to be introduced into a living body is preferably from 2.5 mg / mL to 10.0 mg / mL, more preferably from 5.0 mg / mL to 10.0 mg / mL.
  • the computer 150 may selectively receive an instruction from the user indicating the ICG concentration in the above numerical range. That is, in this case, the computer 150 does not have to accept an instruction from the user indicating the ICG concentration outside the above numerical range. Therefore, when acquiring information indicating that the type of the contrast agent is ICG, the computer 150 issues an instruction from a user indicating a concentration of ICG smaller than 2.5 mg / mL or larger than 10.0 mg / mL. May not be accepted.
  • the computer 150 when acquiring information indicating that the type of the contrast agent is ICG, the computer 150 receives an instruction from the user indicating a concentration of ICG smaller than 5.0 mg / mL or larger than 10.0 mg / mL. It is not necessary to accept.
  • the computer 150 may configure the GUI so that the user cannot specify the ICG concentration outside the numerical range on the GUI. That is, the computer 150 may display the GUI so that the user cannot specify the ICG concentration outside the numerical range on the GUI. For example, the computer 150 may display a pull-down on the GUI that can selectively indicate the concentration of ICG in the above numerical range. The computer 150 may display the density of the ICG outside the numerical range in the pull-down in a grayed-out manner, and may configure the GUI so that the grayed-out density cannot be selected. In addition, the computer 150 may notify an alert when a user specifies an ICG concentration outside the above numerical range on the GUI.
  • any method such as displaying an alert on the display unit 160 and lighting a sound or a lamp can be adopted.
  • the computer 150 may cause the display unit 160 to display the above numerical range as the concentration of ICG to be introduced into the subject.
  • the concentration of the contrast agent to be introduced into the subject is not limited to the numerical range shown here, and a suitable concentration according to the purpose can be adopted. Further, here, an example in which the type of the contrast agent is ICG has been described, but the above configuration can be similarly applied to other contrast agents.
  • 9A to 9D show simulation results of image values (oxygen saturation values) corresponding to the contrast agent in the spectral image in each of the two wavelength combinations.
  • 9A to 9D represent the first wavelength and the second wavelength, respectively.
  • FIG. 9 shows contour lines of image values corresponding to the contrast agent in the spectral image.
  • 9A to 9D show image values corresponding to the contrast agent in the spectral images when the concentration of ICG is 5.04 ⁇ g / mL, 50.4 ⁇ g / mL, 0.5 mg / mL, and 1.0 mg / mL, respectively. Show.
  • an image value corresponding to a contrast agent in a spectral image may be 60% to 100% depending on a combination of wavelengths to be selected. As described above, if such a combination of wavelengths is selected, it becomes difficult to distinguish a blood vessel region and a contrast agent region in a spectral image. 9A to 9D, it is preferable to select a combination of wavelengths such that the image value corresponding to the contrast agent in the spectral image is smaller than 60% or larger than 100%. . Further, it is preferable to select a combination of wavelengths such that the image value corresponding to the contrast agent in the spectral image has a negative value in the combination of wavelengths shown in FIGS. 9A to 9D.
  • FIG. 10 shows the relationship between the concentration of ICG and the image value (the value of equation (1)) corresponding to the contrast agent in the spectral image when 797 nm is selected as the first wavelength and 835 nm is selected as the second wavelength.
  • FIG. 10 shows the relationship between the concentration of ICG and the image value (the value of equation (1)) corresponding to the contrast agent in the spectral image when 797 nm is selected as the first wavelength and 835 nm is selected as the second wavelength.
  • the contrast in the spectral image is increased regardless of the concentration of 5.04 ⁇ g / mL to 1.0 mg / mL.
  • the image value corresponding to the agent is a negative value. Therefore, according to the spectral image generated by such a combination of wavelengths, since the oxygen saturation value of the blood vessel does not take a negative value in principle, the blood vessel region and the contrast agent region are clearly distinguished. be able to.
  • the wavelength is determined based on the information on the contrast agent.
  • the absorption coefficient of hemoglobin may be considered in determining the wavelength.
  • FIG. 11 shows the spectra of the molar absorption coefficient of oxyhemoglobin (dashed line) and the molar absorption coefficient of deoxyhemoglobin (solid line).
  • the magnitude relationship between the molar absorption coefficient of oxyhemoglobin and the molar absorption coefficient of deoxyhemoglobin is reversed at 797 nm. That is, at wavelengths shorter than 797 nm, veins can be easily grasped, and at wavelengths longer than 797 nm, arteries can be grasped easily.
  • lymphatic venule anastomosis for creating a bypass between a lymph vessel and a vein is performed.
  • LVA lymphatic venule anastomosis
  • photoacoustic imaging it is conceivable to use photoacoustic imaging to image both the veins and the lymph vessels in which the contrast agent has accumulated.
  • the vein can be more clearly imaged.
  • at least one of the plurality of wavelengths is set to a wavelength at which the molar absorption coefficient of deoxyhemoglobin is larger than the molar absorption coefficient of oxyhemoglobin.
  • the vein is imaged by setting the wavelength at which the molar absorption coefficient of deoxyhemoglobin is larger than the molar absorption coefficient of oxyhemoglobin at any of the two wavelengths. This is advantageous. By selecting these wavelengths, in the preoperative examination of the lymphatic venule anastomosis, it is possible to accurately image both the lymphatic vessels and the veins into which the contrast agent has been introduced.
  • any of the plurality of wavelengths is a wavelength at which the absorption coefficient of the contrast agent is larger than that of blood, the oxygen saturation accuracy of the blood decreases due to artifacts derived from the contrast agent. Therefore, in order to reduce artifacts derived from the contrast agent, at least one of the plurality of wavelengths may be a wavelength at which the absorption coefficient of the contrast agent is smaller than the absorption coefficient of blood.
  • the light irradiation unit 110 sets the wavelength determined based on the information acquired in S100 in the light source 111.
  • the light source 111 emits light having the determined wavelength.
  • Light generated from the light source 111 is applied to the subject 100 as pulse light via the optical system 112. Then, the pulse light is absorbed inside the subject 100, and a photoacoustic wave is generated by the photoacoustic effect.
  • the introduced contrast agent also absorbs the pulse light and generates a photoacoustic wave.
  • the light irradiation unit 110 may transmit a synchronization signal to the signal collection unit 140 together with the transmission of the pulse light.
  • the light irradiating unit 110 similarly irradiates each of a plurality of wavelengths with light.
  • the user may specify the control parameters such as the irradiation condition (the repetition frequency and wavelength of irradiation light) of the light irradiation unit 110 and the position of the probe 180 by using the input unit 170.
  • the computer 150 may set a control parameter determined based on a user's instruction. Further, the computer 150 may move the probe 180 to a specified position by controlling the driving unit 130 based on the specified control parameter.
  • the drive unit 130 When imaging at a plurality of positions is designated, the drive unit 130 first moves the probe 180 to the first designated position. Note that the drive unit 130 may move the probe 180 to a position programmed in advance when a measurement start instruction is issued.
  • signal collecting section 140 When receiving the synchronization signal transmitted from light irradiating section 110, signal collecting section 140 starts the signal collecting operation. That is, the signal collecting unit 140 generates an amplified digital electric signal by amplifying and AD converting the analog electric signal derived from the photoacoustic wave output from the receiving unit 120, and outputs the amplified digital electric signal to the computer 150. .
  • the computer 150 stores the signal transmitted from the signal collecting unit 140. When imaging at a plurality of scanning positions is specified, the processes of S300 and S400 are repeatedly executed at the specified scanning positions, and irradiation of pulsed light and reception signal data as digital signals derived from acoustic waves are performed. Repeat generation. Note that the computer 150 may acquire and store the position information of the receiving unit 120 at the time of light emission based on the output from the position sensor of the drive unit 130 with the light emission as a trigger.
  • each of a plurality of wavelengths of light is radiated in a time-division manner.
  • the computer 150 as a three-dimensional photoacoustic image acquisition unit generates a photoacoustic image based on the stored signal data.
  • the computer 150 outputs the generated photoacoustic image to the storage device 1200 and stores it.
  • Reconstruction algorithms for converting signal data into a two-dimensional or three-dimensional spatial distribution include analytic reconstruction methods such as backprojection in the time domain and backprojection in the Fourier domain, and model-based methods (repetitive computations). Law) can be adopted.
  • the backprojection method in the time domain includes Universal @ back-projection (UBP), Filtered @ back-projection (FBP), or delay-and-sum (Delay-and-Sum).
  • the computer 150 generates initial sound pressure distribution information (sound pressures generated at a plurality of positions) as a photoacoustic image by performing a reconstruction process on the signal data. Further, the computer 150 calculates the optical fluence distribution of the light radiated on the subject 100 inside the subject 100, and divides the initial sound pressure distribution by the light fluence distribution to obtain the absorption coefficient distribution information by photoacoustic. It may be obtained as an image. A known method can be applied to the calculation method of the light fluence distribution. In addition, the computer 150 can generate a photoacoustic image corresponding to each of the light of a plurality of wavelengths.
  • the computer 150 can generate a first photoacoustic image corresponding to the first wavelength by performing a reconstruction process on signal data obtained by irradiating light of the first wavelength. Further, the computer 150 can generate a second photoacoustic image corresponding to the second wavelength by performing a reconstruction process on the signal data obtained by irradiating the second wavelength light. As described above, the computer 150 can generate a plurality of photoacoustic images corresponding to lights of a plurality of wavelengths.
  • one three-dimensional photoacoustic image (volume data) is generated by image reconstruction using a photoacoustic signal obtained by a single light irradiation on the subject. Further, by performing light irradiation a plurality of times and performing image reconstruction for each light irradiation, time-series three-dimensional image data (time-series volume data) is obtained.
  • the three-dimensional image data obtained by reconstructing the image for each of the plurality of light irradiations is collectively referred to as three-dimensional image data corresponding to the plurality of light irradiations. Note that, since light irradiation is performed a plurality of times in a time series, three-dimensional image data corresponding to the light irradiations a plurality of times constitutes time-series three-dimensional image data.
  • the computer 150 acquires absorption coefficient distribution information corresponding to each of light of a plurality of wavelengths as a photoacoustic image.
  • the absorption coefficient distribution information corresponding to the first wavelength is defined as a first photoacoustic image
  • the absorption coefficient distribution information corresponding to the second wavelength is defined as a second photoacoustic image.
  • the present invention is also applicable to a system that does not include the photoacoustic apparatus 1100.
  • the present invention can be applied to any system as long as the image processing apparatus 1300 as a three-dimensional photoacoustic image acquisition unit can acquire a photoacoustic image.
  • the present invention can be applied to a system that does not include the photoacoustic device 1100 but includes the storage device 1200 and the image processing device 1300.
  • the image processing apparatus 1300 as a three-dimensional photoacoustic image acquisition unit acquires a photoacoustic image by reading a designated photoacoustic image from a group of photoacoustic images stored in the storage device 1200 in advance. be able to.
  • the computer 150 as a three-dimensional spectral image acquisition unit generates a spectral image based on a plurality of photoacoustic images corresponding to a plurality of wavelengths.
  • the computer 150 outputs the spectral image to the storage device 1200 and causes the storage device 1200 to store the spectral image.
  • the computer 150 may generate a spectral image indicating information corresponding to the concentration of a substance constituting the subject, such as glucose concentration, collagen concentration, melanin concentration, and volume fraction of fat and water.
  • the computer 150 may generate the spectral image representing the ratio between the first photoacoustic image corresponding to the first wavelength and the second photoacoustic image corresponding to the second wavelength.
  • the computer 150 may generate a spectral image having image values according to Expression (1) using the first photoacoustic image and the second photoacoustic image.
  • the computer 150 in this step may be considered as a three-dimensional spectral image acquisition unit.
  • the computer 150 may be considered as a three-dimensional photoacoustic image acquisition unit.
  • the image processing apparatus 1300 as the three-dimensional spectral image acquisition unit may acquire a spectral image by reading a designated spectral image from a spectral image group stored in the storage device 1200 in advance. Further, the image processing apparatus 1300 as a three-dimensional photoacoustic image acquisition unit includes at least one of a plurality of photoacoustic images used for generating a read-out spectral image from a group of photoacoustic images stored in the storage device 1200 in advance. A photoacoustic image may be obtained by reading one.
  • Photoacoustic image data and spectral image data can be used as the three-dimensional image data.
  • the photoacoustic image data refers to image data indicating a distribution of an absorption coefficient or the like
  • the spectral image data is converted to photoacoustic image data corresponding to each wavelength when light of a plurality of wavelengths is irradiated on the subject. Indicates image data indicating the density or the like generated based on the image data.
  • the image processing device 1300 reads a photoacoustic image or a spectral image from the storage device 1200, and acquires information on lymph vessels and blood vessels based on the photoacoustic image or the spectral image.
  • the information to be acquired includes information indicating the positions of lymph vessels and blood vessels in the volume data. Note that, as described above, the processing in this step can be performed based on a photoacoustic image derived from at least one wavelength, and a spectral image created from a photoacoustic image derived from each of a plurality of wavelengths is used. You can also.
  • the image processing apparatus 1300 functions as a three-dimensional blood vessel image acquiring unit and a three-dimensional lymph image acquiring unit, and performs information processing.
  • the three-dimensional lymph image acquiring means performs image processing on a three-dimensional photoacoustic image derived from a single wavelength to extract a lymph region and acquire a three-dimensional lymph image.
  • the image processing device 1300 reads the three-dimensional photoacoustic image stored in the storage device 1200.
  • the time range to be read is arbitrary. However, in general, the flow of lymph fluid is intermittent, and the cycle is several tens of seconds to several minutes. Therefore, it is preferable to read a three-dimensional photoacoustic image corresponding to a photoacoustic wave acquired in a relatively long time range.
  • the time range may be set, for example, from 40 seconds to 2 minutes.
  • FIG. 6A is a schematic diagram illustrating one three-dimensional photoacoustic image. Although the actual volume data includes image values derived from substances other than blood vessels and lymph vessels, this figure simply shows that only the blood vessels and lymph vessels are displayed in the volume data.
  • the image processing apparatus 1300 extracts a region where the lymphatic vessels are present from each of the read time-series three-dimensional photoacoustic images.
  • the image processing apparatus 1300 determines the change in the luminance value between the time-series three-dimensional photoacoustic images. There is a method of detecting and judging a portion where the change in the luminance value is large as a lymph region.
  • the time range and the criterion for determining whether or not the region is a lymph region are merely examples, and are appropriately determined according to the condition of the lymphatic vessels in the subject and the conditions regarding the contrast agent and light irradiation. For example, when the predetermined time range is set to 1 minute, when a region having a value that is more than half the luminance value of a typical blood vessel is observed for 5 seconds out of 1 minute, the region is changed to a lymph region. You may decide.
  • FIG. 6B is a schematic diagram illustrating a three-dimensional lymph image acquired from one three-dimensional photoacoustic image.
  • the image processing apparatus 1300 uses a value of oxygen saturation (expression)
  • the lymph region may be extracted by distinguishing the region corresponding to blood from the region corresponding to the contrast agent based on the (calculated value of (1)).
  • the calculated value of Expression (1) can be set to an exclusive range between the region corresponding to the contrast agent and the region corresponding to blood.
  • the image processing apparatus 1300 extracts a region where a blood vessel exists from each of the read time-series three-dimensional photoacoustic images. For example, when a vein is selected as a target blood vessel, extraction may be performed based on a three-dimensional photoacoustic image derived from a photoacoustic wave generated by irradiation with pulsed light in a region where the absorption coefficient of deoxyhemoglobin is relatively high.
  • FIG. 6C is a schematic diagram illustrating a three-dimensional blood vessel image acquired from one three-dimensional photoacoustic image.
  • the image processing apparatus 1300 determines a region corresponding to blood based on the value of oxygen saturation.
  • the blood vessel region may be extracted by distinguishing the region corresponding to the contrast agent from the region. Further, the vein and the artery may be determined based on the value of the oxygen saturation.
  • time-series three-dimensional blood vessel image data and time-series three-dimensional lymph image data separated from the time-series three-dimensional photoacoustic image data are acquired and stored in the storage device.
  • the method of storing these data is arbitrary.
  • each of the three-dimensional blood vessel image data and the three-dimensional lymph image data may be stored as different time-series three-dimensional image data.
  • a flag indicating whether the coordinate is a blood vessel region, a lymphatic region, or neither of the coordinates in the volume data May be stored in association with each other.
  • the information may be stored in association with information on the wavelength of light emitted to the subject. In any case, the storage method does not matter as long as a two-dimensional image reflecting the depth information can be generated in the subsequent processing of this flow.
  • the image processing apparatus 1300 acquires information about the two-dimensional lymph region and information about the blood vessel region from the information about the three-dimensional lymph region and the information about the blood vessel region acquired in S700.
  • the image processing apparatus 1300 functions as a two-dimensional blood vessel image acquiring unit and a two-dimensional lymph image acquiring unit, and performs information processing.
  • the image processing apparatus 1300 as a two-dimensional blood vessel image acquiring unit performs processing based on three-dimensional blood vessel image data derived from certain volume data and two-dimensional blood vessel image data and blood vessel depth information associated therewith. To get.
  • the image processing apparatus 1300 as a two-dimensional lymph image acquiring unit acquires two-dimensional lymph image data and lymph depth information associated therewith based on three-dimensional lymph image data derived from certain volume data.
  • the depth information can also be said to be three-dimensional position information of a specific area in the volume data.
  • the blood vessel depth information indicates three-dimensional position information of the blood vessel region
  • the lymph depth information indicates three-dimensional position information of the lymph region.
  • the image processing apparatus 1300 obtains MIP (Maximum Intensity Projection) image data by projecting the maximum value of the three-dimensional volume data in an arbitrary viewpoint direction.
  • the projection direction of the maximum value is arbitrary.
  • the direction may be from the surface of the subject to the back of the subject.
  • the depth direction is a direction in which the depth increases from the surface of the subject toward the inside of the subject.
  • the projection direction may be a direction corresponding to a coordinate axis determined by the configuration of the photoacoustic apparatus.
  • the depth direction may be any of the XYZ directions.
  • a normal direction to the surface of the subject when a position where light enters the subject may be used as a starting point.
  • FIG. 7A shows a two-dimensional lymph image calculated by projecting the maximum value of the three-dimensional blood vessel image in the Y direction and lymph depth information associated therewith.
  • the lymph depth information includes information indicating the depth at each position where the lymph region exists in the MIP image.
  • the lymph depth information includes information indicating the depth at each position where the lymph region exists in the MIP image.
  • the schematic diagram of FIG. 7B is a schematic diagram showing a two-dimensional blood vessel image calculated by projecting a maximum value of a three-dimensional blood vessel image in the Y direction and blood vessel depth information associated therewith.
  • the lymph depth information indicates a matrix in which the coordinates in the XZ plane of the two-dimensional lymph image are associated with the coordinate information indicating the depth position in the Y direction at the coordinates.
  • information such as luminance, hue, lightness, and saturation associated with the coordinate information may be used.
  • 7B is the same as FIG. 7A.
  • the method applied when calculating two-dimensional image data from three-dimensional image data is not limited to the maximum intensity projection method. Any method may be used as long as positional information on the presence of the lymph region or the blood vessel region on the two-dimensional plane and depth information of the lymph region or the blood vessel region in the viewpoint direction can be obtained.
  • any method such as volume rendering and surface rendering can be adopted.
  • setting conditions such as a display area and a line-of-sight direction when rendering a three-dimensional image in two dimensions can be arbitrarily specified according to an observation target and a device configuration.
  • the image processing apparatus 1300 as the storage control unit stores the two-dimensional blood vessel image data calculated in S800 and the blood vessel depth information in the storage device 1200 in association with each other. Further, the two-dimensional lymph image data and the lymph depth information are stored in the storage device 1200 in association with each other.
  • the method of storage is arbitrary. For example, an array in which a flag indicating whether a pixel is a blood vessel and the depth for each pixel of the two-dimensional blood vessel image data may be used. The same applies to two-dimensional lymph image data.
  • the storage method of this step is particularly effective in reducing the amount of data that increases when generating time-series volume data.
  • the image processing device 1300 as the display control means causes the display device 1400 to display the two-dimensional lymph image data in a format in which the lymph depth information is indicated. Further, the image processing device 1300 as the display control means causes the display device 1400 to display the two-dimensional blood vessel image data in a format in which the blood vessel depth information is indicated. Further, the image processing apparatus 1300 as a display control unit converts a two-dimensional lymph image showing lymph depth information and a two-dimensional blood vessel image showing blood vessel depth information into a two-dimensional blood vessel image showing the correspondence between lymph and blood vessels. It may be displayed in a format that is easy to understand. For example, a blood vessel image and a lymph image can be displayed side by side or superimposed. In particular, it is preferable that the user can easily understand whether or not the lymph and the blood vessel are close to each other.
  • FIG. 8A shows a two-dimensional lymph image that has been subjected to brightness processing based on lymph depth information.
  • FIG. 8B shows a two-dimensional blood vessel image on which lightness processing based on blood vessel depth information has been performed.
  • the image processing method when the image processing apparatus 1300 indicates the depth information on the two-dimensional image is not limited to the brightness display.
  • image processing may be performed to correct at least one of the brightness, saturation, and hue of the blood vessel image and the lymph image so that the depth information can be understood by the user.
  • a process of assigning at least one of lightness, saturation, and hue to the depth information associated with each of the blood vessel image and the lymph image may be performed.
  • the image processing apparatus 1300 may change the color in the image according to the depth.
  • the user may want to know the positional relationship between the lymph vessels and the blood vessels in the depth direction.
  • the image processing apparatus 1300 displays a two-dimensional lymph image with lymph depth information as shown in FIG. 8A and a two-dimensional blood vessel image with blood vessel depth information as shown in FIG. 8B on a display device in a format that is easy for the user to compare. I do. For example, both may be displayed in parallel. Further, both may be switched by a button or a physical switch on the GUI.
  • both may be superimposed and displayed as shown in FIG. 8C.
  • the image processing apparatus 1300 may detect a pair of lymph vessels and blood vessels located in the vicinity by information processing such as image analysis and present the pair to the user using a marker, an arrow, or the like.
  • 8C is switched between the single display or the parallel display of FIGS. 8A and 8B and FIG. 8C by a button or a physical switch on the GUI, and FIG. 8C is further displayed in addition to the single display or the parallel display of FIGS. It may be possible to make a switch so as to perform the switching.
  • the two-dimensional image data and the depth information are stored in association with each other in S900.
  • the image processing device 1300 may generate volume data using this data and display a simple three-dimensional image on a display device. Specifically, the image processing device 1300 assigns the image values in the two-dimensional image data to the three-dimensional space using the depth information associated with the two-dimensional image data. This makes it possible to present a three-dimensional image to a user even when using two-dimensional image data having a relatively small data amount.
  • the method of extracting a blood vessel region and a lymph region from three-dimensional image data, forming a two-dimensional image, and storing and displaying the two-dimensional image has been described.
  • the specific substance and the contrast agent extracted from the three-dimensional image data are not limited to these two. If the image is drawn by photoacoustic imaging, the image may be subjected to the above-described two-dimensional imaging, storage, and display processing.
  • the specific substance can be selected from, for example, hemoglobin, myoglobin, glucose, collagen, melanin, fat and water. Further, among the hemoglobins, finely divided ones, such as oxyhemoglobin and reduced hemoglobin, may be used as the specific substance.
  • the type of the contrast agent is not limited to ICG.
  • the image processing apparatus determines the first area corresponding to the first substance from the three-dimensional image data.
  • First three-dimensional image acquisition means for acquiring the extracted first three-dimensional image data, and acquiring second three-dimensional image data in which a second region corresponding to a second substance is extracted from the three-dimensional image data
  • a second two-dimensional image acquisition unit a first two-dimensional image acquisition unit that acquires, from the first three-dimensional image data, first two-dimensional image data in which three-dimensional position information of the first region is associated with the first three-dimensional image data
  • a second two-dimensional image acquiring unit that acquires, from the second three-dimensional image data, second two-dimensional image data in which three-dimensional position information of the second region is associated with the first two-dimensional image
  • Data and the second two-dimensional image data Storage control means for storing the unit, functions as.
  • the storage control unit may store the first two-dimensional image data and the second two-dimensional image data in the storage unit in association with each other.
  • three or more regions may be respectively extracted from three-dimensional image data. That is, in addition to the first substance and the second substance, a region relating to the third substance or more substances may be extracted.
  • a region relating to the third substance or more substances may be extracted.
  • the artery and the vein can be separated and extracted. Therefore, for each of the arteries, veins, and lymph vessels extracted from the three-dimensional image data, three-dimensional position information is acquired as described above, and two-dimensional image data associated with the three-dimensional position information is acquired and stored. May be.
  • spectral images derived from light irradiation of two wavelengths were used. However, depending on the types of specific substances, more than two types of wavelengths were used.
  • the image processing apparatus also functions as a third three-dimensional image acquisition unit and a third two-dimensional image acquisition unit when extracting a third substance or more substances.
  • the image processing device also functions as a storage control unit that stores the third two-dimensional image in the storage unit in association with the first two-dimensional image data and the second two-dimensional image data.
  • the image processing device 1300 as the display control means displayed a two-dimensional blood vessel image with blood vessel depth information and a two-dimensional lymph image with lymphatic depth information on the display device.
  • the image processing device according to the present embodiment may display a photoacoustic image or a spectral image in addition to such display with depth information or separately from display with depth information.
  • a spectral image may be displayed on a display device so that a region corresponding to a contrast agent and a region other than the contrast agent can be identified. An example of such display will be described.
  • the image processing apparatus 1300 causes the GUI to display a color bar 2400 as a color scale indicating the relationship between the image value of the spectral image and the display color.
  • the image processing apparatus 1300 determines a numerical range of image values to be assigned to the color scale based on information on the contrast agent (for example, information indicating that the type of the contrast agent is ICG) and information indicating the wavelength of irradiation light. You may decide.
  • the image processing apparatus 1300 may determine a numerical range including a negative image value corresponding to the arterial oxygen saturation, the venous oxygen saturation, and the contrast agent.
  • the image processing apparatus 1300 may determine a numerical range of -100% to 100% and set a color bar 2400 in which -100% to 100% is assigned to a color gradation that changes from blue to red. With such a display method, in addition to the identification of the artery and vein, it is also possible to identify the area corresponding to the negative contrast agent. In addition, the image processing apparatus 1300 may cause the indicator 2410 indicating the numerical value range of the image value corresponding to the contrast agent to be displayed based on the information regarding the contrast agent and the information indicating the wavelength of the irradiation light.
  • a negative value area is indicated by an indicator 2410 as a numerical value range of an image value corresponding to ICG.
  • the image processing apparatus 1300 as the region determining means may determine a region corresponding to the contrast agent in the spectral image based on the information on the contrast agent and the information indicating the wavelength of the irradiation light. For example, the image processing apparatus 1300 may determine a region having a negative image value in the spectral image as a region corresponding to the contrast agent. Then, the image processing device 1300 may display the spectral image on the display device 1400 so that the region corresponding to the contrast agent and the other region can be identified.
  • the image processing apparatus 1300 displays an indicator (for example, a frame) indicating a region corresponding to the contrast agent, causing the display color of the region corresponding to the contrast agent to be different from that of the other region, blinking the region corresponding to the contrast agent, and the like.
  • An identification display such as display may be employed.
  • the display mode may be switched to a display mode for selectively displaying an image value corresponding to the ICG.
  • the image processing apparatus 1300 selects a voxel having a negative image value from the spectral image and selectively renders the selected voxel,
  • the ICG area may be selectively displayed.
  • the user may select an item 2710 corresponding to an artery display or an item 2720 corresponding to a vein display.
  • the image processing apparatus 1300 Based on a user's instruction, the image processing apparatus 1300 selectively selects an image value corresponding to an artery (for example, 90% or more and 100% or less) or an image value corresponding to a vein (for example, 60% or more and less than 90%).
  • the display mode may be switched to the display mode.
  • the numerical value range of the image value corresponding to the artery or the image value corresponding to the vein may be changeable based on a user's instruction.
  • hue, lightness, and saturation is assigned to the image value of the spectral image
  • an image in which the remaining parameters of hue, lightness, and saturation are assigned to the image value of the photoacoustic image is displayed as a spectral image.
  • an image in which hue and saturation are assigned to image values of a spectral image and brightness is assigned to image values of a photoacoustic image may be displayed as a spectral image.
  • the conversion table from the image value of the photoacoustic image to the brightness may be changed according to the image value of the spectral image. For example, when the image value of the spectral image is included in the numerical value range of the image value corresponding to the contrast agent, the brightness corresponding to the image value of the photoacoustic image may be smaller than that corresponding to the blood vessel.
  • the conversion table is a table indicating the brightness corresponding to each of the plurality of image values.
  • the image value of the spectral image is included in the numerical value range of the image value corresponding to the contrast agent, the brightness corresponding to the image value of the photoacoustic image may be larger than that corresponding to the blood vessel. That is, when the contrast agent region is compared with the blood vessel region, if the image value of the photoacoustic image is the same, the brightness of the contrast agent region may be greater than that of the blood vessel region.
  • the numerical value range of the image value of the photoacoustic image that does not convert the image value of the photoacoustic image into the brightness may differ depending on the image value of the spectral image.
  • the conversion table may be changed to a table suitable for the type and concentration of the contrast agent and the wavelength of the irradiation light. Therefore, the image processing apparatus 1300 may determine the conversion table from the image value of the photoacoustic image to the brightness based on the information regarding the contrast agent and the information indicating the wavelength of the irradiation light. If it is estimated that the image value of the photoacoustic image corresponding to the contrast agent is larger than that corresponding to the blood vessel, the image processing apparatus 1300 sets the brightness corresponding to the image value of the photoacoustic image corresponding to the contrast agent to the blood vessel. It may be smaller than the corresponding one.
  • the image processing apparatus 1300 may determine the brightness corresponding to the image value of the photoacoustic image corresponding to the contrast agent. May be larger than that corresponding to a blood vessel.
  • the GUI shown in FIG. 12 includes an absorption coefficient image (first photoacoustic image) 2100 corresponding to a wavelength of 797 nm, an absorption coefficient image (second photoacoustic image) 2200 corresponding to a wavelength of 835 nm, and an oxygen saturation image (spectral image) 2300. Is displayed.
  • the GUI may display which wavelength is generated by each image. In the present embodiment, both the photoacoustic image and the spectral image are displayed, but only the spectral image may be displayed.
  • the image processing device 1300 may switch between displaying a photoacoustic image and displaying a spectral image based on a user's instruction.
  • the display unit 160 may be capable of displaying a moving image.
  • the image processing apparatus 1300 generates at least one of the first photoacoustic image 2100, the second photoacoustic image 2200, and the spectral image 2300 in time series, and generates moving image data based on the generated time-series image. It may be configured to generate and output to the display unit 160.
  • the moving image display it is possible to repeatedly display a state in which lymph flows.
  • the speed of the moving image may be a predetermined speed specified in advance or a predetermined speed specified by the user.
  • the frame rate of the moving image be variable in the display unit 160 that can display the moving image.
  • a window for the user to manually input the frame rate, a slide bar for changing the frame rate, and the like may be added to the GUI in FIG.
  • the lymph fluid flows intermittently in the lymphatic vessels, only part of the acquired time-series volume data that can be used to confirm the lymph flow is used. Therefore, if real-time display is performed when checking the flow of lymph, efficiency may decrease. Therefore, by making the frame rate of the moving image displayed on the display unit 160 variable, the fast-moving display of the displayed moving image becomes possible, so that the user can confirm the state of the fluid in the lymphatic vessel in a short time. Become.
  • the display unit 160 may be capable of repeatedly displaying a moving image within a predetermined time range. At this time, it is also preferable to add a GUI such as a window or a slide bar for enabling the user to specify the range in which the repeated display is performed, to FIG. This makes it easier for the user to grasp, for example, how the fluid flows in the lymphatic vessels.
  • a GUI such as a window or a slide bar
  • At least one of the image processing apparatus 1300 and the computer 150 as the information processing apparatus includes a spectral image acquisition unit, a contrast agent information acquisition unit, an area determination unit, a photoacoustic image acquisition unit, and a display control unit. It functions as a device having at least one.
  • each means may be comprised by mutually different hardware, and may be comprised by one hardware.
  • a plurality of units may be configured by one piece of hardware.
  • the blood vessel and the contrast agent can be identified.
  • the image value corresponding to the contrast agent is a blood vessel and the contrast agent.
  • the image processing described in this step can be applied to a case where the image value of the spectral image (oxygen saturation image) corresponding to the contrast agent becomes smaller than 60% or larger than 100%.
  • the present invention is also realized by executing the following processing.
  • software that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program and reads the program. This is the process to be performed.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Molecular Biology (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Vascular Medicine (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Immunology (AREA)
  • Acoustics & Sound (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
PCT/JP2019/032560 2018-08-24 2019-08-21 画像処理装置、画像処理方法、プログラム Ceased WO2020040172A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/180,928 US12114961B2 (en) 2018-08-24 2021-02-22 Image processing apparatus and image processing method and non-transitory computer-readable medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-157794 2018-08-24
JP2018157794A JP7108985B2 (ja) 2018-08-24 2018-08-24 画像処理装置、画像処理方法、プログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/180,928 Continuation US12114961B2 (en) 2018-08-24 2021-02-22 Image processing apparatus and image processing method and non-transitory computer-readable medium

Publications (1)

Publication Number Publication Date
WO2020040172A1 true WO2020040172A1 (ja) 2020-02-27

Family

ID=69593249

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/032560 Ceased WO2020040172A1 (ja) 2018-08-24 2019-08-21 画像処理装置、画像処理方法、プログラム

Country Status (3)

Country Link
US (1) US12114961B2 (https=)
JP (1) JP7108985B2 (https=)
WO (1) WO2020040172A1 (https=)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7362561B2 (ja) * 2020-07-30 2023-10-17 富士フイルム株式会社 放射線画像処理装置、方法およびプログラム
JP2023139380A (ja) * 2022-03-22 2023-10-04 株式会社Luxonus データ圧縮装置、データ圧縮プログラム、データ圧縮方法、データ伸長装置、データ伸長プログラム及びデータ伸長方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013176414A (ja) * 2012-02-28 2013-09-09 Fujifilm Corp 光音響画像生成装置及び方法
JP2018015262A (ja) * 2016-07-28 2018-02-01 国立大学法人京都大学 光音響イメージング装置

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5417699A (en) * 1992-12-10 1995-05-23 Perclose Incorporated Device and method for the percutaneous suturing of a vascular puncture site
WO2006030731A1 (ja) * 2004-09-13 2006-03-23 Hitachi Medical Corporation 超音波撮像装置及び投影像生成方法
JP4818031B2 (ja) * 2005-10-27 2011-11-16 キヤノン株式会社 画像処理装置及び画像処理方法
JP5448353B2 (ja) * 2007-05-02 2014-03-19 キヤノン株式会社 光干渉断層計を用いた画像形成方法、及び光干渉断層装置
JP5809850B2 (ja) * 2011-06-01 2015-11-11 オリンパス株式会社 画像処理装置
JP6278295B2 (ja) * 2013-06-13 2018-02-14 国立大学法人 筑波大学 脈絡膜の血管網を選択的に可視化し解析する光干渉断層計装置及びその画像処理プログラム
JP6305699B2 (ja) * 2013-07-01 2018-04-04 キヤノンメディカルシステムズ株式会社 超音波診断装置及び超音波イメージングプログラム
JP6362420B2 (ja) * 2014-05-26 2018-07-25 キヤノン株式会社 被検体情報取得装置、被検体情報取得方法、および、プログラム
US9808213B2 (en) * 2014-08-11 2017-11-07 Canon Kabushiki Kaisha Image processing apparatus, image processing method, medical image diagnostic system, and storage medium
EP3320852B1 (en) 2015-06-30 2021-03-03 FUJIFILM Corporation Photoacoustic image-generating apparatus and insertion object
JP6925816B2 (ja) * 2017-02-09 2021-08-25 株式会社小松製作所 位置計測システム、作業機械、及び位置計測方法
JP7030455B2 (ja) * 2017-09-06 2022-03-07 キヤノン株式会社 画像処理装置、画像処理方法およびプログラム

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013176414A (ja) * 2012-02-28 2013-09-09 Fujifilm Corp 光音響画像生成装置及び方法
JP2018015262A (ja) * 2016-07-28 2018-02-01 国立大学法人京都大学 光音響イメージング装置

Also Published As

Publication number Publication date
JP7108985B2 (ja) 2022-07-29
US20210177269A1 (en) 2021-06-17
US12114961B2 (en) 2024-10-15
JP2020028669A (ja) 2020-02-27

Similar Documents

Publication Publication Date Title
JP2018202147A (ja) 画像処理装置、画像処理方法、及びプログラム
JP2018089371A (ja) 情報処理装置、情報処理方法、及びプログラム
WO2018230409A1 (ja) 情報処理装置、情報処理方法、及びプログラム
US12114961B2 (en) Image processing apparatus and image processing method and non-transitory computer-readable medium
US20210169397A1 (en) Image processing apparatus, image processing method, and non-transitory computer-readable medium
JP7706722B2 (ja) 光音響イメージングシステム、光音響イメージングシステムの制御方法、および、プログラム
JP2018187394A (ja) 表示制御装置、画像表示方法、及びプログラム
JP7205821B2 (ja) システム
JP7187336B2 (ja) 情報処理装置、情報処理方法、およびプログラム
JP7144805B2 (ja) 画像処理装置、画像処理方法、プログラム
JP2020028670A (ja) 画像処理装置、システム、画像処理方法、プログラム
JP7118718B2 (ja) 被検体情報取得装置、被検体情報処理方法、およびプログラム
JP7142832B2 (ja) 画像処理装置、画像処理方法、プログラム
JP7125709B2 (ja) 画像処理装置、画像処理方法およびプログラム
JP7226728B2 (ja) 画像処理装置、画像処理方法、プログラム
WO2020039640A1 (ja) 情報処理装置、システム、情報処理方法、プログラム
JP7314371B2 (ja) 被検体情報取得装置、被検体情報処理方法、およびプログラム
JP7277212B2 (ja) 画像処理装置、画像処理方法及びプログラム
JP2020028668A (ja) 画像処理装置、画像処理方法、プログラム
JP2020162746A (ja) 画像処理装置、画像処理方法及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19852237

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19852237

Country of ref document: EP

Kind code of ref document: A1