CN112702943A - Photoacoustic imaging method and system and computer readable storage medium - Google Patents
Photoacoustic imaging method and system and computer readable storage medium Download PDFInfo
- Publication number
- CN112702943A CN112702943A CN201880097323.3A CN201880097323A CN112702943A CN 112702943 A CN112702943 A CN 112702943A CN 201880097323 A CN201880097323 A CN 201880097323A CN 112702943 A CN112702943 A CN 112702943A
- Authority
- CN
- China
- Prior art keywords
- photoacoustic
- laser
- data
- signal
- energy value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 173
- 238000012545 processing Methods 0.000 claims abstract description 164
- 238000000034 method Methods 0.000 claims abstract description 60
- 230000001360 synchronised effect Effects 0.000 claims abstract description 47
- 230000004044 response Effects 0.000 claims abstract description 32
- 230000008569 process Effects 0.000 claims description 35
- 239000000523 sample Substances 0.000 claims description 18
- 238000001514 detection method Methods 0.000 claims description 14
- 239000013307 optical fiber Substances 0.000 claims description 14
- 230000001960 triggered effect Effects 0.000 claims description 13
- 238000002604 ultrasonography Methods 0.000 claims description 13
- 239000000126 substance Substances 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 4
- 230000003213 activating effect Effects 0.000 claims description 2
- 230000004913 activation Effects 0.000 claims 1
- 230000003287 optical effect Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 7
- 238000007499 fusion processing Methods 0.000 description 7
- 238000001914 filtration Methods 0.000 description 4
- 238000009499 grossing Methods 0.000 description 4
- 238000010521 absorption reaction Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000002059 diagnostic imaging Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 206010028980 Neoplasm Diseases 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 201000011510 cancer Diseases 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000013399 early diagnosis Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000001678 irradiating effect Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004393 prognosis Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000026676 system process Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
Abstract
The embodiment of the invention discloses a photoacoustic imaging method, a photoacoustic imaging system and a computer-readable storage medium, wherein the method comprises the following steps: receiving a photoacoustic imaging start signal; responding to the photoacoustic imaging starting signal, and sending a laser emission trigger signal to a laser emission device of the photoacoustic imaging system; in response to the photoacoustic imaging start signal, starting an ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals to obtain photoacoustic data; controlling a laser emitting device to emit laser to a target object in response to a laser emission trigger signal, and outputting a laser energy value, wherein the laser energy value indicates an energy level of the emitted laser; acquiring a synchronous signal, wherein the synchronous signal is used for indicating the actual emission time of the laser; determining the corresponding relation between the photoacoustic data and the laser energy value according to the synchronous signal; and processing the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
Description
The embodiment of the invention relates to the field of medical imaging, in particular to a photoacoustic imaging method and system and a computer readable storage medium.
Photoacoustic Imaging (PAI) is a new medical Imaging technology. The photoacoustic imaging combines the advantages of optics and ultrasound, has unique advantages for early diagnosis and prognosis evaluation of serious diseases such as cancer and the like, and is a novel imaging technology with great clinical and industrial prospects. The principle of photoacoustic imaging is as follows: when biological tissues are irradiated by ns-magnitude short pulse laser light, substances with strong optical absorption characteristics such as blood are included in the biological tissues, so that the substances with the strong optical absorption characteristics cause local temperature rise and thermal expansion when absorbing laser energy, ultrasonic waves are generated and spread outwards, and the position and the shape of an absorption part in the tissues are reconstructed by utilizing a reconstruction algorithm.
In the process of photoacoustic imaging, a laser emitting module is triggered to emit laser once receiving a trigger pulse, and laser energy value is output once emitting the laser, the laser energy value is mainly used for correcting and compensating photoacoustic data to ensure the accuracy of photoacoustic images, however, when the laser emitting module is started, the first N pulse signals received by the laser emitting module are not output by the laser, N is an uncertain value, and the N pulse signals without laser output can cause the laser energy value not to correspond to the photoacoustic data, thereby causing the accuracy of the photoacoustic images obtained by the photoacoustic imaging system to be reduced.
Disclosure of Invention
In order to solve the above technical problems, embodiments of the present invention are directed to providing a photoacoustic imaging method and system, and a computer-readable storage medium, which can improve the accuracy of a photoacoustic image.
In one embodiment, a photoacoustic imaging method is provided, applied to a photoacoustic imaging system, the method comprising:
receiving a photoacoustic imaging start signal;
in response to the photoacoustic imaging start signal, sending a laser emission trigger signal to a laser emission device of the photoacoustic imaging system;
in response to the photoacoustic imaging start signal, starting an ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals to obtain photoacoustic data;
controlling the laser emitting device to emit laser light to a target object in response to the laser emission trigger signal, and outputting a laser energy value, wherein the laser energy value indicates an energy magnitude of the emitted laser light;
acquiring a synchronization signal, wherein the synchronization signal is used for indicating the actual emission time of the laser;
determining the corresponding relation between the photoacoustic data and the laser energy value according to the synchronous signal;
and processing the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
In one embodiment, the determining the correspondence between the photoacoustic data and the laser energy value according to the synchronization signal includes:
determining effective photoacoustic data when the synchronous signal is triggered;
marking the effective photoacoustic data with an effective mark;
and sequentially corresponding the effective photoacoustic data to the laser energy value sequences one by one, wherein the laser energy value sequences are arranged according to the output sequence of the laser energy values.
In one embodiment, the sequentially one-to-one correspondence of the effective photoacoustic data and the sequence of laser energy values includes:
sequentially judging whether the photoacoustic data are the effective photoacoustic data or not according to the judgment of whether the photoacoustic data carry the effective mark or not;
when the effective photoacoustic data is judged, enabling the effective photoacoustic data to correspond to first laser energy values arranged at the first position in the laser energy value sequence in a one-to-one mode;
and removing the first laser energy value from the laser energy value sequence, and rearranging the laser energy value sequence according to the output sequence of the laser energy values.
In one embodiment, before the acquiring the synchronization signal, the method further includes:
and deleting the photoacoustic data in sequence.
In one embodiment, the activating the ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals in response to the photoacoustic imaging start signal to obtain photoacoustic data further comprises:
and responding to the synchronous signal, starting the ultrasonic transducer to start receiving the photoacoustic signal, and obtaining the photoacoustic data.
In one embodiment, the determining the correspondence between the photoacoustic data and the laser energy value according to the synchronization signal includes:
and sequentially corresponding the photoacoustic data to the laser energy values one by one.
In one embodiment, the photoacoustic data includes at least: AD data, beamforming data, and signal processing data.
In one embodiment, the method further comprises:
transmitting an ultrasonic wave to the target object;
when receiving an ultrasonic echo responding to the ultrasonic wave from the target object, processing the ultrasonic echo to obtain an ultrasonic image;
and fusing the photoacoustic image and the ultrasonic image to obtain an image to be displayed.
In one embodiment, a photoacoustic imaging system is provided, the photoacoustic imaging system comprising:
a laser emitting device that generates laser light that irradiates a target object;
an optical fiber;
an ultrasonic transducer;
a scanning control device which controls the laser emitting device to generate the laser;
a receiving circuit that receives a photoacoustic signal generated by the target object by the ultrasonic transducer to obtain photoacoustic data;
a processor that processes the photoacoustic data to obtain a photoacoustic image;
a display that displays the photoacoustic image;
wherein the processor further performs the steps of:
receiving a photoacoustic imaging start signal; in response to the photoacoustic imaging start signal, sending a laser emission trigger signal to a laser emission device of the photoacoustic imaging system; in response to the photoacoustic imaging start signal, starting an ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals to obtain photoacoustic data; controlling the laser emitting device to emit laser light to a target object in response to the laser emission trigger signal, and outputting a laser energy value, wherein the laser energy value indicates an energy magnitude of the emitted laser light; acquiring a synchronization signal, wherein the synchronization signal is used for indicating the actual emission time of the laser; determining the corresponding relation between the photoacoustic data and the laser energy value according to the synchronous signal; and processing the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
In one embodiment, the processor is further configured to determine valid photoacoustic data when the synchronization signal is triggered; marking the effective photoacoustic data with an effective mark; and sequentially corresponding the effective photoacoustic data to the laser energy value sequences one by one, wherein the laser energy value sequences are arranged according to the receiving sequence of the laser energy values.
In one embodiment, the processor is further configured to sequentially determine whether the photoacoustic data is the valid photoacoustic data according to whether the photoacoustic data carries the valid flag; when the effective photoacoustic data is judged, enabling the effective photoacoustic data to correspond to first laser energy values arranged at the first position in the laser energy value sequence in a one-to-one mode; and removing the first laser energy value from the laser energy value sequence, and rearranging the laser energy value sequence according to the output sequence of the laser energy values.
In one embodiment, the processor is further configured to delete the photoacoustic data sequentially.
In one embodiment, the processor is further configured to activate the ultrasonic transducer to start receiving the photoacoustic signal in response to the synchronization signal, and obtain the photoacoustic data.
In one embodiment, the processor is further configured to sequentially perform one-to-one correspondence between the photoacoustic data and the laser energy value.
In one embodiment, the photoacoustic data includes at least: filtered data, beamformed data, and signal processing data.
In one embodiment, the photoacoustic imaging system further comprises: a laser detection device;
the laser detection device is arranged at the output end of the optical fiber or the output end of the laser emission device; wherein the content of the first and second substances,
the laser detection device is used for obtaining the synchronous signal when detecting that the laser emitting device emits the laser.
In one embodiment, the laser emitting device is further configured to obtain a synchronization signal when emitting laser light.
In one embodiment, the photoacoustic imaging system further comprises: a transmitting circuit;
the scanning control device is also used for controlling the ultrasonic transmitting device to generate the ultrasonic waves;
the transmitting circuit is used for exciting the ultrasonic probe to transmit the ultrasonic waves to the target object;
the processor is further configured to process the ultrasonic echo to obtain an ultrasonic image when the ultrasonic echo responding to the ultrasonic wave is received from the target object; and fusing the photoacoustic image and the ultrasonic image to obtain an image to be displayed.
In one embodiment, a photoacoustic imaging method is further provided, which is applied to a photoacoustic imaging system, and includes:
receiving a photoacoustic imaging start signal;
in response to the photoacoustic imaging start signal, sending a laser emission trigger signal to a laser emission device of the photoacoustic imaging system;
controlling the laser emitting device to emit laser light to a target object in response to the laser emission trigger signal, and outputting a laser energy value, wherein the laser energy value indicates an energy magnitude of the emitted laser light;
acquiring a synchronization signal, wherein the synchronization signal is used for indicating the actual emission time of the laser;
in response to the synchronization signal, starting an ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals to obtain photoacoustic data;
determining the corresponding relation between the photoacoustic data and the laser energy value;
and processing the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
An embodiment of the present invention provides a computer-readable storage medium, having stored thereon a computer program, for application to a photoacoustic imaging system, which when executed by a processor, implements a photoacoustic imaging method as recited in any of the above.
The embodiment of the invention provides a photoacoustic imaging method, a photoacoustic imaging system and a computer-readable storage medium, wherein the method comprises the following steps: receiving a photoacoustic imaging start signal; responding to the photoacoustic imaging starting signal, and sending a laser emission trigger signal to a laser emission device of the photoacoustic imaging system; in response to the photoacoustic imaging start signal, starting an ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals to obtain photoacoustic data; controlling a laser emitting device to emit laser to a target object in response to a laser emission trigger signal, and outputting a laser energy value, wherein the laser energy value indicates an energy level of the emitted laser; acquiring a synchronous signal, wherein the synchronous signal is used for indicating the actual emission time of the laser; determining the corresponding relation between the photoacoustic data and the laser energy value according to the synchronous signal; and processing the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object. By adopting the scheme, the photoacoustic imaging system acquires the synchronous signal when determining that the laser emitting module generates the laser, and determines the photoacoustic data corresponding to the laser energy value when generating the laser by using the synchronous signal, at the moment, the laser energy value corresponds to the photoacoustic data one by one, so that the finally obtained photoacoustic image has high accuracy.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a first schematic structural diagram of a photoacoustic imaging system according to an embodiment of the present invention;
fig. 2 is a first flowchart of a photoacoustic imaging system according to an embodiment of the present invention;
fig. 3 is a second flowchart of a photoacoustic imaging system according to an embodiment of the present invention;
FIG. 4 is a block diagram of an exemplary photoacoustic imaging system according to an embodiment of the present invention;
FIG. 5 is a timing diagram one of an exemplary laser emission provided by embodiments of the present invention;
fig. 6 is a third flowchart of a photoacoustic imaging method according to an embodiment of the present invention;
fig. 7 is a fourth flowchart of a photoacoustic imaging method according to an embodiment of the present invention;
FIG. 8 is a block diagram of an exemplary photoacoustic imaging system according to an embodiment of the present invention;
FIG. 9 is a timing diagram of an exemplary laser emission provided by an embodiment of the present invention;
fig. 10 is a schematic structural diagram of a photoacoustic imaging system according to an embodiment of the present invention.
So that the manner in which the features and aspects of the embodiments of the present invention can be understood in detail, a more particular description of the embodiments of the invention, briefly summarized above, may be had by reference to the embodiments, some of which are illustrated in the appended drawings.
As shown in fig. 1, a photoacoustic imaging system according to an embodiment of the present invention includes an ultrasonic probe, optical fibers disposed at two ends of the ultrasonic probe, a laser emission module, an ultrasonic emission module, a scan control device, an echo receiving module, a processor, and a display module, where the processor includes an ultrasonic signal processing module, a photoacoustic processing module, an ultrasonic processing module, a laser energy reading module, and a fusion processing module. The functions of the respective modules include:
the scanning control device: and controlling the laser emission module to generate laser, carrying out laser scanning or ultrasonic emission module to generate ultrasonic wave, carrying out ultrasonic scanning, and informing the ultrasonic signal processing module that the current scanning mode is laser scanning or ultrasonic scanning.
The laser emission module: laser light of variable wavelength is generated and emitted to a target object through optical fibers located at both sides of the probe.
An ultrasonic transmitting module: and generating an ultrasonic emission waveform, and transmitting the ultrasonic emission waveform to the target object through the ultrasonic probe.
An echo receiving module: and receiving an echo signal sent by the target object.
The ultrasonic signal processing module: performing general signal processing on the echo signals, comprising: filtering, beam-forming, signal processing, etc.
A photoacoustic processing module: and performing photoacoustic image processing on the photoacoustic data output by the ultrasonic signal processing module, wherein the photoacoustic image processing comprises smoothing and enhancing of an image, compensation and correction of a photoacoustic image and the like.
An ultrasonic processing module: and performing ultrasonic image processing on the ultrasonic data output by the ultrasonic signal processing module, wherein the ultrasonic image processing comprises smoothing and enhancing of an image, removing of noise in the image, improvement of the contrast of the image and the like.
And the laser energy reading module is used for reading the energy value of each laser emission.
A fusion processing module: and performing fusion processing on the data output by the ultrasonic processing module and the photoacoustic processing module.
A display module: the final image is displayed.
The following embodiments are all explained based on the above photoacoustic imaging system.
An embodiment of the present invention provides a photoacoustic imaging method, which is applied to a photoacoustic imaging system, and as shown in fig. 2, the method may include:
and S101, receiving a photoacoustic imaging starting signal.
The photoacoustic imaging method provided by the embodiment of the invention is suitable for the photoacoustic imaging process by utilizing a photoacoustic imaging system.
It should be noted that the photoacoustic imaging system can operate in two imaging modes, namely photoacoustic imaging and ultrasonic imaging, and the photoacoustic imaging system switches the photoacoustic imaging mode and the ultrasonic imaging mode through the scanning control device, wherein in the photoacoustic imaging mode, the scanning control device of the photoacoustic imaging system controls the laser generation module to generate laser with variable wavelength, and the laser is emitted to a target object through an optical fiber, and the received ultrasonic echo signal is processed into a photoacoustic image; in the ultrasonic imaging mode, a scanning control device of the photoacoustic imaging system controls an ultrasonic generation module to generate ultrasonic emission waveforms, the ultrasonic emission waveforms are transmitted to a target object through an ultrasonic probe, and received ultrasonic echo signals are processed into ultrasonic images.
It should be noted that the ultrasonic probe includes an ultrasonic transducer, where the ultrasonic transducer is a piezoelectric element in the ultrasonic probe, and the ultrasonic transducer is used for performing electroacoustic conversion, and the optical fiber in the embodiment of the present invention may be disposed on both sides of the ultrasonic probe, and together with the ultrasonic probe, form a probe that can perform both ultrasonic scanning and photoacoustic scanning; the photoacoustic scanning probe can also exist independently from the ultrasonic probe, and the photoacoustic scanning probe can be formed independently from the ultrasonic transducer and is selected according to actual conditions, and the embodiment of the invention is not limited specifically.
In the embodiment of the invention, a doctor triggers photoacoustic scanning on a software control interface of the photoacoustic imaging system, and the photoacoustic imaging system receives a photoacoustic imaging starting signal sent by a software side at the moment.
And S102, responding to the photoacoustic imaging starting signal, and sending a laser emission trigger signal to a laser emission device of the photoacoustic imaging system.
After the photoacoustic imaging system receives the photoacoustic imaging starting signal, the photoacoustic imaging system responds to the photoacoustic imaging starting signal and sends a laser emission trigger signal to a laser emission device of the photoacoustic imaging system.
In the embodiment of the invention, the software is connected with the scanning control device of the photoacoustic imaging system, after the photoacoustic imaging system responds to and receives a photoacoustic imaging starting signal, the scanning control device starts scanning according to the photoacoustic imaging starting signal, and at the moment, the scanning control device sends a laser emission trigger signal to the laser emission device of the photoacoustic imaging system.
In the embodiment of the invention, the laser emission trigger signal can be a signal in a digital level form such as a trigger pulse, and the scanning control device continuously sends the trigger pulse to the laser emission device.
And S103, in response to the photoacoustic imaging starting signal, starting an ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals to obtain photoacoustic data.
After the photoacoustic imaging system receives the photoacoustic imaging start signal, the photoacoustic imaging system responds to the photoacoustic imaging start signal and starts the ultrasonic transducer of the photoacoustic imaging system to start receiving the photoacoustic signal, so that photoacoustic data is obtained.
In the embodiment of the present invention, the photoacoustic imaging system responds to the received photoacoustic imaging start signal and starts the ultrasonic transducer according to the photoacoustic imaging start signal, at this time, the ultrasonic transducer starts to receive a photoacoustic signal returned by the target object, the receiving circuit (echo receiving module) processes the photoacoustic signal into photoacoustic data, and the processor processes the photoacoustic data into a photoacoustic image.
In the embodiment of the present invention, the processor includes an ultrasonic signal processing module and a photoacoustic processing module, and the ultrasonic signal processing module performs general signal processing on the echo signal received by the receiving circuit to improve the signal-to-noise ratio of the signal, where the communication signal processing includes: and operations such as filtering, beam synthesis and signal processing, wherein the photoacoustic processing module performs processing such as smoothing, image compensation and correction on the data output by the ultrasonic signal processing module to obtain a photoacoustic image.
It should be noted that S102 and S103 are two steps after S101, and the embodiment of the present application does not limit the execution steps of S102 and S103, and a specific execution sequence may be selected according to actual situations.
And S104, responding to the laser emission trigger signal, controlling the laser emission device to emit laser to the target object, and outputting a laser energy value, wherein the laser energy value indicates the energy magnitude of the emitted laser.
After the photoacoustic imaging system sends a laser emission trigger signal to the laser emission device, the photoacoustic imaging system responds to the laser emission trigger signal, controls the laser emission device to emit laser to the target object, and outputs a laser energy value for indicating the energy of the emitted laser.
In the embodiment of the invention, after the laser emitting device of the photoacoustic imaging system receives the (N + 1) th trigger pulse, the laser emitting device generates laser and emits the laser to the target object through the optical fiber, at the moment, the laser energy reading module acquires the laser energy value output by the laser detecting device and transmits the laser energy value to the photoacoustic processing module, and the photoacoustic processing module stores the laser energy value according to the receiving sequence.
It should be noted that, since the laser emitting device needs a certain settling time, the first N trigger pulses emitted by the scanning control device do not trigger the laser emitting device to generate laser light.
And S105, acquiring a synchronous signal, wherein the synchronous signal is used for indicating the actual emission time of the laser.
After the photoacoustic imaging system controls the laser emitting device to emit laser to the target object, the photoacoustic imaging system acquires a synchronization signal. Optionally, the synchronization signal may be output by a laser emitting device or may be output by a laser detecting device, which is specifically selected according to an actual situation, and the embodiment of the present invention is not specifically limited.
Specifically, when the laser emitting device generates laser, the laser emitting device outputs a synchronization signal and a laser energy value.
Optionally, the laser detection device may be disposed on an optical path irradiated by the laser emitted by the laser emitting device, such as an output end of the optical fiber or an output end of the laser emitting device, and the selection is specifically performed according to an actual situation, and the embodiment of the present invention is not specifically limited.
Specifically, when the laser detection device detects that the laser emission device generates laser or the optical fiber emits laser to the target object, the laser detection device sends out a synchronization signal.
In the embodiment of the invention, the laser emitting device or the laser detecting device transmits the synchronous signal to the ultrasonic signal processing module.
In an embodiment of the present invention, the laser detection device may detect an optical flow signal on the optical path, and convert the optical flow signal into a synchronization signal (e.g., a digital level signal) after the optical flow signal is detected by the laser detection device. When the optical flow signal exists on the optical path, the laser is emitted from the laser emitting device, and the optical speed is very fast, so that the time when the optical flow signal is detected to obtain the synchronous signal can be considered as the time when the laser is actually emitted from the laser emitting device, namely the synchronous signal indicates the actual emission time of the laser emitted from the laser emitting device.
Further, after the photoacoustic imaging system receives the photoacoustic imaging starting signal, the photoacoustic imaging system sends a laser emission triggering signal to the laser emission device; the laser emission device responds to the laser emission trigger signal, emits laser to the target object by using the laser emission device, and outputs laser energy value when detecting that the laser emission device emits the laser; and acquiring a synchronous signal, and starting the ultrasonic transducer to start receiving the photoacoustic signal to obtain photoacoustic data.
Specifically, after the photoacoustic imaging system receives a photoacoustic imaging starting signal, the photoacoustic imaging system sends a laser emission triggering signal to the laser emitting device through the scanning control device, the laser emitting device triggers a laser emission process according to the laser emission triggering signal, when the laser emitting device generates laser, the laser emitting device or the laser detecting device generates a synchronizing signal, the scanning control device acquires the synchronizing signal from the laser emitting device or the laser detecting device and starts ultrasonic scanning, at the moment, the optical fiber emits the laser to a target object, and meanwhile, the laser energy reading module acquires a laser energy value.
And S106, determining the corresponding relation between the photoacoustic data and the laser energy value according to the synchronous signal.
After the photoacoustic imaging system acquires the synchronization signal and the laser energy value, the photoacoustic imaging system determines the corresponding relationship between the photoacoustic data and the laser energy value according to the synchronization signal.
In the embodiment of the invention, when the laser emitting device or the laser detecting device transmits the synchronous signal to the ultrasonic signal processing module, the ultrasonic signal processing module acquires the photoacoustic data obtained by current processing.
Optionally, the photoacoustic data includes AD data, beam forming data, signal processing data, and the like, which are specifically selected according to actual situations, and the embodiment of the present invention is not specifically limited.
In the embodiment of the invention, when the target object returns the photoacoustic signal, the ultrasonic probe transmits the received photoacoustic signal to the receiving circuit, the receiving circuit processes the photoacoustic signal into AD data and outputs the AD data to the ultrasonic signal processing module, the ultrasonic signal processing module performs filtering and beam forming on the AD data to obtain beam forming data, then performs signal processing on the beam forming data to obtain signal processing data, and the ultrasonic signal processing module transmits the signal processing data to the photoacoustic processing module so that the photoacoustic processing module processes the signal processing data into a photoacoustic image.
In the embodiment of the invention, when the ultrasonic signal processing module receives a synchronous signal, the ultrasonic signal processing module determines that current photoacoustic data is valid photoacoustic data, the ultrasonic signal processing module marks valid marks on the valid photoacoustic data and sequentially transmits the photoacoustic data to the photoacoustic processing module, the photoacoustic processing module sequentially judges whether the photoacoustic data carries the valid marks, when the photoacoustic data is judged not to carry the valid marks, the photoacoustic data is judged to be invalid photoacoustic data scanned before laser is generated by the laser emission module, at the moment, the photoacoustic processing module discards the data, and when the photoacoustic processing module judges that the valid marks are carried in the valid photoacoustic data, the photoacoustic processing module sequentially corresponds the valid photoacoustic data to the laser energy value sequence one by one.
It should be noted that, since the ultrasonic signal processing module receives the AD data from the echo receiver, processes the AD data into the beamforming data, and processes the beamforming data into the signal processing data, when the ultrasonic signal processing module receives the synchronization signal, the ultrasonic signal processing module may be in a process of receiving the AD data, or in a process of processing the AD data into the beamforming data, or in a process of processing the beamforming data into the signal processing data, and at this time, the ultrasonic signal processing module marks the currently processed AD data, beamforming data, or signal processing data with a valid flag. That is, the ultrasonic signal processing module is present in any one of the processing procedures of the ultrasonic signal processing module according to the operation of marking the photoacoustic data by the synchronization signal.
Further, the ultrasonic signal processing module processes the AD data received from the echo receiver into signal processing data, and when the ultrasonic signal processing module does not receive a synchronization signal in the processing process, the ultrasonic signal processing module discards the photoacoustic data until the ultrasonic signal processing module receives the synchronization signal in the processing process of processing the AD data into the signal processing data, and the ultrasonic signal processing module transmits the effective photoacoustic data into the photoacoustic processing module, and at this time, the photoacoustic processing module sequentially corresponds the received effective photoacoustic data to the laser energy value sequence one to one.
In the embodiment of the invention, when the scanning control device starts ultrasonic scanning according to the synchronous signal, the photoacoustic imaging system receives photoacoustic signals responding to laser by using the ultrasonic transducer and processes the photoacoustic signals into photoacoustic data through the ultrasonic signal processing module, and the photoacoustic processing module corresponds the photoacoustic data to the laser energy value sequences one by one.
And S107, processing the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
After the photoacoustic imaging system determines the corresponding relationship between the photoacoustic data and the laser energy value according to the synchronization signal, the photoacoustic imaging system processes the photoacoustic data based on the corresponding relationship between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
In the embodiment of the invention, after the photoacoustic data and the laser energy value sequence are in one-to-one correspondence, the photoacoustic processing module corrects and compensates the corresponding photoacoustic data by using the laser energy value to ensure the correctness of the finally obtained photoacoustic image.
Further, the photoacoustic processing module further includes processing flows such as smoothing processing and image enhancement processing of the image.
In the embodiment of the invention, the photoacoustic processing module processes photoacoustic data into a photoacoustic image and displays the photoacoustic image.
Further, in the ultrasonic imaging mode, the ultrasonic processing module processes the ultrasonic data output by the ultrasonic signal processing module into an ultrasonic image, the fusion processing module performs fusion processing on the photoacoustic image and the ultrasonic image, and the fused image is displayed through the display module.
The ultrasound image mentioned in the embodiment of the present invention may be a basic ultrasound image such as a B image, a C image, an M image, or the like, or may be a Doppler flow image, a spectral Doppler image, an ultrasound image (elastic image for short) on which tissue elastic parameters are superimposed, or the like obtained based on the basic ultrasound image.
In the embodiment of the present invention, the fusion processing module fuses the ultrasound image and the photoacoustic image in a pseudo-color manner, for example, when the pixel value ranges of the ultrasound image and the photoacoustic image are both 0 to 255, the ultrasound image is regarded as an ultrasound gray image, the photoacoustic image is regarded as a photoacoustic gray image, the size and the resolution of the ultrasound gray image and the photoacoustic gray image are both equal, and the corresponding fusion process may be: the processor converts the photoacoustic grayscale image into a color image with three channels of RGB (referred to as a photoacoustic color image for short) according to a preset grayscale-color mapping relationship, and displays the photoacoustic color image and the ultrasound grayscale image in an overlapping manner, for example, when the grayscale value of a pixel point in the photoacoustic grayscale image is greater than a preset threshold, the pixel point in the fusion image displays the pixel value of the photoacoustic color image, and other pixel points display the pixel value of the ultrasound grayscale image, wherein the preset threshold can be determined according to practical application, and the invention does not limit the specific value thereof.
It can be understood that, when the photoacoustic imaging system determines that the laser emitting module generates laser, the photoacoustic imaging system acquires the synchronization signal, and determines photoacoustic data corresponding to the laser energy value when the laser emitting module generates laser by using the synchronization signal, at this time, the laser energy value and the photoacoustic data are in one-to-one correspondence, so that the finally obtained photoacoustic image has high accuracy.
Illustratively, the embodiments of the present invention provide methods for performing photoacoustic data synchronization by using three photoacoustic imaging systems, and specific examples are respectively described below.
The first way is to mark the photoacoustic data with an effective mark according to the synchronization signal, so that the photoacoustic processing module determines the corresponding relationship between the photoacoustic data and the laser energy value according to the effective mark, as shown in fig. 3, the method specifically includes the following steps:
s201, the scanning control device receives a photoacoustic imaging starting signal.
Here, the description of S201 of the embodiment of the present invention is consistent with that of S101, and is not redundantly described here.
S202, the scanning control device responds to the photoacoustic imaging starting signal and sends a laser emission trigger signal to a laser emission device of the photoacoustic imaging system.
Here, the description of S202 in the embodiment of the present invention is identical to that of S102, and is not repeated here.
S203, the laser emitting device responds to the laser emitting trigger signal, emits laser to the target object and outputs a laser energy value, wherein the laser energy value indicates the energy magnitude of the emitted laser.
Here, the description of S203 in the embodiment of the present invention is identical to that of S104, and is not repeated here.
And S204, the scanning control device responds to the photoacoustic imaging starting signal, starts an ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals, and obtains photoacoustic data.
Here, the description of S204 of the embodiment of the present invention is identical to that of S103, and is not repeated here.
S205, the ultrasonic signal processing module acquires a synchronous signal, wherein the synchronous signal is used for indicating the actual emission time of the laser.
Here, the description of S205 of the embodiment of the present invention is identical to that of S105, and is not repeated here.
Illustratively, as shown in fig. 4, an electrical connection is established between the laser emitting module and the ultrasonic signal processing module, and at this time, the laser emitting module transmits the generated synchronization signal to the ultrasonic signal processing module when emitting the laser.
S206, the ultrasonic signal processing module determines effective photoacoustic data when the synchronous signal is triggered.
After the ultrasonic signal processing module acquires the synchronizing signal, the ultrasonic signal processing module determines effective photoacoustic data when the synchronizing signal is triggered.
In the embodiment of the invention, when the laser emitting device or the laser detecting device transmits the synchronous signal to the ultrasonic signal processing module, the ultrasonic signal processing module acquires the photoacoustic data obtained by current processing.
Optionally, the photoacoustic data includes AD data, beam forming data, signal processing data, and the like, which are specifically selected according to actual situations, and the embodiment of the present invention is not specifically limited.
In the embodiment of the invention, when the target object returns the photoacoustic signal, the ultrasonic probe transmits the received photoacoustic signal to the receiving circuit, the receiving circuit processes the photoacoustic signal into AD data and outputs the AD data to the ultrasonic signal processing module, the ultrasonic signal processing module performs filtering and beam forming on the AD data to obtain beam forming data, then performs signal processing on the beam forming data to obtain signal processing data, and the ultrasonic signal processing module transmits the signal processing data to the photoacoustic processing module so that the photoacoustic processing module processes the signal processing data into a photoacoustic image.
In the embodiment of the present invention, when the ultrasonic signal processing module receives the synchronization signal, the ultrasonic signal processing module determines that the current photoacoustic data is valid photoacoustic data.
And S207, marking effective marks on the effective photoacoustic data by the ultrasonic signal processing module.
And after the ultrasonic signal processing module determines the effective photoacoustic data when the synchronous signal is triggered, the ultrasonic signal processing module marks the effective photoacoustic data with an effective mark.
In the embodiment of the invention, the ultrasonic signal processing module marks effective photoacoustic data and sequentially transmits the photoacoustic data to the photoacoustic processing module.
S208, the photoacoustic processing module sequentially judges whether the photoacoustic data is the effective photoacoustic data according to whether the photoacoustic data carries the effective mark.
After the ultrasonic signal processing module marks effective marks on the effective photoacoustic data, the photoacoustic processing module sequentially judges whether the photoacoustic data carries the effective marks.
In the embodiment of the invention, the photoacoustic processing module sequentially judges whether the photoacoustic data carries the valid mark, and when judging that the photoacoustic data does not carry the valid mark, the photoacoustic processing module judges that the photoacoustic data is invalid photoacoustic data scanned before the laser emission module generates the laser, and at this time, the photoacoustic processing module discards the photoacoustic data.
And S209, when the photoacoustic processing module judges the effective photoacoustic data, the photoacoustic processing module enables the effective photoacoustic data to correspond to first laser energy values arranged at the first position in the laser energy value sequence one by one.
After the photoacoustic processing module sequentially judges whether the photoacoustic data carries the effective mark or not, the photoacoustic processing module corresponds the effective photoacoustic data to a first laser energy value arranged at the first position in the laser energy value sequence.
In the embodiment of the invention, when the photoacoustic processing module judges that the effective photoacoustic data carries the effect mark, the photoacoustic processing module corresponds the effective photoacoustic data to the first laser energy value arranged at the first position in the laser energy value sequence one by one.
S210, the photoacoustic processing module removes the first laser energy value from the laser energy value sequence, and rearranges the laser energy value sequence according to the output sequence of the laser energy values.
After the photoacoustic processing module corresponds the effective photoacoustic data to the first laser energy value arranged at the first position in the laser energy value sequence one by one, the photoacoustic processing module removes the first laser energy value from the laser energy value sequence and rearranges the laser energy value sequence according to the output sequence of the laser energy values.
In the embodiment of the invention, the photoacoustic processing module removes the first laser energy value arranged at the first position from the laser energy value sequence, and sequentially moves the laser energy values except the first laser energy value in the laser energy value sequence forward by one position so as to complete the process of sequencing the laser energy value sequence again according to the output sequence of the laser energy values.
And S211, the photoacoustic processing module processes the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
Here, the description of S211 of the embodiment of the present invention is identical to that of S107, and is not repeated here.
Illustratively, as shown in fig. 5, a laser emission timing diagram is shown, in which the scan control device simultaneously triggers the scan enable signal and the laser emission trigger signal, the first n laser emission trigger signals do not trigger the laser emission device to emit laser, and at this time, there is no output of the laser energy value, and when the (n + 1) th laser emission trigger signal triggers the laser emission device to emit laser, the synchronization signal is triggered, and at this time, the laser energy value is output.
The second way is to mark photoacoustic data with a valid mark according to a synchronization signal, so that the ultrasonic signal processing module directly deletes photoacoustic data before receiving the synchronization signal, and then photoacoustic data received by the photoacoustic processing module corresponds to laser energy values one to one, as shown in fig. 6, which specifically includes the following steps:
and S301, receiving a photoacoustic imaging starting signal by the scanning control device.
Here, the description of S301 of the embodiment of the present invention is identical to that of S201, and is not repeated here.
S302, the scanning control device responds to the photoacoustic imaging starting signal and sends a laser emission trigger signal to a laser emission device of the photoacoustic imaging system.
Here, the description of S302 in the embodiment of the present invention is identical to the description of S202, and is not repeated here.
And S303, the laser emitting device responds to the laser emitting trigger signal, emits laser to the target object and outputs a laser energy value, wherein the laser energy value indicates the energy magnitude of the emitted laser.
Here, the description of S303 in the embodiment of the present invention is identical to that of S203, and is not repeated here.
And S304, the scanning control device responds to the photoacoustic imaging starting signal, starts an ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals, and obtains photoacoustic data.
Here, the description of S304 in the embodiment of the present invention is identical to that of S204, and is not repeated here.
S305, the ultrasonic signal processing module deletes the photoacoustic data in sequence.
When the scanning control device starts the ultrasonic transducer to start receiving the photoacoustic signals and obtain the photoacoustic data, the ultrasonic signal processing module deletes the photoacoustic data in sequence.
In the embodiment of the invention, the photoacoustic data received by the ultrasonic signal processing module before the synchronous signal is acquired is judged to be invalid data, and at the moment, the photoacoustic data received by the ultrasonic signal processing module before the synchronous signal is acquired is directly deleted.
S306, the ultrasonic signal processing module acquires a synchronous signal, wherein the synchronous signal is used for indicating the actual emission time of the laser.
Here, the description of S306 in the embodiment of the present invention is identical to that of S205, and is not repeated here.
And S307, the ultrasonic signal processing module determines effective photoacoustic data when the synchronous signal is triggered.
Here, the description of S307 in the embodiment of the present invention is identical to that of S206, and is not repeated here.
S308, the photoacoustic processing module sequentially corresponds the effective photoacoustic data to the laser energy value sequences one by one, and the laser energy value sequences are arranged according to the output sequence of the laser energy values.
In the embodiment of the invention, after the ultrasonic signal processing module determines the effective photoacoustic data when the synchronous signal is triggered, the ultrasonic signal processing module sequentially transmits the effective photoacoustic data to the photoacoustic processing module, and at the moment, the photoacoustic processing module sequentially corresponds the effective photoacoustic data to the laser energy value sequences one by one, wherein the laser energy value sequences are arranged according to the output sequence of the laser energy values.
S309, the photoacoustic processing module processes the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
Here, the description of S309 in the embodiment of the present invention is identical to that of S210, and is not repeated here.
The third way is to start the ultrasonic scanning according to the synchronization signal, and then the photoacoustic data received by the photoacoustic processing module corresponds to the laser energy value one by one, as shown in fig. 7, specifically including the following steps:
s401, the scanning control device receives a photoacoustic imaging starting signal.
Here, the description of S401 of the embodiment of the present invention is identical to that of S301, and is not repeated here.
S402, the scanning control device responds to the photoacoustic imaging starting signal and sends a laser emission trigger signal to a laser emission device of the photoacoustic imaging system.
Here, the description of S402 in the embodiment of the present invention is identical to that of S302, and is not repeated here.
And S403, the laser emitting device emits laser to the target object in response to the laser emitting trigger signal and outputs a laser energy value, wherein the laser energy value indicates the energy magnitude of the emitted laser.
Here, the description of S403 in the embodiment of the present invention is identical to that of S303, and is not repeated here.
S404, the scanning control device acquires the synchronous signal, responds to the synchronous signal, starts the ultrasonic transducer to start receiving the photoacoustic signal, and obtains photoacoustic data.
After the laser emitting device emits laser to the target object, the scanning control device acquires a synchronization signal, responds to the synchronization signal, and starts the ultrasonic transducer to start receiving the photoacoustic signal to acquire photoacoustic data.
In the embodiment of the present invention, the scanning control device acquires the synchronization signal, and at this time, the scanning control device starts photoacoustic scanning according to the synchronization signal, and at this time, the ultrasonic transducer starts to receive the photoacoustic signal, and processes the photoacoustic signal into photoacoustic data through the receiving circuit and the ultrasonic signal processing module, and transmits the photoacoustic data to the photoacoustic processing module.
Illustratively, as shown in fig. 8, the laser emitting module and the scanning control device are in bidirectional transmission, and the laser emitting module transmits the generated synchronization signal to the scanning control device when emitting laser.
S405, the photoacoustic processing module sequentially corresponds the photoacoustic data to the laser energy values one by one.
Here, the description of S405 in the embodiment of the present invention is identical to that of S308, and is not repeated here.
And S406, the photoacoustic processing module processes the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
Here, the description of S406 of the embodiment of the present invention is identical to the description of S309, and is not repeated here.
Exemplarily, as shown in fig. 9, the scanning timing sequence is a laser synchronization signal scanning timing sequence corresponding to the third mode, where the scanning control device triggers the laser trigger enable, the laser trigger enable generates a laser emission trigger signal, the first n laser emission trigger signals do not trigger the laser emission device to emit laser, and at this time, there is no output of the laser energy value, and when the (n + 1) th laser emission trigger signal triggers the laser emission device to emit laser, the synchronization signal is triggered, and at this time, the synchronization signal triggers the scanning enable to perform the scanning process and output the laser optical energy value.
An embodiment of the present invention further provides a photoacoustic imaging system 1, as shown in fig. 10, where the photoacoustic imaging system 1 includes:
a laser emitting device 10 that generates laser light irradiating a target object;
an optical fiber 11;
an ultrasonic transducer 12;
a scanning control device 13 that controls the laser emitting device to generate the laser light;
a receiving circuit 14 that obtains photoacoustic data by receiving a photoacoustic signal generated by the target object by the ultrasonic transducer;
a processor 15 that processes the photoacoustic data to obtain a photoacoustic image;
a display 16 that displays the photoacoustic image;
wherein the processor 15 further performs the following steps:
receiving a photoacoustic imaging start signal; in response to the photoacoustic imaging start signal, sending a laser emission trigger signal to a laser emission device of the photoacoustic imaging system; in response to the photoacoustic imaging start signal, starting an ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals to obtain photoacoustic data; controlling the laser emitting device to emit laser light to a target object in response to the laser emission trigger signal, and outputting a laser energy value, wherein the laser energy value indicates an energy magnitude of the emitted laser light; acquiring a synchronization signal, wherein the synchronization signal is used for indicating the actual emission time of the laser; determining the corresponding relation between the photoacoustic data and the laser energy value according to the synchronous signal; and processing the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
The processor 15 is further configured to determine valid photoacoustic data when the synchronization signal is triggered; marking the effective photoacoustic data with an effective mark; and sequentially corresponding the effective photoacoustic data to the laser energy value sequences one by one, wherein the laser energy value sequences are arranged according to the receiving sequence of the laser energy values.
Optionally, the processor 15 is further configured to sequentially determine whether the photoacoustic data is the valid photoacoustic data according to whether the photoacoustic data carries the valid flag; when the effective photoacoustic data is judged, enabling the effective photoacoustic data to correspond to first laser energy values arranged at the first position in the laser energy value sequence in a one-to-one mode; and removing the first laser energy value from the laser energy value sequence, and rearranging the laser energy value sequence according to the output sequence of the laser energy values.
Optionally, the processor 15 is further configured to delete the photoacoustic data in sequence.
Optionally, the processor 15 is further configured to send a laser emission trigger signal to the laser emission device; and in response to the laser emission trigger signal, emitting laser to a target object by using the laser emitting device, and outputting a laser energy value. And acquiring a synchronous signal, and starting the ultrasonic transducer to start receiving the photoacoustic signal to obtain photoacoustic data.
Optionally, the processor 15 is further configured to sequentially perform one-to-one correspondence between the photoacoustic data and the laser energy value.
Optionally, the photoacoustic data includes at least: filtered data, beamformed data, and signal processing data.
Optionally, the photoacoustic imaging system 1 further includes: a laser detection device 17;
the laser detection device 17 is arranged at the output end of the optical fiber 11 or the output end of the laser emission device 10; wherein the content of the first and second substances,
the laser detection device 17 is configured to obtain a synchronization signal when detecting that the laser emitting device emits laser.
Optionally, the laser emitting device 10 is further configured to obtain a synchronization signal when emitting the laser.
Optionally, the photoacoustic imaging system 1 further includes: a transmission circuit 18;
the scanning control device 13 is further configured to control the ultrasonic emitting device to generate the ultrasonic wave;
the transmitting circuit 18 is used for exciting the ultrasonic probe to transmit the ultrasonic waves to the target object;
the processor 15 is further configured to, when an ultrasonic echo responding to the ultrasonic wave is received from the target object, process the ultrasonic echo to obtain an ultrasonic image; and fusing the photoacoustic image and the ultrasonic image to obtain an image to be displayed.
An embodiment of the present invention provides a computer-readable storage medium, having stored thereon a computer program, for application to a photoacoustic imaging system, which when executed by a processor, implements a photoacoustic imaging method as recited in any of the above.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
In the embodiment of the invention, when the photoacoustic imaging system determines that the laser emitting module generates the laser, the synchronous signal is obtained, the photoacoustic data corresponding to the laser energy value when the laser is generated is determined by using the synchronous signal, and at the moment, the laser energy value and the photoacoustic data are in one-to-one correspondence, so that the finally obtained photoacoustic image has high accuracy.
Claims (20)
- A photoacoustic imaging method applied to a photoacoustic imaging system, the method comprising:receiving a photoacoustic imaging start signal;in response to the photoacoustic imaging start signal, sending a laser emission trigger signal to a laser emission device of the photoacoustic imaging system;in response to the photoacoustic imaging start signal, starting an ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals to obtain photoacoustic data;controlling the laser emitting device to emit laser light to a target object in response to the laser emission trigger signal, and outputting a laser energy value, wherein the laser energy value indicates an energy magnitude of the emitted laser light;acquiring a synchronization signal, wherein the synchronization signal is used for indicating the actual emission time of the laser;determining the corresponding relation between the photoacoustic data and the laser energy value according to the synchronous signal;and processing the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
- The method according to claim 1, wherein the determining the correspondence between the photoacoustic data and the laser energy value according to the synchronization signal comprises:determining effective photoacoustic data when the synchronous signal is triggered;marking the effective photoacoustic data with an effective mark;and sequentially corresponding the effective photoacoustic data to the laser energy value sequences one by one, wherein the laser energy value sequences are arranged according to the output sequence of the laser energy values.
- The method of claim 2, wherein the sequentially one-to-one correspondence of the photoacoustic data and the sequence of laser energy values comprises:sequentially judging whether the photoacoustic data are the effective photoacoustic data or not according to the judgment of whether the photoacoustic data carry the effective mark or not;when the effective photoacoustic data is judged, enabling the effective photoacoustic data to correspond to first laser energy values arranged at the first position in the laser energy value sequence in a one-to-one mode;and removing the first laser energy value from the laser energy value sequence, and rearranging the laser energy value sequence according to the output sequence of the laser energy values.
- The method of claim 2, wherein prior to acquiring the synchronization signal, the method further comprises:and deleting the photoacoustic data in sequence.
- The method of claim 1, wherein activating an ultrasound transducer of a photoacoustic imaging system to begin receiving photoacoustic signals to obtain photoacoustic data in response to the photoacoustic imaging activation signal further comprises:and responding to the synchronous signal, starting the ultrasonic transducer to start receiving the photoacoustic signal, and obtaining the photoacoustic data.
- The method according to claim 5, wherein the determining the correspondence of the photoacoustic data to the laser energy value according to the synchronization signal comprises:and sequentially corresponding the photoacoustic data to the laser energy values one by one.
- The method according to any of claims 1-6, characterized in that the photoacoustic data comprises at least: AD data, beamforming data, and signal processing data.
- The method of claim 1, further comprising:transmitting an ultrasonic wave to the target object;when receiving an ultrasonic echo responding to the ultrasonic wave from the target object, processing the ultrasonic echo to obtain an ultrasonic image;and fusing the photoacoustic image and the ultrasonic image to obtain an image to be displayed.
- A photoacoustic imaging system, characterized in that the photoacoustic imaging system comprises:a laser emitting device that generates laser light that irradiates a target object;an optical fiber;an ultrasonic transducer;the scanning control device controls the laser emitting device to generate the laser;a receiving circuit that receives a photoacoustic signal generated by the target object by the ultrasonic transducer to obtain photoacoustic data;a processor that processes the photoacoustic data to obtain a photoacoustic image;a display that displays the photoacoustic image;wherein the processor further performs the steps of:receiving a photoacoustic imaging start signal; in response to the photoacoustic imaging start signal, sending a laser emission trigger signal to a laser emission device of the photoacoustic imaging system; in response to the photoacoustic imaging start signal, starting an ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals to obtain photoacoustic data; controlling the laser emitting device to emit laser light to a target object in response to the laser emission trigger signal, and outputting a laser energy value, wherein the laser energy value indicates an energy magnitude of the emitted laser light; acquiring a synchronization signal, wherein the synchronization signal is used for indicating the actual emission time of the laser; determining the corresponding relation between the photoacoustic data and the laser energy value according to the synchronous signal; and processing the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
- The apparatus of claim 9,the processor is further used for determining effective photoacoustic data when the synchronous signal is triggered; marking the effective photoacoustic data with an effective mark; and sequentially corresponding the effective photoacoustic data to the laser energy value sequences one by one, wherein the laser energy value sequences are arranged according to the receiving sequence of the laser energy values.
- The apparatus of claim 10,the processor is further configured to sequentially determine whether the photoacoustic data is the valid photoacoustic data according to whether the photoacoustic data carries the valid flag; when the effective photoacoustic data is judged, enabling the effective photoacoustic data to correspond to first laser energy values arranged at the first position in the laser energy value sequence in a one-to-one mode; and removing the first laser energy value from the laser energy value sequence, and rearranging the laser energy value sequence according to the output sequence of the laser energy values.
- The apparatus of claim 10,the processor is further configured to delete the photoacoustic data in sequence.
- The apparatus of claim 9,the processor is further configured to start the ultrasonic transducer to start receiving the photoacoustic signal in response to the synchronization signal, and obtain the photoacoustic data.
- The apparatus of claim 13,the processor is further configured to sequentially perform one-to-one correspondence between the photoacoustic data and the laser energy values.
- An apparatus according to any of claims 9-14, characterized in that the photo acoustic data comprises at least: filtered data, beamformed data, and signal processing data.
- The apparatus of any of claims 9-14, wherein the photoacoustic imaging system further comprises: a laser detection device;the laser detection device is arranged at the output end of the optical fiber or the output end of the laser emission device; wherein the content of the first and second substances,the laser detection device is used for obtaining the synchronous signal when detecting that the laser emitting device emits the laser.
- The apparatus according to any one of claims 9 to 14,the laser emitting device is also used for obtaining a synchronous signal when emitting laser.
- The apparatus of claim 9, wherein the photoacoustic imaging system further comprises: a transmitting circuit;the scanning control device is also used for controlling the ultrasonic transmitting device to generate the ultrasonic waves;the transmitting circuit is used for exciting the ultrasonic probe to transmit the ultrasonic waves to the target object;the processor is further configured to process the ultrasonic echo to obtain an ultrasonic image when the ultrasonic echo responding to the ultrasonic wave is received from the target object; and fusing the photoacoustic image and the ultrasonic image to obtain an image to be displayed.
- A photoacoustic imaging method applied to a photoacoustic imaging system, the method comprising:receiving a photoacoustic imaging start signal;in response to the photoacoustic imaging start signal, sending a laser emission trigger signal to a laser emission device of the photoacoustic imaging system;controlling the laser emitting device to emit laser light to a target object in response to the laser emission trigger signal, and outputting a laser energy value, wherein the laser energy value indicates an energy magnitude of the emitted laser light;acquiring a synchronization signal, wherein the synchronization signal is used for indicating the actual emission time of the laser;in response to the synchronization signal, starting an ultrasonic transducer of the photoacoustic imaging system to start receiving photoacoustic signals to obtain photoacoustic data;determining the corresponding relation between the photoacoustic data and the laser energy value;and processing the photoacoustic data based on the corresponding relation between the photoacoustic data and the laser energy value to obtain a photoacoustic image of the target object.
- A computer-readable storage medium, having stored thereon a computer program for application in a photoacoustic imaging system, the computer program when executed by a processor implementing the method of any one of claims 1-8.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2018/116265 WO2020102951A1 (en) | 2018-11-19 | 2018-11-19 | Photo acoustic imaging method and system, and computer-readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112702943A true CN112702943A (en) | 2021-04-23 |
Family
ID=70773722
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201880097323.3A Pending CN112702943A (en) | 2018-11-19 | 2018-11-19 | Photoacoustic imaging method and system and computer readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112702943A (en) |
| WO (1) | WO2020102951A1 (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080071172A1 (en) * | 2005-01-20 | 2008-03-20 | Abraham Bruck | Combined 2D Pulse-Echo Ultrasound And Optoacoustic Signal |
| CN102095685A (en) * | 2010-12-02 | 2011-06-15 | 华南师范大学 | Photoacoustic component resolution imaging method and device based on spectral encoding |
| CN102551810A (en) * | 2012-03-09 | 2012-07-11 | 华南师范大学 | Multichannel synchronous real-time digitalized photoacoustic imaging device and method |
| CN102579080A (en) * | 2012-03-07 | 2012-07-18 | 华南师范大学 | Integrated portable confocal opto-acoustic microscopy imaging device and method |
| CN102846378A (en) * | 2012-07-31 | 2013-01-02 | 安徽皖仪科技股份有限公司 | Positioning device and method of three-dimensional imaging ultrasonic diagnosis probe |
| US20130274585A1 (en) * | 2012-04-12 | 2013-10-17 | Canon Kabushiki Kaisha | Object information acquiring apparatus and method for controlling same |
| CN103385758A (en) * | 2013-07-22 | 2013-11-13 | 深圳先进技术研究院 | Intravascular opto-acoustic and ultrasonic dual-mode imaging system and imaging method thereof |
| CN107223035A (en) * | 2017-01-23 | 2017-09-29 | 深圳迈瑞生物医疗电子股份有限公司 | A kind of imaging system, method and ultrasonic image-forming system |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130190591A1 (en) * | 2010-04-30 | 2013-07-25 | Desmond Hirson | Photoacoustic transducer and imaging system |
| JP6388360B2 (en) * | 2013-12-27 | 2018-09-12 | キヤノン株式会社 | SUBJECT INFORMATION ACQUISITION DEVICE AND METHOD FOR CONTROLLING SUBJECT INFORMATION ACQUISITION DEVICE |
| CN104473620B (en) * | 2014-12-24 | 2016-11-30 | 上海交通大学 | A kind of photoacoustic imaging signal multiplexing apparatus and method |
| CN107928709B (en) * | 2017-07-03 | 2023-06-06 | 深圳英美达医疗技术有限公司 | Endoscopic imaging system and control method thereof |
-
2018
- 2018-11-19 CN CN201880097323.3A patent/CN112702943A/en active Pending
- 2018-11-19 WO PCT/CN2018/116265 patent/WO2020102951A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080071172A1 (en) * | 2005-01-20 | 2008-03-20 | Abraham Bruck | Combined 2D Pulse-Echo Ultrasound And Optoacoustic Signal |
| CN102095685A (en) * | 2010-12-02 | 2011-06-15 | 华南师范大学 | Photoacoustic component resolution imaging method and device based on spectral encoding |
| CN102579080A (en) * | 2012-03-07 | 2012-07-18 | 华南师范大学 | Integrated portable confocal opto-acoustic microscopy imaging device and method |
| CN102551810A (en) * | 2012-03-09 | 2012-07-11 | 华南师范大学 | Multichannel synchronous real-time digitalized photoacoustic imaging device and method |
| US20130274585A1 (en) * | 2012-04-12 | 2013-10-17 | Canon Kabushiki Kaisha | Object information acquiring apparatus and method for controlling same |
| CN102846378A (en) * | 2012-07-31 | 2013-01-02 | 安徽皖仪科技股份有限公司 | Positioning device and method of three-dimensional imaging ultrasonic diagnosis probe |
| CN103385758A (en) * | 2013-07-22 | 2013-11-13 | 深圳先进技术研究院 | Intravascular opto-acoustic and ultrasonic dual-mode imaging system and imaging method thereof |
| CN107223035A (en) * | 2017-01-23 | 2017-09-29 | 深圳迈瑞生物医疗电子股份有限公司 | A kind of imaging system, method and ultrasonic image-forming system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020102951A1 (en) | 2020-05-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107223035B (en) | Imaging system, method and ultrasonic imaging system | |
| ATE494838T1 (en) | ULTRASONIC IMAGING SYSTEM AND METHOD | |
| JP2006187594A (en) | Ultrasonic diagnostic system and its method | |
| JP2007125393A (en) | Image processing system and method | |
| JP2002248101A (en) | Ultrasonic photographic method and ultrasonic photographic apparatus | |
| JPWO2017038162A1 (en) | Ultrasonic diagnostic apparatus and control method of ultrasonic diagnostic apparatus | |
| JP2009078124A (en) | Ultrasonic diagnostic system, as well as image processing method and program | |
| GB2460521A (en) | Underwater detection device | |
| JP2004290249A (en) | Ultrasonic imaging apparatus and ultrasonic imaging method | |
| JP2008142151A (en) | Ultrasonic diagnostic apparatus and ultrasonic diagnostic system | |
| CN112702943A (en) | Photoacoustic imaging method and system and computer readable storage medium | |
| JP6944048B2 (en) | Ultrasonic system and control method of ultrasonic system | |
| JP2015066219A (en) | Ultrasonic measuring apparatus and ultrasonic measuring method | |
| KR100527314B1 (en) | Ultrasound imaging apparatus with transmit-focusing points selecting function and method therefor | |
| CN111432730A (en) | Imaging method and imaging system | |
| WO2020082269A1 (en) | Imaging method and imaging system | |
| US6682486B2 (en) | Ultrasonic diagnosing method and apparatus using correlative coefficient | |
| US11333599B2 (en) | Photoacoustic image generation apparatus, photoacoustic image generation method, and photoacoustic image generation program | |
| WO2016059913A1 (en) | Ultrasonic observation apparatus | |
| JP2004160156A (en) | Ultrasonic imaging apparatus and ultrasonic imaging method | |
| JP2003325508A (en) | Ultrasonic diagnostic apparatus | |
| WO2019124524A1 (en) | Ultrasonic observation device, method of operating ultrasonic observation device, and program for operating ultrasonic observation device | |
| WO2023281987A1 (en) | Ultrasonic system and method for controlling ultrasonic system | |
| KR101590350B1 (en) | Method and Ultrasonic Probe for Controlling PRF Adaptively | |
| CN113509209B (en) | Ophthalmic ultrasonic imaging method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |