CN113545747B - Laser speckle-photoacoustic combined imaging device and implementation method thereof - Google Patents
Laser speckle-photoacoustic combined imaging device and implementation method thereof Download PDFInfo
- Publication number
- CN113545747B CN113545747B CN202110610478.6A CN202110610478A CN113545747B CN 113545747 B CN113545747 B CN 113545747B CN 202110610478 A CN202110610478 A CN 202110610478A CN 113545747 B CN113545747 B CN 113545747B
- Authority
- CN
- China
- Prior art keywords
- laser
- photoacoustic
- speckle
- module
- splitting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 83
- 238000000034 method Methods 0.000 title claims abstract description 20
- 230000005284 excitation Effects 0.000 claims abstract description 42
- 238000007493 shaping process Methods 0.000 claims description 60
- 230000003287 optical effect Effects 0.000 claims description 10
- 238000001914 filtration Methods 0.000 claims description 9
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 230000001678 irradiating effect Effects 0.000 claims description 3
- 208000008960 Diabetic foot Diseases 0.000 abstract description 9
- 210000004204 blood vessel Anatomy 0.000 abstract description 6
- 238000013399 early diagnosis Methods 0.000 abstract description 3
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 229910052760 oxygen Inorganic materials 0.000 description 7
- 239000001301 oxygen Substances 0.000 description 7
- 239000008280 blood Substances 0.000 description 6
- 210000003141 lower extremity Anatomy 0.000 description 6
- 210000004369 blood Anatomy 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000017531 blood circulation Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 206010012601 diabetes mellitus Diseases 0.000 description 4
- 238000002604 ultrasonography Methods 0.000 description 4
- 210000001367 artery Anatomy 0.000 description 3
- 238000010968 computed tomography angiography Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000003902 lesion Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000006467 substitution reaction Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000002792 vascular Effects 0.000 description 2
- 206010050473 Abscess limb Diseases 0.000 description 1
- 208000017667 Chronic Disease Diseases 0.000 description 1
- 238000002583 angiography Methods 0.000 description 1
- 230000000747 cardiac effect Effects 0.000 description 1
- 238000007374 clinical diagnostic method Methods 0.000 description 1
- 230000034994 death Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005670 electromagnetic radiation Effects 0.000 description 1
- 230000004089 microcirculation Effects 0.000 description 1
- 230000017074 necrotic cell death Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- GEVPIWPYWJZSPR-UHFFFAOYSA-N tcpo Chemical compound ClC1=CC(Cl)=CC(Cl)=C1OC(=O)C(=O)OC1=C(Cl)C=C(Cl)C=C1Cl GEVPIWPYWJZSPR-UHFFFAOYSA-N 0.000 description 1
- 210000003462 vein Anatomy 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0093—Detecting, measuring or recording by applying one single type of energy and measuring its conversion into another type of energy
- A61B5/0095—Detecting, measuring or recording by applying one single type of energy and measuring its conversion into another type of energy by applying light and detecting acoustic waves, i.e. photoacoustic measurements
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0033—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- Medical Informatics (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Veterinary Medicine (AREA)
- Heart & Thoracic Surgery (AREA)
- Public Health (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Acoustics & Sound (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
The invention discloses a laser speckle-photoacoustic combined imaging device and an implementation method thereof, wherein the device comprises a laser speckle imaging system, a photoacoustic imaging system and an image reconstruction system, the output end of the laser speckle imaging system is connected with the input end of the image reconstruction system, the output end of the photoacoustic imaging system is connected with the input end of the image reconstruction system, the laser speckle imaging system comprises a speckle excitation module and a speckle receiving module, and the photoacoustic imaging module comprises a photoacoustic excitation module and a photoacoustic signal acquisition module; the embodiment of the invention realizes dual-mode imaging through the laser speckle imaging system and the photoacoustic imaging system, can perform omnibearing multi-parameter imaging on foot blood vessels, provides more comprehensive image data support for early diagnosis of diabetic feet, and can be widely applied to the technical field of joint imaging.
Description
Technical Field
The invention relates to the technical field of combined imaging, in particular to a laser speckle-optoacoustic combined imaging device and an implementation method thereof.
Background
Diabetes is one of the most common chronic diseases in China and worldwide, and the incidence rate of diabetes in recent years is in a trend of rising year by year, wherein the probability of diabetes causing arterial lesions of lower limbs is 4 times that of non-diabetic patients. Meanwhile, diabetic foot caused by lower limb arterial lesions is a main cause of death and disability of diabetics.
The current clinical diagnostic methods for diabetic foot mainly comprise the following steps: color Doppler Ultrasound (DUS), three-dimensional dynamic enhanced magnetic resonance angiography (CE-MRA), CT angiography (CTA), percutaneous oxygen partial pressure (TcPO 2), and the like. Color Doppler ultrasound can detect the pipe diameter and blood flow rate of the blood vessel of the lower limb and the foot; however, due to the limitation of the ultrasonic resolution, the micro-blood vessels cannot be imaged, and the blood oxygen saturation in the blood cannot be detected. The three-dimensional dynamic enhanced magnetic resonance vascular imaging can accurately position foot abscess and necrosis parts, can display images of arteries and veins, and can also perform three-dimensional simulated imaging on the lower limb vascular system of a diabetic foot lesion patient through a computer; however, CE-MRA has some electromagnetic radiation, cannot detect blood oxygen saturation, cannot be used by patients with cardiac pacemakers, and is expensive. The CT angiography three-dimensional reconstruction technology can accurately evaluate the conditions of foot structures and stress changes of diabetics, but can not detect blood flow and blood oxygen saturation. The percutaneous oxygen partial pressure detection technology can accurately display the oxygen content in local tissues of a human body and reflect the microcirculation condition of lower limb arteries, so as to judge whether the lower limb arteries are diseased or not and the degree of the diseased; however, the morphology of the blood vessel and the blood flow cannot be detected. In summary, although the above-mentioned several detection techniques can detect different aspects such as blood vessel morphology, blood flow, blood oxygen saturation, etc., the single technique cannot fully reflect the characteristics of the onset of diabetic foot, so developing a more comprehensive multifunctional multi-parameter detection technique for blood vessels has very important significance for early diagnosis of diabetic foot.
Disclosure of Invention
In view of this, the embodiment of the invention provides a laser speckle-photoacoustic combined imaging device and an implementation method thereof, so as to further provide multi-parameter image support for diagnosis of diabetic foot.
In one aspect, the invention provides a laser speckle-photoacoustic combined imaging device, which comprises a laser speckle imaging system, a photoacoustic imaging system and an image reconstruction system, wherein the output end of the laser speckle imaging system is connected with the input end of the image reconstruction system, the output end of the photoacoustic imaging system is connected with the input end of the image reconstruction system, the laser speckle imaging system comprises a speckle excitation module and a speckle receiving module, and the photoacoustic imaging module comprises a photoacoustic excitation module and a photoacoustic signal acquisition module;
the speckle excitation module is used for emitting laser;
the speckle receiving module is used for receiving laser speckle imaging generated by laser excitation;
the photoacoustic excitation module is used for emitting pulse laser;
the photoacoustic signal acquisition module is used for acquiring photoacoustic signals generated by excitation of pulse laser;
the image reconstruction system is used for processing the laser speckle imaging and the photoacoustic signals and determining a reconstructed image;
the speckle excitation module and the photoacoustic excitation module comprise dichroic mirrors, and the dichroic mirrors are used for realizing collinear scanning of speckle laser and pulse laser;
the photoacoustic acquisition module comprises an ultrasonic transducer, and the ultrasonic transducer is used for achieving forward co-located receiving of the photoacoustic signals.
Optionally, the speckle excitation module comprises a laser, a first beam shaping module, a dichroic mirror and a beam expander;
wherein the laser includes but is not limited to a He-Ne laser for emitting laser light to the first beam shaping module;
the first beam shaping module is used for shaping the laser and sending the laser to the dichroic mirror;
the dichroic mirror is used for transmitting the laser to the beam expander;
the beam expander is used for carrying out beam expanding treatment on the laser and sending the laser to biological tissues.
Optionally, the speckle receiving module comprises a filter and a camera;
the optical filter is used for filtering scattered light, and the scattered light is generated by laser irradiation;
the camera includes, but is not limited to, a CMOS camera or a CCD camera for receiving the scattered light filtered by the filter.
Optionally, the photoacoustic excitation module comprises a pulse laser, a beam splitting prism, a photodiode, a second beam shaping module, a dichroic mirror and a beam expander;
the pulse laser is used for emitting laser to the beam splitting prism;
the beam splitting prism is used for splitting the laser into first beam splitting laser and sending the first beam splitting laser to the photodiode, and splitting the laser into second beam splitting laser and sending the second beam splitting laser to the second beam shaping module;
the photodiode is used for receiving the first laser beam;
the second beam shaping module is used for shaping the second beam-splitting laser and sending the second beam-splitting laser to the dichroic mirror;
the dichroic mirror is used for reflecting the second beam splitting laser to the beam expander;
the beam expander is used for carrying out beam expanding treatment on the second beam splitting laser and sending the second beam splitting laser to biological tissues.
Optionally, the photoacoustic signal acquisition module comprises an ultrasonic transducer, an amplifier and an acquisition device;
wherein the ultrasonic transducer is configured to receive the photoacoustic signal and transmit the photoacoustic signal to the amplifier;
the amplifier is used for amplifying the photoacoustic signal and sending the photoacoustic signal to the acquisition equipment;
the acquisition device is used for acquiring the photoacoustic signals.
Alternatively, the laser speckle imaging system and photoacoustic imaging system can emit laser light simultaneously.
Optionally, the first beam shaping module includes a first lens and a second lens, and a small hole capable of accommodating laser passing through is formed between the first lens and the second lens.
Optionally, the second beam shaping module includes a third lens and a fourth lens, and a small hole capable of accommodating laser passing through is arranged between the third lens and the fourth lens.
Optionally, the ultrasonic transducer is a hollow annular ultrasonic transducer.
On the other hand, the embodiment of the invention also discloses a method for realizing the laser speckle-photoacoustic combined imaging device, which comprises the following steps:
transmitting laser to the beam shaping module through a laser;
the laser is shaped by the beam shaping module and is sent to a dichroic mirror;
the laser irradiates biological tissues through the dichroic mirror and the beam expander to generate scattered light;
filtering the scattered light through an optical filter;
receiving the scattered light subjected to filtering treatment through a camera to finish receiving laser speckle imaging;
transmitting pulse laser to the beam splitting prism through a pulse laser;
the pulse laser is split through the beam splitting prism, and a first beam splitting laser and a second beam splitting laser are determined;
the first beam splitting pulse laser is sent to a photodiode through the beam splitting prism, wherein the photodiode is used for triggering and controlling acquisition equipment;
the second beam splitting pulse laser is sent to a beam shaping module through the beam splitting prism;
performing laser shaping treatment on the second beam-splitting pulse laser through the beam shaping module and sending the second beam-splitting pulse laser to a dichroic mirror;
the dichroic mirror reflects the second beam splitting pulse laser to the beam expander;
the beam expander expands the second beam-splitting pulse laser and irradiates the biological tissue to generate a photoacoustic signal;
receiving the photoacoustic signal through a hollow ultrasonic transducer and sending the photoacoustic signal to an amplifier;
amplifying the photoacoustic signal through the amplifier, and sending the photoacoustic signal to acquisition equipment to complete acquisition of the photoacoustic signal;
performing analog-digital conversion processing on the photoacoustic signal through the acquisition equipment, and sending the photoacoustic signal to an image reconstruction system;
and processing the laser speckle imaging and the photoacoustic signals by the image reconstruction system to determine a reconstructed image.
On the other hand, the embodiment of the invention also discloses electronic equipment, which comprises a processor and a memory;
the memory is used for storing programs;
the processor executes the program to implement the method as described above.
In another aspect, embodiments of the present invention also disclose a computer readable storage medium storing a program for execution by a processor to implement a method as described above.
In another aspect, embodiments of the present invention also disclose a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The computer instructions may be read from a computer-readable storage medium by a processor of a computer device, and executed by the processor, to cause the computer device to perform the foregoing method.
Compared with the prior art, the technical scheme provided by the invention has the following technical effects: the invention relates to a laser speckle-photoacoustic combined imaging device and an implementation method thereof, wherein the device comprises a laser speckle imaging system, a photoacoustic imaging system and an image reconstruction system, wherein the output end of the laser speckle imaging system is connected with the input end of the image reconstruction system, the output end of the photoacoustic imaging system is connected with the input end of the image reconstruction system, the laser speckle imaging system comprises a speckle excitation module and a speckle receiving module, and the photoacoustic imaging module comprises a photoacoustic excitation module and a photoacoustic signal acquisition module; the speckle excitation module and the photoacoustic excitation module comprise dichroic mirrors, and the dichroic mirrors are used for carrying out collinear scanning on speckle laser and pulse laser; the photoacoustic acquisition module comprises an ultrasonic transducer, and the ultrasonic transducer is used for receiving the photoacoustic signals in a forward co-located mode; the dual-mode imaging mode of the laser speckle imaging technology and the photoacoustic imaging technology can be utilized to realize the diagnosis of diabetic feet and provide multi-parameter image support.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a system configuration diagram of a laser speckle-photoacoustic combined imaging apparatus according to an embodiment of the present invention;
fig. 2 is a block diagram of a laser speckle-photoacoustic combined imaging apparatus according to an embodiment of the present invention;
in the figure, a He-Ne laser transmitter, a first beam shaping module, a dichroic mirror, a beam expander, a biological tissue, a filter, a CMOS camera, an image reconstruction system, a pulse laser, a beam splitter prism, a photodiode, a second beam shaping module, an ultrasonic transducer, an amplifier, an acquisition device, a first lens, a second lens, a third lens, a fourth lens, and a fourth lens are arranged in sequence, wherein the first beam shaping module, the second beam shaping module, the dichroic mirror, the beam expander, the biological tissue, the filter, the CMOS camera, the image reconstruction system, the pulse laser, the beam splitter prism, the photodiode, the second beam shaping module, the ultrasonic transducer, the amplifier, the acquisition device, the first lens, the second lens, the third lens and the fourth lens are arranged in sequence.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
Referring to fig. 1, the invention provides a laser speckle-photoacoustic combined imaging device, which comprises a laser speckle imaging system, a photoacoustic imaging system and an image reconstruction system, wherein the output end of the laser speckle imaging system is connected with the input end of the image reconstruction system, the output end of the photoacoustic imaging system is connected with the input end of the image reconstruction system, the laser speckle imaging system comprises a speckle excitation module and a speckle receiving module, and the photoacoustic imaging module comprises a photoacoustic excitation module and a photoacoustic signal acquisition module;
the speckle excitation module is used for emitting laser;
a speckle receiving module for receiving laser speckle imaging generated by laser excitation;
the photoacoustic excitation module is used for emitting pulse laser;
the photoacoustic signal acquisition module is used for acquiring photoacoustic signals generated by excitation of pulse laser;
the image reconstruction system is used for processing the laser speckle imaging and the photoacoustic signals and determining a reconstructed image;
the speckle excitation module and the photoacoustic excitation module comprise dichroic mirrors, and the dichroic mirrors are used for realizing collinear scanning of speckle laser and pulse laser;
the photoacoustic acquisition module comprises an ultrasonic transducer, and the ultrasonic transducer is used for realizing forward co-located receiving of photoacoustic signals.
Further as a preferred embodiment, the speckle excitation module includes a laser, a first beam shaping module, a dichroic mirror, and a beam expander;
wherein the laser includes but is not limited to a He-Ne laser for emitting laser light to the first beam shaping module;
the first beam shaping module is used for shaping the laser and sending the laser to the dichroic mirror;
a dichroic mirror for transmitting the laser light to the beam expander;
the beam expander is used for carrying out beam expanding treatment on the laser and sending the laser to the biological tissue.
Referring to fig. 2, a speckle excitation module according to an embodiment of the present invention emits laser light to a first beam shaping module 2 through a laser 1, the first beam shaping module 2 shapes the laser light and sends the shaped laser light to a dichroic mirror 3, the dichroic mirror 3 transmits the shaped laser light to a beam expander 4, and the beam expander 4 expands the laser light and sends the expanded laser light to a biological tissue 5, so as to accomplish the emission of the laser light.
Further as a preferred embodiment, the speckle receiving module comprises a filter and a camera;
the optical filter is used for filtering stray light of scattered light, and the scattered light is generated by laser irradiation;
cameras include, but are not limited to, CMOS cameras or CCD cameras for receiving scattered light filtered through a filter.
Referring to fig. 2, the speckle receiving module according to the embodiment of the present invention filters scattered light generated by laser irradiation through the optical filter 6, and receives the filtered scattered light through the CMOS camera 7, thereby completing the reception of the scattered light.
Further as a preferred embodiment, the photoacoustic excitation module includes a pulse laser, a beam splitting prism, a photodiode, a second beam shaping module, a dichroic mirror, and a beam expander;
the pulse laser is used for emitting laser to the beam splitting prism;
the beam splitting prism is used for splitting the laser into first beam splitting laser and sending the first beam splitting laser to the photodiode, and splitting the laser into second beam splitting laser and sending the second beam splitting laser to the second beam shaping module;
a photodiode for receiving the first laser beam;
the second beam shaping module is used for shaping the second beam-splitting laser and sending the second beam-splitting laser to the dichroic mirror;
a dichroic mirror for reflecting the second split laser to the beam expander;
the beam expander is used for carrying out beam expanding treatment on the second beam-splitting laser and sending the second beam-splitting laser to the biological tissue.
Referring to fig. 2, the photoacoustic excitation module according to the embodiment of the present invention transmits pulse laser to a beam splitting prism 10 through a pulse laser 9, the beam splitting prism 10 splits the pulse laser into two partial beams, one partial beam is transmitted to a photodiode 11, and the photodiode 12 can trigger and control an acquisition device 15 according to the beam; the beam splitting prism 10 sends the other part of light beams to the second beam shaping module 12, the second beam shaping module 12 shapes the light beams and sends the shaped light beams to the dichroic mirror 3, the light beams emitted by the dichroic mirror 3 enter the beam expander 4, and the light beams are irradiated to the biological tissue 5 after being expanded by the beam expander 4, so that the emission of the pulse laser is completed.
Further as a preferred implementation manner, the photoacoustic signal acquisition module of the embodiment of the present invention includes an ultrasonic transducer, an amplifier and an acquisition device;
the ultrasonic transducer is used for receiving the photoacoustic signal and sending the photoacoustic signal to the amplifier;
the amplifier is used for amplifying the photoacoustic signal and sending the photoacoustic signal to the acquisition equipment;
and the acquisition device is used for acquiring the photoacoustic signals.
Referring to fig. 2, a photoacoustic signal collecting module according to an embodiment of the present invention receives a photoacoustic signal generated by pulsed laser irradiation through an ultrasonic transducer 13, and transmits the photoacoustic signal to an amplifier 14, and the amplifier 14 amplifies the photoacoustic signal and transmits the amplified photoacoustic signal to a collecting device to complete collection of the photoacoustic signal.
Further as a preferred embodiment, the laser speckle imaging system and the photoacoustic imaging system are capable of emitting laser light simultaneously.
The laser and the pulse laser simultaneously generate laser, the dichroic mirror realizes collinear excitation of the light path after the light path is shaped, then the CMOS camera collects speckle signals respectively, and the ultrasonic transducer collects photoacoustic signals and sends the photoacoustic signals into the image reconstruction system respectively for image reconstruction.
Further as a preferred embodiment, the first beam shaping module includes a first lens and a second lens, and an aperture capable of allowing the laser to pass through is disposed between the first lens and the second lens.
Referring to fig. 2, the first beam shaping module 2 according to the embodiment of the present invention includes a first lens 16 and a second lens 17.
Further as a preferred embodiment, the second beam shaping module includes a third lens and a fourth lens, and an aperture capable of allowing the laser light to pass through is disposed between the third lens and the fourth lens.
Referring to fig. 2, the second beam shaping module 2 of the embodiment of the present invention includes a third lens 18 and a fourth lens 19.
Further as a preferred embodiment, the ultrasound transducer is a hollow annular ultrasound transducer.
Referring to fig. 2, the ultrasonic ring energizer 13 is a hollow ring-shaped ultrasonic ring energizer capable of passing and irradiating laser speckle excitation light and photoacoustic excitation light simultaneously to the biological tissue 5, and receiving the generated photoacoustic signal.
The embodiment of the invention also provides a method for realizing the laser speckle-photoacoustic combined imaging device, which comprises the following steps:
transmitting laser to the beam shaping module through a laser;
laser shaping is carried out on the laser through a beam shaping module, and the laser is sent to a dichroic mirror;
the laser irradiates the biological tissue through the dichroic mirror and the beam expander to generate scattered light;
filtering the scattered light through an optical filter;
receiving the scattered light subjected to filtering treatment through a camera to finish receiving laser speckle imaging;
transmitting pulse laser to the beam splitting prism through a pulse laser;
the pulse laser is split by a beam splitting prism, and a first beam splitting laser and a second beam splitting laser are determined;
transmitting the first beam-splitting pulse laser to a photodiode through a beam-splitting prism, wherein the photodiode is used for triggering and controlling acquisition equipment;
transmitting the second beam splitting pulse laser to a beam shaping module through a beam splitting prism;
performing laser shaping treatment on the second beam splitting pulse laser through a beam shaping module and sending the second beam splitting pulse laser to a dichroic mirror;
reflecting the second beam splitting pulse laser to the beam expander by the dichroic mirror;
the beam expander expands the second beam-splitting pulse laser and irradiates the biological tissue to generate a photoacoustic signal;
receiving the photoacoustic signal through the hollow ultrasonic transducer and sending the photoacoustic signal to the amplifier;
amplifying the photoacoustic signal through an amplifier, and sending the photoacoustic signal to acquisition equipment to complete acquisition of the photoacoustic signal;
performing analog-digital conversion processing on the photoacoustic signals through acquisition equipment, and sending the photoacoustic signals to an image reconstruction system;
the laser speckle imaging and the photoacoustic signal are processed by an image reconstruction system to determine a reconstructed image.
Referring to fig. 2, a specific workflow of an embodiment of the present invention is described below:
the embodiment of the invention emits laser light through the laser 1; the laser beam is shaped by the first beam shaping module 2, is expanded by the dichroic mirror 3 to the beam expander 4, and is irradiated to the biological tissue 5 by the ultrasonic transducer 13. Scattered light is generated by laser irradiation of the biological tissue 5. The filter 6 filters the scattered light, and the CMOS camera 7 receives an image reconstruction system 8 of the filtered scattered light. The pulse laser 9 emits pulse laser light to the beam splitting prism 10. The beam splitting prism 10 splits the pulse laser, and a part of the laser enters the photodiode 11 for triggering control of the acquisition device 15; part of the laser enters a second beam shaping module 12 for shaping, the shaped beam is reflected by the dichroic mirror 3 to the beam expanding lens 4 for expanding, and the beam is irradiated to the biological tissue 5 through an ultrasonic energy circulator 13. The photoacoustic signal is generated by irradiating the biological tissue with the light beam. The hollow ultrasonic transducer 13 receives the photoacoustic signal and transmits the photoacoustic signal to the amplifier 14, and the amplifier 14 amplifies the photoacoustic signal and transmits the photoacoustic signal to the acquisition device 15. The acquisition device sends the acquired photoacoustic signals to an image reconstruction system 8. The image reconstruction system 8 performs image reconstruction on laser speckle imaging and photoacoustic imaging to obtain a reconstructed image.
The embodiment of the invention also provides electronic equipment, which comprises a processor and a memory; the memory is used for storing programs; the processor executes the program to implement the method as described above.
The embodiment of the invention also provides a computer readable storage medium storing a program, which is executed by a processor to implement the method as described above.
Embodiments of the present invention also disclose a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The computer instructions may be read from a computer-readable storage medium by a processor of a computer device, and executed by the processor, cause the computer device to perform the method as shown above.
In summary, the embodiment of the invention has the following advantages:
(1) According to the embodiment of the invention, the laser speckle imaging system and the photoacoustic imaging system are used for realizing dual-mode imaging, so that the foot blood vessel can be imaged in an omnibearing and multiparameter manner, and a more comprehensive image data support is provided for early diagnosis of diabetic foot;
(2) According to the embodiment of the invention, the dichroscope and the hollow annular ultrasonic transducer can realize collineation of a laser speckle light path and a photoacoustic excitation light path;
(3) The embodiment of the invention can realize co-location scanning through the hollow annular ultrasonic transducer.
In some alternative embodiments, the functions/acts noted in the block diagrams may occur out of the order noted in the operational illustrations. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved. Furthermore, the embodiments presented and described in the flowcharts of the present invention are provided by way of example in order to provide a more thorough understanding of the technology. The disclosed methods are not limited to the operations and logic flows presented herein. Alternative embodiments are contemplated in which the order of various operations is changed, and in which sub-operations described as part of a larger operation are performed independently.
Furthermore, while the invention is described in the context of functional modules, it should be appreciated that, unless otherwise indicated, one or more of the described functions and/or features may be integrated in a single physical device and/or software module or one or more functions and/or features may be implemented in separate physical devices or software modules. It will also be appreciated that a detailed discussion of the actual implementation of each module is not necessary to an understanding of the present invention. Rather, the actual implementation of the various functional modules in the apparatus disclosed herein will be apparent to those skilled in the art from consideration of their attributes, functions and internal relationships. Accordingly, one of ordinary skill in the art can implement the invention as set forth in the claims without undue experimentation. It is also to be understood that the specific concepts disclosed are merely illustrative and are not intended to be limiting upon the scope of the invention, which is to be defined in the appended claims and their full scope of equivalents.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a Read-only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Logic and/or steps represented in the flowcharts or otherwise described herein, e.g., a ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program is printed, as the program may be electronically captured, via, for instance, optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory.
It is to be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, the various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, may be implemented using any one or combination of the following techniques, as is well known in the art: discrete logic circuits having logic gates for implementing logic functions on data signals, application specific integrated circuits having suitable combinational logic gates, programmable Gate Arrays (PGAs), field Programmable Gate Arrays (FPGAs), and the like.
In the description of the present specification, a description referring to terms "one embodiment," "some embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the present invention have been shown and described, it will be understood by those of ordinary skill in the art that: many changes, modifications, substitutions and variations may be made to the embodiments without departing from the spirit and principles of the invention, the scope of which is defined by the claims and their equivalents.
While the preferred embodiment of the present invention has been described in detail, the present invention is not limited to the embodiments described above, and those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of the present invention, and these equivalent modifications or substitutions are included in the scope of the present invention as defined in the appended claims.
Claims (7)
1. The laser speckle-photoacoustic combined imaging device is characterized by comprising a laser speckle imaging system, a photoacoustic imaging system and an image reconstruction system, wherein the output end of the laser speckle imaging system is connected with the input end of the image reconstruction system, the output end of the photoacoustic imaging system is connected with the input end of the image reconstruction system, the laser speckle imaging system comprises a speckle excitation module and a speckle receiving module, and the photoacoustic imaging system comprises a photoacoustic excitation module and a photoacoustic signal acquisition module;
the speckle excitation module is used for emitting laser;
the speckle receiving module is used for receiving laser speckle imaging generated by laser excitation;
the photoacoustic excitation module is used for emitting pulse laser;
the photoacoustic signal acquisition module is used for acquiring photoacoustic signals generated by excitation of pulse laser;
the image reconstruction system is used for processing the laser speckle imaging and the photoacoustic signals and determining a reconstructed image;
the speckle excitation module and the photoacoustic excitation module comprise dichroic mirrors, and the dichroic mirrors are used for carrying out collinear scanning on speckle laser and pulse laser;
the photoacoustic signal acquisition module comprises an ultrasonic transducer, and the ultrasonic transducer is used for receiving the photoacoustic signal in a forward co-located mode; the ultrasonic transducer is a hollow annular ultrasonic transducer;
the speckle excitation module comprises a laser, a first beam shaping module, a dichroic mirror and a beam expander;
wherein the laser includes but is not limited to a He-Ne laser for emitting laser light to the first beam shaping module;
the first beam shaping module is used for shaping the laser and sending the laser to the dichroic mirror;
the dichroic mirror is used for transmitting the laser to the beam expander;
the beam expander is used for carrying out beam expanding treatment on the laser and sending the laser to biological tissues;
the speckle receiving module comprises an optical filter and a camera;
the optical filter is used for filtering scattered light, and the scattered light is generated by laser irradiation;
the camera includes, but is not limited to, a CMOS camera or a CCD camera for receiving the scattered light filtered by the filter.
2. The laser speckle-photoacoustic combined imaging apparatus of claim 1, wherein the photoacoustic excitation module comprises a pulse laser, a beam splitting prism, a photodiode, a second beam shaping module, a dichroic mirror, and a beam expander;
the pulse laser is used for emitting laser to the beam splitting prism;
the beam splitting prism is used for splitting the laser into first beam splitting laser and sending the first beam splitting laser to the photodiode, and splitting the laser into second beam splitting laser and sending the second beam splitting laser to the second beam shaping module;
the photodiode is used for receiving the first beam-splitting laser;
the second beam shaping module is used for shaping the second beam-splitting laser and sending the second beam-splitting laser to the dichroic mirror;
the dichroic mirror is used for reflecting the second beam splitting laser to the beam expander;
the beam expander is used for carrying out beam expanding treatment on the second beam splitting laser and sending the second beam splitting laser to biological tissues.
3. The laser speckle-photoacoustic combined imaging apparatus of claim 1, wherein the photoacoustic signal acquisition module comprises an ultrasonic transducer, an amplifier, and an acquisition device;
wherein the ultrasonic transducer is configured to receive the photoacoustic signal and transmit the photoacoustic signal to the amplifier;
the amplifier is used for amplifying the photoacoustic signal and sending the photoacoustic signal to the acquisition equipment;
the acquisition device is used for acquiring the photoacoustic signals.
4. A laser speckle-photoacoustic combined imaging apparatus according to claim 1, wherein the laser speckle imaging system and the photoacoustic imaging system are capable of emitting laser light simultaneously.
5. The laser speckle-photoacoustic combined imaging apparatus of claim 1, wherein the first beam shaping module comprises a first lens and a second lens, and wherein an aperture capable of allowing the laser light to pass therethrough is provided between the first lens and the second lens.
6. The laser speckle-photoacoustic combined imaging apparatus according to claim 2, wherein the second beam shaping module comprises a third lens and a fourth lens, and an aperture capable of allowing the laser light to pass therethrough is provided between the third lens and the fourth lens.
7. The implementation method of the laser speckle-photoacoustic combined imaging device is characterized by comprising the following steps of:
transmitting laser to the beam shaping module through a laser;
the laser is shaped by the beam shaping module and is sent to a dichroic mirror;
the laser is irradiated to biological tissues through the dichroic mirror and the beam expander to generate scattered light;
filtering the scattered light through an optical filter;
receiving the scattered light subjected to filtering treatment through a camera to finish receiving laser speckle imaging;
transmitting pulse laser to the beam splitting prism through a pulse laser;
the pulse laser is split through the beam splitting prism, and a first beam splitting laser and a second beam splitting laser are determined;
the first beam splitting laser is sent to a photodiode through the beam splitting prism, wherein the photodiode is used for triggering and controlling acquisition equipment;
the second beam splitting laser is sent to a beam shaping module through the beam splitting prism;
performing laser shaping treatment on the second split laser through the beam shaping module and sending the second split laser to a dichroic mirror;
reflecting the second beam-splitting laser to a beam expander through the dichroic mirror;
performing beam expansion treatment on the second beam splitting laser through the beam expander, and irradiating the second beam splitting laser to the biological tissue to generate a photoacoustic signal;
receiving the photoacoustic signal through a hollow annular ultrasonic transducer and sending the photoacoustic signal to an amplifier;
amplifying the photoacoustic signal through the amplifier, and sending the photoacoustic signal to acquisition equipment to complete acquisition of the photoacoustic signal;
performing analog-digital conversion processing on the photoacoustic signal through the acquisition equipment, and sending the photoacoustic signal to an image reconstruction system;
and processing the laser speckle imaging and the photoacoustic signals by the image reconstruction system to determine a reconstructed image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110610478.6A CN113545747B (en) | 2021-06-01 | 2021-06-01 | Laser speckle-photoacoustic combined imaging device and implementation method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110610478.6A CN113545747B (en) | 2021-06-01 | 2021-06-01 | Laser speckle-photoacoustic combined imaging device and implementation method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113545747A CN113545747A (en) | 2021-10-26 |
| CN113545747B true CN113545747B (en) | 2024-04-12 |
Family
ID=78102046
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110610478.6A Active CN113545747B (en) | 2021-06-01 | 2021-06-01 | Laser speckle-photoacoustic combined imaging device and implementation method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113545747B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6039565A (en) * | 1997-01-14 | 2000-03-21 | Chou; Marilyn M. | Combined ultrasonic and laser device and method of use |
| CN101912250A (en) * | 2010-05-24 | 2010-12-15 | 华南师范大学 | Intravascular photoacoustic and ultrasonic double-mode imaging endoscope device and imaging method thereof |
| KR20150014019A (en) * | 2013-07-26 | 2015-02-06 | 연세대학교 원주산학협력단 | Multi-modal imaging device for arthritis diagnosis |
| CN105212898A (en) * | 2015-08-31 | 2016-01-06 | 睿芯生命科技（深圳）有限公司 | A kind of reflective optoacoustic micro imaging system |
| CN106963338A (en) * | 2017-03-31 | 2017-07-21 | 杭州电子科技大学 | Crystalline lens biomethanics and the noninvasive imaging in vivo system of optical characteristics and measuring method |
| CN109752377A (en) * | 2019-02-02 | 2019-05-14 | 佛山科学技术学院 | A kind of beam splitting type bimodal projection chromatography tissue blood vessel imaging device and method |
| CN110179446A (en) * | 2019-04-17 | 2019-08-30 | 南京航空航天大学 | A kind of multi-modality imaging equipment for combining optoacoustic and laser speckle |
| CN110251099A (en) * | 2019-05-23 | 2019-09-20 | 南京航空航天大学 | A kind of multi-modality imaging equipment for combining optoacoustic and optical fiber type laser speckle |
| CN110367942A (en) * | 2019-08-23 | 2019-10-25 | 中国科学技术大学 | Photoacoustic imaging system and method |
| CN112535531A (en) * | 2020-11-27 | 2021-03-23 | 广东省医疗器械研究所 | Method and device for detecting welding effect of biological tissue |
| CN112683807A (en) * | 2020-12-10 | 2021-04-20 | 广东省医疗器械研究所 | Tissue slice imaging method and imaging system |
-
2021
- 2021-06-01 CN CN202110610478.6A patent/CN113545747B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6039565A (en) * | 1997-01-14 | 2000-03-21 | Chou; Marilyn M. | Combined ultrasonic and laser device and method of use |
| CN101912250A (en) * | 2010-05-24 | 2010-12-15 | 华南师范大学 | Intravascular photoacoustic and ultrasonic double-mode imaging endoscope device and imaging method thereof |
| KR20150014019A (en) * | 2013-07-26 | 2015-02-06 | 연세대학교 원주산학협력단 | Multi-modal imaging device for arthritis diagnosis |
| CN105212898A (en) * | 2015-08-31 | 2016-01-06 | 睿芯生命科技（深圳）有限公司 | A kind of reflective optoacoustic micro imaging system |
| CN106963338A (en) * | 2017-03-31 | 2017-07-21 | 杭州电子科技大学 | Crystalline lens biomethanics and the noninvasive imaging in vivo system of optical characteristics and measuring method |
| CN109752377A (en) * | 2019-02-02 | 2019-05-14 | 佛山科学技术学院 | A kind of beam splitting type bimodal projection chromatography tissue blood vessel imaging device and method |
| CN110179446A (en) * | 2019-04-17 | 2019-08-30 | 南京航空航天大学 | A kind of multi-modality imaging equipment for combining optoacoustic and laser speckle |
| CN110251099A (en) * | 2019-05-23 | 2019-09-20 | 南京航空航天大学 | A kind of multi-modality imaging equipment for combining optoacoustic and optical fiber type laser speckle |
| CN110367942A (en) * | 2019-08-23 | 2019-10-25 | 中国科学技术大学 | Photoacoustic imaging system and method |
| CN112535531A (en) * | 2020-11-27 | 2021-03-23 | 广东省医疗器械研究所 | Method and device for detecting welding effect of biological tissue |
| CN112683807A (en) * | 2020-12-10 | 2021-04-20 | 广东省医疗器械研究所 | Tissue slice imaging method and imaging system |
Non-Patent Citations (2)
| Title |
|---|
| Neurophotonics by Laser Speckle and Photoacoustic Imaging;Thakor, NV;2016 INTERNATIONAL CONFERENCE ON OPTICAL MEMS AND NANOPHOTONICS (OMN);全文 * |
| 一种联合光声与激光散斑的多模态成像系统研究;王康, 张欢, 李韪韬等;生命科学仪器;第18卷(第3期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113545747A (en) | 2021-10-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5850633B2 (en) | Subject information acquisition device | |
| JP6661787B2 (en) | Photoacoustic image evaluation device, method and program, and photoacoustic image generation device | |
| CN109497964B (en) | Human blood vessel detection system based on laser photoacoustic spectroscopy | |
| JP2017070385A (en) | Subject information acquisition device and control method thereof | |
| US20180008235A1 (en) | Apparatus, method, and program for obtaining information derived from ultrasonic waves and photoacoustic waves | |
| US20170325693A1 (en) | Photoacoustic apparatus and control method of photoacoustic apparatus | |
| US20170265750A1 (en) | Information processing system and display control method | |
| CN109363636B (en) | Detection method based on coaxial time domain resolution photoacoustic imaging | |
| US20180228377A1 (en) | Object information acquiring apparatus and display method | |
| KR20170093378A (en) | Plaque Detection System and Method | |
| CN113545747B (en) | Laser speckle-photoacoustic combined imaging device and implementation method thereof | |
| JP2023123874A (en) | Photoacoustic imaging system, photoacoustic imaging system control method, and program | |
| US20190183347A1 (en) | Photoacoustic apparatus and object information acquiring method | |
| WO2018097030A1 (en) | Information processing device, information processing method, information processing system, and program | |
| CN113545809A (en) | Intravascular laser speckle-photoacoustic-ultrasonic imaging device and method | |
| CN110914916B (en) | Imaging method, controller and imaging system for monitoring post-EVAR patient | |
| WO2020040172A1 (en) | Image processing device, image processing method, and program | |
| CN109363644B (en) | Detection system based on coaxial time domain resolution photoacoustic imaging | |
| US20190142277A1 (en) | Photoacoustic apparatus and object information acquiring method | |
| JP2019063516A (en) | Information processing apparatus and information processing method | |
| US20210169397A1 (en) | Image processing apparatus, image processing method, and non-transitory computer-readable medium | |
| WO2020040174A1 (en) | Image processing device, image processing method, and program | |
| JP7205821B2 (en) | system | |
| US20180299763A1 (en) | Information processing apparatus, object information acquiring apparatus, and information processing method | |
| JP2020028662A (en) | Image processing device, image processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |