CN115644803A - Multimode imaging system and method based on light-emitting semiconductor - Google Patents
Multimode imaging system and method based on light-emitting semiconductor Download PDFInfo
- Publication number
- CN115644803A CN115644803A CN202211191172.2A CN202211191172A CN115644803A CN 115644803 A CN115644803 A CN 115644803A CN 202211191172 A CN202211191172 A CN 202211191172A CN 115644803 A CN115644803 A CN 115644803A
- Authority
- CN
- China
- Prior art keywords
- imaging
- light
- processing unit
- cooperative processing
- imaging system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
The invention provides a multi-mode imaging system based on a light-emitting semiconductor, which comprises: the system comprises a plurality of laser source arrays, ultrasonic transducers and a cooperative processing unit, wherein the cooperative processing unit sends control instructions to the laser source arrays and the ultrasonic transducers in a time division multiplexing mode, the laser source arrays emit laser signals under the driving of the cooperative processing unit, the ultrasonic transducers emit ultrasonic signals under the driving of the cooperative processing unit, the laser signals and the ultrasonic signals respectively act on biological tissues to generate first echo signals and second echo signals, and the cooperative processing unit receives the first echo signals and the second echo signals based on the ultrasonic transducers to acquire first imaging, second imaging and fused third imaging of the biological tissues; wherein the plurality of laser light source arrays have light emitting cells of different spectral bands. The imaging system of the invention can simultaneously obtain the physical structure characteristics of the biological tissues and the distribution information of the contained biochemical components, and can realize the accurate adjustment of the imaging depth and the imaging resolution.
Description
Technical Field
The invention belongs to the technical field of medical detection, and particularly relates to a multi-modal imaging system and method based on a light-emitting semiconductor.
Background
The locomotor system consists of three organs, bone joints and skeletal muscle. Bones are variously joined together to form a skeleton. Forms the basic shape of the human body and provides attachment for muscles which contract under the nerve innervation, pulling the attached bone, pivoting on the movable bone connection, creating a lever motion, the primary function of the motion system being movement and support. Early diagnosis of diseases of the biological motor system is vital to the health of the population, and the musculoskeletal tissues in the motor system are complex in structure and mainly comprise non-organic matrixes (most of which are minerals) and organic matrixes. The non-organic matrix mainly comprises calcium hydroxyapatite, phosphate and water; the organic matrix mainly comprises collagen, hemoglobin, lipid, etc. The components are distributed in complex tissues to maintain biological movement, when the tissues in a movement system are diseased, the physical structural characteristics of the tissues are changed, and biochemical indexes are changed to different degrees. Therefore, the method has the advantages of non-invasive acquisition of physical structure and biochemical index information of tissues, imaging, analysis and early warning, and has very important clinical significance for early diagnosis and treatment of diseases of the motion system.
At present, medical institutions widely use a CT imaging method based on X-ray to diagnose the physical structure characteristics of bone tissues in a biological motion system, mainly represent the density of the bone tissues by imaging as a diagnosis parameter, but the method cannot effectively acquire biochemical index information such as the content and distribution of collagen, hemoglobin and lipid in the tissues, and cannot realize real-time monitoring and early warning on the motion system. The imaging is not real-time, the reconstruction time is long, and the imaging has radiation, so the imaging method is not suitable for diagnosis and follow-up of people of all ages.
At present, the ultrasonic imaging method widely used by medical institutions can effectively acquire the physical structure characteristics of biological tissues, and the ultrasonic Doppler imaging method can also acquire blood flow information in organs such as heart and lung, but the hemoglobin distribution condition existing in the tissues is difficult to acquire. Some portable ultrasonic imaging devices can image the internal structure of the mammary gland, but the ultrasonic method cannot effectively provide physical structure information and contained biochemical index information aiming at the tissues of a motion system at the same time.
The large pulse laser has been used as an excitation light source in photoacoustic imaging devices, but the large pulse laser has a large structure, needs an additional large power supply and a water cooling device, is difficult to realize miniaturization, and is limited in clinical application. The LED light-emitting semiconductor and the PLD pulse laser diode array have the advantages of stable light-emitting performance, support of multi-spectral light output, low power consumption and the like, and have potential in photoacoustic imaging clinical application. However, the photoacoustic single-mode imaging lacks the key physical structure characteristic information required for diagnosis, and in addition, the LED light-emitting semiconductor and the PLD pulsed laser diode array have not been applied to the tissue clinical diagnosis for the biological motion system.
Therefore, there is a need for providing a product capable of systematically obtaining and comprehensively analyzing the physical structure characteristics of the tissue and the biochemical index information in the tissue for the tissue of the biological motion system.
Disclosure of Invention
In order to solve the above problems, an object of the present invention is to provide a light-emitting semiconductor based multi-modality imaging system and an imaging method, the system can emit light of different spectral bands at a high speed to a biological moving tissue by using an LED light-emitting semiconductor array and a PLD pulsed laser diode array as light sources based on the light absorption characteristics and the photoacoustic effect physical mechanism of musculoskeletal and vascular tissues in a moving system, perform feature analysis and imaging on photoacoustic signals acquired by an ultrasound transducer, achieve content information detection of biochemical indexes of the characterized tissue, and simultaneously, multiplex the ultrasound transducer to achieve acquisition of physical structural characteristics and elastic information of the tissue. And synchronously acquiring the physical structural characteristics of the biological tissues and the distribution information of the contained biochemical components in real time.
In order to achieve the above object, the present invention provides a multi-modality imaging system based on a light emitting semiconductor, including: the ultrasonic imaging system comprises a plurality of laser source arrays, ultrasonic transducers and a cooperative processing unit, wherein the cooperative processing unit sends control instructions to the laser source arrays and the ultrasonic transducers in a time division multiplexing mode, the laser source arrays emit laser signals under the driving of the cooperative processing unit, the ultrasonic transducers emit ultrasonic signals under the driving of the cooperative processing unit, the laser signals and the ultrasonic signals respectively act on biological tissues to generate first echo signals and second echo signals, and the cooperative processing unit receives the first echo signals and the second echo signals based on the ultrasonic transducers to acquire first imaging, second imaging and third imaging of the biological tissues; wherein the plurality of laser light source arrays have light emitting cells of different spectral bands.
In an embodiment of the present invention, the laser source array includes a power supply unit, a controlled circuit unit, and a light emitting unit, one end of the light emitting unit is connected to one end of the power supply unit, the other end of the light emitting unit is grounded through the controlled circuit unit, the controlled end of the controlled circuit unit is in signal connection with the control output port of the cooperative processing unit, and the cooperative processing unit has a plurality of control output ports respectively connected to the plurality of laser source arrays to realize respective control.
In one embodiment of the present invention, the light emitting unit is a plurality of PLD diodes and/or LED diodes connected in series/parallel.
In an embodiment of the present invention, the cooperative processing unit includes an FPGA and a processor, the FPGA outputs a preset TTL signal through a program therein to implement sending a control instruction to the laser source array and the ultrasonic transducer in a time division multiplexing manner, and the processor is configured to receive the first echo signal and the second echo signal through the ultrasonic transducer to perform calculation so as to reconstruct biological tissue imaging.
In an embodiment of the invention, the pulse width and the duty ratio of the preset TTL signal are controlled by an internal program of the FPGA, so as to adjust the light intensity and the frequency of the laser source array.
In an embodiment of the present invention, the system further includes a sensor unit, and the processor in the cooperative processing unit performs corresponding operations according to the relevant parameters acquired by the sensor unit to determine whether the imaging system is placed at the measurement position.
In an embodiment of the present invention, the sensor unit includes an ambient light sensor, a three-axis attitude sensor, a temperature sensor, and a CCD sensor, the ambient light sensor is configured to obtain an ambient light intensity of the imaging system, the three-axis attitude sensor is configured to obtain an X, Y, and Z spatial position and acceleration information of the imaging system, the temperature sensor is configured to obtain a temperature of an area of interest to be measured and an ambient temperature, and the CCD sensor is configured to obtain an image of the area of interest to be measured.
In an embodiment of the present invention, the imaging system further includes a wireless communication unit, the wireless communication unit is in signal connection with the cooperative processing unit, and the cooperative processing unit sends the acquired first echo signal and second echo signal to a target device through the wireless communication unit for reconstruction imaging.
Based on the same inventive concept, the invention also provides a multi-mode imaging method based on the light-emitting semiconductor, which comprises the following steps of: sending a control command to the laser source array and the ultrasonic transducer in a time division multiplexing mode to act on biological tissues to generate a first echo signal and a second echo signal; wherein the laser source array is controlled by the cooperative processing unit to generate laser with different spectral bands to irradiate the biological tissue; generating first, second, and third imaging based on the first and second echo signals, wherein the third imaging is generated based on the first and second imaging fusions or based on the first and second echo signals.
In one embodiment of the invention, the laser source array is controlled by the co-processing unit to generate laser beams with different spot diameters to act on the biological tissue.
Due to the adoption of the technical scheme, compared with the prior art, the invention has the following advantages and positive effects:
1. based on the absorption characteristics of musculoskeletal and vascular tissues to light and the photoacoustic effect physical mechanism in a motion system, a laser source array is used as a light source to emit light of different spectral bands to biological motion tissues at high speed, and a photoacoustic signal acquired by an ultrasonic transducer is used for carrying out characteristic analysis and imaging to realize the detection of biochemical index content information of the biological tissues; and meanwhile, the multiplexing ultrasonic transducer is used for acquiring the physical structure characteristics and the elasticity information of the tissues. And synchronously acquiring the physical structural characteristics of the biological tissues and the distribution information of the contained biochemical components in real time.
2. According to the invention, the LED light-emitting semiconductor array and/or the PLD pulse laser diode array are used as light sources to generate laser pulses, the high-frequency excitation light signal is generated through the control of the FPGA, the photoacoustic signal is obtained through the ultrasonic transducer at a high frame rate and is reconstructed to form images based on the physical effect of the biological motion tissue for absorbing the photoacoustic, and the problem that the traditional photoacoustic medium-large laser serving as a light source is low in emission rate and difficult to realize high-resolution characterization on the distribution of microvessels and hemoglobin in the tissue is solved.
3. According to the invention, the FPGA is used for controlling the excitation time and the excitation pulse width of the laser source array, so that the control of the light intensity and the frequency of laser emitted by the laser source array can be realized, and the accurate control of the irradiation depth and the imaging resolution can be further realized. The laser source array is provided with light emitting diodes with different spectral bands to realize the emission of laser with different spectral bands.
Drawings
The following detailed description of embodiments of the invention is provided in conjunction with the appended drawings, in which:
FIG. 1 is a diagram of a multi-modality imaging system based on a light emitting semiconductor according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a multi-modality imaging system based on a light emitting semiconductor according to an embodiment of the present invention;
fig. 3 is a structural diagram of a multi-modal imaging system based on a light emitting semiconductor according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of the key circuitry of the multi-modality imaging system of the present invention;
FIG. 5 is a schematic diagram of an experimental platform based on a multi-modal imaging system of a light-emitting semiconductor according to the present invention;
FIG. 6,6a is the photoacoustic imaging result, 6b is the ultrasound imaging, and 6c is the fused image.
Detailed Description
The invention is described in further detail below with reference to the figures and specific examples. Advantages and features of the present invention will become apparent from the following description and from the claims. It is to be noted that the drawings are in a very simplified form and are all used in a non-precise ratio for the purpose of facilitating and distinctly aiding in the description of the embodiments of the invention.
It should be noted that all directional indicators (such as up, down, left, right, front, back \8230;) in the embodiments of the present invention are only used to explain the relative positional relationship between the components, the motion situation, etc. in a specific posture (as shown in the attached drawings), and if the specific posture is changed, the directional indicator is changed accordingly.
Example one
The embodiment of the invention provides a multi-modal imaging system based on a light-emitting semiconductor, which is used for solving the problem that the physical structural characteristics of biological moving tissues and the distribution information of biochemical components contained in the biological moving tissues are difficult to acquire synchronously in real time in the prior imaging technology.
As shown in fig. 1, a light emitting semiconductor based multi-modality imaging system includes: the system comprises a plurality of laser source arrays 100, an ultrasonic transducer 200 and a cooperative processing unit 300, wherein the cooperative processing unit 300 sends control instructions to the laser source arrays 100 and the ultrasonic transducer 200 in a time division multiplexing manner, the laser source arrays 100 emit laser signals under the driving of the cooperative processing unit 300, the ultrasonic transducer 200 emits ultrasonic signals under the driving of the cooperative processing unit 300, the laser signals and the ultrasonic signals respectively act on biological tissues to generate first echo signals and second echo signals, and the cooperative processing unit 300 receives the first echo signals and the second echo signals based on the ultrasonic transducer 200 to acquire first imaging, second imaging and third imaging of the biological tissues; wherein the plurality of laser light source arrays 100 have light emitting cells of different spectral bands.
Based on the absorption characteristics of musculoskeletal and vascular tissues to light and the photoacoustic effect physical mechanism in a motion system, a laser source array 100 is used as a light source to emit the biological motion tissue at a high speed, and a photoacoustic signal obtained by an ultrasonic transducer 200 is subjected to characteristic analysis and imaging to represent the content and distribution conditions of biochemical component information such as hydroxyapatite, hemoglobin and the like in the tissue, so that the content information detection of biochemical indexes of the biological tissue is realized; the multiplexing ultrasonic transducer 200 transmits multi-band ultrasonic pulses after modulation, coding, beam synthesis and focusing, and receives ultrasonic signals from different depths of each tissue to realize acquisition of physical structure characteristics and elastic information of the tissue. And further, the physical structure characteristics and the distribution information of the contained biochemical components of the same region of interest of the biological tissue can be synchronously obtained in real time.
The cooperative processing unit 300 sends driving signals to the laser source array 100 and the ultrasonic transducer 200 in a time division multiplexing manner, and synchronously, the ultrasonic transducer 200 receives a first echo signal and a second echo signal generated by the laser source array 100 and the ultrasonic transducer 200 acting on biological tissues in a time division multiplexing manner, and then the cooperative processing unit 200 performs signal processing based on the first echo signal and the second echo signal to obtain an image.
Optionally, the cooperative processing unit 200 may respectively perform imaging on the first echo signal and the second echo signal to obtain a first image and a second image, that is, may respectively obtain the physical structure characteristic of the biological tissue and the distribution information of the contained biochemical components, or may obtain a synthesized third image based on the first echo signal and the second echo signal. Of course, the method of acquiring the composite image is not limited to reconstructing an image by synthesizing the first echo signal and the second echo signal, and may also be performed by two-dimensional synthesis after imaging respectively to obtain a third image.
Preferably, the laser source array 100 includes a power supply unit 101, a controlled circuit unit 102 and a light emitting unit 103, one end of the light emitting unit 103 is connected to one end of the power supply unit 101, the other end of the light emitting unit 103 is grounded through the controlled circuit unit 102, a controlled end of the controlled circuit unit 102 is in signal connection with a control output port of the cooperative processing unit 300, and the cooperative processing unit 300 has a plurality of control output ports respectively connected to the plurality of laser source arrays to realize respective control.
Preferably, the light emitting unit 103 is a plurality of PLD diodes and/or LED diodes connected in series/parallel.
The LED light-emitting semiconductor array and/or the PLD pulse laser diode array are/is adopted as a light source to generate laser pulses, a high-frequency excitation light signal is generated through the control of an FPGA, the photoacoustic signal is obtained through the high frame rate of a probe and is reconstructed to form images based on the physical effect of the biological motion tissue of absorbing light induced noise, and the problem that the traditional photoacoustic medium-large laser serving as the light source is low in emission rate and difficult to realize high-resolution characterization on the distribution of microvessels and hemoglobin in the tissue is solved.
Because the light spot size of the light-emitting unit of the single PLD/LED diode is limited, namely the area which acts on tissues to generate the photoacoustic effect is limited, the photoacoustic signals of deep tissues are weak, and the imaging quality is low, the invention adopts a plurality of groups of PLD/LED diodes to construct a light-emitting array, and simultaneously controls each light-emitting unit 103 in the array, the embodiment can realize the regulation and control of the light spot size within the range of 0.5cm-5cm, improve the performance of obtaining the photoacoustic signals of the tissues, and simultaneously, the output intensity is less than the biological use safety threshold value of 20mj/cm 2 。
The laser source array 100 of the invention is internally provided with PLD/LED arrays of different spectral bands, realizes multi-spectral band light excitation and covers the wavelength range of 405nm-2600nm. Thereby achieving the adjustability of the optical output wavelength.
Preferably, the cooperative processing unit 300 includes an FPGA and a processor, the FPGA implements output of a preset TTL signal through a program therein to implement sending of a control instruction to the laser source array 100 and the ultrasonic transducer 200 in a time division multiplexing manner, and the processor is configured to receive the first echo signal and the second echo signal through the ultrasonic transducer 200 to perform calculation to reconstruct biological tissue imaging.
According to the invention, the FPGA is used for controlling the excitation time and the excitation pulse width of the laser source array, so that the control of the light intensity and the frequency of the laser emitted by the laser source array can be realized, and further, the accurate control of the irradiation depth and the imaging resolution can be realized.
Optionally, as shown in fig. 4, the cooperative processing unit 300 is configured with an FPGA, an ARM, and an x86, where the FPGA generates TTL pulse signals with a pulse width of 10ns to 200ns, a resolution of 1ns, and a pulse frequency of 10Hz to 2kHz, outputs TTL electrical signals through a plurality of control pins, sends the TTL pulse signals to each controlled circuit unit 102, controls the high-speed MOS transistor to be turned on and off, and the power supply unit 101 outputs 10 to 20 times of rated current of the LED/PLD, so as to selectively excite each PLD/LED diode array unit, thereby changing the size of a light spot and the laser frequency, and further changing the laser irradiation intensity and the imaging resolution.
Optionally, the PLD/LED diode array unit may be configured with PLD/LED diodes of different spectral bands, so as to emit excitation light of different spectral bands.
Preferably, the pulse width and the duty ratio of the preset TTL signal are controlled by an internal program of the FPGA, so as to adjust the light intensity and the frequency of the laser source array 100.
Compared with the traditional OPO laser, the device has the advantages of continuously variable and modulatable output pulse width, obviously improved pulse repetition frequency, support of an array LED/PLD, an ultra-small-volume controller and a power supply, no need of an additional refrigerating device and the like.
Preferably, the imaging system further comprises a data storage unit 400, and the data storage unit 400 is connected to the cooperative processing unit 300 and is used for storing data. The storage unit 400 is composed of a 4TB SSD solid state disk, and is also configured with an 8GB DDR4 memory to implement a high-speed data cache.
Preferably, the system further includes a sensor unit 500, and the processor in the cooperative processing unit 300 performs corresponding operations according to the related parameters acquired by the sensor unit 500 to determine whether the imaging system is placed at the measurement position.
Preferably, the sensor unit 500 includes an ambient light sensor 501, a three-axis attitude sensor 502, a temperature sensor 503 and a CCD sensor 504, the ambient light sensor 504 is used for acquiring the ambient light intensity of the imaging system, the three-axis attitude sensor 502 is used for acquiring the X, Y and Z spatial positions and acceleration information of the imaging system, the temperature sensor 503 is used for acquiring the temperature and the ambient temperature of the region of interest to be measured, and the CCD sensor 504 is used for acquiring the image of the region of interest to be measured.
Specifically, the ambient light sensor 501 obtains the intensity of the ambient light, and through optical-electrical conversion, when the amplitude of the electrical signal is smaller than a preset ambient light threshold, the judgment probe is correctly placed at the measurement position. The three-axis attitude sensor 502 acquires the spatial position of the probe in X, Y and Z and acceleration information, and judges that the probe is correctly placed at a measuring position when the electric signal meets the preset range of X, Y, Z and acceleration intervals through magnetic-electric conversion. The temperature sensor 503 acquires the temperature of the region of interest to be measured and the ambient temperature, and judges that the multi-band ultrasound and multi-band photoacoustic intelligent portable imaging probe has been correctly placed at the measurement position through thermal-electrical conversion when the amplitude of the electrical signal is greater than a preset threshold value. The CCD sensor 504 acquires an image of the region of interest to be measured, and calculates the image amplitude of the preset value and the similarity of the texture information through the cooperative processing unit 300, to determine that the probe has been correctly placed at the measurement position.
Preferably, the imaging system further includes a wireless communication unit, the wireless communication unit is in signal connection with the cooperative processing unit 300, and the cooperative processing unit 300 sends the acquired first echo signal and second echo signal to a target device through the wireless communication unit to perform remote reconstruction imaging. The target device may be a cloud server.
Preferably, the wireless communication unit is further configured to wirelessly perform data interaction with the ambient light sensor 501, the three-axis attitude sensor 502, the temperature sensor 503, the CCD sensor 504, and an external cloud server.
Preferably, the imaging system further includes a power source electrically connected to the laser source array 100, the ultrasonic transducer 200 and the co-processing unit 300 for providing electric energy, and the co-processing unit 300 monitors power consumption of the power source and controls the power source to charge according to a preset rule. For example, when the electric quantity of the power supply is lower than a preset value, charging is carried out, and the residual electric quantity of the power supply is displayed through the display module.
Preferably, the imaging system further includes a user interaction module 600, and specifically, the user interaction module 600 may be a touch screen, and the touch screen is configured to receive a control instruction of a user and display an imaging image.
Preferably, the imaging system further comprises an interface unit for communicating and performing data interaction with an external device through a USB or UVC protocol. The interface unit can adopt interfaces such as Thunderbolt 4, displayPort and Type-C interface.
In one embodiment, the laser source array 100, the ultrasonic transducer 200 and the sensor unit 500 may be disposed in a probe housing 1, each component inside the probe housing has a corresponding fixing buckle, a sealing rubber pad and a signal shielding layer, the probe may be replaced and connected to the cooperative processing unit 300 through a parallel signal transmission interface, the cooperative processing unit 300, the data storage unit 400, a battery and the like are disposed in the body 2 and integrated into a whole through a waterproof protective housing, and communicate and perform data interaction with an external device through an interface unit and a wireless communication unit. The overall weight of the probe 1 can be realized to be less than 500g. The analysis imaging module 2 is communicated and transmitted and interacted with through a parallel signal transmission interface 107.
The cooperative processing unit 300, the data storage unit 400, the battery and the like are integrated in the integrated waterproof body 2, and the overall weight is less than 1kg. The units can carry out module replacement upgrading according to the number of signal channels required by imaging or the image reconstruction fusion operation performance; the signals of the sensors are acquired in a wired or wireless mode, the working state of the monitoring device is realized, and multi-array element emission and multi-mode signal receiving and imaging are realized through the cooperative processing unit 300.
The invention is applied to the field of medical health, can be applied to the fields of musculoskeletal imaging, intraoperative imaging, exercise health monitoring, rehabilitation monitoring and the like, is used for solving the problem that portable noninvasive monitoring and diagnosis of diseases of an exercise system are difficult in the prior art, provides early warning for tissue change in the exercise system of a subject, and provides important data for diagnosis of related diseases.
Referring to fig. 2 and 3, when in use, the imaging system is placed in an area to be tested, the 256-array element multiband ultrasonic transducer 200 is tightly coupled with the skin through the ultrasonic coupling agent, and the whole machine is waterproof through the waterproof skin-friendly material shell and the waterproof shell, and can be disinfected and cleaned through alcohol or water; the interface unit is connected with a power supply for charging and can be connected with a display, a keyboard, a mouse, a hard disk and other equipment; and performing touch screen operation and displaying a system operation interface through the user interaction unit.
The physical mechanism and the embodiment of the multi-mode imaging system based on the luminescent semiconductor have the following beneficial effects:
in order to solve the problem that the traditional ultrasonic early diagnosis is insensitive, the invention is based on the absorption characteristics of musculoskeletal and vascular tissues to light and the physical mechanism of photoacoustic effect in a motion system, and based on the LED light-emitting semiconductor array and the PLD pulse laser diode array as light sources, emits light with different spectral bands at high speed of more than 1kHz to the biological motion tissue, and performs characteristic analysis and imaging on photoacoustic signals obtained by an ultrasonic transducer to realize the biochemical index content information of the represented tissue. And meanwhile, the multiplexing ultrasonic transducer is used for acquiring the physical structure characteristics and the elasticity information of the tissues. The problem that the traditional ultrasonic diagnosis only provides physical structure information and is difficult to obtain biochemical component information required by early diagnosis is solved. Meanwhile, the problem that a large laser as a light source needs to be provided with a special power supply and a cooling system, and the photoacoustic imaging is difficult to miniaturize is solved. In addition, the problems that the traditional photoacoustic medium-large laser as a light source is low in emission rate (< 20 Hz), and high-resolution representation of the distribution of the microvessels and hemoglobin in the tissue is difficult to realize are also solved.
Referring to fig. 5, in order to verify the imaging performance of the portable high frame rate multi-modal imaging system based on the light-emitting semiconductor, a photoacoustic and ultrasonic imaging experimental platform is built, and a simulation body is formed by filling three heterogeneous components, namely silicone grease, vaseline and hemoglobin, into PMMA and is used for simulating biochemical components in tissues. The laser source array 100 adopts a 532nm visible light array LED, the power supply unit 101 boosts the voltage of 15V to 70V, generates instantaneous current 20A to drive the LED, sets the light output pulse width of the LED to be 200ns, and sets the pulse repetition frequency to be 1kHz to perform photoacoustic/ultrasonic dual-mode imaging and image fusion. The imaging results are shown in fig. 6. Where 6a is the photoacoustic imaging result, 6b is the ultrasound imaging, and 6c is the fused image of 6a and 6 b.
Due to the fact that the three heterogeneous components of silicone grease, vaseline and hemoglobin have different light absorption characteristics for 532nm, the generated photoacoustic signal intensities are different, and the phenomenon that the contrast difference of the three heterogeneous components in an image is obvious can be observed in the photoacoustic imaging result in fig. 6 a; in addition, the three media are not obvious in the ultrasonic image due to small acoustic impedance difference, mainly reflected signals from the pipe wall, so that the ultrasonic imaging in fig. 6b can clearly reflect the physical structure information and the elastic characteristic difference. The fused image of fig. 6c shows that the three heterogeneous media are filled in the tube, and are consistent with the phantom, and the information of the heterogeneous media and the position of the tube wall can be clearly distinguished from the image.
The result shows that the multi-mode imaging system based on the luminescent semiconductor can represent the space distribution of biochemical components and the physical structure characteristics of the biochemical components in the tissues of the biological motion system, and solves the problems that the traditional ultrasonic diagnosis lacks biochemical component information required by early diagnosis, the photoacoustic single-mode imaging lacks physical structure elastic characteristic information, and the traditional photoacoustic is difficult to miniaturize. The embodiment can also obviously obtain the advantages of high sensitivity, high frame rate, high integration and miniaturization, is suitable for clinical diagnosis of the biological motion system, and particularly can enhance the early diagnosis effect.
It can be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
Example two
Based on the same inventive concept, the invention also provides a multi-mode imaging method based on the light-emitting semiconductor, which comprises the following steps:
s100: sending control instructions to the laser source array and the ultrasonic transducer in a time division multiplexing mode to act on biological tissues to generate a first echo signal and a second echo signal; wherein the laser source array is controlled by the cooperative processing unit to generate laser with different spectral bands to irradiate the biological tissue; and generating the second echo signal excited by the multi-spectrum laser based on the biological tissue photo-acoustic effect physical mechanism.
S200: generating first, second, and third imaging based on the first and second echo signals, wherein the third imaging is generated based on the first and second imaging fusion or based on the first and second echo signals.
In one embodiment of the invention, the laser source array is controlled by the co-processing unit to generate laser beams with different spot diameters to act on the biological tissue.
Further, before step S100, the method further includes: and judging whether the imaging device is accurately arranged at the preset position or not based on the data of one or more sensors among the ambient light sensor, the three-axis attitude sensor, the temperature sensor and the CCD sensor.
The embodiments of the present invention have been described in detail with reference to the accompanying drawings, but the present invention is not limited to the above embodiments. Even if various changes are made to the present invention, it is still within the scope of the present invention if they fall within the scope of the claims of the present invention and their equivalents.
Claims (10)
1. A light emitting semiconductor based multi-modality imaging system, comprising: the ultrasonic imaging system comprises a plurality of laser source arrays, ultrasonic transducers and a cooperative processing unit, wherein the cooperative processing unit sends control instructions to the laser source arrays and the ultrasonic transducers in a time division multiplexing mode, the laser source arrays emit laser signals under the driving of the cooperative processing unit, the ultrasonic transducers emit ultrasonic signals under the driving of the cooperative processing unit, the laser signals and the ultrasonic signals respectively act on biological tissues to generate first echo signals and second echo signals, and the cooperative processing unit receives the first echo signals and the second echo signals based on the ultrasonic transducers to acquire first imaging, second imaging and third imaging of the biological tissues;
wherein the plurality of laser light source arrays have light emitting cells of different spectral bands.
2. The light-emitting semiconductor-based multi-modal imaging system according to claim 1, wherein the laser source array comprises a power supply unit, a controlled circuit unit and a light-emitting unit, one end of the light-emitting unit is connected with one end of the power supply unit, the other end of the light-emitting unit is grounded through the controlled circuit unit, the controlled end of the controlled circuit unit is in signal connection with the control output port of the cooperative processing unit, and the cooperative processing unit has a plurality of control output ports which are respectively connected with the plurality of laser source arrays to realize respective control.
3. The light emitting semiconductor-based multimodal imaging system according to claim 2, wherein the light emitting unit is a plurality of PLD diodes and/or LED diodes in series/parallel.
4. The light-emitting semiconductor-based multi-modality imaging system according to claim 2, wherein the cooperative processing unit comprises an FPGA and a processor, the FPGA realizes output of preset TTL signals through its internal program to realize sending of control instructions to the laser source array and the ultrasonic transducer in a time division multiplexing manner, and the processor is configured to receive the first echo signal and the second echo signal through the ultrasonic transducer for calculation to reconstruct biological tissue imaging.
5. The light emitting semiconductor-based multimodal imaging system according to claim 4, wherein the pulse width and duty cycle of the preset TTL signal are controlled by an internal program of the FPGA to achieve the adjustment of the light intensity and frequency of the array of laser sources.
6. The light-emitting semiconductor-based multimodal imaging system according to claim 1, wherein the system further comprises a sensor unit, and the processor in the cooperative processing unit performs corresponding operation through the related parameters acquired by the sensor unit to determine whether the imaging system is placed at a measurement position.
7. The multi-modal imaging system based on the light-emitting semiconductor of claim 6, wherein the sensor unit comprises an ambient light sensor, a three-axis attitude sensor, a temperature sensor and a CCD sensor, the ambient light sensor is used for acquiring the intensity of ambient light of the imaging system, the three-axis attitude sensor is used for acquiring the X, Y and Z spatial position and acceleration information of the imaging system, the temperature sensor is used for acquiring the temperature of the region of interest to be measured and the ambient temperature, and the CCD sensor is used for acquiring the image of the region of interest to be measured.
8. The light-emitting semiconductor-based multimodal imaging system according to claim 1, wherein the imaging system further comprises a wireless communication unit in signal connection with the co-processing unit, and the co-processing unit sends the acquired first echo signal and second echo signal to a target device through the wireless communication unit for reconstruction imaging.
9. A multi-mode imaging method based on a light-emitting semiconductor is characterized by comprising the following steps:
sending a control command to the laser source array and the ultrasonic transducer in a time division multiplexing mode to act on biological tissues to generate a first echo signal and a second echo signal; wherein the laser source array is controlled by the cooperative processing unit to generate laser with different spectral bands to irradiate the biological tissue;
generating first, second, and third imaging based on the first and second echo signals, wherein the third imaging is generated based on the first and second imaging fusions or based on the first and second echo signals.
10. The light-emitting semiconductor-based multi-modal imaging method as claimed in claim 9, wherein the laser source array is controlled by the cooperative processing unit to generate laser beams with different spot diameters to act on the biological tissue.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211191172.2A CN115644803A (en) | 2022-09-28 | 2022-09-28 | Multimode imaging system and method based on light-emitting semiconductor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211191172.2A CN115644803A (en) | 2022-09-28 | 2022-09-28 | Multimode imaging system and method based on light-emitting semiconductor |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115644803A true CN115644803A (en) | 2023-01-31 |
Family
ID=84985049
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211191172.2A Pending CN115644803A (en) | 2022-09-28 | 2022-09-28 | Multimode imaging system and method based on light-emitting semiconductor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115644803A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116942200A (en) * | 2023-09-20 | 2023-10-27 | 杭州励影光电成像有限责任公司 | Non-multiplexing ultrasonic multi-mode imaging system and method |
-
2022
- 2022-09-28 CN CN202211191172.2A patent/CN115644803A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116942200A (en) * | 2023-09-20 | 2023-10-27 | 杭州励影光电成像有限责任公司 | Non-multiplexing ultrasonic multi-mode imaging system and method |
| CN116942200B (en) * | 2023-09-20 | 2024-02-06 | 杭州励影光电成像有限责任公司 | Non-multiplexing ultrasonic multi-mode imaging system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7279957B2 (en) | Quantitative imaging system and its use | |
| CA2861979C (en) | Laser optoacoustic ultrasonic imaging system (louis) and methods of use | |
| US20190083048A1 (en) | Massively Multi-Frequency Ultrasound-Encoded Tomography | |
| WO2008067438A2 (en) | System and method for photoacoustic guided diffuse optical imaging | |
| CN107550458A (en) | The more characteristic imaging methods of biological tissue based on acoustoelectric effect and acoustic radiation force | |
| Oeri et al. | Hybrid photoacoustic/ultrasound tomograph for real-time finger imaging | |
| CN115644803A (en) | Multimode imaging system and method based on light-emitting semiconductor | |
| US20190059739A1 (en) | Photoacoustic apparatus | |
| EP3326520A1 (en) | Photoacoustic apparatus, information processing method | |
| CN111419191A (en) | Touch ultrasonic photoacoustic breast cancer detector and medical equipment | |
| US20180368696A1 (en) | Object information acquiring apparatus and object information acquiring method | |
| JP7314371B2 (en) | SUBJECT INFORMATION ACQUISITION APPARATUS, SUBJECT INFORMATION PROGRAM, AND PROGRAM | |
| Jiang et al. | Biomedical photoacoustic imaging with unknown spatially distributed ultrasound sensor array | |
| JP7118718B2 (en) | SUBJECT INFORMATION ACQUISITION APPARATUS, SUBJECT INFORMATION PROGRAM, AND PROGRAM | |
| JP2018089346A (en) | Photoacoustic apparatus, image display method and program | |
| CN109044282B (en) | Detection device and detection method integrating touch sensing and optical tomography imaging | |
| CN113332619B (en) | Ultrasonic conformal activation and monitoring imaging system for phase-change nano-droplet drug carrier | |
| Zheng | Wearable optoacoustic sensing and imaging systems for quantitative and multiparametric blood analysis | |
| US20180344168A1 (en) | Photoacoustic apparatus | |
| Tran et al. | Basics of Ultrasound | |
| EP3841982A1 (en) | Image processing device, image processing method, and program | |
| WO2019031607A1 (en) | Photoacoustic apparatus and object information acquiring method | |
| CN117281544A (en) | Time sequence controller for ultrasonic and photoacoustic fusion real-time bone imaging | |
| US20190159760A1 (en) | Photoacoustic probe | |
| KR20240070598A (en) | Photoacoustic probe for prostate imaging |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |