CN110353630A - A kind of opto-acoustic microscopic imaging system and method - Google Patents
A kind of opto-acoustic microscopic imaging system and method Download PDFInfo
- Publication number
- CN110353630A CN110353630A CN201910650799.1A CN201910650799A CN110353630A CN 110353630 A CN110353630 A CN 110353630A CN 201910650799 A CN201910650799 A CN 201910650799A CN 110353630 A CN110353630 A CN 110353630A
- Authority
- CN
- China
- Prior art keywords
- signal
- laser
- module
- target object
- gear
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0093—Detecting, measuring or recording by applying one single type of energy and measuring its conversion into another type of energy
- A61B5/0095—Detecting, measuring or recording by applying one single type of energy and measuring its conversion into another type of energy by applying light and detecting acoustic waves, i.e. photoacoustic measurements
Abstract
The invention discloses a kind of opto-acoustic microscopic imaging system and methods, wherein system includes laser emitting module, Laser Modulation module, image-forming module, detecting module and signal processing module.Laser Modulation module is connect with laser emitting module, for modulating the exit direction of laser signal；Image-forming module is located on the propagation path of laser scanning signal, and the ultrasonic signal generated for reflectance target object is to detecting module；Detecting module is electric signal for conversion ultrasonic wave signal；Detecting module includes ultrasonic transducer, first gear, second gear and stepper motor unit；Stepper motor unit is fixedly connected with first gear, and first gear is engaged with second gear, and second gear is fixedly connected with ultrasonic transducer；Signal processing module is electrically connected with detecting module, for obtaining the micro-image of target object.Opto-acoustic microscopic imaging system and method provided in an embodiment of the present invention realizes the fast imaging to target object, and small in size, at low cost.
Description
Technical field
The present embodiments relate to control and technical field of imaging more particularly to a kind of opto-acoustic microscopic imaging system and sides
Method.
Background technique
Photoacoustic imaging (Photoacoustic Imaging, PAI) is a kind of non-invasive developed in recent years and non-
The new bio medical imaging procedure of ionization type.When pulsed laser irradiation is into biological tissue, the light absorption domain of tissue will be produced
Raw ultrasonic signal, this ultrasonic signal generated by light excitation are known as photoacoustic signal.The photoacoustic signal that biological tissue generates carries
The light absorption characteristics information of tissue can reconstruct the light absorption distributed image in tissue by detecting photoacoustic signal.Optoacoustic at
As combining in the imaging of pure optical texture in high selection characteristic and the imaging of pure ultrasonic tissue the advantages of deep penetration characteristic, height can be obtained
The organization chart picture of resolution ratio and high contrast.
It is produced both at home and abroad when target object is imaged using opto-acoustic microscopic imaging system using pulse laser at present
Raw laser facula excites any photoacoustic signal of target object, passes through the point focusing ultrasonic transducer detecting objects body point
Photoacoustic signal, while machine is carried out to target object using the mobile laser facula of straight line electric translation stage and point focusing ultrasonic transducer
Tool formula scans to obtain the image of target object, kinematic accuracy requirement of the mode of this mechanical scanning to straight line electric translation stage
It is higher, while it being limited to the sliding block and screw-rod structure of straight line electric translation stage, it is slower to the image taking speed of target object.In addition,
The volume that straight line electric translation stage is very large also limits usage scenario, and the modes of emplacement of target object to be measured and position need to cooperate
Opto-acoustic microscopic imaging system, slightly bigger target object can not be placed, to can not be imaged, seminar both domestic and external would generally
It uses more volume instead and target object that more accurate straight line electric translation stage is slightly larger to volume is imaged, but is high-precision straight
Line motorized precision translation stage and mating control cabinet it is expensive.In conclusion existing opto-acoustic microscopic imaging system is using high-precision
Straight line electric translation stage image taking speed is slower, and fast-changing target object can not be imaged real-time, quickly, and volume it is big,
It is at high cost.
Summary of the invention
The present invention provides a kind of opto-acoustic microscopic imaging system and method, to realize the fast imaging to target object, and
Realize the miniaturization and low cost of opto-acoustic microscopic imaging system.
In a first aspect, the embodiment of the invention provides a kind of opto-acoustic microscopic imaging system, including laser emitting module, laser
Modulation module, image-forming module, detecting module and signal processing module；
The Laser Modulation module is connect with the laser emitting module, for modulating the exit direction of laser signal, is obtained
To laser scanning signal；
The image-forming module is located on the propagation path of the laser scanning signal, for transmiting the laser scanning signal
To target object, and ultrasonic signal that the target object generates is reflected to the detecting module；
For the detecting module for detecting to the ultrasonic signal, converting the ultrasonic signal is electric signal；
The detecting module includes ultrasonic transducer, first gear, second gear and stepper motor unit；The stepper motor unit with
The first gear is fixedly connected, and the first gear is engaged with the second gear, and the second gear is changed with the ultrasound
Energy device is fixedly connected；
The signal processing module is electrically connected with the detecting module, for receiving and processing the electric signal, obtains institute
State the micro-image of target object.
Optionally, the first gear includes gear core piece and gear edge part, and the gear edge part is enclosed
Around the gear core piece, the gear core piece is connect with the stepper motor unit, the gear edge part with
The second gear occlusion；
The material of the gear core piece includes insulating materials, and the material of the gear edge part includes metal material
Material.
Optionally, the detecting module further includes radio frequency conductive slip ring, the radio frequency conductive slip ring include first part and
Second part, the first part and the rotatable electrical connection of the second part；
The first part is electrically connected with the ultrasonic transducer, and the second part is electrically connected with the signal processing module
It connects.
Optionally, the opto-acoustic microscopic imaging system further includes mechanical arm；
The Laser Modulation module, image-forming module and detector module are integrally disposed in one end of the mechanical arm.
Optionally, the laser emitting module includes laser source and laser transmission unit, and the laser transmission unit includes
Optical fiber, coaxial stents, condenser lens and three-dimensional adjuster；
The laser transmission unit is located at the laser signal exit end of the laser source, and connects with the Laser Modulation module
It connects；
Along the direction of propagation of the laser signal, the condenser lens, the light are disposed in the coaxial stents
Fine incidence end and the three-dimensional adjuster, the three-dimensional adjuster is fixedly connected with the incidence end of the optical fiber, described same
It is same that bracing strut is used to adjust the laser signal, the condenser lens, the incidence end of the optical fiber and the three-dimensional adjuster
Axis setting.
Optionally, the Laser Modulation module includes: collimation lens, two-dimensional scanning mirrors, scanning lens, vibrating mirror driver
And analog signal output device；
The incidence end of the collimation lens is connect with the exit end of the optical fiber, and the collimation lens is used for the optical fiber
Exit end outgoing laser signal collimation；
The incidence end of the two-dimensional scanning mirrors is connect with the exit end of the collimation lens, for modulating laser signal
Exit direction obtains laser scanning signal；
The exit end of the two-dimensional scanning mirrors is connect with the incidence end of the scanning lens, and the scanning lens is used for will
The laser scanning signal collimation of the exit end outgoing of the two-dimensional scanning mirrors and focusing；
The vibrating mirror driver is electrically connected with the two-dimensional scanning mirrors and the analog signal output device respectively, the mould
Quasi- signal output device is electrically connected with the signal processing module, the signal processing module pass through the analog signal output device to
The vibrating mirror driver transmission scanning galvanometer controls signal, and the vibrating mirror driver is for controlling the two-dimensional scanning mirrors modulation
The exit direction of laser signal.
Optionally, the image-forming module include container, the semi-transparent semi-reflecting unit being fixed on inside container and water-sealed bearing with
And positioned at the container close to the film and distance-sensor of the target object side；
Ultrasonic coupling agent is filled in the container；
The semi-transparent semi-reflecting unit reflects the target object for transmiting the laser scanning signal to target object
The ultrasonic signal of generation is to the ultrasonic transducer；
The water-sealed bearing is located at the inner wall position of the container side, and is fixedly connected with the ultrasonic transducer；
The target object and the film contacts；
The distance-sensor and the film are in the same plane, and the distance-sensor is for measuring the target
Object is at a distance from the film.
Optionally, the signal processing module includes signal processing unit and central processing unit；
The signal processing unit includes signal amplifier, bandpass filter and data collector, the signal amplifier
First end be electrically connected with the ultrasonic transducer, the first end of the second end of the signal amplifier and the bandpass filter
Electrical connection, the first end of the data collector are electrically connected with the second end of the bandpass filter, the data collector
Second end is electrically connected with the central processing unit.
Optionally, the opto-acoustic microscopic imaging system further includes signal generator；
The signal generator is electrically connected with the analog signal output device, the data collector and the laser source respectively
It connects.
Second aspect, the embodiment of the invention also provides a kind of opto-acoustic microscopic imaging methods, are suitable for described in first aspect
Any opto-acoustic microscopic imaging system, method includes the following steps:
The exit direction of step 1, control Laser Modulation module modulation laser signal, carries out entire scan to target object；
Step 2 receives the electric signal that the target object generates after laser signal scanning, and according to the telecommunications
Number obtain the pre-image of the target object；
Step 3, the target area that the target object is determined according to the characteristics of image in the pre-image；
Step 4, the control Laser Modulation module modulate target of the exit direction to the target object of laser signal
Region is scanned；
The electric signal that step 5, the target area for receiving the target object generate after laser signal scanning, and root
The target area image of the target object is obtained according to the electric signal；
The operation of step 6, repeating said steps 4 and step 5 obtains multiple target area images of the target area.
Technical solution provided in an embodiment of the present invention modulates the exit direction of laser signal by Laser Modulation module, obtains
Laser scanning signal is simultaneously scanned target object, and detecting module generates target object by laser scanning signal scanning
Ultrasonic signal is detected, and conversion ultrasonic wave signal is electric signal, and signal processing module receives and processes electric signal, obtains
The micro-image of target object.With the electric linear translation stage or electric rotary table for using big quality and volume in the prior art
Technical solution compare, technical solution provided in an embodiment of the present invention passes through and drives first using small-sized stepper motor unit
Gear and second gear rotation, and then the mode of ultrasonic transducer rotation is driven, greatly reduce opto-acoustic microscopic imaging system
Quality and volume, and with tradition machinery formula scanning method compared with, technical solution provided in an embodiment of the present invention by swash
Optical modulator module carries out optical scanner to target object, also shortens the imaging time to target object, in combination with stepping electricity
The high speed characteristics of machine unit make the image taking speed of every width micro-image be even more to have reached second grade.
Detailed description of the invention
Fig. 1 is a kind of structural schematic diagram of opto-acoustic microscopic imaging system provided in an embodiment of the present invention；
Fig. 2 is a kind of structural schematic diagram of first gear provided in an embodiment of the present invention；
Fig. 3 is a kind of structural schematic diagram of radio frequency conductive slip ring provided in an embodiment of the present invention；
Fig. 4 is a kind of flow diagram of opto-acoustic microscopic imaging method provided in an embodiment of the present invention；
Fig. 5 is a kind of schematic diagram of scan path provided in an embodiment of the present invention；
Fig. 6 is the schematic diagram of another scan path provided in an embodiment of the present invention.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just
Only the parts related to the present invention are shown in description, attached drawing rather than entire infrastructure.
Fig. 1 is a kind of structural schematic diagram of opto-acoustic microscopic imaging system provided in an embodiment of the present invention, as shown in Figure 1, this
Inventive embodiments provide opto-acoustic microscopic imaging system include laser emitting module 11, Laser Modulation module 12, image-forming module 13,
Detecting module 14 and signal processing module 15.Laser Modulation module 12 is connect with laser emitting module 11, for modulating laser
The exit direction of signal obtains laser scanning signal, and image-forming module 13 is located on the propagation path of laser scanning signal, for saturating
Laser scanning signal is penetrated to target object, and the ultrasonic signal that generates of reflectance target object is to detecting module 14, detecting module
14 for detecting ultrasonic signal, and conversion ultrasonic wave signal is electric signal.Detecting module 14 includes ultrasonic transducer
141, first gear 142, second gear 143 and stepper motor unit 144, stepper motor unit 144 and first gear 142 are fixed
Connection, first gear 142 are engaged with second gear 143, and second gear 143 is fixedly connected with ultrasonic transducer 141.Signal processing
Module 15 is electrically connected with detecting module 14, for receiving and processing electric signal, obtains the micro-image of target object.
Laser emitting module 11 issues pulsed laser signal, and Laser Modulation module 12 modulates the exit direction of laser signal,
Laser scanning signal is obtained, laser scanning signal passes through image-forming module 13 and is irradiated on target object, and target object is by laser
The irradiation of signal generates ultrasonic signal, and ultrasonic signal is reflected into detecting module 14, detecting module 14 by image-forming module 13
Ultrasonic signal being detected, and conversion ultrasonic wave signal is electric signal, signal processing module 15 receives and processes electric signal,
Obtain the micro-image of target object.Wherein, illustratively, ultrasonic transducer 141 is line focus ultrasonic transducer, laser scanning
Signal covers on target object along the line search coverage of ultrasonic transducer 141 under the modulation driving of Laser Modulation module 12
Run-down in range, then stepper motor unit 144 drives first gear 142 to rotate predetermined angle, and first gear 142 drives
Second gear 143 rotates, and second gear 143 drives ultrasonic transducer 141 to rotate predetermined angle, and the line of ultrasonic transducer 141 is visited
It surveys area coverage and also rotates predetermined angle, laser scanning signal is under the modulation driving of Laser Modulation module 12, in target
Scanning track on object also rotates predetermined angle, continues rotary ultrasonic energy converter 141, until scanning through entire target object
Imaging region, signal processing module 15 handle the electric signal received, obtain the micro-image of target object.Pass through step
It drives ultrasonic transducer 141 to move synchronously with laser scanning signal into electric motor units 144, it is super to guarantee that ultrasonic transducer 141 receives
The signal-to-noise ratio of acoustic signals.
Technical solution provided in an embodiment of the present invention modulates the exit direction of laser signal by Laser Modulation module 12,
It obtains laser scanning signal and target object is scanned, detecting module 14 passes through laser scanning signal scanning to target object
The ultrasonic signal of generation is detected, and conversion ultrasonic wave signal is electric signal, and signal processing module 15 receives and processes electricity
Signal obtains the micro-image of target object.With the electric linear translation stage for using big quality and volume in the prior art or
The technical solution of electric rotary table is compared, technical solution provided in an embodiment of the present invention, by utilizing small-sized stepper motor list
The mode that member 144 drives first gear 142 and second gear 143 to rotate, and then ultrasonic transducer 141 is driven to rotate, greatly
The quality and volume of opto-acoustic microscopic imaging system are reduced, and compared with the method for tradition machinery formula scanning, the present invention is implemented
The technical solution that example provides carries out optical scanner to target object by Laser Modulation module 12, also shortens to target object
Imaging time makes the image taking speed of every width micro-image be even more to reach in combination with the high speed characteristics of stepper motor unit 144
Second grade.
Fig. 2 is a kind of structural schematic diagram of first gear provided in an embodiment of the present invention, as shown in Fig. 2, optionally, first
Gear 142 includes gear core piece 1421 and gear edge part 1422, and gear edge part 1422 surrounds gear centre portion
Divide 1421, gear core piece 1421 is connect with stepper motor unit 144, and gear edge part 1422 is stung with second gear 143
It closes.The material of gear core piece 1421 includes insulating materials, and the material of gear edge part 1422 includes metal material.
Wherein, gear core piece 1421 can obstruct the interference letter of the generation of stepper motor unit 144 using insulating materials
Number it is transferred to ultrasonic transducer 141, to greatly reduce signal interference, improves ultrasonic transducer 141 and receive ultrasonic wave letter
Number signal-to-noise ratio.Gear edge part 1422 can reduce loss caused by friction using metal material.
Optionally, second gear 143 uses metal material, to reduce friction loss.
Optionally, first gear 142 is identical with the size of second gear 143, so that being driven by stepper motor unit 144
The process that ultrasonic transducer 141 rotates predetermined angle is easier.
Optionally, detecting module 14 further includes radio frequency conductive slip ring 145, and Fig. 3 is that one kind provided in an embodiment of the present invention is penetrated
The structural schematic diagram of frequency conducting slip ring, as shown in figure 3, radio frequency conductive slip ring 145 includes first part 1451 and second part
1452, first part 1451 and the rotatable electrical connection of second part 1452.First part 1451 is electrically connected with ultrasonic transducer 141
It connects, second part 1452 is electrically connected with signal processing module 15.
Wherein, make the signal wire of ultrasonic transducer 141 no longer with ultrasonic transducer using radio frequency conductive slip ring 145
141 rotations, avoid signal wire from winding, coiling and wire rod resulting from damage when solving 141 multiple rotations of ultrasonic transducer
Bad problem, it is ensured that ultrasonic transducer 141 being capable of high-speed rotation.
Shown in continuing to refer to figure 1, optionally, stepper motor unit 144 includes that stepper motor 1441 and stepper motor drive
Device 1442, stepper motor driver 1442 controls the parameters such as rotary step and the rotation speed of stepper motor unit 144, so that light
Sound micro imaging system is more flexible to the imaging of target object.Wherein, optionally, stepper motor driver 1442 individually controls
The parameters such as the rotary step of stepper motor unit 144 and rotation speed, alternatively, stepper motor driver 1442 and signal processing mould
Block 15 is electrically connected, and signal processing module 15 controls signal, stepper motor driver to 1442 transmission electrical machine of stepper motor driver
1442 control the parameters such as rotary step and the rotation speed of stepper motor unit 144 according to motor control signal.
Shown in continuing to refer to figure 1, optionally, opto-acoustic microscopic imaging system provided in an embodiment of the present invention further includes mechanical arm
16.Laser Modulation module 12, image-forming module 13 and detector module 14 are integrally disposed in one end of mechanical arm 16.
In the prior art, target object is directly placed on imaging port, the imaging port that target object is adjacent to, distance
It is non-adjustable, bubble can be generated under the polyethylene film of imaging end face in imaging process, bubble can block and dispersion laser scanning
Signal is to influence to be imaged.Opto-acoustic microscopic imaging system provided in an embodiment of the present invention is by Laser Modulation module 12, image-forming module
13 and detector module 14 be integrally disposed in one end of mechanical arm 16, compact structure is compact, and under the drive of mechanical arm at
As module 13 can with any angle close to target object, and can arbitrarily adjust between image-forming module 13 and target object away from
From to avoid generating bubble between image-forming module 13 and target object, raising imaging precision.
Shown in continuing to refer to figure 1, optionally, laser emitting module 11 includes laser source 111 and laser transmission unit 112,
Laser transmission unit 112 includes optical fiber 1121, coaxial stents 1122, condenser lens 1123 and three-dimensional adjuster 1124.Laser
Defeated unit 112 is located at the laser signal exit end of laser source 111, and connect with Laser Modulation module 12.Along the biography of laser signal
Direction is broadcast, condenser lens 1123, the incidence end 21 of optical fiber 1121 and three-dimensional adjuster are disposed in coaxial stents 1122
1124, three-dimensional adjuster 1124 is fixedly connected with the incidence end 21 of optical fiber 1121, coaxial stents 1122 for adjust laser signal,
Condenser lens 1123, the incidence end 21 of optical fiber 1121 and three-dimensional adjuster 1124 are coaxially disposed.
Illustratively, laser source 111 and coaxial stents 1122 are mountable together, and peace focuses saturating in coaxial stents 1122
Mirror 1123 and three-dimensional adjuster 1124.In the incidence end 21 of the fixed optical fiber 1121 in the center of three-dimensional adjuster 1124, optical fiber 1121
Single mode optical fiber can be selected.The laser signal that laser source 111 exports is focused by condenser lens 1123, in coupled into optical fibres 1121,
To be transmitted to Laser Modulation module 12.Laser signal is transmitted to Laser Modulation module 12 by optical fiber 1121, so that laser tune
The movement of molding block 12 is more flexible.
Optionally, laser source 111 is pulse laser, and the width of laser pulse is nanosecond.Pulse laser output
The Wavelength tunable of laser signal pass through since different target object is different to the trap of the laser of different wave length and adjust arteries and veins
The different laser signal of laser output wavelength is rushed, can be imaged for different target objects.Alternatively, being believed using laser
Number nonadjustable pulse laser of wavelength reduces the cost of opto-acoustic microscopic imaging system, can be selected for different target objects
The pulse laser of different wave length.
Shown in continuing to refer to figure 1, optionally, Laser Modulation module 12 includes: collimation lens 121, two-dimensional scanning mirrors
122, scanning lens 123, vibrating mirror driver 124 and analog signal output device 125.The incidence end and optical fiber of collimation lens 121
1121 exit end connection, the laser signal that collimation lens 121 is used to for the exit end of optical fiber 1121 being emitted collimate.Two-dimensional scanning
The incidence end of galvanometer 122 is connect with the exit end of collimation lens 121, for modulating the exit direction of laser signal, obtains laser
Scanning signal.The exit end of two-dimensional scanning mirrors 122 is connect with the incidence end of scanning lens 123, and scanning lens 123 is used for two
It ties up the laser scanning signal collimation of the exit end outgoing of scanning galvanometer 122 and focuses.Vibrating mirror driver 124 respectively with two-dimensional scanning
Galvanometer 122 and analog signal output device 125 are electrically connected, and analog signal output device 125 is electrically connected with signal processing module 15, signal
Processing module 15 transmits scanning galvanometer to vibrating mirror driver 124 by analog signal output device 125 and controls signal, vibrating mirror driver
124 modulate the exit direction of laser signal for controlling two-dimensional scanning mirrors 122.
Illustratively, optical fiber 1121 is connected to two-dimensional scanning vibration by the collimation lens 121 with laser signal corresponding wavelength
The incidence end of 122 shell of mirror, the exit end of two-dimensional scanning mirrors 122 are fixed with scanning lens 123.Collimation lens 121, two dimension are swept
Retouch galvanometer 122, scanning lens 123 can be integrally disposed in one end of mechanical arm 16 together with ultrasonic transducer 141 so that scanning
The midpoint of the search coverage of the central axis and ultrasonic transducer 141 of lens 123 coincides, while two-dimensional scanning mirrors 122 export
Laser scanning signal focus and ultrasonic transducer 141 search coverage on the same imaging end face, improve ultrasonic transduction
The signal-to-noise ratio for the ultrasonic signal that device 141 receives, to improve the image quality to target object.Two-dimensional scanning mirrors 122
It is controlled by vibrating mirror driver 124, vibrating mirror driver 124 is electrically connected with analog signal output device 125, analog signal output device 125
It is electrically connected with signal processing module 15, signal processing module 15 is transmitted by analog signal output device 125 to vibrating mirror driver 124
Scanning galvanometer controls signal, and vibrating mirror driver 124 controls signal control two-dimensional scanning mirrors 122 according to scanning galvanometer and modulates laser
The exit direction of signal.Wherein, multi-functional input-output card can be selected in analog signal output device 125, increases opto-acoustic microscopic imaging
The flexibility of system.
Target object is scanned by the way of mechanical scanning in the prior art, image taking speed is slower, due to machinery
The intrinsic drawback of scanning, physical scan area are generally higher than tested target object, have also dragged slowly image taking speed to a certain extent.
Opto-acoustic microscopic imaging system provided in an embodiment of the present invention modulates going out for laser signal using miniature two-dimensional scanning mirrors 122
It penetrates direction and obtains laser scanning signal, image taking speed is promoted by the method for optical scanner.
Shown in continuing to refer to figure 1, image-forming module 13 includes container 131, the semi-transparent semi-reflecting unit 132 being fixed on inside container
With water-sealed bearing 133 and positioned at container 131 close to the film 134 and distance-sensor 135 of target object side.Container 131
Interior to be filled with ultrasonic coupling agent 136, semi-transparent semi-reflecting unit 132 reflects mesh for transmission laser scanning signal to target object
Ultrasonic signal that object generates is marked to ultrasonic transducer 141.Water-sealed bearing 133 is located at 131 side inner wall position of container, and
It is fixedly connected with ultrasonic transducer 141, target object is contacted with film 134, and distance-sensor 135 is located at same with film 134
In plane, distance-sensor 135 is for measuring target object at a distance from film 134.
Illustratively, 131 inside of container is tiltedly embedded with semi-transparent semi-reflecting unit 132, and the material of semi-transparent semi-reflecting unit 132 is transparent
Inorganic macromolecule material, be transmissive to laser scanning signal and reflect ultrasonic wave signal, laser scanning signal is worn
It crosses image-forming module 13 to be irradiated on target object, and the ultrasonic signal that target object generates is reflexed into ultrasonic transducer 141.
Colourless ultrasonic coupling agent is filled in container 131, ultrasonic coupling agent can efficiently reduce ultrasonic signal
Decaying improves image quality to increase the signal-to-noise ratio of 141 received ultrasonic signal of ultrasonic transducer.
Water-sealed bearing 133 is provided at 131 side inner wall position of container, ultrasonic transducer 141 can be in water-sealed bearing 133
Inside is freely rotated, while guaranteeing that ultrasonic coupling agent will not be leaked out from ultrasonic transducer 141 and the junction of water-sealed bearing 133
Come, prevents ultrasonic coupling agent from ultrasonic transducer 141 and image-forming module 13 while to realize fixed ultrasonic transducer 141
Interface outflow, guarantee ultrasonic transducer 141 can under the driving of stepper motor unit 144 high-speed rotation.
Container 131 has film 134 and distance-sensor 135 close to target object side, and distance-sensor 135 can monitor
The distance between end face and object to be measured object is imaged, convenient for adjusting the position of image-forming module 13 in real time, wherein imaging end face is
The contact surface of image-forming module 13 and target object.When target object is imaged, target object and imaging end face can according at
As the suitable distance of demand holding, ultrasonic coupling agent is filled between target object and film 134, reduces declining for ultrasonic signal
Subtract.
Optionally, image-forming module 13 is fixed on mechanical arm 16, and mechanical arm 16 is electrically connected with signal processing module 15, is passed through
Signal processing module 15 controls the movement of mechanical arm 16, to realize the movement of image-forming module 13 any angle and pre-determined distance.
Shown in continuing to refer to figure 1, optionally, signal processing module 15 includes signal processing unit 151 and central processing list
Member 152.Signal processing unit 151 includes signal amplifier 1511, bandpass filter 1512 and data collector 1513, and signal is put
The first end 31 of big device 1511 is connect with ultrasonic transducer 141, the second end 32 and bandpass filter of signal amplifier 1511
1512 first end 33 is electrically connected, and the first end 35 of data collector 1513 is electrically connected with the second end 34 of bandpass filter 1512
It connects, the second end 36 of data collector 1513 is electrically connected with central processing unit 152.
Wherein, signal amplifier 1511 is used to amplify the electric signal of ultrasonic transducer 141, optionally, signal amplifier
1511 be low-noise signal amplifier, to reduce the interference of 1511 pairs of signal amplifier imagings.Bandpass filter 1512 is for filtering out
Interference signal improves the signal-to-noise ratio of the electric signal of ultrasonic transducer 141.Data collector 1513 is used for ultrasonic transducer 141
The electric signal of output is converted to digital signal, in order to which central processing unit 152 handles digital signal.
Optionally, in embodiments of the present invention, signal amplifier 1511 can pass through
Optionally, central processing unit 152 is computer, and computer is provided with acquisition control software and data processing is soft
Part, wherein Labview software can be used in acquisition control software, for controlling two-dimensional scanning vibration by analog signal output device 125
Mirror 122 modulates the exit direction of laser signal, and then is scanned to target object, control the drive of stepper motor unit 144 the
One gear 142 and second gear 143 rotate, and then drive the operating of ultrasonic transducer 141, and control laser source 111 exports
The triggering etc. of pulsed laser signal.Matlab software can be used in data processing software, for collecting to data collector 1513
Digital signal handled, reconstruct the image of target object.
Shown in continuing to refer to figure 1, optionally, opto-acoustic microscopic imaging system provided in an embodiment of the present invention further includes signal hair
Raw device 17.Signal generator 17 is electrically connected with analog signal output device 125, data collector 1513 and laser source 111 respectively.
Wherein, signal generator 17 is electrically connected with the signal of laser source 111 triggering port, coordinates analog signal for controlling
Follower 125, data collector 1513 and laser source 111 are run simultaneously, and improve photoacoustic imaging quality.
The opto-acoustic microscopic imaging system with optical resolution that the embodiment of the invention provides a kind of, by by Laser Modulation
Module 12, image-forming module 13 and detector module 14 are integrally disposed in one end of mechanical arm 16, and apparatus structure compact is realized
From any angle close to target object, to adapt to the position of target object, scene has wide range of applications, and can arbitrarily adjust imaging
The distance between module 13 and target object improve imaging to avoid generating bubble between image-forming module 13 and target object
Precision.It drives ultrasonic transducer 141 to move using volume very little and the cracking stepper motor unit 144 of speed, greatly improves
Image taking speed.
Based on same inventive concept, the embodiment of the invention also provides a kind of opto-acoustic microscopic imaging methods, are suitable for upper
Any opto-acoustic microscopic imaging system of embodiment offer, the explanation of same as the previously described embodiments or corresponding structure and term are provided
Details are not described herein, and Fig. 4 is a kind of flow diagram of opto-acoustic microscopic imaging method provided in an embodiment of the present invention, such as Fig. 4 institute
Show, method includes the following steps:
The exit direction of step 1, control Laser Modulation module modulation laser signal, carries out entire scan to target object.
Wherein, illustratively, Fig. 5 is a kind of schematic diagram of scan path provided in an embodiment of the present invention, as shown in figure 5,
Ultrasonic transducer 141 is line focus ultrasonic transducer, the imaging region of target object is provided in round, ultrasonic transducer 141
Search coverage be target object diameter 51, Laser Modulation module modulate laser signal exit direction, to target object
Diameter 51 is scanned, and after the completion of scanning, stepper motor unit 144 drives ultrasonic transducer 141 to rotate predetermined angle, at this point,
The search coverage of ultrasonic transducer 141 is the diameter 52 of target object, and Laser Modulation module modulates the exit direction of laser signal,
The diameter 52 of target object is scanned, until entire round imaging region is completed in scanning.
Step 2 receives the electric signal that target object generates after laser signal scans, and obtains mesh according to the electric signal
Mark the pre-image of object.
Wherein, central processing unit 152 handles the collected digital signal of data collector 1513, reconstructs mesh
The pre-image of object is marked, illustratively, pre-image is circle.
Step 3, the target area that the target object is determined according to the characteristics of image in pre-image.
Wherein, illustratively, central processing unit 152 carries out image dividing processing to pre-image, obtains specific target
Region, for example recognize the specific target areas of tumour.
Step 4, the control Laser Modulation module modulate target of the exit direction to the target object of laser signal
Region is scanned.
Wherein, the modulation track to laser signal is changed by Laser Modulation module, so that the scanning of laser signal hot spot
Region is only in specific target area.Illustratively, Fig. 6 is the signal of another scan path provided in an embodiment of the present invention
Figure is swept every time as shown in fig. 6, Laser Modulation module control laser scanning signal is scanned the target area of target object
The extended line for the scan path retouched passes through the center of circle 61 of target object imaging region, similarly with step 1, passes through stepper motor list
Member 144 drives ultrasonic transducer 141 to rotate predetermined angle, completes the scanning to the target area of target object.
The electric signal that step 5, the target area for receiving the target object generate after laser signal scanning, and root
The target area image of the target object is obtained according to the electric signal.
The operation of step 6, repeating said steps 4 and step 5 obtains multiple target area images of the target area.
In conclusion the embodiment of the invention provides a kind of opto-acoustic microscopic imaging methods, illustratively, in mechanical arm 16
Under drive, image-forming module 13 slowly close to target object, is imaged end face and is coated with ultrasonic coupling agent, in the work of distance-sensor 135
Under, imaging end face and target object keep suitable distance.Laser Modulation module modulates the exit direction of laser signal, in mesh
The search coverage coverage area run-down on object along ultrasonic transducer 141 is marked, then ultrasonic transducer 141 is in stepping electricity
A small predetermined angle is rotated under the drive of machine unit 144, it is small that the track of laser scanning signal consequently also rotates correspondence
Predetermined angle, successively execute, until entire imaging region is completed in scanning.Laser scanning signal is irradiated on target object, is produced
Raw ultrasonic signal, when scanning the ultrasonic signal that generates of each scan position semi-transparent half can be traveled to by ultrasonic coupling agent
The surface of anti-unit 132, is then reflected into the surface of ultrasonic transducer 141, thus ultrasonic signal is caught by ultrasonic transducer 141
It obtains.Radio frequency conductive slip ring 145 is electrically connected with ultrasonic transducer 141 and signal amplifier 1511 respectively, and ultrasonic transducer 141 will be adopted
The ultrasonic signal collected is converted to electric signal, and electric signal is transmitted by very low radio frequency conductive slip ring 145 is lost into low noise
In signal amplifier 1511, amplified electric signal is transferred to computer using 1512 filtering interference signals of bandpass filter
Data collector 1513 in be converted to digital signal, finally, digital signal by the software in central processing unit 152 at
Reason obtains the pre-image of entire round imaging region.Image dividing processing of the pre-image Jing Guo central processing unit 152 it
Afterwards, specific target area is obtained, the modulation track to laser signal is changed by Laser Modulation module, so that laser signal
Hot spot only scans the specific target area back and forth, to obtain the dynamic monitoring image data of target area.
Opto-acoustic microscopic imaging method provided in an embodiment of the present invention first obtains object in a manner of multi-angle diameter scans
Then the pre-image of body identifies specific target area, extract specific target area using image segmentation, pass through laser tune
Molding block changes to the modulation track of laser signal, so that the scanning area of laser signal hot spot is only in specific target area,
And then arbitrary specific target areas is carried out repeating rapidly to scan, achieve the effect that dynamic monitoring.Wherein, variable specific
Target area increases the flexibility of system, is only scanned to target area, greatly improves image taking speed, has fine
Time resolution, carry out quick multiple scanning for a long time for specific region, can realize dynamic imaging to target object
Monitoring has extensive potential applicability in clinical practice.
Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that
The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation,
It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention
It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also
It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.
Claims (10)
1. a kind of opto-acoustic microscopic imaging system, which is characterized in that including laser emitting module, Laser Modulation module, image-forming module,
Detecting module and signal processing module；
The Laser Modulation module is connect with the laser emitting module, for modulating the exit direction of laser signal, is swashed
Optical scanning signal；
The image-forming module is located on the propagation path of the laser scanning signal, for transmiting the laser scanning signal to mesh
Object is marked, and reflects ultrasonic signal that the target object generates to the detecting module；
For the detecting module for detecting to the ultrasonic signal, converting the ultrasonic signal is electric signal；It is described
Detecting module includes ultrasonic transducer, first gear, second gear and stepper motor unit；The stepper motor unit with it is described
First gear is fixedly connected, and the first gear is engaged with the second gear, the second gear and the ultrasonic transducer
It is fixedly connected；
The signal processing module is electrically connected with the detecting module, for receiving and processing the electric signal, obtains the mesh
Mark the micro-image of object.
2. opto-acoustic microscopic imaging system according to claim 1, which is characterized in that the first gear includes gear centre
Part and gear edge part, the gear edge part surround the gear core piece, the gear core piece and institute
The connection of stepper motor unit is stated, the gear edge part is engaged with the second gear；
The material of the gear core piece includes insulating materials, and the material of the gear edge part includes metal material.
3. opto-acoustic microscopic imaging system according to claim 1, which is characterized in that the detecting module further includes that radio frequency is led
Electric slip ring, the radio frequency conductive slip ring include first part and second part, and the first part and the second part can revolve
Turn electrical connection；
The first part is electrically connected with the ultrasonic transducer, and the second part is electrically connected with the signal processing module.
4. opto-acoustic microscopic imaging system according to claim 1, which is characterized in that further include mechanical arm；
The Laser Modulation module, image-forming module and detector module are integrally disposed in one end of the mechanical arm.
5. opto-acoustic microscopic imaging system according to claim 1, which is characterized in that the laser emitting module includes laser
Source and laser transmission unit, the laser transmission unit include optical fiber, coaxial stents, condenser lens and three-dimensional adjuster；
The laser transmission unit is located at the laser signal exit end of the laser source, and connect with the Laser Modulation module；
Along the direction of propagation of the laser signal, the condenser lens, the optical fiber are disposed in the coaxial stents
Incidence end and the three-dimensional adjuster, the three-dimensional adjuster are fixedly connected with the incidence end of the optical fiber, the coaxial branch
Frame is used to adjust the laser signal, the condenser lens, the incidence end of the optical fiber and the three-dimensional adjuster and coaxially sets
It sets.
6. opto-acoustic microscopic imaging system according to claim 5, which is characterized in that the Laser Modulation module includes: standard
Straight lens, two-dimensional scanning mirrors, scanning lens, vibrating mirror driver and analog signal output device；
The incidence end of the collimation lens is connect with the exit end of the optical fiber, and the collimation lens is used for going out the optical fiber
Penetrate the laser signal collimation for bringing out and penetrating；
The incidence end of the two-dimensional scanning mirrors is connect with the exit end of the collimation lens, for modulating the outgoing of laser signal
Direction obtains laser scanning signal；
The exit end of the two-dimensional scanning mirrors is connect with the incidence end of the scanning lens, and the scanning lens is used for will be described
The laser scanning signal collimation of the exit end outgoing of two-dimensional scanning mirrors and focusing；
The vibrating mirror driver is electrically connected with the two-dimensional scanning mirrors and the analog signal output device respectively, the simulation letter
Number follower is electrically connected with the signal processing module, and the signal processing module passes through the analog signal output device Xiang Suoshu
Vibrating mirror driver transmits scanning galvanometer and controls signal, and the vibrating mirror driver is for controlling the two-dimensional scanning mirrors modulation laser
The exit direction of signal.
7. opto-acoustic microscopic imaging system according to claim 1, which is characterized in that the image-forming module includes container, consolidates
The semi-transparent semi-reflecting unit and water-sealed bearing that are scheduled on inside container and positioned at the container close to the thin of the target object side
Film and distance-sensor；
Ultrasonic coupling agent is filled in the container；
The semi-transparent semi-reflecting unit reflects the target object and generates for transmiting the laser scanning signal to target object
Ultrasonic signal to the ultrasonic transducer；
The water-sealed bearing is located at the inner wall position of the container side, and is fixedly connected with the ultrasonic transducer；
The target object and the film contacts；
The distance-sensor and the film are in the same plane, and the distance-sensor is for measuring the target object
At a distance from the film.
8. opto-acoustic microscopic imaging system according to claim 6, which is characterized in that the signal processing module includes signal
Processing unit and central processing unit；
The signal processing unit includes signal amplifier, bandpass filter and data collector, and the of the signal amplifier
One end is electrically connected with the ultrasonic transducer, and the second end of the signal amplifier and the first end of the bandpass filter are electrically connected
It connecing, the first end of the data collector is electrically connected with the second end of the bandpass filter, and the second of the data collector
End is electrically connected with the central processing unit.
9. opto-acoustic microscopic imaging system according to claim 8, which is characterized in that further include signal generator；
The signal generator is electrically connected with the analog signal output device, the data collector and the laser source respectively.
10. a kind of opto-acoustic microscopic imaging method is suitable for opto-acoustic microscopic imaging system of any of claims 1-9,
Characterized by comprising the following steps:
The exit direction of step 1, control Laser Modulation module modulation laser signal, carries out entire scan to target object；
Step 2 receives the electric signal that the target object generates after laser signal scanning, and according to the electric signal
To the pre-image of the target object；
Step 3, the target area that the target object is determined according to the characteristics of image in the pre-image；
Step 4, the control Laser Modulation module modulate target area of the exit direction to the target object of laser signal
It is scanned；
The electric signal that step 5, the target area for receiving the target object generate after laser signal scanning, and according to institute
It states electric signal and obtains the target area image of the target object；
The operation of step 6, repeating said steps 4 and step 5 obtains multiple target area images of the target area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910650799.1A CN110353630A (en) | 2019-07-18 | 2019-07-18 | A kind of opto-acoustic microscopic imaging system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910650799.1A CN110353630A (en) | 2019-07-18 | 2019-07-18 | A kind of opto-acoustic microscopic imaging system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110353630A true CN110353630A (en) | 2019-10-22 |
Family
ID=68221051
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910650799.1A Pending CN110353630A (en) | 2019-07-18 | 2019-07-18 | A kind of opto-acoustic microscopic imaging system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110353630A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110960198A (en) * | 2019-11-06 | 2020-04-07 | 浙江大学 | Near-infrared two-region confocal microscopic imaging system based on multi-dimensional adjusting frame |
| CN114098637A (en) * | 2021-11-10 | 2022-03-01 | 南方科技大学 | Large-field-of-view photoacoustic microscopic imaging device and method |
| CN114451871A (en) * | 2022-04-13 | 2022-05-10 | 常州英诺激光科技有限公司 | Photoacoustic scanning imaging equipment, working method and image scanning method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102743191A (en) * | 2012-06-28 | 2012-10-24 | 华南师范大学 | Focusing rotary scanning photoacoustic ultrasonic blood vessel endoscope imaging device and focusing rotary scanning photoacoustic ultrasonic blood vessel endoscope imaging method |
| CN105011906A (en) * | 2015-06-11 | 2015-11-04 | 北京大学 | Photoacoustic computed tomography system combined with slip ring and tomographic method thereof |
| CN105769128A (en) * | 2016-05-06 | 2016-07-20 | 华南师范大学 | Integrated opto-acoustic, ultrasonic and opto-acoustic elastic endoscopic imaging device and method thereof |
| US20160235305A1 (en) * | 2009-01-09 | 2016-08-18 | Washington University | Miniaturized photoacoustic imaging apparatus including a rotatable reflector |
| CN106769876A (en) * | 2016-11-28 | 2017-05-31 | 电子科技大学 | The new scan method and its device of a kind of optical resolution photoacoustic microscope |
| CN107713994A (en) * | 2017-11-14 | 2018-02-23 | 电子科技大学 | Multi-modal optical imaging system |
| US20180055343A1 (en) * | 2016-08-24 | 2018-03-01 | Unist(Ulsan National Institute Of Science And Tech Nology) | Photoacoustic and ultrasonic endoscopy system including a coaxially configured optical and electromagnetic rotary waveguide assembly and implementation method thereof |
-
2019
- 2019-07-18 CN CN201910650799.1A patent/CN110353630A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160235305A1 (en) * | 2009-01-09 | 2016-08-18 | Washington University | Miniaturized photoacoustic imaging apparatus including a rotatable reflector |
| CN102743191A (en) * | 2012-06-28 | 2012-10-24 | 华南师范大学 | Focusing rotary scanning photoacoustic ultrasonic blood vessel endoscope imaging device and focusing rotary scanning photoacoustic ultrasonic blood vessel endoscope imaging method |
| CN105011906A (en) * | 2015-06-11 | 2015-11-04 | 北京大学 | Photoacoustic computed tomography system combined with slip ring and tomographic method thereof |
| CN105769128A (en) * | 2016-05-06 | 2016-07-20 | 华南师范大学 | Integrated opto-acoustic, ultrasonic and opto-acoustic elastic endoscopic imaging device and method thereof |
| US20180055343A1 (en) * | 2016-08-24 | 2018-03-01 | Unist(Ulsan National Institute Of Science And Tech Nology) | Photoacoustic and ultrasonic endoscopy system including a coaxially configured optical and electromagnetic rotary waveguide assembly and implementation method thereof |
| CN106769876A (en) * | 2016-11-28 | 2017-05-31 | 电子科技大学 | The new scan method and its device of a kind of optical resolution photoacoustic microscope |
| CN107713994A (en) * | 2017-11-14 | 2018-02-23 | 电子科技大学 | Multi-modal optical imaging system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110960198A (en) * | 2019-11-06 | 2020-04-07 | 浙江大学 | Near-infrared two-region confocal microscopic imaging system based on multi-dimensional adjusting frame |
| CN114098637A (en) * | 2021-11-10 | 2022-03-01 | 南方科技大学 | Large-field-of-view photoacoustic microscopic imaging device and method |
| CN114098637B (en) * | 2021-11-10 | 2023-07-04 | 南方科技大学 | Large-view-field photoacoustic microscopic imaging device and method |
| CN114451871A (en) * | 2022-04-13 | 2022-05-10 | 常州英诺激光科技有限公司 | Photoacoustic scanning imaging equipment, working method and image scanning method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110353630A (en) | A kind of opto-acoustic microscopic imaging system and method | |
| EP2946721B1 (en) | Device and method for optoacoustic imaging of an object | |
| CN104706323B (en) | High-speed large-view-field multi-spectral photoacoustic imaging method and device | |
| CN108606777B (en) | Photoacoustic computed tomography system based on adjustable focusing type optical fiber sensor | |
| CN107941708A (en) | Compact optical resolution ratio photoacoustic microscope based on micro electromechanical scanning galvanometer | |
| CN113397481B (en) | photoacoustic-OCT bimodal endoscopic imaging system and method based on optical fiber scanning | |
| CN106419803A (en) | Intravascular opto-acoustic absorption, elasticity, viscosity multimode imaging integrated endoscopy and imaging method | |
| US20220361842A1 (en) | Portable probe for photoacoustic tomography and real-time photoacoustic tomography device | |
| CN108742528A (en) | A kind of the fast linear cofocus scanning optoacoustic probe and its imaging method of no water coincidence | |
| CN114010151B (en) | Photoacoustic ultrasound multi-mode imaging system | |
| CN106821320A (en) | A kind of opto-acoustic microscopic imaging system | |
| JP2012024426A (en) | Measuring device | |
| CN115040083B (en) | Photoacoustic tomography and ultrasonic imaging system and method based on multiple ultrasonic transducers | |
| CN106691377A (en) | Photoacoustic microimaging adaptive scanning system and method | |
| CN110584615A (en) | Bimodal endoscopic imaging system | |
| CN113848184B (en) | Micro-cavity photoacoustic imaging system based on flexible substrate | |
| CN115844331A (en) | Multi-angle photoacoustic tomography system and method | |
| CN114129132A (en) | Large-field-of-view high-speed photoacoustic microscopic imaging device and method | |
| CN207768360U (en) | A kind of opto-acoustic microscopic imaging system | |
| CN115079167A (en) | Terahertz continuous wave three-dimensional tomography device and method | |
| CN216792006U (en) | Photoacoustic microscope system with high speed and large visual field | |
| CN115235996B (en) | Cambered surface photoacoustic microscopic imaging device and method based on swinging voice coil motor | |
| CN114305330A (en) | Portable photoacoustic microscopic imaging device applied to fat transplantation and imaging method thereof | |
| CN117687188A (en) | Time delay device, lattice Lu Nisen relaxation photoacoustic imaging method and system | |
| JP6305587B2 (en) | Photoacoustic wave receiving device, apparatus, and photoacoustic wave receiving method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191022 |