CN103048294A - Integrated multi-mode imaging method fusing ultrasonic imaging, photoacoustic imaging and optical coherence tomography and system employing same - Google Patents

Integrated multi-mode imaging method fusing ultrasonic imaging, photoacoustic imaging and optical coherence tomography and system employing same Download PDF

Info

Publication number
CN103048294A
CN103048294A CN2012105614496A CN201210561449A CN103048294A CN 103048294 A CN103048294 A CN 103048294A CN 2012105614496 A CN2012105614496 A CN 2012105614496A CN 201210561449 A CN201210561449 A CN 201210561449A CN 103048294 A CN103048294 A CN 103048294A
Authority
CN
China
Prior art keywords
imaging
lens
optical fiber
road optical
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012105614496A
Other languages
Chinese (zh)
Inventor
曾吕明
刘国栋
杨迪武
纪轩荣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangxi Science and Technology Normal University
Original Assignee
Jiangxi Science and Technology Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangxi Science and Technology Normal University filed Critical Jiangxi Science and Technology Normal University
Priority to CN2012105614496A priority Critical patent/CN103048294A/en
Publication of CN103048294A publication Critical patent/CN103048294A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention provides a portable multi-mode imaging method fusing photoacoustic imaging and optical coherence tomography and a system employing the same. The system consists of a laser diode, a drive power supply, a signal generator, a lock-in amplifier, a photoelectric detector, an optical fiber coupler, LEDs, a signal processor, a three-dimensional translation stage, optical fibers, a lens group, a reflector, a dichroic mirror, an optical path housing and a sample table, and can achieve independent optical coherence tomography or photoacoustic imaging and optical coherence tomography combined multi-mode imaging. According to the invention, a photoacoustic imaging system is miniaturized and combined with an optical coherence tomography system to form an integrated portable system so as to realize integration, miniaturization and practicability of two-mode imaging.

Description

Merge integrated multi-modality imaging method and the system thereof of ultrasonic imaging, photoacoustic imaging and optical coherent chromatographic imaging
Technical field
The present invention relates to a kind of multi-modality imaging technology, particularly relate to a kind of integrated multi-modality imaging method and system thereof that merges ultrasonic imaging, photoacoustic imaging and optical coherent chromatographic imaging.
Background technology
The single mode image technology can only come imaging according to the variation of the in a certain respect characteristic of sample, can not many-sidedly obtain abundant information and the internal association thereof of sample, has certain application limitation.Only reflect the acoustic impedance characteristic of sample such as ultrasonic imaging (Ultrasonic Imaging, USI), it has advantages of high-penetrability, but image contrast is very low, and easily causes erroneous judgement disconnected because the pseudoreflex phenomenon appears in example interface Multi reflection and secondary lobe interference; Photoacoustic imaging (Photoacoustic Imaging, PAI) only reflect that sample is to the Optical Absorption characteristic, it adopts broad band ultrasonic detector detection ultrasound wave to replace detecting scattered photon in the pure optical imagery, effectively avoided the strong scattering impact of sample on light, generally can reach 2-5 centimetre investigation depth, and resolution tens is to hundreds of micron amount; Optical coherent chromatographic imaging (Optical Coherence Tomography, OCT) only reflect that sample is to the scattering of light characteristic, but in general sample is very small to the variation of reflection of light rate, and along with the penetration depth of light increases, the strong scattering of light in sample causes its imaging space resolution to descend rapidly, generally can only reach the investigation depth of 1-5 millimeter, but several microns to tens microns of resolutions.
A kind of trend of current image technology development is multi-modality imaging, the image technology that is about to different modalities mutually combines to provide more abundant image information, such as the USI/PAI technology, but the acoustic impedance information of USI image sampling, but the optical absorption information of simultaneously PAI image sampling; PAI/OCT technology, but the optical absorption information of PAI image sampling, but the light scattering characteristic of simultaneously OCT image sampling.The single mode imaging can only observe an aspect information, and multi-modality imaging can observe the information of two even two above aspects simultaneously, and this is most important to the interaction between the different system in the research object.
Summary of the invention
Purpose of the present invention just provides a kind of integrated multi-modality imaging method and system thereof that merges ultrasonic imaging, photoacoustic imaging and optical coherent chromatographic imaging, it is portable integrated with the image technology of ultrasonic imaging, photoacoustic imaging and three kinds of difference in functionalitys of optical coherent chromatographic imaging, and the combination in any that can reach three kinds of image modes is used.
The integrated multi-modality imaging method of fusion ultrasonic imaging of the present invention, photoacoustic imaging and optical coherent chromatographic imaging may further comprise the steps:
1, the pulse laser of laser diode emission is radiated at after lens combination, dichronic mirror and lens combination focus on and inspires photoacoustic signal on the sample, and sonac receives photoacoustic signal, via gathering computing machine behind on-off circuit and the pre-process circuit;
2, the pulse voltage of impulse voltage generator emission is applied to through on-off circuit and inspires ultrasonic signal on the sonac, ultrasonic signal passes sample stage and is radiated on the sample and is reflected back, sonac receives ultrasound echo signal again, via gathering computing machine behind on-off circuit and the pre-process circuit;
3, the weak coherent laser that sends of light emitting diode is derived by optical fiber, be divided into two-way through fiber coupler, wherein one road light is derived by optical fiber for surveying light, be radiated on the sample after lens combination, dichronic mirror and lens combination focus on, reflection is by being radiated on the photodetector behind lens combination, dichronic mirror, lens combination, optical fiber, fiber coupler and the optical fiber;
4, continuous laser another Lu Guangwei reference light behind optical fiber and fiber coupler of sending of light emitting diode is radiated on the catoptron through optical fiber and lens combination, and reflection is by being radiated on the photodetector behind lens combination, optical fiber, fiber coupler and the optical fiber;
5, the interference light after the detection light that is reflected back and reference light are relevant is detected by photodetector, gathers the inlet signal processor behind lock-in amplifier;
6, the D translation platform drives the sample stage that upper surface is placed with sample and does two-dimension translational scanning.
Above-mentioned steps 1 and 6 can effectively be surveyed the photoacoustic signal that sample excitation goes out, and obtains the optical absorption characteristics of sample, realizes the photoacoustic imaging to sample.
Above-mentioned steps 2 and 6 can effectively be surveyed the ultrasonic echo of sample reflection, obtains the acoustic impedance characteristic of sample, realizes the ultrasonic imaging to sample.
Above-mentioned steps 3-6 can effectively survey the scattered photon of sample, obtains the light scattering characteristic of sample, realizes the optical coherent chromatographic imaging to sample.
The system of the integrated multi-modality imaging method of fusion ultrasonic imaging of the present invention, photoacoustic imaging and optical coherent chromatographic imaging, be made of control and processing unit, light splitting and focusing unit, described control and processing unit comprise laser diode, light emitting diode, photodetector, lock-in amplifier, computing machine, pre-process circuit, time schedule controller, impulse voltage generator, on-off circuit, sonac, D translation platform, sample stage; Described light splitting and focusing unit comprise optical fiber, fiber coupler, lens combination, catoptron, dichronic mirror, light path shell.
Described sonac, on-off circuit, pre-process circuit, computing machine successively wire connect, and described on-off circuit also is connected with the impulse voltage generator wire; Described time schedule controller is connected with laser diode, lock-in amplifier, impulse voltage generator difference wire; Described photodetector, lock-in amplifier, computing machine successively wire connect; Described computing machine is connected with D translation platform wire, and described D translation platform also is connected with catoptron, sample stage; Described fiber coupler is connected with light emitting diode, photodetector respectively by optical fiber.
Described lens combination can be formed by one or more lens combination respectively.
Described catoptron can be driven by the D translation platform and do the one dimension translation.
Be placed with sample on the described sample stage, and can do two-dimension translational by the drive of D translation platform.
The invention has the beneficial effects as follows:
(1) light source of the present invention adopts respectively light emitting diode and the laser diode of miniaturization, effectively raises portability and the practicality of system architecture;
(2) the present invention is combined into integrated multimodal systems with ultrasonic image-forming system, photoacoustic imaging system and optical coherence tomography system, realize the integral structure of three kinds of image modes, can survey simultaneously acoustic impedance characteristic, optical absorption characteristics and the light scattering characteristic of sample;
(3) the present invention is a unit with the light path part organic assembling of photoacoustic imaging and optical coherent chromatographic imaging, effectively reduces complexity and the instability of system architecture;
(4) ultrasonic imaging of the present invention and optical coherent chromatographic imaging all adopt dorsad detection mode, effectively raise operability and the scope of application of system, can be widely used in the fields such as film detection, gemstone testing, industrial flaw detection, medical image.
Description of drawings
Fig. 1 is structural representation of the present invention.
Embodiment
Embodiment 1
The structure of the present embodiment as shown in Figure 1, each element the name be called: 1, laser diode, 2, light emitting diode, 3, photodetector, 4, lock-in amplifier, 5, computing machine, 6, pre-process circuit, 7, time schedule controller, 8, impulse voltage generator, 9, on-off circuit, 10, sonac, 11, the D translation platform, 12, one road optical fiber, 13, two road optical fiber, 14, three road optical fiber, 15, four road optical fiber, 16, fiber coupler, 17, lens under the side, 18, lens on the side, 19, upper lens, 20, lower lens, 21, catoptron, 22, dichronic mirror, 23, the light path shell, 24, sample stage, 25, sample.
Wherein laser diode 1 is selected the 905D4S12X model of U.S. Laser Components company, and its pulse laser wavelength that sends is 905nm, and peak power is 140W; Light emitting diode 2 is selected the optical fiber output type super-radiance light emitting diode SLD-101 of the high light science and technology in Beijing, and centre wavelength is 750-1600nm, and spectrum width is 20-80nm, and output power is 0,2-25mW; The point focusing probe of frequency 7,5MHz centered by the sonac 10, its relative bandwidth is about 75%.
A kind of integrated multi-modality imaging method that merges ultrasonic imaging, photoacoustic imaging and optical coherent chromatographic imaging, it is characterized in that, the pulse laser of laser diode 1 emission inspires photoacoustic signal through being radiated at after upper lens 19, dichronic mirror 22 and 20 focusing of lower lens on the sample 25 on the sample stage 24, sonac 10 receives photoacoustic signal, advances computing machine 5 via on-off circuit 9 and pre-process circuit 6 rear collections; The pulse voltage of impulse voltage generator 8 emissions is applied on the sonac 10 through on-off circuit 9 and inspires ultrasonic signal, ultrasonic signal passes sample stage 24 and is radiated on the sample 25 and is reflected back, sonac 10 receives ultrasound echo signal again, advances computing machine 5 via on-off circuit 9 and pre-process circuit 6 rear collections; The weak coherent laser of light emitting diode 2 emissions is derived by two road optical fiber 13, be divided into two-way through fiber coupler 16, wherein one road light is derived by three road optical fiber 14 for surveying light, be radiated on the sample 25 after lens under the side 17, dichronic mirror 22 and lower lens 20 focus on, reflection is by being radiated on the photodetector 3 behind lens 17, three road optical fiber 14, fiber coupler 16 and four road optical fiber 15 under lower lens 20, dichronic mirror 22, the side; The weak coherent laser that light emitting diode 2 sends another Lu Guangwei reference light behind two road optical fiber 13 and fiber coupler 16, lens 18 are radiated on the catoptron 21 on one road optical fiber 12 and side, and reflection is by being radiated on the photodetector 3 behind lens on the side 18, one road optical fiber 12, fiber coupler 16 and four road optical fiber 15; Interference light after the detection light that is reflected back and reference light are relevant is detected by photodetector 3, gathers computing machine 5 behind lock-in amplifier 4, realizes the multi-modality imaging of the independent or combination in any of ultrasonic imaging, photoacoustic imaging and optical coherent chromatographic imaging.
The system of the integrated multi-modality imaging method of above-mentioned fusion ultrasonic imaging, photoacoustic imaging and optical coherent chromatographic imaging, be made of control and processing unit, light splitting and focusing unit, described control and processing unit comprise laser diode 1, light emitting diode 2, photodetector 3, lock-in amplifier 4, computing machine 5, pre-process circuit 6, time schedule controller 7, impulse voltage generator 8, on-off circuit 9, sonac 10, D translation platform 11, sample stage 24; Described light splitting and focusing unit comprise under one road optical fiber 12, two road optical fiber 13, three road optical fiber 14, four road optical fiber 15, fiber coupler 16, the side lens 18, upper lens 19, lower lens 20, catoptron 21, dichronic mirror 22, light path shell 23 on lens 17, the side, upper lens 19 place the top of dichronic mirror 22, lower lens 20 place the below of dichronic mirror 22, and lens 17 place the side of dichronic mirror 22 under the side; Sonac 10, on-off circuit 9, pre-process circuit 6, computing machine 5 successively wire connect, and on-off circuit 9 also is connected with impulse voltage generator 8 wires; Time schedule controller 7 is connected with laser diode 1, lock-in amplifier 4, impulse voltage generator 8 difference wires; Described photodetector 3, lock-in amplifier 4, computing machine 5 successively wire connect; Described computing machine 5 is connected with D translation platform 11 wires, described catoptron 21, sample stage 24 all with D translation platform 11 mechanical connections; Described fiber coupler 16 is connected with light emitting diode 2, photodetector 3 respectively by two road optical fiber 13, four road optical fiber 15.
Under the described side on lens 17, the side lens 18, upper lens 19, lower lens 20 formed by one or more lens combination respectively.
Described catoptron 21 can be driven by D translation platform 11 and do the one dimension translation.
Be placed with sample 25 on the described sample stage 24, and can do two-dimension translational by 11 drives of D translation platform.

Claims (3)

1. integrated multi-modality imaging method that merges ultrasonic imaging, photoacoustic imaging and optical coherent chromatographic imaging, it is characterized in that: the pulse laser of laser diode (1) emission is radiated on the sample (25) after upper lens (19), dichronic mirror (22) and lower lens (20) focus on and inspires photoacoustic signal, sonac (10) receives photoacoustic signal, via gathering computing machine (5) behind on-off circuit (9) and the pre-process circuit (6); The pulse voltage of impulse voltage generator (8) emission is applied on the sonac (10) through on-off circuit (9) and inspires ultrasonic signal, ultrasonic signal passes sample stage (24), and to be radiated sample (25) upper and be reflected back, sonac (10) receives ultrasound echo signal again, via gathering computing machine (5) behind on-off circuit (9) and the pre-process circuit (6); The weak coherent laser of light emitting diode (2) emission is derived by two road optical fiber (13), be divided into two-way through fiber coupler (16), wherein one road light is derived by three road optical fiber (14) for surveying light, be radiated on the sample (25) after lens under the side (17), dichronic mirror (22) and lower lens (20) focus on, reflection is by being radiated on the photodetector (3) behind lens (17), three road optical fiber (14), fiber coupler (16) and four road optical fiber (15) under lower lens (20), dichronic mirror (22), the side; The weak coherent laser that light emitting diode (2) sends another Lu Guangwei reference light behind two road optical fiber (13) and fiber coupler (16), be radiated on the catoptron (21) through lens (18) on one road optical fiber (12) and the side, reflection is by being radiated on the photodetector (3) behind lens on the side (18), one road optical fiber (12), fiber coupler (16) and four road optical fiber (15); Interference light after the detection light that is reflected back and reference light are relevant is detected by photodetector (3), behind lock-in amplifier (4), gather computing machine (5), realize the multi-modality imaging of the independent or combination in any of ultrasonic imaging, photoacoustic imaging and optical coherent chromatographic imaging.
2. realize fusion ultrasonic imaging claimed in claim 1 for one kind, the system of the integrated multi-modality imaging method of photoacoustic imaging and optical coherent chromatographic imaging, by control and processing unit, light splitting and focusing unit consist of, and it is characterized in that: described control and processing unit comprise laser diode (1), light emitting diode (2), photodetector (3), lock-in amplifier (4), computing machine (5), pre-process circuit (6), time schedule controller (7), impulse voltage generator (8), on-off circuit (9), sonac (10), D translation platform (11), sample stage (24); Described light splitting and focusing unit comprise under one road optical fiber (12), two road optical fiber (13), three road optical fiber (14), four road optical fiber (15), fiber coupler (16), the side lens (18), upper lens (19), lower lens (20), catoptron (21), dichronic mirror (22), light path shell (23) on lens (17), the side, upper lens (19) place the top of dichronic mirror (22), lower lens (20) place the below of dichronic mirror (22), and lens under the side (17) place the side of dichronic mirror (22); Sonac (10), on-off circuit (9), pre-process circuit (6), computing machine (5) successively wire connect, and on-off circuit (9) also is connected with impulse voltage generator (8) wire; Time schedule controller (7) is connected with laser diode (1), lock-in amplifier (4), impulse voltage generator (8) difference wire; Described photodetector (3), lock-in amplifier (4), computing machine (5) successively wire connect; Described computing machine (5) is connected with D translation platform (11) wire, described catoptron (21), sample stage (24) all with D translation platform (11) mechanical connection; Described fiber coupler (16) is connected with light emitting diode (2), photodetector (3) respectively by two road optical fiber (13), four road optical fiber (15).
3. the system of the integrated multi-modality imaging method of fusion ultrasonic imaging according to claim 2, photoacoustic imaging and optical coherent chromatographic imaging, it is characterized in that: lens (18), upper lens (19), lower lens (20) are formed by one or more lens combination respectively on lens under the described side (17), the side.
CN2012105614496A 2012-12-21 2012-12-21 Integrated multi-mode imaging method fusing ultrasonic imaging, photoacoustic imaging and optical coherence tomography and system employing same Pending CN103048294A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2012105614496A CN103048294A (en) 2012-12-21 2012-12-21 Integrated multi-mode imaging method fusing ultrasonic imaging, photoacoustic imaging and optical coherence tomography and system employing same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012105614496A CN103048294A (en) 2012-12-21 2012-12-21 Integrated multi-mode imaging method fusing ultrasonic imaging, photoacoustic imaging and optical coherence tomography and system employing same

Publications (1)

Publication Number Publication Date
CN103048294A true CN103048294A (en) 2013-04-17

Family

ID=48061013

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012105614496A Pending CN103048294A (en) 2012-12-21 2012-12-21 Integrated multi-mode imaging method fusing ultrasonic imaging, photoacoustic imaging and optical coherence tomography and system employing same

Country Status (1)

Country Link
CN (1) CN103048294A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104188625A (en) * 2014-08-20 2014-12-10 上海交通大学 Multimodal microscopic imaging system
CN106529483A (en) * 2016-11-16 2017-03-22 南昌洋深电子科技有限公司 High-resolution photoacoustic microscopic imaging identity recognition system and recognition method thereof
CN107411708A (en) * 2017-05-22 2017-12-01 上海交通大学 A kind of optical coherence tomography and photoacoustic imaging bimodal endoscope
CN107713994A (en) * 2017-11-14 2018-02-23 电子科技大学 Multi-modal optical imaging system
CN108760048A (en) * 2018-04-13 2018-11-06 中国科学院西安光学精密机械研究所 Optical coherence microspectrum imaging detecting device based on acousto-optic tunable filter
CN109446118A (en) * 2018-09-14 2019-03-08 天津大学 Expansible multi-modal chromatographic imaging system based on cpci bus
CN113030249A (en) * 2021-03-11 2021-06-25 天津大学 Multi-mode configurable wideband ultrasound tomography system
CN114264612A (en) * 2022-01-05 2022-04-01 东北大学秦皇岛分校 PAI-OCT dual-mode imaging system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
SHULIANG JIAO 等: "hotoacoustic ophthalmoscopy for in vivo retinal imaging", 《OPTICS EXPRESS》 *
YI YANG 等: "Integrated optical coherence tomography,ultrasound and photoacoustic imaging for ovarian tissue characterization", 《BIOMEDICAL OPTICS EXPRESS》 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104188625A (en) * 2014-08-20 2014-12-10 上海交通大学 Multimodal microscopic imaging system
CN104188625B (en) * 2014-08-20 2016-03-16 上海交通大学 A kind of multi-modal micro imaging system
CN106529483A (en) * 2016-11-16 2017-03-22 南昌洋深电子科技有限公司 High-resolution photoacoustic microscopic imaging identity recognition system and recognition method thereof
CN107411708A (en) * 2017-05-22 2017-12-01 上海交通大学 A kind of optical coherence tomography and photoacoustic imaging bimodal endoscope
CN107713994A (en) * 2017-11-14 2018-02-23 电子科技大学 Multi-modal optical imaging system
CN108760048A (en) * 2018-04-13 2018-11-06 中国科学院西安光学精密机械研究所 Optical coherence microspectrum imaging detecting device based on acousto-optic tunable filter
CN108760048B (en) * 2018-04-13 2024-01-30 中国科学院西安光学精密机械研究所 Optical coherence micro-spectrum imaging detection device based on acousto-optic tunable filter
CN109446118A (en) * 2018-09-14 2019-03-08 天津大学 Expansible multi-modal chromatographic imaging system based on cpci bus
CN109446118B (en) * 2018-09-14 2021-11-05 天津大学 Extensible multi-modal tomography system based on CPCI bus
CN113030249A (en) * 2021-03-11 2021-06-25 天津大学 Multi-mode configurable wideband ultrasound tomography system
CN114264612A (en) * 2022-01-05 2022-04-01 东北大学秦皇岛分校 PAI-OCT dual-mode imaging system

Similar Documents

Publication Publication Date Title
CN103048294A (en) Integrated multi-mode imaging method fusing ultrasonic imaging, photoacoustic imaging and optical coherence tomography and system employing same
CN103048271A (en) Portable type bi-modal imaging method employing combined photoacoustic imaging and optical coherence tomography and system of method
CN104188625B (en) A kind of multi-modal micro imaging system
CN102636434A (en) Portable three-dimensional visual photoacoustic imaging system
CN103654867B (en) Imaging probe and there is the imaging device of this imaging probe
CN105784599B (en) A kind of opto-acoustic imaging devices and its imaging method based on graphene
CN105050485A (en) Compact laser and efficient pulse delivery for photoacoustic imaging
CN102944521B (en) Non-contact photoacoustic and optical coherence tomography dual-imaging device and detection method thereof
CN106442394A (en) Terahertz near-field imaging system and terahertz near-field imaging method
CN107713994A (en) Multi-modal optical imaging system
WO2015010409A1 (en) Intravascular photoacoustic and ultrasonic dual-mode imaging system and imaging method thereof
JP2009528091A (en) Scanning beam imager and endoscope configured for scanning a beam of a selected beam shape and / or providing multiple fields of view
CN110367941B (en) Detection light fusion non-contact photoacoustic-optical coherence tomography dual-mode imaging system
CN106983494B (en) Multi-modality imaging system and imaging method thereof
CN102636435A (en) Visible photo-acoustic imaging system based on three-dimensional dynamic focusing laser galvanometer scanning
CN103200875A (en) Photoacoustic imaging apparatus and operating method therefor
CN115494479B (en) Single photon radar system based on pulse sequence extraction and 3D imaging method
CN103054610B (en) Photoacoustic imaging device free of limitation of ultrasonic transducer frequency bands and detection method of photoacoustic imaging device
CN103054558A (en) Integrated handheld opto-acoustic microscope imaging probe
CN110031865A (en) A kind of vegetation detection binary channels fluorescent laser radar system
CN102488494A (en) Totally internal reflection type photo-acoustic microscopic imaging system and method
CN201207035Y (en) Light acoustic imaging apparatus based on multi-element phase-controlled focus ring array
CN112213737A (en) Long-distance photon counting three-dimensional laser radar imaging system and method thereof
CN1175784C (en) Optically Chronatographic imaging method and equipment with focusing, ultraconic wave and modulation
CN106772420A (en) The continuous ray laser radar system of EO-1 hyperion of finely ground particles detection under water

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20130417