CN104224127A - Optical projection tomography device and method based on camera array - Google Patents

Optical projection tomography device and method based on camera array Download PDF

Info

Publication number
CN104224127A
CN104224127A CN201410475970.7A CN201410475970A CN104224127A CN 104224127 A CN104224127 A CN 104224127A CN 201410475970 A CN201410475970 A CN 201410475970A CN 104224127 A CN104224127 A CN 104224127A
Authority
CN
China
Prior art keywords
array
camera array
camera
projection
dynamic range
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410475970.7A
Other languages
Chinese (zh)
Inventor
王晓蕊
李凌澄
张思伟
黄曦
刘德连
董维科
张建奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xidian University
Original Assignee
Xidian University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xidian University filed Critical Xidian University
Priority to CN201410475970.7A priority Critical patent/CN104224127A/en
Publication of CN104224127A publication Critical patent/CN104224127A/en
Pending legal-status Critical Current

Links

Abstract

The invention provides an optical projection tomography device and a method based on a camera array. A light source array and the camera array are utilized to realize two-dimensional projection images of different exposures of an organism, and high-quality reconstruction of a three-dimensional image of a biological sample is realized through a high dynamic range imaging technique and a filter back projection algorithm. According to the optical projection tomography device and the method based on the camera array, an imaging module mainly comprises a scanning acquisition module and a data processing module, wherein the scanning acquisition module mainly comprises: (1) a light source module formed by the light source array, an optical lens, a beam expander and a polarizer; (2) a biological sample platform formed by a stepping motor rotating platform and a sample clamping device; (3) a two-dimensional projection image acquisition module formed by a microscope, the camera array, a polarization analyzer and a filter plate; the data processing module mainly comprises: (1) high dynamic range image synthesis; (2) rotary center position correction; (3) filter back projection three-dimensional reconstruction.

Description

Based on optical projection fault imaging device and the method for camera array
Technical field
The invention belongs to technical field of imaging, especially relate to a kind of optical projection fault imaging device based on camera array and method, can be used for the biological tissue of 1mm to 10mm, the evaluation and test of the curative effect of medication of organ and embryo and gene expression etc. the research of aspect
Background technology
The feature that optical projection fault imaging (OPT) technology utilizes visible ray linearly to propagate in small size biology, transmitted beam penetrates sample and obtains projection, carries out anatomical structure three-dimensional imaging (transmission-type OPT), is similar to X-ray CT.OPT imaging technique has micron-sized spatial resolution, the visual field of 1-10mm, and have the features such as micron-sized spatial resolution, radiationless, cost is low, the high resolution three-dimensional imaging for small size biological specimen provides a kind of new effective means.But it is unintelligible still to there is imaging samples details in OPT imaging, sample scatter, the problems such as dynamic imaging in vivo cannot be completed, need further to improve, the present invention can data acquisition faster, institute's acquisition of image data details is more clear, meets the requirement of the dynamic imaging in vivo of biological specimen further.In the optical projection computed tomography (SPECT) system of Tian Jie team of Chinese Academy of Sciences independent research, see that Guo enters, Liu Xia, Dong Di, Zhu Shouping, Yang Xin, Tian Jie. live body optical projection computed tomography (SPECT) system and application. automatization's journal, 2013,39 (12): 2043-2050, although achieve the live body three-dimensional imaging for small mode animals such as fruit bat pupas, spatial resolution reaches 10um, but axis information is clear not, and can only for small mode animal imagings such as fruit bat pupas, second-rate for the imaging samples absorbing isomery, the requirement of dynamic imaging in vivo can not be met.
With reference to Fig. 2, traditional optical projection fault imaging, comprises high-power white light-emitting diode 20, beam expander 21, aperture 22, telecentric light lens 23, sample 24, object lens 25, CMOS camera 26.Its image-forming principle is: send visible ray by high-power white light-emitting diode 20, is irradiated on beam expander 21, and light is irradiated on telecentric lens 23 by becoming uniform light spots after beam expander 21 and aperture 22, projects on biological specimen.After on radiation of visible light to sample 24, a part of light is absorbed by biological specimen, scattering, and a part is through biological specimen.Transillumination is imaged on CMOS camera 26 through object lens 25, and CMOS camera 26 collects transillumination with certain frame frequency.Biological specimen 24 is by a gripper on motor, and motor rotates with a fixed step size angle, often rotates once, and CMOS camera just gathers once from the light that sample transmission is come.Finally, motor rotates a circle with biological specimen, and camera completes biological specimen 360 degree of omnidirectional shootings, obtains one group of two-dimensional transmission figure of sample.Transmission plot is imported in computer, after calculating sample center of rotation, adopt filtered back projection technique (FBP), first two-dimensional projection image is transformed to frequency domain, after ramp function filtering, carry out the back projection of 360 degree in inverse transformation to time domain, correct according to calculated center of rotation in the process of rebuilding simultaneously, obtain the three-dimensional reconstruction image of biological specimen.
But, traditional optical projection fault imaging is to the restriction of two-dimensional transmission image formed by biological specimen due to the absorption isomery characteristic of biological specimen and the dynamic range of camera, part imaging effect for sample different-thickness is different, cause reconstructed results undesirable, sample 3-D view details is unintelligible, and the region even had cannot imaging.
Based on this, provide a kind of optical projection Laminographic device and technology to overcome the above problems and just seem particularly necessary.
Summary of the invention
For solving above-mentioned prior art Problems existing, the object of the present invention is to provide a kind of optical projection fault imaging device based on camera array and method, several low dynamic range echogramses synthesis details HDR figure clearly can be applied, and the imaging of the biological specimen absorbing isomery characteristic can be completed by controlling time of exposure, and owing to using camera array, effectively improve the acquisition rate of low dynamic range echograms, the dynamic imaging in vivo of biological specimen can be realized.Utilize array of source and camera array to realize the two-dimension projection exposed the difference of organism, and the high-quality being realized the 3-D view of biological specimen by high dynamic range imaging technology and filter back-projection algorithm is rebuild.
For achieving the above object, technical scheme of the present invention is:
Based on the optical projection fault imaging device of camera array,
The described optical projection fault imaging device based on camera array, with reference to Fig. 1, its image-forming module is divided into two large modules:
One, scanning collection module:
Comprise: 1, light source module: by array of source, optical lens, beam expander and polarizer composition; 2, biological specimen platform: by motor rotation platform, sample clamping device is formed; 3, two-dimension projection acquisition module: be made up of microscope and camera array, analyzer;
Two, data processing module:
Comprise: 1, high dynamic range images synthesis; 2, center of rotation position correction; 3, filtered back projection's three-dimensional reconstruction;
Array of source is positioned over the original position of light path, after CMOS camera array is placed on object lens, light source cell in array of source and relevant beam expander unit, polarizer unit, analyzer unit, camera unit in object lens and camera array becomes one-to-one relationship, and each imaging optical path does not interfere with each other, to ensure the Quick Acquisition of the low dynamic range echograms of different exposure time.
Further, described array of source, the N number of light source cell identical with the characteristics of luminescence by parameter forms, the characteristics of luminescence identical with the low dynamic range echograms ensureing the same angle different exposure time when imaging only with time of exposure for unitary variant, and the light that each unit sends is different through polarizer rear polarizer angle, to ensure not interfere with each other when imaging.
Further, described camera array, is made up of model, N number of CMOS camera unit that parameter is identical with imaging characteristic, consistent to ensure the imaging characteristic of system, and controlled the aperture time of camera unit by control software design, carry out the collection of the image of different time of exposure.
Further, by the step angle of motor in setting sample platform, to make between camera unit, relative to the multiple that the angle of sample is motor step angle, to make each camera unit in camera array can both photograph the projection of the same angle of sample.
Further, when single camera unit gathers image at every turn, time of exposure is certain, between camera unit, time of exposure is different, by using different cameral collection to the same angle of sample, obtain the different low dynamic range echograms of same angle, best region in different exposure time hypograph in the low dynamic range echograms of same angle is synthesized, obtains the high dynamic range images of this angle.
Utilize the optical projection tomography method based on camera array of above-mentioned arbitrary device, utilize array of source and camera array to realize the two-dimension projection exposed the difference of organism, and realize the three-dimensional image superior quality reconstruction of biological specimen by high dynamic range imaging technology and filter back-projection algorithm.Relative to prior art, beneficial effect of the present invention is:
1) the present invention arranges controllable exposure time camera array owing to have employed collection terminal, realizes optical projection tomography technology, can complete the collection of the low-dynamic range two-dimension projection of different exposure time in same time relative to single camera collection.
2) owing to camera array and high dynamic imaging techniques being combined, final three-dimensional reconstruction image details is clear, and the less requirement that can meet live body real-time optical tomography further of interference of stray light, is more conducive to the realization of dynamic imaging in vivo.
Accompanying drawing explanation
Fig. 1 is Irnaging procedures figure of the present invention.
Fig. 2 is traditional optical projection fault imaging schematic diagram.
Fig. 3 is structural representation of the present invention.
Detailed description of the invention
For setting forth the present invention further for the technological means reaching predetermined goal of the invention and take and effect, below in conjunction with accompanying drawing, to according to the present invention propose based on the optical projection fault imaging device of camera array and the structure of method, method and characteristic are described in detail.But accompanying drawing is only description of the invention to be provided with reference to the use with explanation, is not be construed as limiting the present invention.
For realizing the quick of optical projection fault imaging and high dynamic range imaging, the comprehensive camera array imaging of the present invention, high dynamic range imaging and optical projection fault imaging, propose a kind of optical projection fault imaging device based on camera array and method, as shown in Figure 3.
With reference to Fig. 3, the optical projection fault imaging device based on camera array that the present invention proposes and method, comprise high-power diode array of source 30, beam expander 31, the polarizer 32, telecentric lens 33, sample 34, analyzer 35, object lens 36, CMOS camera array 37.Wherein, in array of source 30, each light source cell sends the visible ray of different wave length, can not produce interference effect during to ensure to be irradiated on sample at the same time.The effect of the polarizer 32 is that the light that light source is sent becomes polarized light after the polarizer, polarized light is after projecting on biological specimen, due to the scattering properties of sample biological tissue, only have and directly keep polarizing angle degree transmitted through the trajectory luminous energy of sample, part changes through the light beam polarization characteristic of sample scatter, after analyzer 35, only have trajectory light to pass analyzer, all the other veiling glares are stopped by analyzer.CMOS camera array 37 controls its shutter speed by control system, and different cameral unit shutter speed is different, controlling time of exposure, can realize the data acquisition of the high dynamic range imaging of sample by controlling shutter speed.
The image-forming principle of said system is as follows:
In high-power diode array of source 30, Different Light unit sends white light separately, visible ray becomes even after beam expander, rise through polaroid and to the rearly become polarized light, uniform parallel light beam is become after telecentric lens 33, be irradiated on sample, visible ray is through the absorption of biological specimen and scattering, some light from sample behind through, comprising a part directly transmitted through the transillumination of sample, namely scattering and the Absorption of sample is not subject at sample interior, directly through the trajectory light of sample, another part is after sample Multiple Scattering, irradiate out behind from sample, this a part of veiling glare, the image quality of meeting severe jamming two-dimension projection, cause sample soft edge in X-Y scheme, details is unclear, can the serious reconstruction effect reducing final three-dimensional reconstruction.Because illumination light becomes polarized light after the polarizer, therefore transmitted through the trajectory light polarization angle of sample can not change, and the veiling glare after sample scatter, polarization characteristic changes, after analyzer, veiling glare can by filtering, only have trajectory light to be passed through, suppress the effect of veiling glare in this approach, improve image quality.Light beam is imaged in CMOS camera array 37 through object lens afterwards.The shutter speed of the CMOS camera controlled corresponding to Different Light by control software design controls time of exposure, not in the same time Different Light respectively exposure 10ms is carried out, 20ms to the same angle of biological specimen, 40ms, 80ms, 120ms, 160ms, obtains the low dynamic range echograms of each angle of sample.Under different exposure time, the two-dimension projection that CMOS camera records is due to the absorption isomery characteristic of sample, and time of exposure is shorter, and sample permeability good part axis information is more clear, and time of exposure is longer, and the part axis information of permeability difference is more clear.By camera unit in accurate Calculation motor rotary step and camera array relative to the relation of the angle of sample, chosen steps motor rotary step is to meet the same angle of sample by rotating by different cameral imaging.Motor often rotates once, and each camera gathers a secondary data according to respective time of exposure, and therefore rotation steps required time must be greater than the longest time of exposure.After motor rotates a circle, 360 degree of two-dimension projection collections of the complete paired samples of camera array.According to high dynamic range imaging method, on computers the two-dimension projection gathered under same for sample angle different exposure time is extracted, final details high-dynamics image is clearly synthesized by utilizing the low dynamic range echograms of the corresponding best details of each time of exposure, then by calculating the center of rotation of the high Dynamic Two-dimensional projection obtained, adopt filtered back projection technique (FBP), first two-dimensional projection image is transformed to frequency domain, after ramp function filtering, inverse transformation carries out the back projection of 360 degree to time domain again, correct according to calculated center of rotation in the process of rebuilding simultaneously, obtain the three-dimensional reconstruction image of biological specimen.The present invention effectively can strengthen the imaging effect of the sample of reconstruction, has researched and proposed new road, better can complete medicine curative effect evaluation, the research of gene expression for biological tissue's organ of 1mm to 10mm yardstick and the dynamic of embryo at body.
The above, be only the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, and any change of expecting without creative work or replacement, all should be encompassed within protection scope of the present invention.Therefore, the protection domain that protection scope of the present invention should limit with claims is as the criterion.

Claims (6)

1., based on the optical projection fault imaging device of camera array, it is characterized in that,
The described optical projection fault imaging device based on camera array, its image-forming module is divided into two large modules:
One, scanning collection module:
Comprise: 1, light source module: by array of source, optical lens, beam expander and polarizer composition; 2, biological specimen platform: by motor rotation platform, sample clamping device is formed; 3, two-dimension projection acquisition module: be made up of microscope and camera array, analyzer;
Two, data processing module:
Comprise: 1, high dynamic range images synthesis; 2, center of rotation position correction; 3, filtered back projection's three-dimensional reconstruction;
Array of source is positioned over the original position of light path, after CMOS camera array is placed on object lens, light source cell in array of source and relevant beam expander unit, polarizer unit, analyzer unit, camera unit in object lens and camera array becomes one-to-one relationship, and each imaging optical path does not interfere with each other, to ensure the Quick Acquisition of the low dynamic range echograms of different exposure time.
2. optical projection fault imaging device according to claim 1, it is characterized in that, described array of source, the N number of light source cell identical with the characteristics of luminescence by parameter forms, the characteristics of luminescence identical with the low dynamic range echograms ensureing the same angle different exposure time when imaging only with time of exposure for unitary variant, and the light that each unit sends is different through polarizer rear polarizer angle, to ensure not interfere with each other when imaging.
3. optical projection fault imaging device according to claim 1, it is characterized in that, described camera array, be made up of model, N number of CMOS camera unit that parameter is identical with imaging characteristic, consistent to ensure the imaging characteristic of system, and controlled the aperture time of camera unit by control software design, carry out the collection of the image of different time of exposure.
4. optical projection fault imaging device according to claim 1, it is characterized in that, by the step angle of motor in setting sample platform, to make between camera unit, relative to the multiple that the angle of sample is motor step angle, to make each camera unit in camera array can both photograph the projection of the same angle of sample.
5. optical projection fault imaging device according to claim 1, it is characterized in that, when single camera unit gathers image at every turn, time of exposure is certain, between camera unit, time of exposure is different, by using different cameral collection to the same angle of sample, obtain the different low dynamic range echograms of same angle, the best region in different exposure time hypograph in the low dynamic range echograms of same angle is synthesized, obtain the high dynamic range images of this angle.
6. utilize the optical projection tomography method based on camera array of device described in above-mentioned arbitrary claim, it is characterized in that, utilize array of source and camera array to realize the two-dimension projection exposed the difference of organism, and realize the three-dimensional image superior quality reconstruction of biological specimen by high dynamic range imaging technology and filter back-projection algorithm.
CN201410475970.7A 2014-09-17 2014-09-17 Optical projection tomography device and method based on camera array Pending CN104224127A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410475970.7A CN104224127A (en) 2014-09-17 2014-09-17 Optical projection tomography device and method based on camera array

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410475970.7A CN104224127A (en) 2014-09-17 2014-09-17 Optical projection tomography device and method based on camera array

Publications (1)

Publication Number Publication Date
CN104224127A true CN104224127A (en) 2014-12-24

Family

ID=52213682

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410475970.7A Pending CN104224127A (en) 2014-09-17 2014-09-17 Optical projection tomography device and method based on camera array

Country Status (1)

Country Link
CN (1) CN104224127A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104702971A (en) * 2015-03-24 2015-06-10 西安邮电大学 High dynamic range imaging method of camera array
CN104783801A (en) * 2015-04-14 2015-07-22 精迪测量技术(上海)有限公司 Human body high-speed scanning instrument and three-dimensional modeling method
CN104849852A (en) * 2015-05-07 2015-08-19 清华大学 Camera array-based light field microscopic imaging system and method
CN106846383A (en) * 2017-01-23 2017-06-13 宁波诺丁汉大学 High dynamic range images imaging method based on 3D digital micro-analysis imaging systems
CN107219228A (en) * 2017-06-29 2017-09-29 佛山科学技术学院 A kind of emerald three-dimensional imaging detection means and its detection method
CN107576676A (en) * 2017-09-27 2018-01-12 北京数字精准医疗科技有限公司 A kind of three-dimensional molecular imaging system based on CT and optical fusion
CN107860336A (en) * 2017-09-18 2018-03-30 深圳奥比中光科技有限公司 Depth camera and system without crosstalk
CN109285213A (en) * 2018-07-18 2019-01-29 西安电子科技大学 Comprehensive polarization three-dimensional rebuilding method
CN111134626A (en) * 2020-01-13 2020-05-12 西安电子科技大学 Flat mammary gland diffusion light tomography system without optical fiber
CN115019589A (en) * 2022-07-19 2022-09-06 天津医科大学 Intelligent CT teaching simulation system based on optics

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060096358A1 (en) * 2004-10-28 2006-05-11 University Of Washington Optical projection tomography microscope
US20090103792A1 (en) * 2007-10-22 2009-04-23 Visiongate, Inc. Depth of Field Extension for Optical Tomography
CN102743159A (en) * 2012-07-26 2012-10-24 中国科学院自动化研究所 Optical projection tomographic imaging system
CN104013417A (en) * 2014-04-25 2014-09-03 浙江工商大学 X-ray light field imaging and calibrating method based on pinhole array

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060096358A1 (en) * 2004-10-28 2006-05-11 University Of Washington Optical projection tomography microscope
US20090103792A1 (en) * 2007-10-22 2009-04-23 Visiongate, Inc. Depth of Field Extension for Optical Tomography
CN102743159A (en) * 2012-07-26 2012-10-24 中国科学院自动化研究所 Optical projection tomographic imaging system
CN104013417A (en) * 2014-04-25 2014-09-03 浙江工商大学 X-ray light field imaging and calibrating method based on pinhole array

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
PENG FEI ET AL: "High dynamic range optical projection tomography(HDR-OPT)", 《OPTICAL EXPRESS 》 *
郭进 等: "活体光学投影断层成像系统与应用", 《自动化学报》 *

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104702971A (en) * 2015-03-24 2015-06-10 西安邮电大学 High dynamic range imaging method of camera array
CN104702971B (en) * 2015-03-24 2018-02-06 西安邮电大学 camera array high dynamic range imaging method
CN104783801A (en) * 2015-04-14 2015-07-22 精迪测量技术(上海)有限公司 Human body high-speed scanning instrument and three-dimensional modeling method
CN104849852A (en) * 2015-05-07 2015-08-19 清华大学 Camera array-based light field microscopic imaging system and method
CN104849852B (en) * 2015-05-07 2017-03-08 清华大学 Light field micro imaging system based on camera array and method
CN106846383A (en) * 2017-01-23 2017-06-13 宁波诺丁汉大学 High dynamic range images imaging method based on 3D digital micro-analysis imaging systems
CN106846383B (en) * 2017-01-23 2020-04-17 宁波诺丁汉大学 High dynamic range image imaging method based on 3D digital microscopic imaging system
CN107219228A (en) * 2017-06-29 2017-09-29 佛山科学技术学院 A kind of emerald three-dimensional imaging detection means and its detection method
CN107860336A (en) * 2017-09-18 2018-03-30 深圳奥比中光科技有限公司 Depth camera and system without crosstalk
CN107576676A (en) * 2017-09-27 2018-01-12 北京数字精准医疗科技有限公司 A kind of three-dimensional molecular imaging system based on CT and optical fusion
CN107576676B (en) * 2017-09-27 2023-11-28 北京数字精准医疗科技有限公司 Three-dimensional molecular imaging system based on CT and optical fusion
CN109285213A (en) * 2018-07-18 2019-01-29 西安电子科技大学 Comprehensive polarization three-dimensional rebuilding method
CN111134626A (en) * 2020-01-13 2020-05-12 西安电子科技大学 Flat mammary gland diffusion light tomography system without optical fiber
CN111134626B (en) * 2020-01-13 2021-08-24 西安电子科技大学 Flat mammary gland diffusion light tomography system without optical fiber
CN115019589A (en) * 2022-07-19 2022-09-06 天津医科大学 Intelligent CT teaching simulation system based on optics
CN115019589B (en) * 2022-07-19 2023-11-28 天津医科大学 Intelligent CT teaching simulation system based on optics

Similar Documents

Publication Publication Date Title
CN104224127A (en) Optical projection tomography device and method based on camera array
KR101687971B1 (en) Apparatus and method for checking breast cancer
CN107631995B (en) Three-dimensional terahertz tomography system and scanning and image reconstruction method
CN103308452B (en) Optical projection tomography image capturing method based on depth-of-field fusion
WO2016107349A1 (en) Computed-tomography method and device
CN107616784B (en) Wide-field photoacoustic ultrasonic breast coronal plane scanning imaging device and method based on 1024 linear array detection
CN108020509A (en) The method and its device of a kind of optical projection tomography
US20190209868A1 (en) Systems and methods for intrafractional ct imaging in image-guided radiotherapy
CN103961128B (en) Zoom point conical beam CT imaging device
CN104783767A (en) Device and method for detecting human body microcirculation by means of orthogonal polarization spectral imaging
US20170188984A1 (en) Filter set of computed tomography scanning device and control method thereof
KR20090130719A (en) Tomography images acquisition method
JP6881682B2 (en) X-ray imaging device
Brombal et al. Motion artifacts assessment and correction using optical tracking in synchrotron radiation breast CT
US20230389881A1 (en) Radiologic Biopsy System and Method
CN202151360U (en) Tube/detector synchronous linkage scanning device
US11723610B2 (en) Method and device for creating a cephalometric image
KR102180602B1 (en) Cephalo X-ray image acquisition device capable of obtaining 3D facial optical images and cephalo X-ray images
DE102011089178B4 (en) Method for recording a projection image and imaging device
CN114486956A (en) Low-dose miniature cone-beam CT scanning system and method based on X-ray lens
KR102644862B1 (en) X-ray imaging apparatus and method for controlling the same
US11903748B2 (en) Method and device for creating a cephalometric image
KR102596189B1 (en) Ct apparatus
CN208799207U (en) A kind of long depth of field blood flow radiography figure acquisition device of three-dimensional
TWI742891B (en) Planar positron emission tomography device for brain

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20141224