CN103226114B - Various visual angles stereoscopic radiation imaging system and method - Google Patents

Various visual angles stereoscopic radiation imaging system and method Download PDF

Info

Publication number
CN103226114B
CN103226114B CN201310113258.8A CN201310113258A CN103226114B CN 103226114 B CN103226114 B CN 103226114B CN 201310113258 A CN201310113258 A CN 201310113258A CN 103226114 B CN103226114 B CN 103226114B
Authority
CN
China
Prior art keywords
image
detector
picture
ray
stereo
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310113258.8A
Other languages
Chinese (zh)
Other versions
CN103226114A (en
Inventor
吴志芳
安继刚
苗积臣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN201310113258.8A priority Critical patent/CN103226114B/en
Publication of CN103226114A publication Critical patent/CN103226114A/en
Application granted granted Critical
Publication of CN103226114B publication Critical patent/CN103226114B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Analysing Materials By The Use Of Radiation (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

The invention discloses a kind of various visual angles stereoscopic radiation imaging system and method, its system comprises: send ray by forming radiographic source and the collimating apparatus of at least two beam wire harness after collimating apparatus, the angle wherein between arbitrary neighborhood two beam wire harness is 3 degree ~ 15 degree; Receive the ray through tested object, and be converted to the detector system that data-signal sends to image data collection system; To the data handling system that view data processes; Image after process is carried out the image display system shown, wherein: detector system comprises at least two group detector arrays, the image that any two groups of detectors obtain can generate the stereo-picture at certain visual angle, and the image that many group detectors obtain can obtain the stereo-picture at multiple visual angle.Compare single-view pick-up unit, the present invention, by multiple detector array and collimating apparatus, realizes the various visual angles three-dimensional imaging to tested object, by the object areas of object Internal tandem duplication separately, can determine suspicious item particular location, improve detectability.

Description

Various visual angles stereoscopic radiation imaging system and method
Technical field
The present invention relates to radiography field, particularly one various visual angles stereoscopic radiation imaging system and method.
Background technology
Large object three-dimensional imaging pick-up unit is the upgrading products of conventional container, goods train and motor vehicle detecting technology, since the phase at the end of the nineties in last century, along with country crack down on smuggling, the requirement of transportation ro-ro transport safety, highway green channel vehicle detection, the radiation image-forming detecting system for container, motor vehicle and goods train is equipped in a large number and is exported to multiple country.
The radiation image-forming detecting system of the container extensively adopted at present, goods train and car all adopts single row detector array, its system composition as shown in Figure 1, the ray that radiographic source 11 sends is collimated into fan-ray beam through collimating apparatus 12, after tested object 13, transmitted ray is measured by linear array detector array 14, tested object 13 moves along the direction perpendicular to beam, generates fluoroscopy images by scanning by data acquisition and image display system 15.This method once can only obtain the fluoroscopy images at a visual angle, the object forward lapped can not be distinguished, and owing to not having depth information, cannot determine the particular location of suspicious item.
Development in recent years goes out the left and right fluoroscopy images that a kind of detector array utilizing two groups to form an angle as described in Chinese invention patent CN101210895B " a kind of method and system of double view angle scanning radiation imaging " obtains, left and right view data is carried out split, mate, build up skeleton view tomograph in the depth direction, thus the fluoroscopy images formed with depth information, can identify the object of different depth.Because the shape, position, kind etc. of internal container loaded article are different, and cannot know in advance, therefore to want that interested article are carried out Iamge Segmentation, space orientation very difficult for this method, and image recognition effect is undesirable, and practical value is little.
Summary of the invention
(1) technical matters that will solve
The technical problem to be solved in the present invention is, for the deficiencies in the prior art, a kind of various visual angles stereoscopic radiation imaging system and method are provided, utilize human eye binocular stereo imaging principle, the three-dimensional imaging to tested object is realized by binocular stereo imaging technology, the object of tested object internal region of interest can be observed from different perspectives, thus know the shape of object, locus and internal structural information, for judging that contraband goods, dangerous material and die Konterbande etc. provide foundation.
(2) technical scheme
The invention provides a kind of various visual angles stereoscopic radiation imaging system, comprising: radiographic source, collimating apparatus, detector system, image data collection system, data handling system and image display system;
Described radiographic source, sends ray and generates at least two beam wire harness by collimating apparatus;
Described detector system, receives the ray through tested object, and is converted to data-signal and sends to described image data collection system;
Described image data collection system, sends to data handling system by the view data collected;
Described data handling system, the image after process is also sent to image display system by image data processing;
Described detector system comprises at least two group detector arrays; The ray that described radiographic source sends is 3 degree ~ 15 degree by the angle between arbitrary neighborhood two beam wire harness in the beam that formed after collimating apparatus.
Wherein, the angle between described arbitrary neighborhood two beam wire harness is 8 degree ~ 9 degree.
Wherein, described radiographic source is X-ray machine radiographic source, isotope radiographic source or accelerator x-ray source.
Wherein, described detector array is classified as gas filled ionization chamber detector array, scintillator detector array or semiconductor detector array.
The invention provides a kind of method utilizing above-mentioned various visual angles stereoscopic radiation imaging system to generate stereoscopic radiation image, comprise the following steps:
S1: radiographic source sends ray and generates at least two beam wire harness by collimating apparatus, the angle between arbitrary neighborhood two beam wire harness is 3 degree ~ 15 degree;
S2: the detector array of often organizing of detector system receives through the ray entering this detector array after tested object, and synthetic image signal also sends to image data collection system;
S3: described image data collection system receives picture signal and sends to data handling system;
S4: described processing data of data processing system signal, returns S2 and repeat S2-S4, until the image generating the acquisition of all detector arrays;
S5: in the image that the detector array described in S4 obtains, chooses angle and is not more than the image that two groups of detector arrays corresponding to any two beam wire harness of 30 degree obtain, generate stereo-picture, and stereo-picture is sent to image display system.
Wherein, in S1, as long as the angle between arbitrary neighborhood two beam wire harness is between 3 degree ~ 15 degree, the fluoroscopy images that just can be obtained respectively by two of its correspondence group detector array generates the stereo-picture of a certain viewing angle, this stereo-picture can meet eye-observation requirement, can realize object of the present invention.But along with the increase of this angle, the correlativity of the fluoroscopy images of two groups of detector arrays acquisitions of its correspondence just diminishes, and the picture quality of three-dimensional imaging and observing effect will be deteriorated.Therefore, in order to improve the quality of stereo-picture further, ensure excellent Detection results, this angle is preferably 8 degree ~ 9 degree.
Wherein, in S2, described detector system receives the ray through tested object and after generating described picture signal, sends to described image data collection system by amplifier.
Wherein, each stereo-picture generated in S5 is all converted to left simulated view respectively by the image obtained by two groups of detector arrays and right simulated view is formed.
In S5, the method generating stereo-picture is: look point-score, light point-score, time-sharing procedure or holography method.
Various visual angles stereoscopic radiation imaging system of the present invention and method can be used for the large objects such as detected set vanning, goods train, motor vehicle, and the small-sized object such as luggage case, hand-baggage.
(3) beneficial effect
Compare single-view pick-up unit, the present invention, by multiple detector array and collimating apparatus, achieves the various visual angles three-dimensional imaging to tested object, by the object areas of object Internal tandem duplication separately, can determine suspicious item particular location, improve detectability.
Accompanying drawing explanation
Fig. 1 is the single row detector array radiation imaging system composition schematic diagram of prior art;
Fig. 2 is the structured flowchart of the present invention's various visual angles stereoscopic radiation imaging system;
Fig. 3 is the flow chart of steps of the present invention's various visual angles stereoscopic radiation formation method;
Fig. 4 is the theory diagram of the present invention's various visual angles stereoscopic radiation formation method;
Fig. 5 is the algorithm flow chart of the present invention's various visual angles stereoscopic radiation formation method.
Embodiment
Below in conjunction with drawings and Examples, the specific embodiment of the present invention is described in further detail.Following examples only for illustration of the present invention, but are not used for limiting the scope of the invention.
As shown in Figure 2, various visual angles stereoscopic radiation imaging system of the present invention, comprising: radiographic source 21, collimating apparatus 22, detector system 24, amplifier 25, image data collection system 26, data handling system 27 and image display system 28.
Described radiographic source 21, sends ray and generates at least two beam wire harness by collimating apparatus 22, and described radiographic source 21 is x-ray source, isotope radiographic source or accelerator radiographic source.
Described detector system 24, receives the ray through tested object, and is converted to data-signal and sends to described image data collection system 26.
Described amplifier 25, receives the data-signal of described detector system 24 transmission and after being amplified by this data-signal, sends to described image data collection system 26.
Described image data collection system 26, sends to data handling system 27 by the view data collected.
Described data handling system 27, the image after process is also sent to image display system 28 by image data processing.
Described detector system 24 comprises at least two group detector arrays; The ray that described radiographic source sends is 3 degree ~ 15 degree by the angle in the beam of formation after collimating apparatus 22 between arbitrary neighborhood two beam wire harness, and preferably, the angle between described arbitrary neighborhood two beam wire harness is 8 degree ~ 9 degree.Described detector array is classified as gas filled ionization chamber detector array, scintillator detector array or semiconductor detector array.
As shown in Figure 3, the present invention also provides a kind of method utilizing above-mentioned various visual angles stereoscopic radiation imaging system to generate stereoscopic radiation image, comprising:
S1: radiographic source sends ray and generates at least two beam wire harness by collimating apparatus, the angle between arbitrary neighborhood two beam wire harness is 3 degree ~ 15 degree.Preferably, the angle between described arbitrary neighborhood two beam wire harness is 8 degree ~ 9 degree.
S2: the detector array of often organizing of detector system receives through the ray entering this detector array after tested object, and synthetic image signal also sends to image data collection system.
In order to improve the quality of viewdata signal, described detector system sends to described image data collection system by amplifier after the ray through tested object is converted to data-signal.
S3: described image data collection system receives picture signal and sends to data handling system;
S4: described processing data of data processing system signal, returns S2 and repeat S2-S4, until the image generating the acquisition of all detector arrays;
S5: the image obtained according to all detector arrays in S4, chooses angle and is not more than the image that two groups of detector arrays corresponding to any two beam wire harness of 30 degree obtain, generate stereo-picture, and stereo-picture is sent to image display system.The image that the detector array being less than 30 degree due to any two groups of angles obtains all can generate the stereo-picture of some observation angles, therefore just can be obtained up to many C for N group detector array n 2the stereo-picture of=N* (N-1)/2 different observation angle.By the stereo-picture of these different observation angles of comprehensive observing, the shape information of tested object internal region of interest, spatial information and structural information can be obtained further, improve Detection results further.
In S5, the method generating stereo-picture comprises: the stereo-picture formation method that look point-score, light point-score, time-sharing procedure or holography method etc. are conventional.The each stereo-picture generated all is converted to left simulated view respectively by the image obtained by two groups of detector arrays and right simulated view is formed.
Difference with the prior art of the present invention is, beyond the detector array adopting two groups or more, a width stereo-picture of a certain observation angle can be formed, also can form multiple stereo-pictures of different observation angle, thus the different objects of tested object Internal tandem duplication can be distinguished.
The ultimate principle of three-dimensional imaging of the present invention as shown in Figure 4, utilize human eye binocular stereo imaging principle, the ray of radiographic source 41 is through tested object 42, left detector array 43 and right detector array 44 is utilized to obtain the scan image of two angles, by the anthropomorphic binocular observation effect of modulus of conversion, utilize stereo image display system to be observed separately by right and left eyes by two width images respectively, namely left simulated view is observed by left eye, right simulated view is observed separately by right eye, then can produce object dimensional stereo-picture.Left detector array 43 and the beam corresponding to right detector array 44 can be equal with the angle (45,46) perpendicular to direction of scanning, also can not wait, be equivalent to binocular and face object time equal, are equivalent to binocular stravismus object when not waiting.Angle between two beam wire harness of the present invention and angle 45 and angle 46 sum.
Fig. 5 is the algorithm flow chart of the present invention's various visual angles stereoscopic radiation formation method.As Fig. 5 and with reference to shown in figure 4, utilize described angle (45,46), equivalent perspective view (i.e. viewing angle) θ=(angle 45+ angle 46)/2 can be calculated, that input according to user or determined by empirical data simulation human eye interpupillary distance L, calculates equivalent viewing distance D=L*ctan (θ)/2 by equivalent perspective view θ and simulation interpupillary distance L.According to space length and the sweep velocity of two groups of detector acquisition times and arrangement, the image that two groups of detectors collect is alignd along direction of scanning, and according to the geometry of the two groups of detector arrays stretching conversion by image, the bearing of trend (this direction is perpendicular to direction of scanning) along detector array aligns.According to equivalent viewing distance D and simulation interpupillary distance L, by the view data that obtained by right side detector after alignment to the right displacement images width L/D doubly, be partially filled middle grey, as left simulated view after translation; The image data location obtained by left side detector after alignment is constant, and grey in image end filling, picture traverse is consistent with left simulated view, as right simulated view.After obtaining left and right simulated view, input stereo image display system, utilizes binocular stereo imaging principle, can generate three-dimensional image.Human eye can observe this stereo-picture by 3D glasses.
The present invention utilizes above-mentioned three-dimensional imaging principle, the fluoroscopy images that any two groups of adjacent detector arrays not only can be adopted to produce generates the stereo-picture of a certain viewing angle, the fluoroscopy images that the non-conterminous detector array that any two groups of angles also can be selected to be not more than 30 degree produces generates the stereo-picture of multiple different viewing angle, thus obtain multiple scanning perspective stereoscopic images of the inner a certain area-of-interest of tested object, for the tested object of examination of not unpacking is as container, goods train, the large objects such as motor vehicle, and luggage case, the contraband goods of the small-sized object inside such as hand-baggage, dangerous material, die Konterbande provides more image information.
Above embodiment is only for illustration of the present invention, and be not limitation of the present invention, those of ordinary skill in the art, without departing from the spirit and scope of the present invention, can also make a variety of changes and modification, and its all equivalent technical solutions all should belong to category of the present invention.

Claims (7)

1. a various visual angles stereoscopic radiation imaging system, comprising: radiographic source, collimating apparatus, detector system, image data collection system, data handling system and image display system;
Described radiographic source, sends ray and generates at least two beam wire harness by collimating apparatus;
Described detector system, receives the ray through tested object, and is converted to data-signal and sends to described image data collection system;
Described image data collection system, sends to described data handling system by the view data collected;
Described data handling system, the image after process is also sent to described image display system by image data processing;
It is characterized in that, described detector system comprises at least two group detector arrays; The ray that described radiographic source sends is 8 degree ~ 9 degree by the angle between arbitrary neighborhood two beam wire harness in the beam that formed after collimating apparatus;
Described data handling system, also be not more than for choosing angle the image that two groups of detector arrays corresponding to any two beam wire harness of 30 degree obtain, generate stereo-picture, described stereo-picture is all converted to left simulated view respectively by the image obtained by two groups of detector arrays and right simulated view is formed.
2. the system as claimed in claim 1, is characterized in that, described radiographic source is X-ray machine radiographic source, isotope radiographic source or accelerator x-ray source.
3. the system as claimed in claim 1, is characterized in that, described detector array is classified as gas filled ionization chamber detector array, scintillator detector array or semiconductor detector array.
4. utilize the various visual angles stereoscopic radiation imaging system described in claim 1 to generate a method for stereoscopic radiation image, it is characterized in that, comprise the following steps:
S1: radiographic source sends ray and generates at least two beam wire harness by collimating apparatus, the angle between arbitrary neighborhood two beam wire harness is 8 degree ~ 9 degree;
S2: the detector array of often organizing of detector system receives through the ray entering this detector array after tested object, and synthetic image signal also sends to image data collection system;
S3: described image data collection system receives picture signal and sends to data handling system;
S4: described processing data of data processing system signal, returns S2 and repeat S2-S4, until the image generating the acquisition of all detector arrays;
S5: in the image that the detector array described in S4 obtains, chooses angle and is not more than the image that two groups of detector arrays corresponding to any two beam wire harness of 30 degree obtain, generate stereo-picture, and stereo-picture is sent to image display system.
5. method as claimed in claim 4, is characterized in that, in S2, described detector system receives the ray through tested object and after generating described picture signal, sends to described image data collection system by amplifier.
6. method as claimed in claim 4, is characterized in that, in S5, the method generating stereo-picture is: look point-score, light point-score, time-sharing procedure or holography method.
7. method as claimed in claim 4, is characterized in that, each stereo-picture generated in S5 is all converted to left simulated view respectively by the image obtained by two groups of detector arrays and right simulated view is formed.
CN201310113258.8A 2013-04-02 2013-04-02 Various visual angles stereoscopic radiation imaging system and method Active CN103226114B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310113258.8A CN103226114B (en) 2013-04-02 2013-04-02 Various visual angles stereoscopic radiation imaging system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310113258.8A CN103226114B (en) 2013-04-02 2013-04-02 Various visual angles stereoscopic radiation imaging system and method

Publications (2)

Publication Number Publication Date
CN103226114A CN103226114A (en) 2013-07-31
CN103226114B true CN103226114B (en) 2015-09-30

Family

ID=48836639

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310113258.8A Active CN103226114B (en) 2013-04-02 2013-04-02 Various visual angles stereoscopic radiation imaging system and method

Country Status (1)

Country Link
CN (1) CN103226114B (en)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104567758B (en) * 2013-10-29 2017-11-17 同方威视技术股份有限公司 Stereo imaging system and its method
CN104306013B (en) * 2014-10-31 2016-08-24 清华大学 A kind of method of adjustment of CT system neutral array detector position
CN104459812A (en) * 2014-12-17 2015-03-25 同方威视技术股份有限公司 Pull type multi-view-angle article inspection system and application method thereof
CN105784733A (en) * 2015-01-26 2016-07-20 公安部第研究所 Channel type double-view-angle X-ray safety inspection device
CN105739232B (en) * 2016-03-02 2018-01-16 中国科学院上海应用物理研究所 A kind of real-time stereo imaging system and imaging method based on synchrotron radiation
CN106841249A (en) * 2017-04-12 2017-06-13 北京君和信达科技有限公司 Transmission-type radiation image-forming system
CN107300721B (en) * 2017-08-10 2023-12-15 苏州曼德克光电有限公司 Ray-based three-dimensional imaging detection system for cargo vehicle
CN107449790A (en) * 2017-09-04 2017-12-08 南京中车浦镇城轨车辆有限责任公司 A kind of resistance spot welding quality decision-making system and method based on ray detection
EP3908185B1 (en) * 2019-01-10 2023-10-18 Shenzhen Xpectvision Technology Co., Ltd. An imaging system having radiation detectors of different orientations
CN109917354B (en) * 2019-04-26 2020-06-02 上海禾赛光电科技有限公司 Receiving device of laser radar, laser radar and echo processing method thereof
CN111221049B (en) * 2020-03-18 2022-08-26 苏州瑞迈斯医疗科技有限公司 Three-dimensional tomography imaging equipment
CN111626930A (en) * 2020-04-30 2020-09-04 兰州大学 Omnibearing three-dimensional photographing method
CN111830584B (en) * 2020-07-21 2024-01-26 同方威视技术股份有限公司 Self-help security inspection system, security inspection method and article security inspection equipment
CN114764069A (en) * 2020-12-31 2022-07-19 同方威视技术股份有限公司 Radiation inspection system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0261984A2 (en) * 1986-09-26 1988-03-30 Max Robinson Three-dimensional visual screening system
WO1999013323A2 (en) * 1997-09-09 1999-03-18 American Science And Engineering, Inc. A tomographic inspection system
CN2529247Y (en) * 2001-08-14 2003-01-01 清华大学 Single radiation source double-imaging scanning radiation imaging device
CN1514300A (en) * 2002-12-31 2004-07-21 �廪��ѧ Method of multi viewing angle x-ray stereo imaging and system
CN101210895A (en) * 2006-12-28 2008-07-02 清华同方威视技术股份有限公司 Double view angle scanning radiation imaging method and system
CN102411157A (en) * 2011-08-05 2012-04-11 北京睿思厚德辐射信息科技开发有限公司 Method and device for unilaterally scanning object and bilaterally and stereoscopically imaging
CN202442975U (en) * 2011-09-14 2012-09-19 上海英迈吉东影图像设备有限公司 Safety inspection equipment capable of implementing single-source multi-view-angle rotational scanning

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6904122B2 (en) * 2001-10-31 2005-06-07 Inventqjaya Sdn. Bhd. 3D stereoscopic X-ray system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0261984A2 (en) * 1986-09-26 1988-03-30 Max Robinson Three-dimensional visual screening system
WO1999013323A2 (en) * 1997-09-09 1999-03-18 American Science And Engineering, Inc. A tomographic inspection system
CN2529247Y (en) * 2001-08-14 2003-01-01 清华大学 Single radiation source double-imaging scanning radiation imaging device
CN1514300A (en) * 2002-12-31 2004-07-21 �廪��ѧ Method of multi viewing angle x-ray stereo imaging and system
CN101210895A (en) * 2006-12-28 2008-07-02 清华同方威视技术股份有限公司 Double view angle scanning radiation imaging method and system
CN102411157A (en) * 2011-08-05 2012-04-11 北京睿思厚德辐射信息科技开发有限公司 Method and device for unilaterally scanning object and bilaterally and stereoscopically imaging
CN202442975U (en) * 2011-09-14 2012-09-19 上海英迈吉东影图像设备有限公司 Safety inspection equipment capable of implementing single-source multi-view-angle rotational scanning

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Design of a stereoscopic X-ray imaging system using a single X-ray source;J.P.O. Evans et al.;《NDT&E International》;20001231;第33卷(第5期);第325-332页 *
X射线多视角立体成像方法的研究;肖永顺等;《光电子 激光》;20031031;第14卷(第10期);第1078-1080页 *

Also Published As

Publication number Publication date
CN103226114A (en) 2013-07-31

Similar Documents

Publication Publication Date Title
CN103226114B (en) Various visual angles stereoscopic radiation imaging system and method
JP6017631B2 (en) Security check CT system and method
US6763083B2 (en) Article screening system
EP1938752B1 (en) Method and system for binocular steroscopic scanning radiographic imaging
EP2869094B1 (en) Stereoscopic imaging systems and methods
EP2273257B1 (en) Imaging system using a straight-line trajectory scan and method thereof
JP5281073B2 (en) Material imaging
JP5763551B2 (en) Apparatus and method for viewing objects
US20060078085A1 (en) Stereoscopic x-ray imaging apparatus for obtaining three dimensional coordinates
JP6538811B2 (en) Inspection apparatus and method of inspecting a container
US9414788B2 (en) X-ray imaging apparatus and method of generating stereoscopic image
JP2010522877A (en) Material imaging
CN105759318B (en) Safety detection device and detection method thereof
JP5806115B2 (en) Interpretation of X-ray data
CN201043955Y (en) Double-visual angle scan radiation image forming apparatus
US20110102430A1 (en) System and method for presenting tomosynthesis images
CN102901740A (en) Channel type four visual angles X ray liquid state article safety inspection system
EP3018628A2 (en) Imaging apparatus and imaging method
US20130315469A1 (en) Method for 3d inspection of an object using x-rays
San Yong Threat image projection for stereoscopic x-ray screening systems
Kolokytha et al. Three-dimensional imaging of hold baggage for airport security

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant