CN110276792A - Model acquisition methods and device based on digital filter - Google Patents

Model acquisition methods and device based on digital filter Download PDF

Info

Publication number
CN110276792A
CN110276792A CN201910443724.6A CN201910443724A CN110276792A CN 110276792 A CN110276792 A CN 110276792A CN 201910443724 A CN201910443724 A CN 201910443724A CN 110276792 A CN110276792 A CN 110276792A
Authority
CN
China
Prior art keywords
camera
calibration
processor
model acquisition
projector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910443724.6A
Other languages
Chinese (zh)
Other versions
CN110276792B (en
Inventor
袁丹寿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Angrui Shanghai Information Technology Co Ltd
Original Assignee
Angrui Shanghai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Angrui Shanghai Information Technology Co Ltd filed Critical Angrui Shanghai Information Technology Co Ltd
Priority to CN201910443724.6A priority Critical patent/CN110276792B/en
Publication of CN110276792A publication Critical patent/CN110276792A/en
Application granted granted Critical
Publication of CN110276792B publication Critical patent/CN110276792B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/521Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • G06T2207/10012Stereo images

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention discloses a kind of model acquisition methods and device based on digital filter, the model acquisition methods are realized by a model acquisition device, model acquisition device includes a camera, a digital filter, a projector and a processor, and model acquisition methods include: that processor demarcates the camera and projector;Projector projects sinusoidal configuration light;Camera shoots sinusoidal configuration photogenerated structure optical image;The digital filter obtains filtering image;Processor obtains absolute phase-shift according to the package phase shift for filtering image capturing sinusoidal configuration light, and according to the package phase shift;The projector projects sinusoidal configuration light on target object;The object image for the target object that camera shooting is projected by sinusoidal configuration light;The processor obtains the threedimensional model of target object according to the absolute phase-shift and object image of sinusoidal configuration light.The present invention has arithmetic speed fast, and the time for obtaining the model of object is short, the higher advantage of model accuracy.

Description

Model acquisition methods and device based on digital filter
Technical field
The present invention relates to a kind of model acquisition methods and device based on digital filter.
Background technique
Three-dimensional reconstruction refers to the mathematical model established to three-dimension object and be suitble to computer representation and processing, is in computer ring The basis of its property is handled it, operated and analyzed under border, and establishes the virtual of expression objective world in a computer The key technology of reality.
It is a kind of three-dimensional reconstruction mode that optical grating projection, which carries out three-dimensional reconstruction, and grating is projected to reference planes respectively and is tested Body surface, what it is due to reference planes selection is horizontal plane, and the reference grating projected to above will not deform;Work as grating When projecting to testee surface, grating can generate different degrees of deformation, be that measured object body surface is received due to projection grating The modulation of face height.The testee height placed is different, and the phase change degree of grating is also different therewith, and two-dimensional surface becomes The three-dimensional appearance information of body surface is carried in the phase change of shape striped.It therefore, can be with by seeking the changing value of phase Height of the object at respective point is obtained, to obtain the chamfered shape of three-dimension object.
Slow, the low defect of precision that there are modeling speeds in existing optical grating projection progress three-dimensional reconstruction.
Summary of the invention
The technical problem to be solved by the present invention is to model to overcome existing optical grating projection exist in three-dimensional reconstruction Speed is slow, the low defect of precision, provides fast with arithmetic speed, and the time for obtaining the model of object is short, and model accuracy is higher The model acquisition methods and device based on digital filter of advantage.
The present invention is to solve above-mentioned technical problem by following technical proposals:
A kind of model acquisition methods based on digital filter, it is characterized in that, the model acquisition methods pass through a mould Type acquisition device realizes that the model acquisition device includes a camera, a digital filter, a projector and a processor, The model acquisition methods include:
The processor demarcates the camera and projector;
The projector projects sinusoidal configuration light;
Camera shoots sinusoidal configuration photogenerated structure optical image;
The low frequency signal and negative frequency signal that the digital filter filters the structure optical image are to obtain filtering image;
The processor and is obtained according to the package phase shift of filtering image capturing sinusoidal configuration light according to the package phase shift Take absolute phase-shift;
The projector projects sinusoidal configuration light on target object;
The object image for the target object that the camera shooting is projected by sinusoidal configuration light;
The processor obtains the three-dimensional mould of target object according to the absolute phase-shift and object image of sinusoidal configuration light Type.
Preferably, for the lateral coordinates such as imaging point on the filtering image, the processor according to formula f (x)= a0+a0cos(2πf0X) the package phase shift of the imaging point is obtained.
Preferably, the processor is separately connected the camera and the projector, the processor is to the camera And the projector sends trigger signal respectively;
The camera includes a pick-up lens, and the projector includes a projection lens, the shooting side of the pick-up lens The plane domain is directed to the projecting direction of the projection lens;
The model acquisition methods include:
The plane domain is equipped with a removable calibration pattern;
The plane domain of the camera shooting only calibration pattern is calibration image;
The processor demarcates the camera using the calibration image, and obtains camera calibration data;
The projector projects the calibration picture of at least two brightness to the plane domain;
The calibration picture that the camera shoots each brightness on the plane domain is picture images;
The processor carries out projector and the camera using the camera calibration data and the picture images Between calibration.
Preferably, the projector projects the calibration picture of at least two brightness to the plane domain, comprising:
The projector projects the calibration picture of at least two gray scale to the plane domain;Or,
The projector projects at least two in the calibration maps on piece to one calibration picture of plane domain projection The grayscale image of gray scale.
Preferably, the plane domain includes: equipped with a removable calibration pattern
Calibration pattern, the color changeable of the calibration pattern are shown on the plane domain;
The camera transmits the calibration image of the calibration pattern of at least two color to the processor;
The processor passes through whole calibration images and demarcates the camera.
Preferably, the plane domain includes a power supply module and a display panel, the display panel is equipped with electricity Chromotropic dye is caused, the power supply module is connect with the electrochromic dyes.
Preferably, the plane domain is a translucent blank, the calibration maps are printed in the front of the translucent blank Case, the back side of the translucent blank are equipped with several LED light, and the illumination direction of the LED light is directed at the translucent blank;
The model acquisition methods include:
The processor controls the brightness of the LED light;
After the processor also sends adjusting luminance signal to the control chip, Xiang Suoshu camera sends trigger signal.
Preferably, the plane domain is liquid crystal planer region, the liquid crystal planer region shows predetermined pattern, described pre- If the shape of pattern is identical as the calibration shape of pattern, the color changeable of predetermined pattern.
The present invention also provides a kind of model acquisition device based on digital filter, it is characterized in that, the model obtains Device includes a camera, a projector and a processor, and the model acquisition device obtains for realizing model as described above Take method.
Preferably, the processor includes opening for the model DLP LightCrafter4500 of Texas Instruments Plate is sent out, the model acquisition device includes a shell, and the camera and the projector are set in the shell, the phase Machine includes a pick-up lens, and the projector includes a projection lens, the pick-up lens and the projection lens and shoots In the front of the shell.
On the basis of common knowledge of the art, above-mentioned each optimum condition, can any combination to get each preferable reality of the present invention Example.
The positive effect of the present invention is that:
Model acquisition device based on digital filter of the invention have arithmetic speed it is fast, obtain the model of object when Between short, the higher advantage of model accuracy.
Detailed description of the invention
Fig. 1 is the flow chart of the model acquisition methods of the embodiment of the present invention 1.
Specific embodiment
The present invention is further illustrated below by the mode of embodiment, but does not therefore limit the present invention to the reality It applies among a range.
Embodiment 1
The present embodiment provides a kind of model acquisition device based on digital filter, the model acquisition device include a phase Machine, a projector, a digital filter and a processor.
The processor includes the development board of the model DLP LightCrafter 4500 of Texas Instruments.
The processor is for demarcating the camera and projector;
The projector is for projecting sinusoidal configuration light;
Camera is for shooting sinusoidal configuration photogenerated structure optical image;
The low frequency signal and negative frequency signal that the digital filter is used to filter the structure optical image are to obtain filtering shadow Picture;
The processor is used for the package phase shift according to filtering image capturing sinusoidal configuration light, and according to the package phase It moves and obtains absolute phase-shift;The package phase shift for having passed through multiframe sinusoidal configuration light for obtaining absolute phase-shift obtains, and can also pass through The mode of space encoding alignment projection obtains the absolute phase-shift.
The projector is used to project sinusoidal configuration light on target object;
The camera is used to shoot the object image of the target object projected by sinusoidal configuration light;
The processor is used to obtain the three of target object according to the package phase shift of sinusoidal configuration light and object image Dimension module.
Specifically, for the lateral coordinates such as imaging point on the filtering image, the processor according to formula f (x)= a0+a0cos(2πf0X) the package phase shift of the imaging point is obtained.
The low frequency signal and negative frequency signal that the digital filter filters the structure optical image are led to obtaining filtering image The expression formula of real and imaginary parts of imaging point, the letter comprising the package phase shift in the imaginary part can be obtained by crossing digital filter Breath.
The model acquisition device of the present embodiment includes the function of specific calibration for cameras and projector.
The processor is separately connected the camera and the projector, and the processor is to the camera and the throwing Shadow instrument sends trigger signal respectively;
The camera includes a pick-up lens, and the projector includes a projection lens, the shooting side of the pick-up lens The plane domain is directed to the projecting direction of the projection lens;
The plane domain is equipped with a removable calibration pattern;
The plane domain that the camera is used to shoot only calibration pattern is calibration image;
The processor is used to demarcate the camera using the calibration image, and obtains camera calibration data;
The projector is used to project the calibration picture of at least two brightness to the plane domain;
The calibration picture that the camera is used to shoot each brightness on the plane domain is picture images;
The processor is used to utilize the camera calibration data and picture images progress projector and described Calibration between camera.
Specifically, the projector projects the calibration picture of at least two brightness to the plane domain.
The calibration picture of two brightness can by two ways one of obtain.
The projector projects the calibration picture of at least two gray scale to the plane domain;Or,
The projector projects at least two in the calibration maps on piece to one calibration picture of plane domain projection The grayscale image of gray scale.
The plane domain is equipped with a removable calibration pattern
Calibration pattern, the color changeable of the calibration pattern are shown on the plane domain;
The camera is used to transmit the calibration image of the calibration pattern of at least two color to the processor;
The processor is used to demarcate the camera by whole calibration images.
The function of the calibration pattern variable color can be realized by following 3 kinds of modes:
Mode one, the plane domain include a power supply module and a display panel, and the display panel is equipped with electricity Chromotropic dye is caused, the power supply module is connect with the electrochromic dyes.
Mode two, the plane domain are a translucent blank, and the calibration maps are printed in the front of the translucent blank Case, the back side of the translucent blank are equipped with several LED light, and the illumination direction of the LED light is directed at the translucent blank;
The model acquisition methods include:
The processor controls the brightness of the LED light;
After the processor also sends adjusting luminance signal to the control chip, Xiang Suoshu camera sends trigger signal.
Mode three, the plane domain are liquid crystal planer region, and the liquid crystal planer region shows predetermined pattern, described pre- If the shape of pattern is identical as the calibration shape of pattern, the color changeable of predetermined pattern.
Fig. 1, using above-mentioned model acquisition device, the present embodiment also provides a kind of model acquisition methods, comprising:
Step 100, the processor demarcate the camera and projector;
Step 101, the projector projects sinusoidal configuration light;
Step 102, camera shoot sinusoidal configuration photogenerated structure optical image;
The low frequency signal and negative frequency signal that step 103, the digital filter filter the structure optical image are to obtain filter Wave image;
Step 104, the processor are according to the package phase shift of filtering image capturing sinusoidal configuration light, and according to the packet It wraps up in phase shift and obtains absolute phase-shift;
Step 105, the projector project sinusoidal configuration light on target object;
The object image for the target object that step 106, camera shooting are projected by sinusoidal configuration light;
Step 107, the processor obtain target object according to the absolute phase-shift and object image of sinusoidal configuration light Threedimensional model.
In step 103, for lateral coordinates such as the imaging points filtered on image, the processor is according to formula f (x) =a0+a0cos(2πf0X) the package phase shift of the imaging point is obtained.
Wherein the camera of step 100 and the scaling method of projector include:
Plane domain is equipped with a removable calibration pattern;
The plane domain of the camera shooting only calibration pattern is calibration image;
The processor demarcates the camera using the calibration image, and obtains camera calibration data;
The projector projects the calibration picture of at least two brightness to the plane domain;
The calibration picture that the camera shoots each brightness on the plane domain is picture images;
The processor carries out projector and the camera using the camera calibration data and the picture images Between calibration.
The projector projects the calibration picture of at least two brightness to the plane domain, comprising:
The projector projects the calibration picture of at least two gray scale to the plane domain;
Furthermore it is also possible to by the projector to one calibration picture of plane domain projection, and in the calibration maps On piece projects the grayscale image of at least two gray scale.Namely think that the mode of calibration maps on piece polishing obtains the calibration of two brightness Picture.
The plane domain is equipped with a removable calibration pattern
Calibration pattern, the color changeable of the calibration pattern are shown on the plane domain;
The camera transmits the calibration image of the calibration pattern of at least two color to the processor;
The processor passes through whole calibration images and demarcates the camera.
The color changeable of the calibration pattern may include by following 3 kinds of implementation methods:
The plane domain includes a power supply module and a display panel, and the display panel is contaminated equipped with electrochromism Material, the power supply module are connect with the electrochromic dyes.
The plane domain is a translucent blank, and the calibration pattern is printed in the front of the translucent blank, described The back side of translucent blank is equipped with several LED light, and the illumination direction of the LED light is directed at the translucent blank;
The model acquisition methods include:
The processor controls the brightness of the LED light;
After the processor also sends adjusting luminance signal to the control chip, Xiang Suoshu camera sends trigger signal.
Stating plane domain is liquid crystal planer region, and the liquid crystal planer region shows predetermined pattern, the predetermined pattern Shape is identical as the calibration shape of pattern, the color changeable of predetermined pattern.
Although specific embodiments of the present invention have been described above, it will be appreciated by those of skill in the art that these It is merely illustrative of, protection scope of the present invention is defined by the appended claims.Those skilled in the art is not carrying on the back Under the premise of from the principle and substance of the present invention, many changes and modifications may be made, but these are changed Protection scope of the present invention is each fallen with modification.

Claims (10)

1. a kind of model acquisition methods based on digital filter, which is characterized in that the model acquisition methods pass through a model Acquisition device realizes that the model acquisition device includes a camera, a digital filter, a projector and a processor, institute Stating model acquisition methods includes:
The processor demarcates the camera and projector;
The projector projects sinusoidal configuration light;
Camera shoots sinusoidal configuration photogenerated structure optical image;
The low frequency signal and negative frequency signal that the digital filter filters the structure optical image are to obtain filtering image;
The processor obtains absolutely according to the package phase shift for filtering image capturing sinusoidal configuration light, and according to the package phase shift To phase shift;
The projector projects sinusoidal configuration light on target object;
The object image for the target object that the camera shooting is projected by sinusoidal configuration light;
The processor obtains the threedimensional model of target object according to the absolute phase-shift and object image of sinusoidal configuration light.
2. model acquisition methods as described in claim 1, which is characterized in that for cross such as the imaging points filtered on image To coordinate, the processor is according to formula f (x)=a0+a0cos(2πf0X) the package phase shift of the imaging point is obtained.
3. model acquisition methods as described in claim 1, which is characterized in that the processor be separately connected the camera and The projector, the processor send trigger signal to the camera and the projector respectively;
The camera include a pick-up lens, the projector include a projection lens, the shooting direction of the pick-up lens with The projecting direction of the projection lens is directed at the plane domain;
The model acquisition methods include:
The plane domain is equipped with a removable calibration pattern;
The plane domain of the camera shooting only calibration pattern is calibration image;
The processor demarcates the camera using the calibration image, and obtains camera calibration data;
The projector projects the calibration picture of at least two brightness to the plane domain;
The calibration picture that the camera shoots each brightness on the plane domain is picture images;
The processor is carried out between projector and the camera using the camera calibration data and the picture images Calibration.
4. model acquisition methods as claimed in claim 3, which is characterized in that the projector is projected to the plane domain The calibration picture of few 2 brightness, comprising:
The projector projects the calibration picture of at least two gray scale to the plane domain;Or,
The projector projects at least two gray scale in the calibration maps on piece to one calibration picture of plane domain projection Grayscale image.
5. model acquisition methods as claimed in claim 3, which is characterized in that the plane domain is equipped with a removable mark Determining pattern includes:
Calibration pattern, the color changeable of the calibration pattern are shown on the plane domain;
The camera transmits the calibration image of the calibration pattern of at least two color to the processor;
The processor passes through whole calibration images and demarcates the camera.
6. model acquisition methods as claimed in claim 5, which is characterized in that the plane domain include a power supply module and One display panel, the display panel are equipped with electrochromic dyes, and the power supply module is connect with the electrochromic dyes.
7. model acquisition methods as claimed in claim 5, which is characterized in that the plane domain is a translucent blank, institute The calibration pattern is printed in the front for stating translucent blank, and the back side of the translucent blank is equipped with several LED light, the LED The illumination direction of lamp is directed at the translucent blank;
The model acquisition methods include:
The processor controls the brightness of the LED light;
After the processor also sends adjusting luminance signal to the control chip, Xiang Suoshu camera sends trigger signal.
8. model acquisition methods as claimed in claim 5, which is characterized in that the plane domain is liquid crystal planer region, institute It states liquid crystal planer region and shows predetermined pattern, the shape of the predetermined pattern is identical as the calibration shape of pattern, presets figure The color changeable of case.
9. a kind of model acquisition device based on digital filter, which is characterized in that the model acquisition device include a camera, One projector and a processor, the model acquisition device is for realizing mould as claimed in any of claims 1 to 8 in one of claims Type acquisition methods.
10. model acquisition device as claimed in claim 9, which is characterized in that the processor includes Texas Instruments's public affairs The development board of the model DLP LightCrafter 4500 of department, the model acquisition device include a shell, the camera with And the projector is set in the shell, the camera includes a pick-up lens, and the projector includes a projection lens, The pick-up lens and the projection lens are simultaneously shot in the front of the shell.
CN201910443724.6A 2019-05-27 2019-05-27 Model obtaining method and device based on digital filter Active CN110276792B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910443724.6A CN110276792B (en) 2019-05-27 2019-05-27 Model obtaining method and device based on digital filter

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910443724.6A CN110276792B (en) 2019-05-27 2019-05-27 Model obtaining method and device based on digital filter

Publications (2)

Publication Number Publication Date
CN110276792A true CN110276792A (en) 2019-09-24
CN110276792B CN110276792B (en) 2023-02-07

Family

ID=67959084

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910443724.6A Active CN110276792B (en) 2019-05-27 2019-05-27 Model obtaining method and device based on digital filter

Country Status (1)

Country Link
CN (1) CN110276792B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6049384A (en) * 1996-02-27 2000-04-11 Cyberoptics Corporation Method and apparatus for three dimensional imaging using multi-phased structured light
US20140253929A1 (en) * 2011-10-18 2014-09-11 Nanyang Technological University Apparatus and method for 3d surface measurement
CN104457615A (en) * 2014-11-14 2015-03-25 深圳大学 Three-dimensional digital imaging method based on generalized S transformation
CN106840036A (en) * 2016-12-30 2017-06-13 江苏四点灵机器人有限公司 A kind of diadactic structure light optimization method suitable for fast three-dimensional appearance measuring
US20190101382A1 (en) * 2017-09-27 2019-04-04 Brown Univ ersity Techniques for shape measurement using high frequency patterns and related systems and methods

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6049384A (en) * 1996-02-27 2000-04-11 Cyberoptics Corporation Method and apparatus for three dimensional imaging using multi-phased structured light
US20140253929A1 (en) * 2011-10-18 2014-09-11 Nanyang Technological University Apparatus and method for 3d surface measurement
CN104457615A (en) * 2014-11-14 2015-03-25 深圳大学 Three-dimensional digital imaging method based on generalized S transformation
CN106840036A (en) * 2016-12-30 2017-06-13 江苏四点灵机器人有限公司 A kind of diadactic structure light optimization method suitable for fast three-dimensional appearance measuring
US20190101382A1 (en) * 2017-09-27 2019-04-04 Brown Univ ersity Techniques for shape measurement using high frequency patterns and related systems and methods

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
刘伟涛: "基于结构光投影的三维测量系统关键技术研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Also Published As

Publication number Publication date
CN110276792B (en) 2023-02-07

Similar Documents

Publication Publication Date Title
CN100397035C (en) Three-dimensional measuring apparatus, filter lattice moire plate and illuminating means
CN110276838A (en) Model acquisition methods and device based on laser-projector
JP2018515759A (en) Device for optical 3D measurement of objects
WO2018028152A1 (en) Image acquisition device and virtual reality device
CN107783353A (en) For catching the apparatus and system of stereopsis
CN109798841A (en) The calibration system and method for camera and projector
CN110291359A (en) Three-dimensional measuring apparatus
CN110264506A (en) Imaging method and device based on space encoding
CN109900223A (en) Imaging method and device for projection grating modeling
CN113551618B (en) Fringe projection three-dimensional shape measuring method and device based on diffraction encoding phase plate
CN100417976C (en) Three-dimensional photographic technology
CN215338216U (en) Fringe projection three-dimensional shape measuring device based on diffractive optical element
CN205899162U (en) Spot projector looses based on LED light source
CN110060302B (en) Analysis system and method for calibrating camera and projector
CN110176065A (en) Model acquisition methods and device based on space encoding
CN110276792A (en) Model acquisition methods and device based on digital filter
CN109900222A (en) Model acquisition methods and device based on projection grating modeling
CN110264558A (en) Model acquisition methods and device based on laser-projector
Zhou et al. Light field projection for lighting reproduction
CN217236740U (en) Optical device for realizing high-precision three-dimensional form
CN110060301A (en) Calibration system and method for projection grating modeling
KR102080506B1 (en) 3D optical scanner
CN210570529U (en) Calibration system for camera and projector
RU153982U1 (en) DEVICE FOR MONITORING LINEAR SIZES OF THREE-DIMENSIONAL OBJECTS
KR101451792B1 (en) Image rendering apparatus and method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant