CN109068054A - Adaptive face recognition front-end system - Google Patents

Adaptive face recognition front-end system Download PDF

Info

Publication number
CN109068054A
CN109068054A CN201810865956.6A CN201810865956A CN109068054A CN 109068054 A CN109068054 A CN 109068054A CN 201810865956 A CN201810865956 A CN 201810865956A CN 109068054 A CN109068054 A CN 109068054A
Authority
CN
China
Prior art keywords
controller
photoreceptor
end system
face recognition
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810865956.6A
Other languages
Chinese (zh)
Other versions
CN109068054B (en
Inventor
彭骏
郑卓鑫
吉纲
张立
王卓
曹震
童小峰
张艳君
韩达
李楚琛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Routon Electronic Co ltd
Wuhan Precision Business Machine Co ltd
Original Assignee
Routon Electronic Co ltd
Wuhan Precision Business Machine Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Routon Electronic Co ltd, Wuhan Precision Business Machine Co ltd filed Critical Routon Electronic Co ltd
Priority to CN201810865956.6A priority Critical patent/CN109068054B/en
Publication of CN109068054A publication Critical patent/CN109068054A/en
Application granted granted Critical
Publication of CN109068054B publication Critical patent/CN109068054B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/141Control of illumination
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

The embodiment of the invention provides a self-adaptive face recognition front-end system, which comprises: the device comprises a photoreceptor, an angle regulator, a camera and a controller; the light sensor is connected with the controller and used for sending the sensed light signal to the controller; the angle adjuster is connected with the controller and used for receiving a control command of the controller and adjusting the angle of the camera; the camera is connected with the angle regulator and used for receiving the reflected light of the face; and the controller is connected with the photoreceptor and the angle regulator and is used for receiving the optical signal transmitted by the photoreceptor and controlling the angle regulator according to the optical signal to realize the self-adaptive regulation of the front-end system to the light. The invention can lead the face recognition front-end system to carry out self-adjustment according to the environment condition, thereby achieving clearer imaging effect.

Description

Adaptive recognition of face front end system
Technical field
The present embodiments relate to mode identification technology more particularly to a kind of adaptive recognition of face front end systems.
Background technique
Recognition of face front end is mainly used for capturing face and shows recognition result, generally comprises camera and display screen.It takes the photograph As head catcher's face photographic quality be influence face recognition accuracy one very big factor, so recognition of face front end system Design it is critically important.The camera and display screen of current recognition of face front end have also having for separation integrated, when deployment Typically just by naked eyes observation carry out angle debugging, furthermore current front end system for different light adaptability compared with Difference, such as indoor and outdoors are entirely two different environment, and the environment of different periods is also different, and for another example backlight is also an order The problem of number of people aches.Another problem is power saving, and current system is usually operating in 24 hours, does not have light at night When resulted in waste.Therefore, find it is a kind of can be according to carrying out the economic and practical of ego state adjusting the case where environment Recognition of face front end system, just become industry technical problem urgently to be resolved.
Summary of the invention
In view of the above-mentioned problems existing in the prior art, the embodiment of the invention provides a kind of adaptive recognition of face front end systems System.
A kind of adaptive recognition of face front end system provided in an embodiment of the present invention, comprising: photoreceptor, angle demodulator, Camera and controller;
Photoreceptor is connect with the controller, for the optical signal sensed to be sent to the controller;Angular adjustment Device is connect with the controller, for receiving the control command of the controller, and adjusts the angle of the camera;Camera shooting Head is connect with the angle demodulator, for receiving face reflected light;Controller connects with the photoreceptor and angle demodulator It connects, for receiving the optical signal of photoreceptor transmission, the angle demodulator is controlled according to the optical signal, realizes front end system pair The automatic adjusument of light.
The embodiment of the invention provides a kind of adaptive recognition of face front end systems, by recognition of face front end system Photoreceptor is added, in the adjusting by controller, recognition of face front end system can be made to carry out self according to ambient conditions and adjusted Section, reaches clearer imaging effect.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is the present invention Some embodiments for those of ordinary skill in the art without creative efforts, can also basis These attached drawings obtain other attached drawings.
Fig. 1 is adaptive recognition of face front end system schematic diagram in first embodiment of the invention;
Fig. 2 is adaptive recognition of face front end system schematic diagram in second embodiment of the invention;
Fig. 3 is adaptive recognition of face front end system schematic diagram in third embodiment of the invention;
Fig. 4 is adaptive recognition of face front end system schematic diagram in fourth embodiment of the invention;
Fig. 5 is adaptive recognition of face front end system schematic diagram in fifth embodiment of the invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Currently, the observation of naked eyes is typically just relied on to carry out angle debugging when recognition of face front end system is disposed, In this case poor for the adaptability of different light.For example, indoor light is weaker under normal conditions, and outdoor light Line is stronger, and light intensity in different time periods is also different on the same day, as 12 points to 2 points of light intensity of high noon is significantly greater than early Upper 8 points to 9 points of light intensity.In addition to this, backlight also results in the problems such as the imaging is not clear.It is a kind of based on above-mentioned status It is capable of the recognition of face front end system of the various environment of self-adaptation with regard to ready to appear.Technical solution of the present invention just aims to solve the problem that This problem, the embodiment of the invention provides a kind of adaptive recognition of face front end systems.It is the present invention first referring to Fig. 1, Fig. 1 Adaptive recognition of face front end system schematic diagram in embodiment, comprising:
Photoreceptor 102, angle demodulator 103, camera 104 and controller 101;
Photoreceptor 102 is connect with the controller 101, for the optical signal sensed to be sent to the controller 101.Specifically, the optical signal sensed is sent to the controller 101 in real time by the photoreceptor 102.
Angle demodulator 103 is connect with the controller 101, for receiving the control command of the controller 101, and Adjust the angle of the camera 104;
Camera 104 is connect, for receiving face reflected light with the angle demodulator 103;
Wherein, the optical axis of the camera 104 is parallel with the optical axis of the photoreceptor 102.
Controller 101 is connect with the photoreceptor 102 and angle demodulator 103, for receiving the transmission of photoreceptor 102 Optical signal controls the angle demodulator 103 according to the optical signal, realizes adaptive recognition of face front end system to light Automatic adjusument.Specifically, the photoreceptor 102 senses the maximum light of brightness, and calculates the maximum light of the brightness With the angle of the optical axis of photoreceptor 102, and the angle is sent to the controller 101, controller is according to the angle control It makes the angle demodulator 103 and deflects corresponding angle, make the camera 104 towards the maximum direction of brightness.
On the basis of first embodiment, second embodiment of the invention joined timer, can preferably be promoted adaptive Answer the adaptive effect of recognition of face front end system.Referring to fig. 2, Fig. 2 is adaptive recognition of face in second embodiment of the invention Front end system schematic diagram, comprising:
Photoreceptor 202, angle demodulator 203, camera 204, controller 201 and timer 2 05.
Timer 2 05 is connect with the photoreceptor 202, for starting the photoreceptor 202 at the time of setting, makes institute It states photoreceptor 202 and the optical signal sensed is sent to the controller 201.Wherein, it refers at the time of setting such as 2 pm Or the specific moment such as 9 points of morning.Photoreceptor 202, angle demodulator 203, camera 204 and controller 201 effect and this hair Identical in bright first embodiment, this will not be repeated here.
On the basis of second embodiment, third embodiment of the invention joined light aid, can preferably be promoted adaptive Answer the adaptive effect of recognition of face front end system.It is adaptive recognition of face in third embodiment of the invention referring to Fig. 3, Fig. 3 Front end system schematic diagram, comprising:
Photoreceptor 302, angle demodulator 303, camera 304, controller 301, timer 305 and light aid 306.
Light aid 306 is connect, for supplementing brightness with the controller 301.Specifically, if the photoreceptor 302 connects The maximum luminance of receipts is less than the first preset threshold, then controller 301 sends control instruction to light aid 306, the light aid 306, which shine, supplements brightness.Wherein, the first preset threshold can be 10cd, 15cd, 20cd or 30cd.Photoreceptor 302, angle Act on identical in adjuster 303, camera 304, controller 301 and timer 305 and second embodiment, details are not described herein.
On the basis of 3rd embodiment, fourth embodiment of the invention joined suspend mode unit, can preferably be promoted certainly The energy-saving effect for adapting to recognition of face front end system, to further increase its economy.Referring to fig. 4, Fig. 4 is the present invention the 4th Adaptive recognition of face front end system schematic diagram in embodiment, comprising:
Photoreceptor 402, angle demodulator 403, camera 404, controller 401, timer 405, light aid 406 and suspend mode Unit 407.
Suspend mode unit 407 is connect with the controller 401, if the received maximum luminance of the photoreceptor 402 is less than Two preset thresholds, then controller 401 issues control instruction to the suspend mode unit 407, and the suspend mode unit 407 controls adaptively Recognition of face front end system enters dormant state.Wherein, the second preset threshold can be 1cd, 2cd, 3cd or 5cd.Photoreceptor 402, the work in angle demodulator 403, camera 404, controller 401, timer 405 and light aid 406 and 3rd embodiment With identical, details are not described herein.
On the basis of fourth embodiment, fifth embodiment of the invention joined infrared inductor, can preferably be promoted The energy-saving effect of adaptive recognition of face front end system, to further increase its economy.It is the present invention the referring to Fig. 5, Fig. 5 Adaptive recognition of face front end system schematic diagram in five embodiments, comprising:
Photoreceptor 502, angle demodulator 503, camera 504, controller 501, timer 505, light aid 506, suspend mode Unit 507 and infrared inductor 508.
Infrared inductor 508 is connect with the controller 501, for incuding human infrared radiation, and according to described infrared The adaptive recognition of face front end system of radiation control enters dormant state.Specifically, if the infrared inductor 508 sends human body The instruction that infra-red radiation is 0 is to controller 501, then the controller 501 issues control instruction, institute to the suspend mode unit 507 It states suspend mode unit 507 and controls adaptive recognition of face front end system and enter dormant state.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations;Although Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be used To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features; And these are modified or replaceed, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution spirit and Range.

Claims (10)

1.一种自适应人脸识别前端系统,其特征在于,包括:1. An adaptive face recognition front-end system, characterized in that, comprising: 感光器、角度调节器、摄像头及控制器;Photoreceptor, angle adjuster, camera and controller; 感光器,与所述控制器连接,用于将感应到的光信号发送至所述控制器;a photoreceptor, connected to the controller, for sending the sensed light signal to the controller; 角度调节器,与所述控制器连接,用于接收所述控制器的控制命令,并调节所述摄像头的角度;an angle adjuster, connected to the controller, for receiving a control command from the controller, and adjusting the angle of the camera; 摄像头,与所述角度调节器连接,用于接收人脸反射光;A camera, connected to the angle adjuster, is used to receive the reflected light of the human face; 控制器,与所述感光器及角度调节器连接,用于接收感光器传送的光信号,根据所述光信号控制所述角度调节器,实现自适应人脸识别前端系统对光线的自适应调节。The controller is connected with the photoreceptor and the angle adjuster, and is used to receive the light signal transmitted by the photoreceptor, and control the angle adjuster according to the light signal, so as to realize the adaptive adjustment of the light by the adaptive face recognition front-end system . 2.根据权利要求1所述的自适应人脸识别前端系统,其特征在于,所述控制器,与所述感光器及角度调节器连接,用于接收感光器传送的光信号,根据所述光信号控制所述角度调节器,包括:所述感光器感应到亮度最大的光线,并计算所述亮度最大的光线与感光器光轴的夹角,并将所述夹角发送至所述控制器,控制器根据所述夹角控制所述角度调节器偏转相应的角度,使所述摄像头朝向亮度最大的方向。2. The adaptive face recognition front-end system according to claim 1, wherein the controller is connected to the photoreceptor and the angle adjuster for receiving the optical signal transmitted by the photoreceptor, according to the The light signal controls the angle regulator, including: the photoreceptor senses the light with the highest brightness, and calculates the angle between the light with the highest brightness and the optical axis of the photoreceptor, and sends the angle to the control The controller controls the angle adjuster to deflect by a corresponding angle according to the included angle, so that the camera faces the direction with the maximum brightness. 3.根据权利要求1所述的自适应人脸识别前端系统,其特征在于,所述摄像头的光轴与所述感光器的光轴平行。3. The adaptive face recognition front-end system according to claim 1, wherein the optical axis of the camera is parallel to the optical axis of the photoreceptor. 4.根据权利要求1所述的自适应人脸识别前端系统,其特征在于,所述感光器实时将感应到的光信号发送至所述控制器。4. The adaptive face recognition front-end system according to claim 1, wherein the photoreceptor sends the sensed light signal to the controller in real time. 5.根据权利要求1所述的自适应人脸识别前端系统,其特征在于,还包括:5. adaptive face recognition front-end system according to claim 1, is characterized in that, also comprises: 定时器,与所述感光器连接,用于在设定的时刻启动所述感光器,使所述感光器将感应到的光信号发送至所述控制器。A timer, connected to the photoreceptor, is used to activate the photoreceptor at a set time, so that the photoreceptor sends the sensed light signal to the controller. 6.根据权利要求1所述的自适应人脸识别前端系统,其特征在于,还包括:6. adaptive face recognition front-end system according to claim 1, is characterized in that, also comprises: 补光器,与所述控制器连接,用于补充光亮度。The fill light device is connected with the controller and is used to supplement light brightness. 7.根据权利要求6所述的自适应人脸识别前端系统,其特征在于,所述补光器,与所述控制器连接,用于补充光亮度,包括:7. The adaptive face recognition front-end system according to claim 6, wherein the supplementary light device is connected with the controller for supplementary brightness, comprising: 若所述感光器接收的最大光亮度小于第一预设阈值,则控制器发送控制指令至补光器,所述补光器发光补充光亮度。If the maximum light brightness received by the photoreceptor is less than the first preset threshold, the controller sends a control command to the light fill device, and the light fill device emits light to supplement the light brightness. 8.根据权利要求1所述的自适应人脸识别前端系统,其特征在于,还包括:8. adaptive face recognition front-end system according to claim 1, is characterized in that, also comprises: 休眠单元,与所述控制器连接,若所述感光器接收的最大光亮度小于第二预设阈值,则控制器向所述休眠单元发出控制指令,所述休眠单元控制自适应人脸识别前端系统进入休眠状态。A dormant unit connected to the controller, if the maximum light brightness received by the photoreceptor is less than a second preset threshold, the controller sends a control instruction to the dormant unit, and the dormant unit controls the adaptive face recognition front end The system goes into hibernation. 9.根据权利要求8所述的自适应人脸识别前端系统,其特征在于,还包括:9. adaptive face recognition front-end system according to claim 8, is characterized in that, also comprises: 红外感应器,与所述控制器连接,用于感应人体红外辐射,并根据所述红外辐射控制自适应人脸识别前端系统进入休眠状态。The infrared sensor is connected with the controller, and is used to sense the infrared radiation of the human body, and control the adaptive face recognition front-end system to enter the dormant state according to the infrared radiation. 10.根据权利要求9所述的自适应人脸识别前端系统,其特征在于,所述红外感应器,与所述控制器连接,用于感应人体红外辐射,并根据所述红外辐射控制自适应人脸识别前端系统进入休眠状态,包括:10. The adaptive face recognition front-end system according to claim 9, wherein the infrared sensor is connected to the controller for sensing human body infrared radiation, and controlling the adaptive face recognition according to the infrared radiation. The face recognition front-end system enters a dormant state, including: 若所述红外感应器发送人体红外辐射为0的指令至控制器,则所述控制器向所述休眠单元发出控制指令,所述休眠单元控制自适应人脸识别前端系统进入休眠状态。If the infrared sensor sends an instruction that the infrared radiation of the human body is 0 to the controller, the controller sends a control instruction to the sleep unit, and the sleep unit controls the adaptive face recognition front-end system to enter a sleep state.
CN201810865956.6A 2018-08-01 2018-08-01 Adaptive face recognition front-end system Active CN109068054B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810865956.6A CN109068054B (en) 2018-08-01 2018-08-01 Adaptive face recognition front-end system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810865956.6A CN109068054B (en) 2018-08-01 2018-08-01 Adaptive face recognition front-end system

Publications (2)

Publication Number Publication Date
CN109068054A true CN109068054A (en) 2018-12-21
CN109068054B CN109068054B (en) 2020-07-07

Family

ID=64832519

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810865956.6A Active CN109068054B (en) 2018-08-01 2018-08-01 Adaptive face recognition front-end system

Country Status (1)

Country Link
CN (1) CN109068054B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070081261A1 (en) * 2005-10-07 2007-04-12 Rolin Gebelein Methods and Apparatus Providing Improved Visual Capabilities of Optical Instruments
JP2011090236A (en) * 2009-10-26 2011-05-06 Hitachi Omron Terminal Solutions Corp Automatic angle setting display machine
CN103895583A (en) * 2014-04-14 2014-07-02 上海电机学院 Navigation rack for vehicle
CN203745952U (en) * 2013-12-11 2014-07-30 联想(北京)有限公司 Electronic equipment
CN104902080A (en) * 2015-04-30 2015-09-09 广东欧珀移动通信有限公司 Information interaction method and device
CN105227834A (en) * 2015-09-09 2016-01-06 深圳市沃特沃德科技有限公司 The photographic method of mobile intelligent terminal and device
CN205080618U (en) * 2015-10-13 2016-03-09 刘劲飞 Vehicle event data recorder based on infrared induction self -adaptation adjustment direction of making a video recording
CN105459079A (en) * 2016-01-08 2016-04-06 金陵科技学院 Solar energy robot for chemistry accident treatment and working method
CN206021380U (en) * 2016-08-11 2017-03-15 吴翔宇 Teaching student computer

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070081261A1 (en) * 2005-10-07 2007-04-12 Rolin Gebelein Methods and Apparatus Providing Improved Visual Capabilities of Optical Instruments
JP2011090236A (en) * 2009-10-26 2011-05-06 Hitachi Omron Terminal Solutions Corp Automatic angle setting display machine
CN203745952U (en) * 2013-12-11 2014-07-30 联想(北京)有限公司 Electronic equipment
CN103895583A (en) * 2014-04-14 2014-07-02 上海电机学院 Navigation rack for vehicle
CN104902080A (en) * 2015-04-30 2015-09-09 广东欧珀移动通信有限公司 Information interaction method and device
CN105227834A (en) * 2015-09-09 2016-01-06 深圳市沃特沃德科技有限公司 The photographic method of mobile intelligent terminal and device
CN205080618U (en) * 2015-10-13 2016-03-09 刘劲飞 Vehicle event data recorder based on infrared induction self -adaptation adjustment direction of making a video recording
CN105459079A (en) * 2016-01-08 2016-04-06 金陵科技学院 Solar energy robot for chemistry accident treatment and working method
CN206021380U (en) * 2016-08-11 2017-03-15 吴翔宇 Teaching student computer

Also Published As

Publication number Publication date
CN109068054B (en) 2020-07-07

Similar Documents

Publication Publication Date Title
CN109640442B (en) Classroom light environment control system based on NB-IOT
US11140319B2 (en) Eye-tracking module with scenario-based mode switching function
CN101872106B (en) Intelligent infrared camera and intelligent infrared light intensity adjustment method thereof
CN103796374B (en) An LED lighting control system and its working method
CN216649794U (en) Autonomous adjustment light supplementing device based on inspection robot
CN102938851B (en) A kind of automatic stand-by processing method and set-top box based on set-top box
KR20140077802A (en) The light device and the method for controlling the same
CN203552276U (en) Facial recognition device applicable to wide-dynamic-range ambient light
CN105554981A (en) Table lamp adjusting method and device
CN205750263U (en) A kind of projector curtain regulating brightness
CN109068054A (en) Adaptive face recognition front-end system
CN205864557U (en) Camera with automatic light supplementing function
KR20140085851A (en) Camera having dimming function of an infrared lamp for zoom magnification
CN202583666U (en) Night-vision illuminating system
CN105744702A (en) Intelligent acousto-optic illumination control method
WO2018219292A1 (en) Background illumination apparatus for information terminal
TWI866509B (en) Adaptive display backlight control system and method for controlling the backlight
CN115941867A (en) Energy-saving infrared supplementary light method and system for camera
CN210328089U (en) Illumination control device
CN206072849U (en) Eye-protecting lamp
CN105627264A (en) Device and method for controlling brightness of bulb
CN109637498A (en) A kind of control system and control method that computer screen brightness is intelligently adjusted
JP2017037746A (en) Lighting control system, lighting control device, and lighting control method
CN105809150A (en) Method and system for turning on fluorescent lamp on basis of energy saving
CN205754987U (en) A kind of inductive lightning lamp system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant