CN113343001B - Data storage system of face recognition terminal - Google Patents

Data storage system of face recognition terminal Download PDF

Info

Publication number
CN113343001B
CN113343001B CN202110584066.XA CN202110584066A CN113343001B CN 113343001 B CN113343001 B CN 113343001B CN 202110584066 A CN202110584066 A CN 202110584066A CN 113343001 B CN113343001 B CN 113343001B
Authority
CN
China
Prior art keywords
module
data
portrait
electrically connected
central database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110584066.XA
Other languages
Chinese (zh)
Other versions
CN113343001A (en
Inventor
姚启良
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Chuguan Information Technology Co ltd
Original Assignee
Wuhan Chuguan Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Chuguan Information Technology Co ltd filed Critical Wuhan Chuguan Information Technology Co ltd
Priority to CN202110584066.XA priority Critical patent/CN113343001B/en
Publication of CN113343001A publication Critical patent/CN113343001A/en
Application granted granted Critical
Publication of CN113343001B publication Critical patent/CN113343001B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/55Clustering; Classification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Collating Specific Patterns (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a data storage system of a face recognition terminal, and particularly relates to the technical field of face recognition. According to the invention, the module to be deleted and the quick access module are arranged, the device can respond to the face recognition process through two ways, so that the response to the recognition process through different ways is ensured when the face recognition is carried out, the face recognition efficiency is improved, and the device can delete the portrait data of the client needing to delete the information through the module to be deleted, so that the storage space of the central database is increased, and the use effect of the device is improved.

Description

Data storage system of face recognition terminal
Technical Field
The invention relates to the technical field of face recognition, in particular to a data storage system of a face recognition terminal.
Background
Face recognition is a biological recognition technology for carrying out identity recognition based on facial feature information of a person, a camera or a camera is used for collecting images or video streams containing the face, and automatically detecting and tracking the face in the images, so that a series of related technologies for carrying out face recognition on the detected face are carried out, face data collected by the camera are stored through a data storage system, but the existing data storage system needs to respond through a database when the collected face data are extracted and compared, a large amount of data information is stored in the database, and the database cannot respond to instructions quickly when the collected face data are extracted, so that the face recognition efficiency is influenced, the storage space of a face recognition terminal is limited, and the data storage system cannot carry out efficient data storage, so that the operation speed of the device is influenced, and the operation efficiency and the processing effect are difficult to guarantee.
Disclosure of Invention
In order to overcome the defects in the prior art, the invention provides a data storage system of a face recognition terminal, which aims to solve the technical problems that: the existing data storage system needs to respond through a database when extracting and comparing the collected face data, a large amount of data information is stored in the database, and the data cannot be quickly responded to instructions when extracting, so that the efficiency of face recognition is affected, and the storage space of the face recognition terminal is limited, so that the data storage system cannot conduct efficient data storage, the running speed of the device is affected, and the running efficiency and the processing effect are difficult to guarantee.
In order to achieve the above purpose, the present invention provides the following technical solutions: the utility model provides a data storage system of face identification terminal, includes control panel, control panel's output is connected with external recognition module's input electricity, external recognition module's output is connected with data receiving module's input electricity, data receiving module's output is connected with data encryption module's input electricity, data encryption module's output is connected with central database's input electricity, central database's output is connected with data access record module's input electricity, data access record module's output is connected with central database's input electricity, data access record module's output is connected with categorised storage module's input electricity, categorised storage module's output is connected with data access record module's input electricity, categorised storage module's output is connected with data extraction bank's input electricity, data extraction bank's output is connected with data comparison module's input electricity, data comparison module's output is connected with control panel's input electricity, control panel's output is connected with data access record module's input electricity, data access record module's output is connected with categorised storage module's input electricity, categorised storage module's output is connected with data comparison module's input electricity, data extraction module is connected with data comparison module's input.
As a further aspect of the invention: the classified storage module is internally provided with a module to be deleted, a conventional access module and a quick access module, the output end of the quick access module is electrically connected with the input end of the data extraction library, the output end of the conventional access module is electrically connected with the input end of the data access recording module, and the output end of the module to be deleted is electrically connected with the input end of the data deletion module.
As a further aspect of the invention: the external identification module is internally provided with a portrait region segmentation module and a portrait characteristic acquisition module, and the output end of the portrait characteristic acquisition module is electrically connected with the input end of the data receiving module.
As a further aspect of the invention: when the control panel identifies the deleting operation, the module to be deleted responds to the control panel and then transmits the data to be deleted in the central database to the data deleting module for deleting, so that the data stored in the central database is reduced, and more storage space is provided for the central database.
The conventional access module can record the facial feature information with fewer times of use, and when the conventional access module receives the instruction, the instruction is fed back, and then the central database is accessed through the data access recording module, so that the facial feature data are extracted from the central database.
The quick access module can record frequently used face characteristic information, then sends an instruction to the central database through the data access recording module, so that the frequently used face characteristic information in the central database is extracted, the extracted information is transmitted to the data extraction library for storage, and when the quick access module receives the instruction, the quick access module can directly extract data from the data extraction library, and then compares the image characteristics through the data comparison module.
As a further aspect of the invention: the portrait region segmentation module can process portrait data acquired by the external recognition module, the portrait region segmentation module can divide an eye region, a nose region and a mouth region of a portrait, and can carry out image enhancement processing on the characteristics of the divided regions, and then the portrait region segmentation module transmits the divided data to the portrait characteristic acquisition module.
The portrait characteristic acquisition module can receive the data transmitted by the portrait region segmentation module, then analyze the received data transmitted by the portrait region segmentation module, acquire the division region of the portrait and the enhanced part of the image during analysis, and then transmit the acquired data to the data receiving module.
As a further aspect of the invention: the data encryption module can process the data after the format conversion of the data receiving module, so that the converted data can be encrypted through the data encryption module, information theft of the portrait characteristic data is prevented by illegal access instructions, and the encrypted data is transmitted to the central database for storage by the data encryption module.
The central database can store the portrait features after data encryption, after receiving the instruction of the external identification module, the central database can analyze the portrait collected by the external identification module, then the data access recording module gives the instruction to the classification storage module, the classification storage module can respond to the data access recording module to extract portrait feature information in the central database or the data extraction database, and then the data comparison module compares the portrait features.
The invention has the beneficial effects that:
1. According to the invention, the module to be deleted, the conventional access module and the quick access module are arranged, when the central database receives different times of access, the data access record module receives instructions to search, and when the search requirements meet the range of the conventional access module or the quick access module, the classification storage module accesses the central database or the data extraction library through the range which corresponds to the range in the data access record module, so that portrait characteristic data are extracted from the central database or the data extraction library and transmitted to the data comparison module, and then the portrait characteristic is compared, when the control panel identifies the deletion operation, the module to be deleted responds to the control panel and then transmits data to be deleted in the central database to the data deletion module to be deleted, so that more storage space is provided for the central database;
2. According to the invention, the image region segmentation module and the image feature acquisition module are arranged, when the control panel receives an instruction to control the external recognition module to shoot the image features, the external recognition module can transmit image data to the image region segmentation module for processing, the image region segmentation module can divide the eye region, the nose region and the mouth region of the image, the features of the divided regions can be subjected to image enhancement processing, then the image region segmentation module transmits the divided data to the image feature acquisition module, then the image feature acquisition module analyzes the data transmitted by the received image region segmentation module, and can acquire the division region and the image enhancement part of the image during analysis, and then the acquired data is transmitted to the data receiving module, so that the external recognition module can effectively divide the acquired image through the image region segmentation module, and the image feature acquisition module can effectively process the acquired image, thereby improving the working efficiency of the external recognition module, and simultaneously reducing the size of the acquired image data, and improving the utilization efficiency of the central data storage space.
Drawings
FIG. 1 is a block diagram of a system of the present invention;
in the figure: the system comprises a control panel 1, an external identification module 2, a portrait area segmentation module 201, a portrait characteristic acquisition module 202, a data receiving module 3, a data encryption module 4, a central database 5, a data access recording module 6, a classified storage module 7, a module to be deleted 701, a conventional access module 702, a quick access module 703, a data extraction library 8, a data comparison module 9 and a data deletion module 10.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
As shown in fig. 1, the invention provides a data storage system of a face recognition terminal, which comprises a control panel 1, wherein the output end of the control panel 1 is electrically connected with the input end of an external recognition module 2, the output end of the external recognition module 2 is electrically connected with the input end of a data receiving module 3, the output end of the data receiving module 3 is electrically connected with the input end of a data encryption module 4, the output end of the data encryption module 4 is electrically connected with the input end of a central database 5, the output end of the central database 5 is electrically connected with the input end of a data access recording module 6, the output end of the data access recording module 6 is electrically connected with the input end of a classification storage module 7, the output end of the classification storage module 7 is electrically connected with the input end of a data extraction library 8, the output end of the data extraction library 8 is electrically connected with the input end of a data comparison module 9, the output end of the data comparison module 9 is electrically connected with the input end of the control panel 1, the output end of the control panel 1 is electrically connected with the input end of the data access recording module 6, the output end of the data access recording module 6 is electrically connected with the input end of the classification storage module 7, the output end of the classification storage module 7 is electrically connected with the input end of the data extraction module 9 is electrically connected with the input end of the data comparison module 9.
The classified storage module 7 is internally provided with a module 701 to be deleted, a conventional access module 702 and a quick access module 703, the output end of the quick access module 703 is electrically connected with the input end of the data extraction library 8, the output end of the conventional access module 702 is electrically connected with the input end of the data access recording module 6, and the output end of the module 701 to be deleted is electrically connected with the input end of the data deletion module 10.
The external identification module 2 is internally provided with a portrait region segmentation module 201 and a portrait characteristic acquisition module 202, and the output end of the portrait characteristic acquisition module 202 is electrically connected with the input end of the data receiving module 3.
The to-be-deleted module 701 is configured to respond to the control panel 1 when the control panel 1 recognizes the deletion operation, and then transmit the data to be deleted in the central database 5 to the data deletion module 10 for deletion, thereby reducing the data stored in the central database 5 and providing more storage space for the central database 5.
Conventional access module 702: the conventional access module 702 can record facial feature information with fewer uses, and when the conventional access module 702 receives the instruction, the instruction is fed back, and then the central database 5 is accessed through the data access recording module 6, so that the facial feature data is extracted from the central database 5.
The quick access module 703 can record frequently used face feature information, then send an instruction to the central database 5 through the data access recording module 6, so as to extract the frequently used face feature information in the central database 5, and transmit the extracted information to the data extraction library 8 for storage, when the quick access module receives the instruction, the quick access module 703 can directly extract data from the data extraction library 8, and then compare the face features through the data comparison module 9.
The portrait region segmentation module 201 can process portrait data acquired by the external recognition module 2, the portrait region segmentation module 201 can divide an eye region, a nose region and a mouth region of a portrait, and can perform image enhancement processing on features of the divided regions, and then the portrait region segmentation module 201 transmits the divided data to the portrait feature acquisition module 202.
The portrait characteristic acquisition module 202 can receive the data transmitted by the portrait region segmentation module 201, then analyze the received data transmitted by the portrait region segmentation module 201, acquire the region of division of the portrait and the enhanced part of the image during analysis, and then transmit the acquired data to the data receiving module 3.
The data encryption module 4, after the portrait characteristic acquisition module 202 transmits the data to the data receiving module 3, the data receiving module 3 performs format conversion on the received data, the converted data is transmitted to the data encryption module 4 by the data receiving module 3 to encrypt the data, an instruction for preventing illegal access is used for information theft of the portrait characteristic data, and the encrypted data is transmitted to the central database 5 by the data encryption module 4 to be stored.
The central database 5 can store the portrait features after data encryption, after receiving the instruction of the external identification module 2, the central database 5 can analyze the portrait collected by the external identification module 2, then the data access recording module 6 gives the instruction to the classification storage module 7, the classification storage module 7 can respond to the data access recording module 6 to extract portrait feature information in the central database 5 or the data extraction database 8, and then the data comparison module 9 can compare the portrait features.
The human face recognition process is responded through two ways, so that the human face recognition process can be responded through different ways when the human face recognition is carried out, the human face recognition efficiency is improved, the human face data of a client needing to delete information can be deleted through the module 701 to be deleted, the storage space of the central database 5 is increased, and the use effect of the human face recognition device is improved.
The external recognition module 2 is enabled to effectively divide the acquired human images through the human image region segmentation module 201 by arranging the control panel 1, and the acquired human images are efficiently processed through the human image feature acquisition module 202, so that the working efficiency of the external recognition module 2 is improved, the size of the acquired human image data is reduced, and the utilization efficiency of the storage space of the central database 5 is improved.
By arranging the data encryption module 4, the data receiving module 3 performs format conversion on the data transmitted by the external identification module 2, and the data receiving module 3 can transmit the received data to the data encryption module 4, so that the data encryption module 4 can encrypt the received data, personal information can be protected, and illegal access to the central database 5 is prevented from stealing the personal information.
The last points to be described are: while the invention has been described in detail in the foregoing general description and with reference to specific embodiments, the foregoing embodiments are merely illustrative of the technical aspects of the invention and are not limiting thereof; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the invention.

Claims (4)

1. The data storage system of the face recognition terminal comprises a control panel (1), and is characterized in that: the output end of the control panel (1) is electrically connected with the input end of the external identification module (2), the output end of the external identification module (2) is electrically connected with the input end of the data receiving module (3), the output end of the data receiving module (3) is electrically connected with the input end of the data encryption module (4), the output end of the data encryption module (4) is electrically connected with the input end of the central database (5), the output end of the central database (5) is electrically connected with the input end of the data access recording module (6), the output end of the data access recording module (6) is electrically connected with the input end of the central database (5), the output end of the data access recording module (6) is electrically connected with the input end of the classification storage module (7), the output end of the classification storage module (7) is electrically connected with the input end of the data extraction module (8), the output end of the data extraction module (8) is electrically connected with the input end of the control panel (9) in comparison with the input end of the control panel (1), the output end of the classification storage module (7) is electrically connected with the input end of the data deleting module (10), the output end of the central database (5) is electrically connected with the input end of the data comparing module (9), and the output end of the external identification module (2) is electrically connected with the input end of the data comparing module (9);
The device comprises a classification storage module (7), wherein a module to be deleted (701), a conventional access module (702) and a quick access module (703) are arranged in the classification storage module (7), the output end of the quick access module (703) is electrically connected with the input end of a data extraction library (8), the output end of the conventional access module (702) is electrically connected with the input end of a data access recording module (6), and the output end of the module to be deleted (701) is electrically connected with the input end of a data deletion module (10);
The module to be deleted (701) is that when the control panel (1) identifies the deletion operation, the control panel (1) is responded and then data needing to be deleted in the central database (5) are transmitted to the data deletion module (10) for deletion, so that the data stored in the central database (5) are reduced, and more storage space is provided for the central database (5);
Conventional access module (702): the conventional access module (702) can record face characteristic information with fewer times of use, the conventional access module (702) feeds back the instruction after receiving the instruction, and then the conventional access module accesses the central database (5) through the data access recording module (6), so that the face characteristic data is extracted from the central database (5);
The quick access module (703) can record frequently used face feature information, then, a data access recording module (6) sends an instruction to the central database (5), so that the frequently used face feature information in the central database (5) is extracted, the extracted information is transmitted to the data extraction library (8) to be stored, and when the quick access module receives the instruction, the quick access module (703) can directly extract data from the data extraction library (8), and then, the data comparison module (9) compares the image features.
2. A data storage system of a face recognition terminal according to claim 1, wherein: the external identification module (2) is internally provided with a portrait region segmentation module (201) and a portrait characteristic acquisition module (202), and the output end of the portrait characteristic acquisition module (202) is electrically connected with the input end of the data receiving module (3).
3. A data storage system of a face recognition terminal according to claim 2, wherein: the portrait region segmentation module (201) can process portrait data acquired by the external identification module (2), the portrait region segmentation module (201) can divide an eye region, a nose region and a mouth region of a portrait, and can carry out image enhancement processing on the characteristics of the divided regions, and then the portrait region segmentation module (201) transmits the divided data to the portrait characteristic acquisition module (202);
the portrait characteristic acquisition module (202) can receive data transmitted by the portrait region segmentation module (201), then analyze the received data transmitted by the portrait region segmentation module (201), acquire the division region of the portrait and the enhanced part of the image during analysis, and then transmit the acquired data to the data receiving module (3).
4. A data storage system of a face recognition terminal according to claim 2, wherein: the data encryption module (4) can process the data after the format conversion of the data receiving module (3), so that the converted data can be encrypted through the data encryption module (4), the illegal access instruction is prevented from stealing the portrait characteristic data, and the encrypted data is transmitted to the central database (5) for storage by the data encryption module (4);
the central database (5) can store the portrait features after data encryption, after receiving the instruction of the external identification module (2), the central database (5) can analyze the portrait collected by the external identification module (2), then the data access recording module (6) gives the instruction to the classification storage module (7), the classification storage module (7) can respond to the data access recording module (6) to extract portrait feature information in the central database (5) or the data extraction database (8), and then the data comparison module (9) compares the portrait features.
CN202110584066.XA 2021-05-27 2021-05-27 Data storage system of face recognition terminal Active CN113343001B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110584066.XA CN113343001B (en) 2021-05-27 2021-05-27 Data storage system of face recognition terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110584066.XA CN113343001B (en) 2021-05-27 2021-05-27 Data storage system of face recognition terminal

Publications (2)

Publication Number Publication Date
CN113343001A CN113343001A (en) 2021-09-03
CN113343001B true CN113343001B (en) 2024-05-07

Family

ID=77471692

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110584066.XA Active CN113343001B (en) 2021-05-27 2021-05-27 Data storage system of face recognition terminal

Country Status (1)

Country Link
CN (1) CN113343001B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115080640B (en) * 2022-07-26 2023-06-02 三三智能科技(日照)有限公司 Data storage system based on PVDF piezoelectric film ultrasonic sensor and application

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090119565A (en) * 2008-05-16 2009-11-19 중앙대학교 산학협력단 Apparatus for face detect and recognition based on embedded system and face dectect and recognition in using the apparatus
KR101297295B1 (en) * 2013-02-14 2013-08-14 우원소프트 주식회사 Security control system by face recognition
CN108376256A (en) * 2018-05-08 2018-08-07 兰州大学 One kind is based on ARM processing platform dynamic processing face identification systems and its equipment
CN109214310A (en) * 2018-08-16 2019-01-15 安徽超清科技股份有限公司 Improve the method and face identification system of recognition of face efficiency
CN112052730A (en) * 2020-07-30 2020-12-08 广州市标准化研究院 3D dynamic portrait recognition monitoring device and method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090119565A (en) * 2008-05-16 2009-11-19 중앙대학교 산학협력단 Apparatus for face detect and recognition based on embedded system and face dectect and recognition in using the apparatus
KR101297295B1 (en) * 2013-02-14 2013-08-14 우원소프트 주식회사 Security control system by face recognition
CN108376256A (en) * 2018-05-08 2018-08-07 兰州大学 One kind is based on ARM processing platform dynamic processing face identification systems and its equipment
CN109214310A (en) * 2018-08-16 2019-01-15 安徽超清科技股份有限公司 Improve the method and face identification system of recognition of face efficiency
CN112052730A (en) * 2020-07-30 2020-12-08 广州市标准化研究院 3D dynamic portrait recognition monitoring device and method

Also Published As

Publication number Publication date
CN113343001A (en) 2021-09-03

Similar Documents

Publication Publication Date Title
Li et al. Cropping and attention based approach for masked face recognition
CN100481112C (en) Human face recognition system and recognition method
CN108229427B (en) Identity security verification method and system based on identity document and face recognition
US20200151434A1 (en) Face image retrieval methods and systems, photographing apparatuses, and computer storage media
CN105825176A (en) Identification method based on multi-mode non-contact identity characteristics
WO2024001123A1 (en) Image recognition method and apparatus based on neural network model, and terminal device
CN109214300A (en) A kind of suspect's method for early warning and its system based on recognition of face
WO2018040306A1 (en) Method for detecting frequent passers-by in monitoring video
CN104836991A (en) Camera with privacy protection function
CN113343001B (en) Data storage system of face recognition terminal
CN202815870U (en) Certificate photograph and face automatic identification system
Khatun et al. A deep four-stream siamese convolutional neural network with joint verification and identification loss for person re-detection
Ullah et al. Gender recognition from face images with dyadic wavelet transform and local binary pattern
CN212160688U (en) Face recognition integrated front-end device with biological feature privacy protection function
CN104915590A (en) Human face recognition system and method applied to computer encryption
CN104463143A (en) Identification system based on image processing
Fu Design of facial recognition system based on visual communication effect
WO2023093241A1 (en) Pedestrian re-identification method and apparatus, and storage medium
CN101901332A (en) Fingerprint identification system and method
Xu et al. Asymmetric adversarial-based feature disentanglement learning for cross-database micro-expression recognition
WO2016082253A1 (en) Three-dimensional face recognition method for entry and exit administration
CN101196985B (en) Eye positioning method used for complex background image
Megahed et al. Face2face manipulation detection based on histogram of oriented gradients
Ardakany et al. An extended local binary pattern for gender classification
CN208969684U (en) Lip reading identifying system under complex environment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant