CN108229427A - A kind of identity-based certificate and the identity security verification method and system of recognition of face - Google Patents

A kind of identity-based certificate and the identity security verification method and system of recognition of face Download PDF

Info

Publication number
CN108229427A
CN108229427A CN201810085256.5A CN201810085256A CN108229427A CN 108229427 A CN108229427 A CN 108229427A CN 201810085256 A CN201810085256 A CN 201810085256A CN 108229427 A CN108229427 A CN 108229427A
Authority
CN
China
Prior art keywords
image
face
certificate
identity
verification
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810085256.5A
Other languages
Chinese (zh)
Other versions
CN108229427B (en
Inventor
尤新革
赵心怡
鲁剑箫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Huake heding Information Technology Co.,Ltd.
Shenzhen Huazhong University of Science and Technology Research Institute
Original Assignee
Nanjing China Tech And Ancient Cooking Vessel Information Technology Co Ltd
Shenzhen Huazhong University of Science and Technology Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing China Tech And Ancient Cooking Vessel Information Technology Co Ltd, Shenzhen Huazhong University of Science and Technology Research Institute filed Critical Nanjing China Tech And Ancient Cooking Vessel Information Technology Co Ltd
Priority to CN201810085256.5A priority Critical patent/CN108229427B/en
Publication of CN108229427A publication Critical patent/CN108229427A/en
Application granted granted Critical
Publication of CN108229427B publication Critical patent/CN108229427B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/213Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
    • G06F18/2135Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on approximation criteria, e.g. principal component analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/285Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/446Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering using Haar-like filters, e.g. using integral image techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/50Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Library & Information Science (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The invention discloses a kind of identity-based certificate and the identity security verification method and system of recognition of face, method includes:It obtains and stores log-on message and the system registry step of registered images, it acquires certificate information, image, scan image and real-time face image and the information collection step of database inquired according to certificate information in chip, differentiate the certificate false distinguishing step of the certificate true and false according to image in chip and scan image, the image preprocessing step of Face datection and pretreatment is carried out to image, verification holder and the whether consistent face verification step of the certificate owner and storage or the database update step for updating the data registered images in library;System for carrying out the process includes:Video streaming image unit, certificate information collection unit, image pre-processing unit, face verification unit and database management unit.The present invention can improve efficiency and the accuracy of certificate false distinguishing and face verification, and be applicable to carry out the scene of identity security verification based on various identity cards.

Description

A kind of identity-based certificate and the identity security verification method and system of recognition of face
Technical field
The invention belongs to the safety certification field of living things feature recognition, more particularly, to a kind of identity-based certificate and The identity security verification method and system of recognition of face.
Background technology
Identity security verification is widely used in the scenes such as bank, customs, airport, railway station, with non-in identity document Universal and face recognition technology the high speed development of contact intelligent chip, more and more occasions are for authentication system Simplification, high efficiency, accuracy propose higher requirement.
On the one hand identity security verification needs to verify the true and false of certificate, on the other hand need to verify that holder owns with certificate Whether person is consistent.At present, it for the former, is mainly identified using the anti-fake point of certificate in itself or artificial judgment chip It reads photo and whether document surface printing photo is consistent.And for the latter, then usually requiring staff is manually veritified, It not only takes considerable time, and the highly reliable experience and ability dependent on staff verified so that the peace of whole system Full property significantly reduces.
It is more existing at present that system is verified based on the identity security of China second-generation identity card and face recognition technology, in order to solve Chip storage photograph pixel it is extremely low can not application image treatment technology the problem of, part system take networking obtain the original photograph of certificate The method that piece is compared again with scene photograph, the requirement of networking lead to application range critical constraints.
Application No. is CN102902959A, it is entitled " based on China second-generation identity card storage certificate photo face identification method and The scheme that the patent document of system " proposes demonstrate,proves data center without access identity, but the program needs to take greatly chip photo Complicated pre-treatment step is measured, and determination decisions still rely on face training library.
Application No. is CN102129555A, entitled " method and system that authentication is carried out based on second generation identity card " Patent document, complete verification to holder identity by comparing identity card surface scan photo and live-pictures, but due to Scanning the photo that obtains, there are can not normalized influence of noise caused by hardware so that the feature of extraction can not accurately express figure As information, so as to which system identification accuracy is relatively low, the strict demand in safety check scene can not be met.
In addition, domestic there is no the identity security verification system that can handle the identity documents such as Hongkong and Macro's pass and passport at present System can not meet the needs of customs or international large-scale activity safety check scene.
Invention content
In view of the drawbacks of the prior art and Improvement requirement, the present invention provides a kind of identity-based certificate and recognitions of face Identity security verification method and system it is intended that independent of external data base, can directly verify holder and certificate institute The consistency for the person of having, so as to improve the efficiency of verification and accuracy rate, while number of units after gradually expanding with verification systematic difference According to library, to realize the inclusive authentication based on various identity cards such as No.2 residence card, Hongkong and Macro's pass, passports, into one Step ensures public safety.
To achieve the above object, one side according to the invention provides a kind of identity-based certificate and recognition of face Identity security verification method, include the following steps:
(1) system registry step:The certificate information of user identity certificate is obtained as log-on message, and acquires user front Then log-on message and registered images are stored in database by clearly facial image without a hat on as registered images;Identity document can To include but not limited to No.2 residence card, Hongkong and Macro's pass, passport;The certificate information of identity document include certificate number and The name of holder;
(2) information collection step:Obtain the certificate information of user identity certificate, image and document surface printing in chip The scan image of photo, and acquire real-time face image;Database is inquired according to certificate information, if inquiring relevant entry, Registered images are extracted from query result;If inquiry creates one according to certificate information in the database less than relevant entry New entry, registered images are sky in the new entry created;
(3) certificate false distinguishing step:It is special that the shallow-layer of image and scan image in the chip got by step (2) is extracted respectively Sign, and carry out consistency checking;If image is consistent with scan image in chip, it is transferred to step (4);If it image and is swept in chip Tracing then verified and do not passed through as inconsistent, and verification terminates;
(4) image preprocessing step:If in step (2), registered images are got, then face are carried out to real-time face image Detection and pretreatment obtain the first contrast images, and carry out Face datection and pretreatment to registered images, obtain the second comparison diagram Picture;If in step (2), registered images have not been obtained, then Face datection and pretreatment is carried out to real-time face image, obtains first Contrast images, and Face datection and pretreatment are carried out to the higher image of picture quality in image in chip and scan image, it obtains To the second contrast images;By carrying out Face datection and pretreatment to image, the Efficiency and accuracy of face verification can be improved;
(5) face verification step:The first contrast images got by step (4) and the second contrast images are extracted respectively Further feature, and calculate the matching degree of the two;If matching degree is higher than first threshold, it is transferred to step (6);Otherwise, it verifies obstructed It crosses, verification terminates;
(6) database update step:If in step (2), registered images have not been obtained, then by the real-time face of this acquisition Image is stored in the corresponding entry of database, and be transferred to step (7) as registered images;If in step (2), registration is got Image, and the time interval of current authentication time gap last time data base update time is more than second threshold, then adopts this The real-time face image of collection updates the data corresponding entry in library, and be transferred to step (7) as registered images;If step (2) In, registered images are got, and the time interval of current authentication time gap last time data base update time is less than second Threshold value is then transferred to step (7);
(7) it is verified, verification terminates.
Further, in step (5) for judge face verification whether by first threshold rule of thumb set;First Threshold value is bigger, then the computation complexity of face verification is lower, but the accuracy of face verification is lower;On the contrary, first threshold is got over Small, then the accuracy of face verification is higher, but the computation complexity of face verification is higher.
Further, in step (5), between the further feature of the further feature of the first contrast images and the second contrast images Matching degree for both COS distance.
Further, the second threshold for determining whether to update registered images in step (6) is set according to practical application scene; Second threshold is smaller, then registered images update is more frequent, and the accuracy of face verification is higher, but it is larger to update expense;On the contrary, Second threshold is smaller, then more infrequently, update expense is smaller, but the accuracy of face verification is also smaller for registered images update.
Further, the shallow-layer extracted in step (3) is characterized as SURF features, histogram level projection properties, histogram The feature that upright projection feature and Gradient Features are composed;To reduce computation complexity, while improve extraction rate.
Further, in step (3), the method for consistency checking includes:Calculate the Europe between extracted shallow-layer feature Formula distance;If Euclidean distance is more than third threshold value, judge that image is consistent with scan image in chip;Otherwise, it is determined that in chip Image and scan image are inconsistent.
Further, third threshold value is rule of thumb set;As system comes into operation, database meeting dynamic expanding is System will be regularly updated, and third threshold value will be more accurate.
Further, Haar features can be used in step (4) and Adaboost graders carry out Face datection;
Further, in step (4), the pretreatment of image is included:Histogram equalization, gaussian filtering denoising and image Size normalization;
Further, in step (4), the method for the picture quality of image and scan image includes in comparable chip:Compare The size of the image file of image and scan image in chip, image file is bigger, then picture quality is higher;The second generation is occupied People's identity card, the picture quality of scan image are higher;For passport, the picture quality of image is higher in chip.
Further, in step (5), the method for extraction image further feature includes:The higher-dimension convolution feature of image is obtained, Dimension-reduction treatment is carried out to higher-dimension convolution feature again, obtains the low-dimensional feature suitable for calculating;It is tested using low-dimensional feature as face The further feature of card;Method for obtaining image higher-dimension convolution feature includes but not limited to depth convolutional neural networks;For The method for carrying out dimension-reduction treatment to higher-dimension convolution feature includes but not limited to Principal Component Analysis Algorithm.
It is another aspect of this invention to provide that the present invention also provides one kind to be used to implement identity-based provided by the present invention The system of certificate and the identity security verification method of recognition of face, including:Video streaming image unit, certificate information collection unit, Image pre-processing unit, face verification unit and database management unit;
Video streaming image unit is used for the acquisition user front-face and hat-free photos in system registry, and clearly facial image is used as registration Image;Video streaming image unit is additionally operable to acquire real-time face image in information collection;
Certificate information collection unit be used in system registry typing certificate information as log-on message;Certificate information collection Unit is additionally operable in information collection image in the certificate information and chip of reading identity card part, and identity document is scanned To obtain the scan image of document surface printing photo;
Image pre-processing unit is used to carry out Face datection and pretreatment to image in image preprocessing, to improve face The accuracy of verification;
Face verification unit for image in extraction is obtained by certificate information collection unit in certificate false distinguishing chip and Then scan image extracts the shallow-layer feature of the two and carries out consistency checking respectively;Face verification unit is additionally operable in face Extraction obtains the first contrast images and the second contrast images by image pre-processing unit during verification, then the first comparison of extraction respectively The further feature of image and the second contrast images and the matching degree for calculating the two;
Database management unit is used to obtain log-on message from certificate information collection unit, and from video in system registry Stream picture unit obtains registered images, and the log-on message got and registered images then are stored in database;Data base administration Unit is additionally operable to obtain certificate information, and inquire number according to the certificate information got from information acquisition unit in information collection According to library;Database management unit is additionally operable to obtain real-time face image as note from video streaming image unit in database update Volume image, and the registered images got are stored in or are updated into database.
Further, video streaming image unit is camera.
Further, certificate information collection unit includes:CIS (Contact Image Sensor, contact type image sensing Device) image capture module and chip card reader;CIS image capture modules are used to scan certificate to obtain identity document surface printing The scan image of photo, chip card reader is for image in the certificate information and chip of reading identity card part.
Further, face verification unit is characterized as that SURF features, histogram level projection are special from the shallow-layer of image zooming-out The feature that sign, histogram upright projection feature and Gradient Features are composed, to reduce computation complexity, while improves extraction Speed.
Further, the method for face verification unit from image zooming-out further feature includes:Obtain the higher-dimension convolution of image Feature, then dimension-reduction treatment is carried out to higher-dimension convolution feature, obtain the low-dimensional feature suitable for calculating;Using low-dimensional feature as people The further feature of face verification.
In general, by the above technical scheme conceived by the present invention, following advantageous effect can be obtained:
(1) database for storing identity document information and registered images is established, and periodically registered images are carried out Update on the one hand independent of external data base, can improve the efficiency of identity security verification;On the other hand, it is tested for face The contrast images of the card facial image recent for user and the real-time face image of acquisition, can significantly improve face verification just True rate, and on this basis, face verification is not strongly dependent upon manual operation, can significantly improve the verification speed of face verification Degree;
(2) in certificate false distinguishing, the scanning of image and document surface printing photo in the chip by extracting identity document The shallow-layer feature of image completes the identification of the certificate true and false, is no longer dependent on artificial discriminating, can improve certificate false distinguishing efficiency and Accuracy;And extract shallow-layer be characterized as SURF features, histogram level projection properties, histogram upright projection feature and The feature that Gradient Features are composed to reduce computation complexity, while improves extraction rate;
(3) a variety of certificates such as No.2 residence card, Hongkong and Macro's pass, passport can be directed to and completes identity security verification, It can be suitable for a variety of identity securities and verify scene;Meanwhile with systematic difference, a variety of cards for will storing user in database Part information can realize the comprehensive verification to various identity cards;
(4) when obtaining less than registered images, image and document surface printing photo in the chip of identity document can be chosen Scan image in one of contrast images of the higher image of picture quality as face verification, it is thus possible to ensure face verification Accuracy.
Description of the drawings
Fig. 1 is the flow chart of identity-based certificate provided by the invention and the identity security verification method of recognition of face;
Fig. 2 is the structure of the identity security verification system of identity-based certificate provided in an embodiment of the present invention and recognition of face Block diagram;
Fig. 3 is the first embodiment of identity security verification method provided by the present invention;
Fig. 4 is the second embodiment of identity security verification method provided by the present invention.
Specific embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, it is right The present invention is further elaborated.It should be appreciated that specific embodiment described herein is only to explain the present invention, not For limiting the present invention.As long as in addition, technical characteristic involved in the various embodiments of the present invention described below that Conflict is not formed between this to can be combined with each other.
Identity-based certificate provided by the invention and the identity security verification method of recognition of face, as shown in Figure 1, including such as Lower step:
(1) system registry step:The certificate information of user identity certificate is obtained as log-on message, and acquires the people of user Then face image will use log-on message and registered images deposit database as registered images;The certificate information packet of identity document Include certificate number and the name of holder;
(2) information collection step:Obtain the certificate information of user identity certificate, image and document surface printing in chip The scan image of photo, and acquire real-time face image;Database is inquired according to certificate information, if inquiring relevant entry, Registered images are extracted from query result;If inquiry creates one according to certificate information in the database less than relevant entry New entry, registered images are sky in the new entry created;
(3) certificate false distinguishing step:The shallow-layer feature of image and scan image in chip is extracted respectively, and is carried out consistency and sentenced It is fixed;If image is consistent with scan image in chip, it is transferred to step (4);If image and scan image are inconsistent in chip, test Card does not pass through, and verification terminates;
(4) image preprocessing step:If in step (2), registered images are got, then face are carried out to real-time face image Detection and pretreatment obtain the first contrast images, and carry out Face datection and pretreatment to registered images, obtain the second comparison diagram Picture;If in step (2), registered images have not been obtained, then Face datection and pretreatment is carried out to real-time face image, obtains first Contrast images, and Face datection and pretreatment are carried out to the higher image of picture quality in image in chip and scan image, it obtains To the second contrast images;By carrying out Face datection and pretreatment to image, the Efficiency and accuracy of face verification can be improved;
(5) face verification step:The further feature of the first contrast images and the second contrast images is extracted respectively, and calculates two The matching degree of person;If matching degree is higher than first threshold, it is transferred to step (6);Otherwise, verification does not pass through, and verification terminates;
(6) database update step:If in step (2), registered images have not been obtained, then using real-time face image as note Volume image is stored in the corresponding entry of database, and is transferred to step (7);If in step (2), registered images are got, and work as Time interval of the preceding verification time apart from last time data base update time is more than second threshold, then using real-time face image as note Volume image, updates the data corresponding entry in library, and be transferred to step (7);If in step (2), registered images are got, and work as Time interval of the preceding verification time apart from last time data base update time is less than second threshold, then is transferred to step (7);
(7) it is verified, verification terminates.
With reference to identity security verification method shown in FIG. 1, an embodiment of the present invention provides a kind of this method that is used to implement System, as shown in Fig. 2, including:Video streaming image unit, certificate information collection unit, image pre-processing unit, face verification list Member and database management unit;
Video streaming image unit is used for the acquisition user front-face and hat-free photos in system registry, and clearly facial image is used as registration Image;Video streaming image unit is additionally operable to acquire real-time face image in information collection;In the present embodiment, video streaming image Unit is the camera that can acquire facial image in real time;
Certificate information collection unit be used in system registry typing certificate information as log-on message;Certificate information collection Unit is additionally operable in information collection image in the certificate information and chip of reading identity card part, and identity document is scanned To obtain the scan image of document surface printing photo;In the present embodiment, certificate information collection unit includes the card based on CIS Part scanner and chip card reader;Image scanner based on CIS is used to scan certificate to obtain document surface printing photo Scan image;Chip card reader is for image in the certificate information and chip of reading identity card part;Certificate information collection unit is also Equipment including supporting to be manually entered, such as mouse, keyboard;
Image pre-processing unit is used to carry out Face datection and pretreatment to image in image preprocessing, to improve face The accuracy of verification;
Face verification unit is used to obtain image and scanning figure in chip from certificate information collection unit in certificate false distinguishing Then picture extracts the feature of the two and carries out consistency checking respectively;Face verification unit is additionally operable in face verification from figure As pretreatment unit the first contrast images of acquisition and the second contrast images, the first contrast images and the second comparison are then extracted respectively The further feature of image and the matching degree for calculating the two;
Database management unit is used to obtain log-on message from certificate information collection unit, and from video in system registry Stream picture unit obtains registered images, and the log-on message got and registered images then are stored in database;Data base administration Unit is additionally operable to obtain certificate information, and inquire number according to the certificate information got from information acquisition unit in information collection According to library;Database management unit is additionally operable to obtain real-time face image as note from video streaming image unit in database update Volume image, and the registered images got are stored in or are updated into database.
Face verification unit is characterized as SURF features, histogram level projection properties, histogram from the shallow-layer of image zooming-out The feature that upright projection feature and Gradient Features are composed to reduce computation complexity, while improves extraction rate;Face The method of authentication unit from image zooming-out further feature includes:The higher-dimension convolution feature of image is obtained, then to higher-dimension convolution feature Dimension-reduction treatment is carried out, obtains the low-dimensional feature suitable for calculating;Using low-dimensional feature as the further feature for face verification.
In the first application scenarios, user has been based on No.2 residence card and has completed system registry step, therefore data The certificate information and registered images of user identity certificate have been stored in library.
Under the first application scenarios, as shown in figure 3, identity security verification method provided by the present invention specifically include as Lower step:
(11) information collection step:Read the certificate information of user's No.2 residence card, image in chip, and to Family No.2 residence card is scanned the scan image to obtain document surface printing photo, while acquires real-time face figure Picture;Database is inquired according to the certificate information of reading, extracts the registered images stored in database;
(12) certificate false distinguishing step:The shallow-layer feature of image and scan image in chip is extracted respectively, and carries out consistency Judgement;If image is consistent with scan image in chip, it is transferred to step (13);If image and scan image are inconsistent in chip, It then verifies and does not pass through, verification terminates;In the present embodiment, the method for consistency checking includes:Respectively extract chip in image and The shallow-layer feature of scan image;The shallow-layer of extraction is characterized as SURF features, histogram level projection properties, histogram upright projection The feature that feature and Gradient Features are composed;To reduce computation complexity, while improve extraction rate;Calculate what is extracted Euclidean distance between shallow-layer feature;If Euclidean distance is more than third threshold value, judge that image is consistent with scan image in chip; Otherwise, it is determined that image and scan image are inconsistent in chip;Third threshold value is rule of thumb set;As system comes into operation, number According to library meeting dynamic expanding, system will be regularly updated, and third threshold value will be more accurate;
(13) image preprocessing step:Face datection and pretreatment are carried out to real-time face image, obtain the first comparison diagram Picture, and the registered images extracted to inquiry database carry out Face datection and pretreatment, obtain the second contrast images;In this reality It applies in example, Face datection is carried out using Haar features and Adaboost graders;Pretreatment includes:Histogram equalization, Gauss filter Wave denoising and image size normalization;
(14) face verification step:The further feature of the first contrast images and the second contrast images is extracted respectively, and is calculated The COS distance of the two is as matching degree;If matching degree is higher than first threshold, it is transferred to step (15);Otherwise, verification does not pass through, Verification terminates;In the present embodiment, the method for extraction image further feature includes:Image is obtained by depth convolutional neural networks Higher-dimension convolution feature, then by Principal Component Analysis Algorithm to higher-dimension convolution feature carry out dimension-reduction treatment, obtain suitable for calculate Low-dimensional feature;Using low-dimensional feature as the further feature for face verification;
(15) database update step:If the time interval of current authentication time gap last time data base update time is more than Second threshold then using real-time face image as registered images, updates the data corresponding entry in library, and be transferred to step (16); Otherwise, it is transferred to step (16);Second threshold is rule of thumb set;
(16) it is verified, verification terminates.
In the second application scenarios, the accredited part of user institute is passport, and not yet completes system registry step, therefore data The certificate information and registered images of the user identity certificate are not present in library.
Under the first application scenarios, as shown in figure 4, identity security verification method provided by the present invention specifically include as Lower step:
(21) information collection step:It reads the certificate information of user's passport, image in chip, and user's passport is swept The scan image to obtain document surface printing photo is retouched, while acquires real-time face image;It is looked into according to the certificate information of reading Database is ask, query result is sky, creates a new entry, the registration corresponding to new entry according to certificate information in the database Image is sky;
(22) certificate false distinguishing step:The shallow-layer feature of image and scan image in chip is extracted respectively, and carries out consistency Judgement;If image is consistent with scan image in chip, it is transferred to step (23);If image and scan image are inconsistent in chip, It then verifies and does not pass through, verification terminates;In the present embodiment, the method for consistency checking includes:Respectively extract chip in image and The shallow-layer feature of scan image;The shallow-layer of extraction is characterized as SURF features, histogram level projection properties, histogram upright projection The feature that feature and Gradient Features are composed;To reduce computation complexity, while improve extraction rate;Calculate what is extracted Euclidean distance between shallow-layer feature;If Euclidean distance is more than third threshold value, judge that image is consistent with scan image in chip; Otherwise, it is determined that image and scan image are inconsistent in chip;Third threshold value is rule of thumb set;As system comes into operation, number According to library meeting dynamic expanding, system will be regularly updated, and third threshold value will be more accurate;
(23) image preprocessing step:Face datection and pretreatment are carried out to collected facial image, obtain first pair Face datection and pretreatment are carried out than image, and to image in the chip of passport, obtains the second contrast images;In the present embodiment In, Face datection is carried out using Haar features and Adaboost graders;Pretreatment includes:Histogram equalization, gaussian filtering are gone It makes an uproar and image size normalization;
(24) face verification step:The further feature of the first contrast images and the second contrast images is extracted respectively, and is calculated The COS distance of the two is as matching degree;If matching degree is higher than first threshold, it is transferred to step (25);Otherwise, verification does not pass through, Verification terminates;In the present embodiment, the method for extraction image further feature includes:Image is obtained by depth convolutional neural networks Higher-dimension convolution feature, then by Principal Component Analysis Algorithm to higher-dimension convolution feature carry out dimension-reduction treatment, obtain suitable for calculate Low-dimensional feature;Using low-dimensional feature as the further feature for face verification;
(25) database update step:Using collected real-time face image as registered images, deposit database corresponds to Entry in, and be transferred to step (26);
(26) it is verified, verification terminates.
As it will be easily appreciated by one skilled in the art that the foregoing is merely illustrative of the preferred embodiments of the present invention, not to The limitation present invention, all any modification, equivalent and improvement made all within the spirits and principles of the present invention etc., should all include Within protection scope of the present invention.

Claims (6)

1. a kind of identity-based certificate and the identity security verification method of recognition of face, which is characterized in that include the following steps:
(1) system registry step:The certificate information of user identity certificate is obtained as log-on message, and acquires user's front-face and hat-free photos Clearly then log-on message and registered images are stored in database by facial image as registered images;
(2) information collection step:Obtain the certificate information of user identity certificate, image and document surface printing photo in chip Scan image, and acquire real-time face image;Database is inquired according to certificate information, if inquiring relevant entry, from looking into It askes in result and extracts registered images;If inquiry creates a new item according to certificate information in the database less than relevant entry Mesh, registered images are sky in the new entry created;
(3) certificate false distinguishing step:It is special that the shallow-layer of image and scan image in the chip got by the step (2) is extracted respectively Sign, and carry out consistency checking;If image is consistent with the scan image in the chip, it is transferred to step (4);If the core Image and the scan image are inconsistent in piece, then verify and do not pass through, and verification terminates;
(4) image preprocessing step:If in the step (2), registered images are got, then the real-time face image are carried out Face datection and pretreatment, obtain the first contrast images, and carry out Face datection and pretreatment to the registered images, obtain the Two contrast images;If in the step (2), registered images have not been obtained, then Face datection are carried out to the real-time face image And pretreatment, obtain the first contrast images, and the figure higher to picture quality in image in the chip and the scan image As carrying out Face datection and pretreatment, the second contrast images are obtained;By carrying out Face datection and pretreatment to image, to improve The Efficiency and accuracy of face verification;
(5) face verification step:The first contrast images got by the step (4) and the second contrast images are extracted respectively Further feature, and calculate the two matching degree;If the matching degree is higher than first threshold, it is transferred to step (6);Otherwise, it verifies not Pass through, verification terminates;
(6) database update step:If in the step (2), registered images have not been obtained, then by the real-time face of this acquisition Image is stored in the corresponding entry of database, and be transferred to step (7) as registered images;If in the step (2), get Registered images, and the time interval of current authentication time gap last time data base update time is more than second threshold, then incite somebody to action this The real-time face image of secondary acquisition updates the data corresponding entry in library, and be transferred to step (7) as registered images;If step (2) in, registered images are got, and the time interval of current authentication time gap last time data base update time is less than Two threshold values are then transferred to step (7);
(7) it is verified, verification terminates.
2. identity-based certificate as described in claim 1 and the identity security verification method of recognition of face, which is characterized in that institute It states in step (3), the shallow-layer of extraction is characterized as SURF features, histogram level projection properties, histogram upright projection feature And the feature that Gradient Features are composed, to reduce computation complexity, while improve extraction rate.
3. identity-based certificate as described in claim 1 and the identity security verification method of recognition of face, which is characterized in that institute It states in step (5), the method for extraction image further feature includes:The higher-dimension convolution feature of image is obtained, then to higher-dimension convolution spy Sign carries out dimension-reduction treatment, obtains the low-dimensional feature suitable for calculating;Using low-dimensional feature as the further feature for face verification.
4. a kind of system of the identity security verification method based on identity-based certificate described in claim 1 and recognition of face, It is characterised in that it includes:Video streaming image unit, certificate information collection unit, image pre-processing unit, face verification unit with And database management unit;
The video streaming image unit is used for the acquisition user front-face and hat-free photos in system registry, and clearly facial image is used as registration Image;The video streaming image unit is additionally operable to acquire real-time face image in information collection;
The certificate information collection unit be used in system registry typing certificate information as log-on message;The certificate information Collecting unit is additionally operable in information collection image in the certificate information and chip of reading identity card part, and identity document is carried out Scan the scan image to obtain document surface printing photo;
Described image pretreatment unit is used to carry out Face datection and pretreatment to image in image preprocessing, to improve face The accuracy and speed of verification;
The face verification unit is schemed for being extracted in certificate false distinguishing in the chip obtained by the certificate information collection unit Then picture and scan image extract the shallow-layer feature of the two and carry out consistency checking respectively;The face verification unit is also used In the first contrast images and the second contrast images that in face verification, extraction is obtained by described image pretreatment unit, Ran Houfen It indescribably takes the further feature of first contrast images and second contrast images and calculates the matching degree of the two;
The database management unit is used in system registry from certificate information collection unit acquisition log-on message, and from The video streaming image unit obtains registered images, and the log-on message got and registered images then are stored in database;Institute Database management unit is stated to be additionally operable to obtain certificate information from described information collecting unit, and according to getting in information collection Certificate information inquiry database;The database management unit is additionally operable in database update from the video streaming image list Member obtains real-time face image as registered images, and the registered images got are stored in or are updated into database.
5. identity-based certificate as claimed in claim 4 and the identity security of recognition of face verification system, which is characterized in that institute It states face verification unit and is characterized as that SURF features, histogram level projection properties, histogram are vertically thrown from the shallow-layer of image zooming-out The feature that shadow feature and Gradient Features are composed to reduce computation complexity, while improves extraction rate.
6. identity-based certificate as claimed in claim 4 and the identity security of recognition of face verification system, which is characterized in that institute The method for stating face verification unit from image zooming-out further feature includes:The higher-dimension convolution feature of image is obtained, then higher-dimension is rolled up Product feature carries out dimension-reduction treatment, obtains the low-dimensional feature suitable for calculating;Low-dimensional feature is special as the deep layer for face verification Sign.
CN201810085256.5A 2018-01-29 2018-01-29 Identity security verification method and system based on identity document and face recognition Active CN108229427B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810085256.5A CN108229427B (en) 2018-01-29 2018-01-29 Identity security verification method and system based on identity document and face recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810085256.5A CN108229427B (en) 2018-01-29 2018-01-29 Identity security verification method and system based on identity document and face recognition

Publications (2)

Publication Number Publication Date
CN108229427A true CN108229427A (en) 2018-06-29
CN108229427B CN108229427B (en) 2020-07-10

Family

ID=62669090

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810085256.5A Active CN108229427B (en) 2018-01-29 2018-01-29 Identity security verification method and system based on identity document and face recognition

Country Status (1)

Country Link
CN (1) CN108229427B (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109376725A (en) * 2018-12-21 2019-02-22 北京无线电计量测试研究所 A kind of identification check method and apparatus based on iris recognition
CN109522881A (en) * 2018-12-25 2019-03-26 华南理工大学 A kind of examinee information checking method based on recognition of face
CN109711339A (en) * 2018-12-26 2019-05-03 天地融科技股份有限公司 A kind of passport recognition methods, control equipment and device
CN110011812A (en) * 2019-04-10 2019-07-12 民航成都电子技术有限责任公司 A kind of card method for anti-counterfeit suitable for airport security
CN110147740A (en) * 2019-04-30 2019-08-20 北京迈格威科技有限公司 Face identification method, device, equipment and storage medium
CN110164007A (en) * 2019-05-21 2019-08-23 一石数字技术成都有限公司 A kind of access control system of identity-based evidence and facial image incidence relation
TWI671685B (en) * 2018-09-19 2019-09-11 和碩聯合科技股份有限公司 Face recognition method and electronic device using the same
CN110414454A (en) * 2019-07-31 2019-11-05 南充折衍智能光电科技有限公司 A kind of testimony of a witness unification identifying system based on machine vision
CN110414358A (en) * 2019-06-28 2019-11-05 平安科技(深圳)有限公司 Information output method, device and storage medium based on face intelligent recognition
CN110555926A (en) * 2019-07-26 2019-12-10 华中科技大学 Access control method based on multi-certificate recognition and corresponding device
CN110569718A (en) * 2019-07-26 2019-12-13 华中科技大学 Examinee identity verification method and device based on certificate
JP2020021164A (en) * 2018-07-30 2020-02-06 大日本印刷株式会社 Certification device, issuing device, issuing system, issuing method, and program
GB2576521A (en) * 2018-08-21 2020-02-26 Shufti Pro Ltd Systems and methods for remotely verifying user identities
CN111144164A (en) * 2018-11-02 2020-05-12 上海迦叶网络科技有限公司 Intelligent recognition system based on body scars
CN111222887A (en) * 2020-01-08 2020-06-02 中钞科堡现金处理技术(北京)有限公司 Intelligent identity recognition system and method and intelligent teller machine
CN111898536A (en) * 2019-08-27 2020-11-06 创新先进技术有限公司 Certificate identification method and device
CN112016925A (en) * 2019-05-29 2020-12-01 福州云豆网络科技有限公司 Bank account security verification face recognition method based on encryption algorithm
CN112598836A (en) * 2020-12-14 2021-04-02 天时地理(深圳)智能科技有限公司 Face recognition comparison system and method based on deep learning
CN113094677A (en) * 2021-06-10 2021-07-09 天聚地合(苏州)数据股份有限公司 Identity authentication method, identity authentication device, storage medium and equipment
CN113486727A (en) * 2021-06-11 2021-10-08 福建数博讯信息科技有限公司 Face recognition optimization method based on certificate photo as data source
CN113672964A (en) * 2021-08-31 2021-11-19 大连市公安局 Certificate inspection method based on standard sample feature database
CN115496500B (en) * 2022-11-22 2023-02-10 天津郡阳科技发展有限公司 Information collection method and system based on big data
CN116959064A (en) * 2023-06-25 2023-10-27 上海腾桥信息技术有限公司 Certificate verification method and device, computer equipment and storage medium

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004318409A (en) * 2003-04-15 2004-11-11 Nec Soft Ltd Personal authentication system
CN102970207A (en) * 2011-09-01 2013-03-13 腾讯科技(深圳)有限公司 Instant communication method, client device and instant communication system
CN103279764A (en) * 2013-06-27 2013-09-04 苏州福丰科技有限公司 Real-name network authentication system based on face identification
CN103426016A (en) * 2013-08-14 2013-12-04 湖北微模式科技发展有限公司 Method and device for authenticating second-generation identity card
CN204155293U (en) * 2014-09-01 2015-02-11 上海智达商投资管理合伙企业(有限合伙) A kind of demo plant based on recognition of face and verification system
CN104504321A (en) * 2015-01-05 2015-04-08 湖北微模式科技发展有限公司 Method and system for authenticating remote user based on camera
CN105005779A (en) * 2015-08-25 2015-10-28 湖北文理学院 Face verification anti-counterfeit recognition method and system thereof based on interactive action
CN105160321A (en) * 2015-09-05 2015-12-16 深圳市飞思未来云媒体科技有限公司 Vision-and-wireless-positioning-based mobile terminal identity verification method
CN105550638A (en) * 2015-12-07 2016-05-04 深圳市安网通信有限公司 Intelligent self-service identity card customs control system and intelligent self-service identity card customs control method
CN106339673A (en) * 2016-08-19 2017-01-18 中山大学 ATM identity authentication method based on face recognition
CN106529258A (en) * 2016-11-30 2017-03-22 赵云龙 Security management method and system for mobile equipment
CN106650560A (en) * 2015-11-04 2017-05-10 上海市公安局刑事侦查总队 Identity authentication method based on identity card and identity authentication processor and system thereof

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004318409A (en) * 2003-04-15 2004-11-11 Nec Soft Ltd Personal authentication system
CN102970207A (en) * 2011-09-01 2013-03-13 腾讯科技(深圳)有限公司 Instant communication method, client device and instant communication system
CN103279764A (en) * 2013-06-27 2013-09-04 苏州福丰科技有限公司 Real-name network authentication system based on face identification
CN103426016A (en) * 2013-08-14 2013-12-04 湖北微模式科技发展有限公司 Method and device for authenticating second-generation identity card
CN204155293U (en) * 2014-09-01 2015-02-11 上海智达商投资管理合伙企业(有限合伙) A kind of demo plant based on recognition of face and verification system
CN104504321A (en) * 2015-01-05 2015-04-08 湖北微模式科技发展有限公司 Method and system for authenticating remote user based on camera
CN105005779A (en) * 2015-08-25 2015-10-28 湖北文理学院 Face verification anti-counterfeit recognition method and system thereof based on interactive action
CN105160321A (en) * 2015-09-05 2015-12-16 深圳市飞思未来云媒体科技有限公司 Vision-and-wireless-positioning-based mobile terminal identity verification method
CN106650560A (en) * 2015-11-04 2017-05-10 上海市公安局刑事侦查总队 Identity authentication method based on identity card and identity authentication processor and system thereof
CN105550638A (en) * 2015-12-07 2016-05-04 深圳市安网通信有限公司 Intelligent self-service identity card customs control system and intelligent self-service identity card customs control method
CN106339673A (en) * 2016-08-19 2017-01-18 中山大学 ATM identity authentication method based on face recognition
CN106529258A (en) * 2016-11-30 2017-03-22 赵云龙 Security management method and system for mobile equipment

Cited By (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020021164A (en) * 2018-07-30 2020-02-06 大日本印刷株式会社 Certification device, issuing device, issuing system, issuing method, and program
JP7073967B2 (en) 2018-07-30 2022-05-24 大日本印刷株式会社 Certification device, issuing device, issuing system, issuing method, program
GB2576521A (en) * 2018-08-21 2020-02-26 Shufti Pro Ltd Systems and methods for remotely verifying user identities
TWI671685B (en) * 2018-09-19 2019-09-11 和碩聯合科技股份有限公司 Face recognition method and electronic device using the same
CN111144164A (en) * 2018-11-02 2020-05-12 上海迦叶网络科技有限公司 Intelligent recognition system based on body scars
CN109376725B (en) * 2018-12-21 2022-09-23 北京无线电计量测试研究所 Identity verification method and device based on iris recognition
CN109376725A (en) * 2018-12-21 2019-02-22 北京无线电计量测试研究所 A kind of identification check method and apparatus based on iris recognition
CN109522881A (en) * 2018-12-25 2019-03-26 华南理工大学 A kind of examinee information checking method based on recognition of face
CN109711339A (en) * 2018-12-26 2019-05-03 天地融科技股份有限公司 A kind of passport recognition methods, control equipment and device
CN110011812A (en) * 2019-04-10 2019-07-12 民航成都电子技术有限责任公司 A kind of card method for anti-counterfeit suitable for airport security
CN110147740A (en) * 2019-04-30 2019-08-20 北京迈格威科技有限公司 Face identification method, device, equipment and storage medium
CN110147740B (en) * 2019-04-30 2021-07-09 北京迈格威科技有限公司 Face recognition method, device, equipment and storage medium
CN110164007A (en) * 2019-05-21 2019-08-23 一石数字技术成都有限公司 A kind of access control system of identity-based evidence and facial image incidence relation
CN112016925A (en) * 2019-05-29 2020-12-01 福州云豆网络科技有限公司 Bank account security verification face recognition method based on encryption algorithm
CN110414358A (en) * 2019-06-28 2019-11-05 平安科技(深圳)有限公司 Information output method, device and storage medium based on face intelligent recognition
CN110414358B (en) * 2019-06-28 2022-11-25 平安科技(深圳)有限公司 Information output method and device based on intelligent face recognition and storage medium
CN110569718A (en) * 2019-07-26 2019-12-13 华中科技大学 Examinee identity verification method and device based on certificate
CN110555926A (en) * 2019-07-26 2019-12-10 华中科技大学 Access control method based on multi-certificate recognition and corresponding device
CN110569718B (en) * 2019-07-26 2021-11-05 华中科技大学 Examinee identity verification method and device based on certificate
CN110414454A (en) * 2019-07-31 2019-11-05 南充折衍智能光电科技有限公司 A kind of testimony of a witness unification identifying system based on machine vision
CN111898536A (en) * 2019-08-27 2020-11-06 创新先进技术有限公司 Certificate identification method and device
CN111222887A (en) * 2020-01-08 2020-06-02 中钞科堡现金处理技术(北京)有限公司 Intelligent identity recognition system and method and intelligent teller machine
CN111222887B (en) * 2020-01-08 2024-04-16 中钞科堡现金处理技术(北京)有限公司 Intelligent identity recognition system and method and intelligent teller machine
CN112598836A (en) * 2020-12-14 2021-04-02 天时地理(深圳)智能科技有限公司 Face recognition comparison system and method based on deep learning
CN113094677A (en) * 2021-06-10 2021-07-09 天聚地合(苏州)数据股份有限公司 Identity authentication method, identity authentication device, storage medium and equipment
CN113486727A (en) * 2021-06-11 2021-10-08 福建数博讯信息科技有限公司 Face recognition optimization method based on certificate photo as data source
CN113672964A (en) * 2021-08-31 2021-11-19 大连市公安局 Certificate inspection method based on standard sample feature database
CN113672964B (en) * 2021-08-31 2024-01-23 大连市公安局 Certificate checking method based on standard sample feature database
CN115496500B (en) * 2022-11-22 2023-02-10 天津郡阳科技发展有限公司 Information collection method and system based on big data
CN116959064A (en) * 2023-06-25 2023-10-27 上海腾桥信息技术有限公司 Certificate verification method and device, computer equipment and storage medium
CN116959064B (en) * 2023-06-25 2024-04-26 上海腾桥信息技术有限公司 Certificate verification method and device, computer equipment and storage medium

Also Published As

Publication number Publication date
CN108229427B (en) 2020-07-10

Similar Documents

Publication Publication Date Title
CN108229427A (en) A kind of identity-based certificate and the identity security verification method and system of recognition of face
CN108985134B (en) Face living body detection and face brushing transaction method and system based on binocular camera
CN106778525B (en) Identity authentication method and device
CN105956578B (en) A kind of face verification method of identity-based certificate information
CN106203294B (en) The testimony of a witness based on face character analysis unifies auth method
CN105930709B (en) Face recognition technology is applied to the method and device of testimony of a witness consistency check
CN103426016B (en) Method and device for authenticating second-generation identity card
CN101710383B (en) Method and device for identity authentication
CN105631272B (en) A kind of identity identifying method of multiple security
CN106529414A (en) Method for realizing result authentication through image comparison
WO2019024636A1 (en) Identity authentication method, system and apparatus
CN110516649B (en) Face recognition-based alumni authentication method and system
CN107609515B (en) Double-verification face comparison system and method based on Feiteng platform
CN106203322A (en) A kind of identity authorization system based on hand back vein and palmmprint fusion image and method
CN109657627A (en) Auth method, device and electronic equipment
Wild et al. Comparative test of smartphone finger photo vs. touch-based cross-sensor fingerprint recognition
Lu et al. A pore-based method for fingerprint liveness detection
CN113011544B (en) Face biological information identification method, system, terminal and medium based on two-dimensional code
CN108133187B (en) The one-to-one iris identification method of dimensional variation invariant feature and the voting of more algorithms
Khan et al. Investigating linear discriminant analysis (LDA) on dorsal hand vein images
CN111291586B (en) Living body detection method, living body detection device, electronic equipment and computer readable storage medium
CN114067402A (en) Human face living body detection based on central difference convolution and receptive field feature fusion
Patel et al. Fingerprint matching using two methods
CN112801034A (en) Finger vein recognition device
JP2005242432A (en) Face authentication system and processing method for the system and program therefor

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP03 Change of name, title or address

Address after: 430000 room 04, floor 3, building 3, phase III, international enterprise center, No. 1, Guanggu Avenue, Donghu New Technology Development Zone, Wuhan, Hubei 3602 (Wuhan area of free trade zone)

Patentee after: Wuhan Huake heding Information Technology Co.,Ltd.

Patentee after: HUAZHONG University OF SCIENCE AND TECHNOLOGY RESEARCH INSTITUTE SHENZHEN

Address before: 210000 No. 99-74, Taizhong Road, Zijin (Pukou) science and technology entrepreneurship special community, Pukou District, Nanjing, Jiangsu Province

Patentee before: NANJING HUAKE HEDING INFORMATION TECHNOLOGY Co.,Ltd.

Patentee before: HUAZHONG University OF SCIENCE AND TECHNOLOGY RESEARCH INSTITUTE SHENZHEN

CP03 Change of name, title or address