CN103324879A - System and method for identification verification on mobile terminal and based on face recognition and intelligent card - Google Patents

System and method for identification verification on mobile terminal and based on face recognition and intelligent card Download PDF

Info

Publication number
CN103324879A
CN103324879A CN2013102824285A CN201310282428A CN103324879A CN 103324879 A CN103324879 A CN 103324879A CN 2013102824285 A CN2013102824285 A CN 2013102824285A CN 201310282428 A CN201310282428 A CN 201310282428A CN 103324879 A CN103324879 A CN 103324879A
Authority
CN
China
Prior art keywords
face
authentication
information
smart card
people
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013102824285A
Other languages
Chinese (zh)
Other versions
CN103324879B (en
Inventor
严则明
杨明慧
胡永涛
邹翔
黄苏杨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Third Research Institute of the Ministry of Public Security
Original Assignee
Third Research Institute of the Ministry of Public Security
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Third Research Institute of the Ministry of Public Security filed Critical Third Research Institute of the Ministry of Public Security
Priority to CN201310282428.5A priority Critical patent/CN103324879B/en
Publication of CN103324879A publication Critical patent/CN103324879A/en
Application granted granted Critical
Publication of CN103324879B publication Critical patent/CN103324879B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Collating Specific Patterns (AREA)

Abstract

The invention relates to a system for realizing an identification verification function on a mobile terminal and based on face recognition and an intelligent card. The system comprises a user interface module, a face data collection module, a face feature information extracting and processing module, an NFC (near field communication) module and an encryption module. The invention further relates to a method for realizing identification verification control on the mobile terminal and based on the face recognition and the intelligent card by the aid of the system. By the system and the method, personal privacy and safety of users can be guaranteed; an NFC function of the mobile terminal is utilized to read related information on the intelligent card, the system has a non-contact feature, a card reader is not needed, and great convenience is brought to identification verification on the mobile terminal, so that safety for users to perform identification verification on the mobile terminal through the intelligent card can be effectively guaranteed; overall framework is simple and practical, rapidness and convenience in application process are realized, working performance is stable and reliable, and application range is wide.

Description

Mobile device is based on authentication system and the method for recognition of face and smart card
Technical field
The present invention relates to the information security certification field, particularly smart card holder identity legitimacy verification technique field specifically refers on a kind of mobile device to realize based on recognition of face and smart card system and the method thereof of authentication function.
Background technology
Smart card or have the various certificates of electronic chip and card is widely used as the carrying tool of personal information.Along with popularizing of mobile device, increasing daily routines need mobile device and smart card communications.In conventional art, generally need for mobile device connect an external card reader realize with smart card communicate by letter the inconvenience that causes the user to carry and operate.NFC(Near Field Communication, wireless near field communication) as a kind of contactless identification and interconnection technique, a kind of solution of simple, touch is provided, only need be on mobile device built-in NFC chip, for application developer provides the corresponding interface storehouse, can realize with smart card between communicate by letter.
When the sensitive data on the visit smart card or execution key operation, in order to protect personal information, require the holder to import PIN code (Personal Identification Number, PIN (Personal Identification Number)) usually, just can operate by verification.When mobile device used smart card system, PIN code was imported by terminal keyboard, is illegally obtained the keystroke record by the third party easily, thereby is stolen PIN code.Even transmission again after PIN code is encrypted is encrypted the key that uses and also is present in the terminal internal memory, can not guarantee that PIN code is not stolen.
Face recognition technology is a kind of of biometrics identification technology, refer to from the rest image that comprises people's face or video sequence image, extract the individualized feature of people's face, these characteristic informations carry out identification by analyzing relatively, have uniqueness, naturality, advantage such as untouchable.If can replace the PIN code of smart card with face characteristic information, will have greater security.
Summary of the invention
The objective of the invention is to have overcome above-mentioned shortcoming of the prior art, provide a kind of security risk that can avoid existing by terminal input PIN code, effectively guarantee the user mobile device use smart card carry out security, the framework of authentication simple and practical, use efficient and convenient, stable and reliable working performance, the scope of application to realize system and the method thereof of authentication function comparatively widely on the mobile device based on recognition of face and smart card.
In order to realize above-mentioned purpose, realize that based on recognition of face and smart card system and the method thereof of authentication function are as follows on the mobile device of the present invention:
Based on the system of recognition of face and smart card realization authentication function, its principal feature is that described system comprises on this mobile device:
Subscriber interface module is used for carrying out alternately with the user, guides user's operation, and calls the correlation module function;
People's face data acquisition module is connected with described subscriber interface module, carries out people's face video information acquisition operations by the camera on the mobile device;
Face characteristic information is extracted processing module, is connected with described subscriber interface module, people's face video information that described people's face data acquisition module is received is handled, and extracted face characteristic information;
The NFC communication module is connected with described subscriber interface module, communicates by NFC function and the outside intelligent card of calling mobile device, obtains relevant NFC label information;
Encrypting module extracts processing module with described subscriber interface module, face characteristic information respectively and is connected with the NFC communication module, by the NFC label information described face characteristic information is encrypted.
Extracting processing module based on the face characteristic information in the system of recognition of face and smart card realization authentication function on this mobile device comprises:
The blink detection unit is used for human face image sequence is carried out blink detection;
The image pretreatment unit is used for facial image is carried out pre-service, to set the hunting zone of unique point;
The feature point extraction unit is used for the characteristic point information of facial image is extracted.
Comprise pupil, interior tail of the eye point, nostril, nose, the corners of the mouth based on the unique point in the system of recognition of face and smart card realization authentication function on this mobile device.
The private key that comprises smart card numbers and be used for encrypting based on the NFC label information in the system of recognition of face and smart card realization authentication function on this mobile device.
This utilizes above-mentioned system to realize carrying out the method that authentication is controlled based on recognition of face and smart card on the mobile device, its principal feature is, described method comprises the operation of authentication client process and authentication service system request processing operation, described authentication client process operation may further comprise the steps:
(11) system operates according to the user, starts and initialization operation;
(12) described people's face data acquisition module is taken people's face by the camera on the mobile device, and imports corresponding people's face video segment information;
(13) described face characteristic information is extracted processing module handler face video segment information, and extracts face characteristic information;
(14) system carries out the prompting operation that the user brushes smart card, and described NFC communication module communicates with outside smart card according to user's the NFC function of operation by mobile device of swiping the card, and obtains relevant NFC label information;
(15) described encrypting module utilizes described NFC label information to carry out the face characteristic information encryption;
(16) user profile and the smart card numbers in described NFC label information of system after with the face characteristic information encryption is sent to long-range authentication service system in the lump as authentication request information and carries out authentication;
Described authentication service system request is handled operation, may further comprise the steps:
(21) described authentication service system receives described authentication request information;
(22) service system judges whether the request form meets default prescribed form;
(23) if correct format then continues step (24) and handles; Otherwise return the result of " authentication failure " to the authentication client, and end process;
(24) before the deadline whether the certificate of verifying corresponding smart card according to the smart card numbers in the described authentication request information;
(25) if before the deadline, then continuing step (26), handles by certificate; Otherwise return the result of " authentication failure " to the authentication client, and end process;
(26) in the database of authentication service system, inquire about relevant user profile according to the smart card numbers in the described authentication request information;
(27) PKI with corresponding user is decrypted the user profile in the described authentication request information;
(28) face characteristic information that deciphering is obtained is carried out the characteristic matching checking;
(29) if be proved to be successful, then return the result of " by authentication " to the authentication client, otherwise the result who returns " authentication failure " is to the authentication client.
Carry out the handler's face video segment information in the method for authentication control and extract face characteristic information based on recognition of face and smart card on this realization mobile device, may further comprise the steps:
(131) described face characteristic information extraction processing module is carried out blink detection to the image sequence in people's face video segment information;
(132) if detection is not passed through, then return above-mentioned steps (12) and take again;
(133) described face characteristic information extraction processing module is carried out face characteristic information extraction processing one by one to each frame in the described image sequence.
Carry out each frame in the image sequence is carried out face characteristic information one by one extract and handle in the method for authentication control based on recognition of face and smart card on this realization mobile device, may further comprise the steps:
(1331) current frame image is carried out image pretreatment operation;
(1332) if the pre-service failure then abandons this current frame image, and the next frame image in the extraction image sequence, above-mentioned steps (1331) continued;
(1333) if the pre-service success is then carried out the feature point extraction operation to this current frame image;
(1334) if there is not two field picture pre-service success in the image sequence in described people's face video segment information, then this people's face video segment information integral body is defective, returns above-mentioned steps (12) and takes again;
(1335) reach the maximum frame number of systemic presupposition when pre-service success and the image accumulative total of carrying out feature point extraction operation, perhaps all images in the image sequence in this people's face video segment information all disposes, then will extract resulting whole face characteristic information and carry out Combined Treatment, and calculate final feature extraction result.
Carry out the image pretreatment operation of carrying out in the method for authentication control based on recognition of face and smart card on this realization mobile device, may further comprise the steps:
(13311) coloured image is converted to gray-scale map, and to filter obviously can not be the part of people's face;
(13312) carry out preliminary people's face localization process by normalization template matching process.
The normalization template matching process that passes through that carries out in the method for authentication control based on recognition of face and smart card on this realization mobile device carries out preliminary people's face localization process, is specially:
According to people's face priori, utilize normalization template coupling, in whole facial image, determine the general area of face, and the roughly hunting zone of unique point.
The normalization template of carrying out in the method for authentication control based on recognition of face and smart card on this realization mobile device is the average face that a plurality of different people's face gray level images calculate, and marks the key position that wherein is used for coupling.
Carry out carrying out the feature point extraction operation in the method for authentication control based on recognition of face and smart card on this realization mobile device, may further comprise the steps:
(13331) ocular is carried out level and vertical gradient image integral projection, determine pupil position information;
(13332) ocular is determined in the position centered by two eye pupil holes, carries out binary conversion treatment and obtains binary image, and accurately locate interior tail of the eye dot position information in conjunction with the SUSAN operator;
(13333) based on two eye pupil hole sites, adopt the area grayscale integral projection to determine two nostril dot position informations in the nose region of search;
(13334) near above two nostril point lines, search for highlight regions, namely obtain the nose positional information;
(13335) gray scale normalization, binary conversion treatment are carried out in the face zone, obtain binary image, and use the SUSAN operator to obtain the face edge image;
(13336) be that the angle point extraction is carried out on the basis with the face edge image, obtain the precise position information of two corners of the mouths.
The maximum frame number that carries out the systemic presupposition in the method for authentication control based on recognition of face and smart card on this realization mobile device is 100 frames.
The system and the method thereof that realize the authentication function based on recognition of face and smart card have been adopted on the mobile device of this invention, owing to wherein take the authentication based on face characteristic information, utilize irreplaceable, the characteristics that can not usurp, can not lose of people's face, guaranteed effectively finishing of authentication, proof procedure only need be imported user people's face information, the user does not need to arrange and the keeping password, thereby security threat such as avoid password to lose or to reveal that identity theft, the identity brought are falsely used also saves and revises the complicated operation degree that password etc. brings; The simultaneous verification process has very strong privacy, face characteristic information is by the encrypted private key in the smart card, send with the ciphertext form, even the assailant intercepts and captures authentication request, there is not corresponding PKI can't obtain the Any user personal information yet, simultaneously, the userspersonal information also is with the storage of ciphertext form in the database of authentication service system, has guaranteed user's individual privacy safety; And provide convenience for mobile equipment identity checking, can utilize the NFC function of mobile device to read relevant information on the smart card, have non-contacting characteristics, need not card reader, provide a great convenience for carrying out authentication at mobile device, thereby guaranteed that effectively the user uses smart card to carry out the security of authentication at mobile device, overall architecture is simple and practical, use is efficient and convenient, and stable and reliable working performance, the scope of application are comparatively extensive.
Description of drawings
Fig. 1 is the allomeric function module architectures synoptic diagram of realizing the system of authentication function on the mobile device of the present invention based on recognition of face and smart card.
Fig. 2 is the configuration diagram of extracting processing module on the mobile device of the present invention based on the face characteristic information in the system of recognition of face and smart card realization authentication function.
Fig. 3 is for carrying out authentication client process operational flowchart in the method for authentication control based on recognition of face and smart card on the realization mobile device of the present invention.
Fig. 4 handles operational flowchart for the authentication service system request of carrying out in the method for authentication control based on recognition of face and smart card on the realization mobile device of the present invention.
Fig. 5 extracts schematic flow sheet for the face characteristic information of carrying out in the method for authentication control based on recognition of face and smart card on the realization mobile device of the present invention.
Embodiment
In order more to be expressly understood technology contents of the present invention, describe in detail especially exemplified by following examples.
At first provide some symbol definitions in the invention:
● face characteristic information (pic): to the face characteristic information that people's face video of input extracts after handling, each user has its unique characteristic information.
● facial image numbering (i): the image in people's face video is numbered in order, i.e. i two field picture, i=1,2,3 ...
● people's face video frame number parameter (M): the total number of images in people's face video, i.e. total N two field picture in Shu Ru the video.
● qualified facial image number of parameters (N): in video processing procedure to the counting of qualified facial image, since 0.To each two field picture, before carrying out the extraction of special medical treatment point, carry out pre-service earlier, judge as pre-service not contain people's face in this image that then need not to carry out feature point extraction, this image is defective, has passed through pre-service as image, then is designated as qualified image, to M+1.
● the private key of storing on the smart card (KPV): the private key of storing on the smart card that is used for enciphered message, can read this private key during with smart card communications, with its cryptographic operation of being correlated with.
● smart card numbers (CardNumber): unique card number that smart card just has when providing, the authentication service system is with the relevant information of this number inquiring user in database.As blocking expired or calcellation, this number also cancels thereupon.
See also illustrated in figures 1 and 2ly, realize the system of authentication function on this mobile device based on recognition of face and smart card, comprising:
(1) subscriber interface module is used for carrying out alternately with the user, guides user's operation, and calls the correlation module function;
(2) people's face data acquisition module is connected with described subscriber interface module, carries out people's face video information acquisition operations by the camera on the mobile device;
(3) face characteristic information is extracted processing module, is connected with described subscriber interface module, people's face video information that described people's face data acquisition module is received is handled, and extracted face characteristic information; This face characteristic information is extracted processing module and is comprised:
● the blink detection unit is used for human face image sequence is carried out blink detection;
● the image pretreatment unit is used for facial image is carried out pre-service, to set the hunting zone of unique point;
● the feature point extraction unit is used for the characteristic point information of facial image is extracted; This unique point comprises pupil, interior tail of the eye point, nostril, nose, the corners of the mouth;
(4) NFC communication module is connected with described subscriber interface module, communicates by NFC function and the outside intelligent card of calling mobile device, obtains relevant NFC label information; The private key that this NFC label information comprises smart card numbers and is used for encrypting;
(5) encrypting module extracts processing module with described subscriber interface module, face characteristic information respectively and is connected with the NFC communication module, by the NFC label information described face characteristic information is encrypted.
See also Fig. 3 again to shown in Figure 5, this utilizes above-mentioned system to realize carrying out the method that authentication is controlled based on recognition of face and smart card on the mobile device, handle operation comprising the operation of authentication client process and authentication service system request, described authentication client process operation may further comprise the steps:
(11) system operates according to the user, starts and initialization operation;
(12) described people's face data acquisition module is taken people's face by the camera on the mobile device, and imports corresponding people's face video segment information;
(13) described face characteristic information is extracted processing module handler face video segment information, and extracts face characteristic information; This handler's face video segment information is also extracted face characteristic information, may further comprise the steps:
(a) described face characteristic information extraction processing module is carried out blink detection to the image sequence in people's face video segment information;
(b) if detection is not passed through, then return above-mentioned steps (12) and take again;
(c) described face characteristic information extraction processing module is carried out face characteristic information extraction processing one by one to each frame in the described image sequence, may further comprise the steps:
(i) current frame image is carried out image pretreatment operation, may further comprise the steps:
(I) coloured image is converted to gray-scale map, and to filter obviously can not be the part of people's face;
(II) carry out preliminary people's face localization process by normalization template matching process, be specially:
According to people's face priori, utilize normalization template coupling, in whole facial image, determine the general area of face, and the roughly hunting zone of unique point; This normalization template is the average face that a plurality of different people's face gray level images calculate, and marks the key position that wherein is used for coupling;
If (ii) pre-service failure then abandons this current frame image, and extract the next frame image in the image sequence, continue above-mentioned steps (i);
If (iii) pre-service success is then carried out the feature point extraction operation to this current frame image, may further comprise the steps:
(I) ocular is carried out level and vertical gradient image integral projection, determine pupil position information;
(II) ocular is determined in the position centered by two eye pupil holes, carries out binary conversion treatment and obtains binary image, and accurately locate interior tail of the eye dot position information in conjunction with the SUSAN operator;
(III) based on two eye pupil hole sites, adopt the area grayscale integral projection to determine two nostril dot position informations in the nose region of search;
(IV) near above two nostril point lines, search for highlight regions, namely obtain the nose positional information;
(V) gray scale normalization, binary conversion treatment are carried out in the face zone, obtain binary image, and use the SUSAN operator to obtain the face edge image;
(VI) be that the angle point extraction is carried out on the basis with the face edge image, obtain the precise position information of two corners of the mouths;
If (iv) there is not two field picture pre-service success in the image sequence in described people's face video segment information, then this people's face video segment information integral body is defective, returns above-mentioned steps (12) and takes again;
(v) reach the maximum frame number of systemic presupposition when pre-service success and the image accumulative total of carrying out feature point extraction operation, perhaps all images in the image sequence in this people's face video segment information all disposes, then will extract resulting whole face characteristic information and carry out Combined Treatment, and calculate final feature extraction result; The maximum frame number of this systemic presupposition is 100 frames;
(14) system carries out the prompting operation that the user brushes smart card, and described NFC communication module communicates with outside smart card according to user's the NFC function of operation by mobile device of swiping the card, and obtains relevant NFC label information;
(15) described encrypting module utilizes described NFC label information to carry out the face characteristic information encryption;
(16) user profile and the smart card numbers in described NFC label information of system after with the face characteristic information encryption is sent to long-range authentication service system in the lump as authentication request information and carries out authentication;
Described authentication service system request is handled operation, may further comprise the steps:
(21) described authentication service system receives described authentication request information;
(22) service system judges whether the request form meets default prescribed form;
(23) if correct format then continues step (24) and handles; Otherwise return the result of " authentication failure " to the authentication client, and end process;
(24) before the deadline whether the certificate of verifying corresponding smart card according to the smart card numbers in the described authentication request information;
(25) if before the deadline, then continuing step (26), handles by certificate; Otherwise return the result of " authentication failure " to the authentication client, and end process;
(26) in the database of authentication service system, inquire about relevant user profile according to the smart card numbers in the described authentication request information;
(27) PKI with corresponding user is decrypted the user profile in the described authentication request information;
(28) face characteristic information that deciphering is obtained is carried out the characteristic matching checking;
(29) if be proved to be successful, then return the result of " by authentication " to the authentication client, otherwise the result who returns " authentication failure " is to the authentication client.
In the middle of reality is used, the present invention utilizes the uniqueness of people's face in conjunction with the authentication demand on the mobile device, is the checking means with the recognition of face, in conjunction with NFC function and the smart card communications of mobile device, the auth method based on recognition of face and smart card has been proposed on a kind of mobile device.Its principle is that the NFC function by mobile device reads the information in the smart card, people's face information is encrypted, send to service system with intelligent card numbers, inquire about and mate by service system, thereby solve the problem of carrying out authentication at mobile device.
Face recognition technology is a kind of of biometrics identification technology, refer to from the rest image that comprises people's face or video sequence image, extract the individualized feature of people's face, these characteristic informations carry out identification by analyzing relatively, have uniqueness, naturality, advantage such as untouchable.
The present invention realizes authentication by face recognition technology, adopts the algorithm based on people's face key feature point to extract face characteristic information, utilizes the shape of people's face key position and structure to describe people's face, as the characteristic information of identification.According to the human visual system principle, from the geometric properties of people's face, extract have size, the unique point of rotation and shift invariant, can pick out the key feature point position of people's face major organs rapidly and accurately, to extract its characteristic information.To a width of cloth facial image sample, can extract the each several part feature of people's face easily by the location feature point, be that benchmark carries out normalized to each eigenwert with the unique point, can make the eigenwert of extraction have unchangeability on translation, rotation and the yardstick, by like this people's face being carried out standardization processing.Thereby, before extract minutiae, do not need sample is carried out the standardization of size, help to strengthen antijamming capability, improve discrimination.
See also shown in Figure 2ly, provided the unit of handling face characteristic information, mainly be divided into 3 processing units: blink detection, image pre-service and extract minutiae.By after the blink detection, to each the two field picture extract minutiae in the video, utilize union rule to calculate net result at last, thereby improve discrimination.
Provide specifying of processing module below:
Blink detection: in order to prevent verifying with holder's photo, so the requirement input is people's face video of holder.Before people's face video of handling input, human face image sequence is carried out blink detection, it is qualified that the people's face video by blink detection is only.
Image pre-service: will carry out pre-service to facial image before the extract minutiae, to set the hunting zone of unique point.Pre-service at first is converted into gray-scale map with coloured image, because the color of background and clothing is unfavorable for the location of human face region, be converted into gray-scale map after, area of skin color brightness is higher, can effectively distinguish area of skin color and non-area of skin color like this, filtering obviously can not be the part of people's face.Then by normalization template matching process Primary Location people face, in whole facial image, determine the roughly hunting zone of unique point.Cromogram is converted into gray-scale map can reduces the subgraph of actual participation normalization coupling and the resolution of template, accelerate matching speed, and change insensitive to image change in size and angle to a certain extent.
Extract minutiae: the image after the pre-service just can carry out the extraction of unique point, extracts unique points such as pupil, interior tail of the eye point, nostril, nose, the corners of the mouth successively.Carry out face characteristic when extracting, owing to the marginal information of part can't be organized effectively, utilizing the feature of edge and angle point to carry out the location of people's face key feature point.Wherein select SUSAN(Smallest Univalue Segment Assimilating Nucleus) operator be used for to extract edge and the angle point feature of regional area.Critical area is carried out gray scale normalization, binary conversion treatment, obtain binary image, carry out edge and angle point extraction in conjunction with the SUSAN operator then, obtain the exact position of unique point.
Process based on the authentication of recognition of face and smart card is as follows:
The present invention has mainly comprised the two large divisions: one is based on the authentication client (hereinafter to be referred as the authentication client) of recognition of face and NFC, the 2nd, authentication service system.To be described in detail this two large divisions below.
1, based on the authentication client of recognition of face and NFC
When the user will carry out authentication, at first by the camera collection people face information of authentication client call mobile device, extract face characteristic information.Characteristic information pic through above-mentioned face characteristic information leaching process obtains is sent to the checking of authentication service system request by the authentication client.Authentication request need comprise following two parameters at least: ( , CardNumber), and need satisfy the call format of authentication service system.Wherein smart card can be encrypted with rivest, shamir, adelman the face characteristic information that sends; what transmit in the communication process all is data encrypted; so both can protect privacy of user; also guaranteed data security; even victim obtains, there is not corresponding smart card can't decipher user profile yet.
The authentication client is formed module and is mainly comprised: user interface, people's face data acquisition module, face characteristic information extraction module, NFC communication module and encrypting module, and concrete structure can be referring to shown in Figure 1, and module is described in detail as follows:
● user interface, be used for carrying out alternately with the user, guide user's operation, and call the correlation module function.
● people's face data acquisition module, control mobile device camera carries out people's face video acquisition.
● the face characteristic information extraction module, the people's face video that receives is handled characteristic information extraction.
● the NFC communication module, communicate by NFC function and the smart card that calls mobile device, obtain relevant information.When the user with smart card when the mobile device, read the NFC label information on the smart card, the private key that comprises card number and be used for encrypting.
● encrypting module, use smart card information that face characteristic information is encrypted.The cryptographic algorithm that the present invention adopts is selected from the cryptographic algorithm of State Commercial Cryptography Administration's issue, and the user can select voluntarily.
The concrete workflow of authentication client can be referring to Fig. 3, and embodiment can be referring to " authentication client workflow ".
2, authentication service system
After authentication request is received by the authentication service system, confirm at first whether this request is effective, comprised whether the request form meets system's regulation, and whether before the deadline the certificate of smart card, can not only prevent Replay Attack effectively like this, and improve system effectiveness.If this authentication request is effective, then in database, inquires about relevant user profile according to the smart card numbers in the request, otherwise this request is not handled.
The authentication service system queries is decrypted the user profile in the checking request with PKI after relevant user profile, and sends into corresponding authentication module the subscriber identity information after deciphering is carried out checkings such as characteristic matching; If checking is unsuccessful, then returns " authentication failure " to the authentication client, as be proved to be successful then and return " by authentication " to the authentication client on the mobile device.
Stored user information is all through encrypting in the database, and design is the purpose for the protection privacy of user like this, so also can improve safety of user data simultaneously.Even such as the database information leakage has taken place, the assailant can only get access to encrypted ciphertext information, there is not correct smart card information can't obtain the real information of user yet.
The idiographic flow of authentication service system handles request sees also shown in Figure 3, and embodiment can be referring to " authentication service system handles request flow process ".
(1) authentication client workflow wherein comprises 6 steps as shown in Figure 3:
(1) user starts the authentication client.
(2) take people's face by the mobile device camera, import one section people's face video.
(3) handler's face video extracts face characteristic information, referring to shown in Figure 5, comprises following steps:
Step1: sequence of video images is carried out blink detection, detect and do not take again by then changeing step (2).
Step2: each frame to sequence of video images carries out the face characteristic information extraction, mainly is divided into following 2 steps:
Step2.1: carry out pre-service.Pre-service comprises two processes: the one, coloured image is converted into gray-scale map, and filtering obviously can not be the part of people's face.The 2nd, by normalization template matching process Primary Location people face, namely according to people's face priori, utilize normalization template coupling, in whole facial image, determine the general area of face, and the roughly hunting zone of unique point.This template is the average face that calculates with a plurality of different people's face gray level images, and wherein key position marks to be used for coupling.If pre-service failure then illustrates not comprise people's face in this image, abandon successful then employing.
Step2.2: carry out the extraction of unique point for the image that adopts.At first ocular is carried out level and vertical gradient image integral projection, determine pupil position, ocular is determined in the position centered by two eye pupil holes, carries out accurately locating interior tail of the eye point in conjunction with the SUSAN operator after the binaryzation.Then based on two eye pupil hole sites, adopt the area grayscale integral projection to determine two nostril points in the nose region of search, near above the two nostril lines, search for highlight regions, be nose.At last gray scale normalization, binary conversion treatment are carried out in the face zone, obtain binary image, use the SUSAN operator to obtain the face edge image then, carry out angle point based on this and extract the exact position that can obtain two corners of the mouths.
Step3: if do not have a two field picture in the video by pre-service, then this video is defective, returns step (2) and takes again; When the image that adopts reaches 100 frames, perhaps whole images all disposes in the video, then with the face characteristic information Combined Treatment of gained, calculates net result pic.
(4) the prompting user brushes smart card;
(5) with smart card pic is encrypted.For example work as the user and select to use RSA Algorithm, when providing protection with smart card for face characteristic information, the result after shielded face characteristic information pic encrypts is
(6) send authentication request to the authentication service system, required parameter have ( CardNumber).
(2) authentication service system request treatment scheme sees also shown in Figure 4ly, wherein comprises 5 steps:
(1) receives authentication request.
(2) judge whether the request form meets system's regulation.If correct format then changes step (3) and continues to handle; Otherwise flow process finishes.
(3) before the deadline whether the certificate of verifying this smart card according to the card number in the request.If certificate is effective, then changes step (4) and continue to handle; Otherwise authentication failed is returned.
(4) in database, inquire about relevant user profile according to the smart card numbers in the request.
(5) with corresponding client public key the user profile in the request is decrypted.
(6) information that deciphering is obtained is sent into authentication module and is carried out checkings such as characteristic matching.If be proved to be successful, return " by authentication " and give the authentication client, otherwise return " authentication failure ".
The system and the method thereof that realize the authentication function based on recognition of face and smart card have been adopted on the above-mentioned mobile device, owing to wherein take the authentication based on face characteristic information, utilize irreplaceable, the characteristics that can not usurp, can not lose of people's face, guaranteed effectively finishing of authentication, proof procedure only need be imported user people's face information, the user does not need to arrange and the keeping password, thereby security threat such as avoid password to lose or to reveal that identity theft, the identity brought are falsely used also saves and revises the complicated operation degree that password etc. brings; The simultaneous verification process has very strong privacy, face characteristic information is by the encrypted private key in the smart card, send with the ciphertext form, even the assailant intercepts and captures authentication request, there is not corresponding PKI can't obtain the Any user personal information yet, simultaneously, the userspersonal information also is with the storage of ciphertext form in the database of authentication service system, has guaranteed user's individual privacy safety; And provide convenience for mobile equipment identity checking, can utilize the NFC function of mobile device to read relevant information on the smart card, have non-contacting characteristics, need not card reader, provide a great convenience for carrying out authentication at mobile device, thereby guaranteed that effectively the user uses smart card to carry out the security of authentication at mobile device, overall architecture is simple and practical, use is efficient and convenient, and stable and reliable working performance, the scope of application are comparatively extensive.
In this instructions, the present invention is described with reference to its certain embodiments.But, still can make various modifications and conversion obviously and not deviate from the spirit and scope of the present invention.Therefore, instructions and accompanying drawing are regarded in an illustrative, rather than a restrictive.

Claims (12)

1. realize the system of authentication function on the mobile device based on recognition of face and smart card, it is characterized in that described system comprises:
Subscriber interface module is used for carrying out alternately with the user, guides user's operation, and calls the correlation module function;
People's face data acquisition module is connected with described subscriber interface module, carries out people's face video information acquisition operations by the camera on the mobile device;
Face characteristic information is extracted processing module, is connected with described subscriber interface module, people's face video information that described people's face data acquisition module is received is handled, and extracted face characteristic information;
The NFC communication module is connected with described subscriber interface module, communicates by NFC function and the outside intelligent card of calling mobile device, obtains relevant NFC label information;
Encrypting module extracts processing module with described subscriber interface module, face characteristic information respectively and is connected with the NFC communication module, by the NFC label information described face characteristic information is encrypted.
2. realize the system of authentication function on the mobile device according to claim 1 based on recognition of face and smart card, it is characterized in that described face characteristic information is extracted processing module and comprised:
The blink detection unit is used for human face image sequence is carried out blink detection;
The image pretreatment unit is used for facial image is carried out pre-service, to set the hunting zone of unique point;
The feature point extraction unit is used for the characteristic point information of facial image is extracted.
3. realize the system of authentication function on the mobile device according to claim 2 based on recognition of face and smart card, it is characterized in that described unique point comprises pupil, interior tail of the eye point, nostril, nose, the corners of the mouth.
4. according to the system that realizes the authentication function on each described mobile device in the claim 1 to 3 based on recognition of face and smart card, it is characterized in that the private key that described NFC label information comprises smart card numbers and is used for encrypting.
5. one kind is utilized the described system of claim 1 to realize carrying out the method that authentication is controlled based on recognition of face and smart card on the mobile device, it is characterized in that, described method comprises the operation of authentication client process and authentication service system request processing operation, described authentication client process operation may further comprise the steps:
(11) system operates according to the user, starts and initialization operation;
(12) described people's face data acquisition module is taken people's face by the camera on the mobile device, and imports corresponding people's face video segment information;
(13) described face characteristic information is extracted processing module handler face video segment information, and extracts face characteristic information;
(14) system carries out the prompting operation that the user brushes smart card, and described NFC communication module communicates with outside smart card according to user's the NFC function of operation by mobile device of swiping the card, and obtains relevant NFC label information;
(15) described encrypting module utilizes described NFC label information to carry out the face characteristic information encryption;
(16) user profile and the smart card numbers in described NFC label information of system after with the face characteristic information encryption is sent to long-range authentication service system in the lump as authentication request information and carries out authentication;
Described authentication service system request is handled operation, may further comprise the steps:
(21) described authentication service system receives described authentication request information;
(22) service system judges whether the request form meets default prescribed form;
(23) if correct format then continues step (24) and handles; Otherwise return the result of " authentication failure " to the authentication client, and end process;
(24) before the deadline whether the certificate of verifying corresponding smart card according to the smart card numbers in the described authentication request information;
(25) if before the deadline, then continuing step (26), handles by certificate; Otherwise return the result of " authentication failure " to the authentication client, and end process;
(26) in the database of authentication service system, inquire about relevant user profile according to the smart card numbers in the described authentication request information;
(27) PKI with corresponding user is decrypted the user profile in the described authentication request information;
(28) face characteristic information that deciphering is obtained is carried out the characteristic matching checking;
(29) if be proved to be successful, then return the result of " by authentication " to the authentication client, otherwise the result who returns " authentication failure " is to the authentication client.
6. carry out the method that authentication is controlled based on recognition of face and smart card on the realization mobile device according to claim 5, it is characterized in that described handler's face video segment information is also extracted face characteristic information, may further comprise the steps:
(131) described face characteristic information extraction processing module is carried out blink detection to the image sequence in people's face video segment information;
(132) if detection is not passed through, then return above-mentioned steps (12) and take again;
(133) described face characteristic information extraction processing module is carried out face characteristic information extraction processing one by one to each frame in the described image sequence.
7. carry out the method for authentication control on the realization mobile device according to claim 6 based on recognition of face and smart card, it is characterized in that, describedly each frame in the image sequence is carried out face characteristic information one by one extract and handle, may further comprise the steps:
(1331) current frame image is carried out image pretreatment operation;
(1332) if the pre-service failure then abandons this current frame image, and the next frame image in the extraction image sequence, above-mentioned steps (1331) continued;
(1333) if the pre-service success is then carried out the feature point extraction operation to this current frame image;
(1334) if there is not two field picture pre-service success in the image sequence in described people's face video segment information, then this people's face video segment information integral body is defective, returns above-mentioned steps (12) and takes again;
(1335) reach the maximum frame number of systemic presupposition when pre-service success and the image accumulative total of carrying out feature point extraction operation, perhaps all images in the image sequence in this people's face video segment information all disposes, then will extract resulting whole face characteristic information and carry out Combined Treatment, and calculate final feature extraction result.
8. carry out the method that authentication is controlled based on recognition of face and smart card on the realization mobile device according to claim 7, it is characterized in that the described image pretreatment operation of carrying out may further comprise the steps:
(13311) coloured image is converted to gray-scale map, and to filter obviously can not be the part of people's face;
(13312) carry out preliminary people's face localization process by normalization template matching process.
9. carry out the method for authentication control on the realization mobile device according to claim 8 based on recognition of face and smart card, it is characterized in that, describedly carry out preliminary people's face localization process by normalization template matching process, be specially:
According to people's face priori, utilize normalization template coupling, in whole facial image, determine the general area of face, and the roughly hunting zone of unique point.
10. carry out the method that authentication is controlled based on recognition of face and smart card on the realization mobile device according to claim 9, it is characterized in that, described normalization template is the average face that a plurality of different people's face gray level images calculate, and marks the key position that wherein is used for coupling.
11. carry out the method that authentication is controlled based on recognition of face and smart card on the realization mobile device according to claim 7, it is characterized in that the described feature point extraction of carrying out is operated, and may further comprise the steps:
(13331) ocular is carried out level and vertical gradient image integral projection, determine pupil position information;
(13332) ocular is determined in the position centered by two eye pupil holes, carries out binary conversion treatment and obtains binary image, and accurately locate interior tail of the eye dot position information in conjunction with the SUSAN operator;
(13333) based on two eye pupil hole sites, adopt the area grayscale integral projection to determine two nostril dot position informations in the nose region of search;
(13334) near above two nostril point lines, search for highlight regions, namely obtain the nose positional information;
(13335) gray scale normalization, binary conversion treatment are carried out in the face zone, obtain binary image, and use the SUSAN operator to obtain the face edge image;
(13336) be that the angle point extraction is carried out on the basis with the face edge image, obtain the precise position information of two corners of the mouths.
12. carry out the method that authentication is controlled based on recognition of face and smart card on the realization mobile device according to claim 7, it is characterized in that the maximum frame number of described systemic presupposition is 100 frames.
CN201310282428.5A 2013-07-05 2013-07-05 Mobile device is based on recognition of face and the authentication system of smart card and method Active CN103324879B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310282428.5A CN103324879B (en) 2013-07-05 2013-07-05 Mobile device is based on recognition of face and the authentication system of smart card and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310282428.5A CN103324879B (en) 2013-07-05 2013-07-05 Mobile device is based on recognition of face and the authentication system of smart card and method

Publications (2)

Publication Number Publication Date
CN103324879A true CN103324879A (en) 2013-09-25
CN103324879B CN103324879B (en) 2016-08-10

Family

ID=49193616

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310282428.5A Active CN103324879B (en) 2013-07-05 2013-07-05 Mobile device is based on recognition of face and the authentication system of smart card and method

Country Status (1)

Country Link
CN (1) CN103324879B (en)

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104584030A (en) * 2014-11-15 2015-04-29 深圳市三木通信技术有限公司 Verification application method and device based on face recognition
CN104601333A (en) * 2015-02-11 2015-05-06 浙江中烟工业有限责任公司 Two-dimensional code remote authentication method based on man-machine features
CN104734852A (en) * 2013-12-24 2015-06-24 中国移动通信集团湖南有限公司 Identity authentication method and device
CN104750240A (en) * 2013-12-27 2015-07-01 由田新技股份有限公司 Password input method based on eye opening and closing state and security device applying same
CN104915661A (en) * 2015-07-02 2015-09-16 湖北贝力思智能科技有限公司 Intelligent dynamic human face encryption recognition system
WO2015154341A1 (en) * 2014-04-11 2015-10-15 快车科技有限公司 Method, device and system for improving device security by hardware binding
CN105025018A (en) * 2015-07-06 2015-11-04 国网山东寿光市供电公司 Method for safety verification in communication process
CN105391680A (en) * 2014-08-27 2016-03-09 霍夫曼-拉罗奇有限公司 Identification, authentication and authorization method in a laboratory system
CN105426785A (en) * 2015-12-31 2016-03-23 深圳市朗科科技股份有限公司 Data decryption method of mobile data storing device and mobile data storing device
WO2016107010A1 (en) * 2014-12-30 2016-07-07 中兴通讯股份有限公司 Encryption/decryption method and apparatus, mobile terminal and computer storage medium
CN105894285A (en) * 2016-04-01 2016-08-24 孙景芝 Using method of face payment system based on Bluetooth-assisted authentication
WO2017114289A1 (en) * 2015-12-29 2017-07-06 中国银联股份有限公司 Bank-card information authentication method, client terminal, and banking system
CN107093235A (en) * 2017-04-12 2017-08-25 上海泰金电子科技有限公司 A kind of intelligent residential district doorway machine control system
CN107757940A (en) * 2017-10-31 2018-03-06 河南飞防兵科技有限公司 A kind of UAV Intelligent image capturing system
CN105913262B (en) * 2016-04-01 2018-06-29 泰芯科技(杭州)有限公司 Facial payment system based on bluetooth assistant authentification
CN108259823A (en) * 2017-12-28 2018-07-06 天地融科技股份有限公司 A kind of method and system that security control is carried out using safety equipment
CN109154954A (en) * 2016-05-27 2019-01-04 微软技术许可有限责任公司 Account verification in the offer system of delay
CN111292087A (en) * 2020-01-20 2020-06-16 北京沃东天骏信息技术有限公司 Identity verification method and device, computer readable medium and electronic equipment
CN112799331A (en) * 2021-01-26 2021-05-14 芜湖中科思萌特物联网科技有限公司 Demodulation method of FPGA (field programmable Gate array) unfreezing program
CN112948792A (en) * 2019-11-26 2021-06-11 华为技术有限公司 Unlocking method and device
WO2021128989A1 (en) * 2019-12-26 2021-07-01 华为技术有限公司 Authentication method and device
CN113326490A (en) * 2021-06-30 2021-08-31 杭州布厂汇网络科技有限公司 Identity authentication equipment and identity authentication method based on industrial internet platform
CN114005160A (en) * 2021-10-28 2022-02-01 建湖县公安局 Access control system and method based on identity two-dimensional code and artificial intelligence
CN116308379A (en) * 2023-02-03 2023-06-23 星汉智能科技股份有限公司 Smart card holder identity authentication method, smart card, terminal and medium
CN116308379B (en) * 2023-02-03 2024-05-31 星汉智能科技股份有限公司 Smart card holder identity authentication method, smart card, terminal and medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7676441B2 (en) * 2004-06-11 2010-03-09 Canon Kabushiki Kaisha Information processing apparatus, information processing method, pattern recognition apparatus, and pattern recognition method
CN101908140A (en) * 2010-07-29 2010-12-08 中山大学 Biopsy method for use in human face identification
CN102902959A (en) * 2012-04-28 2013-01-30 王浩 Face recognition method and system for storing identification photo based on second-generation identity card
CN103123708A (en) * 2011-08-23 2013-05-29 宏达国际电子股份有限公司 Secure payment method, mobile device and secure payment system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7676441B2 (en) * 2004-06-11 2010-03-09 Canon Kabushiki Kaisha Information processing apparatus, information processing method, pattern recognition apparatus, and pattern recognition method
CN101908140A (en) * 2010-07-29 2010-12-08 中山大学 Biopsy method for use in human face identification
CN103123708A (en) * 2011-08-23 2013-05-29 宏达国际电子股份有限公司 Secure payment method, mobile device and secure payment system
CN102902959A (en) * 2012-04-28 2013-01-30 王浩 Face recognition method and system for storing identification photo based on second-generation identity card

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104734852A (en) * 2013-12-24 2015-06-24 中国移动通信集团湖南有限公司 Identity authentication method and device
CN104734852B (en) * 2013-12-24 2018-05-08 中国移动通信集团湖南有限公司 A kind of identity identifying method and device
CN104750240B (en) * 2013-12-27 2018-02-02 由田新技股份有限公司 Password input method based on eye opening and closing state and security device applying same
CN104750240A (en) * 2013-12-27 2015-07-01 由田新技股份有限公司 Password input method based on eye opening and closing state and security device applying same
WO2015154341A1 (en) * 2014-04-11 2015-10-15 快车科技有限公司 Method, device and system for improving device security by hardware binding
US10491604B2 (en) 2014-08-27 2019-11-26 Roche Diagnostics Operations, Inc. Identification, authentication, and authorization method in a laboratory system
CN105391680B (en) * 2014-08-27 2020-05-22 霍夫曼-拉罗奇有限公司 Identification, authentication and authorization method in laboratory system
CN105391680A (en) * 2014-08-27 2016-03-09 霍夫曼-拉罗奇有限公司 Identification, authentication and authorization method in a laboratory system
US10944760B2 (en) 2014-08-27 2021-03-09 Roche Diagnostics Operations, Inc. Identification, authentication, and authorization method in a laboratory system
CN104584030A (en) * 2014-11-15 2015-04-29 深圳市三木通信技术有限公司 Verification application method and device based on face recognition
CN104584030B (en) * 2014-11-15 2017-02-22 深圳市三木通信技术有限公司 Verification application method and device based on face recognition
WO2016107010A1 (en) * 2014-12-30 2016-07-07 中兴通讯股份有限公司 Encryption/decryption method and apparatus, mobile terminal and computer storage medium
CN104601333A (en) * 2015-02-11 2015-05-06 浙江中烟工业有限责任公司 Two-dimensional code remote authentication method based on man-machine features
CN104915661A (en) * 2015-07-02 2015-09-16 湖北贝力思智能科技有限公司 Intelligent dynamic human face encryption recognition system
CN105025018A (en) * 2015-07-06 2015-11-04 国网山东寿光市供电公司 Method for safety verification in communication process
WO2017114289A1 (en) * 2015-12-29 2017-07-06 中国银联股份有限公司 Bank-card information authentication method, client terminal, and banking system
CN105426785A (en) * 2015-12-31 2016-03-23 深圳市朗科科技股份有限公司 Data decryption method of mobile data storing device and mobile data storing device
CN105913262B (en) * 2016-04-01 2018-06-29 泰芯科技(杭州)有限公司 Facial payment system based on bluetooth assistant authentification
CN105894285A (en) * 2016-04-01 2016-08-24 孙景芝 Using method of face payment system based on Bluetooth-assisted authentication
CN109154954A (en) * 2016-05-27 2019-01-04 微软技术许可有限责任公司 Account verification in the offer system of delay
CN109154954B (en) * 2016-05-27 2021-11-02 微软技术许可有限责任公司 System and method for providing user account
CN107093235A (en) * 2017-04-12 2017-08-25 上海泰金电子科技有限公司 A kind of intelligent residential district doorway machine control system
CN107757940A (en) * 2017-10-31 2018-03-06 河南飞防兵科技有限公司 A kind of UAV Intelligent image capturing system
CN108259823A (en) * 2017-12-28 2018-07-06 天地融科技股份有限公司 A kind of method and system that security control is carried out using safety equipment
CN112948792A (en) * 2019-11-26 2021-06-11 华为技术有限公司 Unlocking method and device
WO2021128989A1 (en) * 2019-12-26 2021-07-01 华为技术有限公司 Authentication method and device
CN111292087A (en) * 2020-01-20 2020-06-16 北京沃东天骏信息技术有限公司 Identity verification method and device, computer readable medium and electronic equipment
CN112799331A (en) * 2021-01-26 2021-05-14 芜湖中科思萌特物联网科技有限公司 Demodulation method of FPGA (field programmable Gate array) unfreezing program
CN112799331B (en) * 2021-01-26 2022-09-20 芜湖中科思萌特物联网科技有限公司 Demodulation method of FPGA (field programmable Gate array) unfreezing program
CN113326490A (en) * 2021-06-30 2021-08-31 杭州布厂汇网络科技有限公司 Identity authentication equipment and identity authentication method based on industrial internet platform
CN114005160A (en) * 2021-10-28 2022-02-01 建湖县公安局 Access control system and method based on identity two-dimensional code and artificial intelligence
CN116308379A (en) * 2023-02-03 2023-06-23 星汉智能科技股份有限公司 Smart card holder identity authentication method, smart card, terminal and medium
CN116308379B (en) * 2023-02-03 2024-05-31 星汉智能科技股份有限公司 Smart card holder identity authentication method, smart card, terminal and medium

Also Published As

Publication number Publication date
CN103324879B (en) 2016-08-10

Similar Documents

Publication Publication Date Title
CN103324879A (en) System and method for identification verification on mobile terminal and based on face recognition and intelligent card
US10671716B2 (en) User authentication method and system using variable keypad and biometric identification
TWI676947B (en) Payment authentication method and authentication system based on face recognition and HCE
CN110414200A (en) Auth method, device, storage medium and computer equipment
CN1860724B (en) Method for identification
CN105635099A (en) Identity authentication method, identity authentication system, terminal and server
CN111095246B (en) Method and electronic device for authenticating user
CN110313008A (en) Method and smart card suitable for the registration of gradually fingerprint
CN106789077A (en) A kind of real name identification method and system
KR101675728B1 (en) Method and apparatus for processing user authentification using information processing device
CN111815833A (en) Hotel access control authentication system based on intelligent identification and encryption technology
US20210264135A1 (en) Secure facial recognition
JP2011165102A (en) Biometrics authentication system and portable terminal
KR101853270B1 (en) Authentication method for portable secure authentication apparatus using fingerprint
CN104462926A (en) Intelligent card identity recognition method and system
TWI427543B (en) A security verification method and a portable transmission device using the method
CN209821700U (en) Wearable equipment and identity authentication system
KR20160101248A (en) Portable secure authentication apparatus using fingerprint
CN111934770B (en) Identity authentication method and system combining visible light technology
KR102528040B1 (en) Kiosk and its control method
WO2022237550A1 (en) Access control authentication method, apparatus and system for preventing privacy leak
JP2003178274A (en) Issuing device and issuing system for information storage medium used for access control
CN109005158B (en) Authentication method of dynamic gesture authentication system based on fuzzy safe
KR101965749B1 (en) Camera based contactless fingerprint reader
Jeevitha et al. Smart Banking Machine Embedded with Iris Biometric Controlled System

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant