WO2018213946A1 - 图像识别方法、图像识别装置、电子装置及计算机存储介质 - Google Patents
图像识别方法、图像识别装置、电子装置及计算机存储介质 Download PDFInfo
- Publication number
- WO2018213946A1 WO2018213946A1 PCT/CN2017/085233 CN2017085233W WO2018213946A1 WO 2018213946 A1 WO2018213946 A1 WO 2018213946A1 CN 2017085233 W CN2017085233 W CN 2017085233W WO 2018213946 A1 WO2018213946 A1 WO 2018213946A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- feature
- feature information
- information
- fingerprint
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/1347—Preprocessing; Feature extraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/12—Fingerprints or palmprints
- G06V40/1365—Matching; Classification
Definitions
- the present invention relates to the field of biometrics, and in particular, to an image recognition method, an image recognition device, an electronic device, and a computer storage medium.
- Biometric technology especially fingerprint recognition, is widely used in smart terminals such as mobile phones. Since the setting position of the smart terminal is limited, when the biological image sensing is performed, the larger the sensing area is, the higher the cost is. Therefore, the image sensing area has a certain limit, and fingerprint identification is taken as an example, and the commonly used sensing area is currently used. It is 25% to 30% of the entire fingerprint area of the finger.
- the sensing area is small, if the recognition accuracy is to be ensured, it is necessary to collect the registration multiple times.
- the image information to be identified needs to be compared with all the registered templates to obtain the recognition result. In this way, image recognition takes a long time and is not conducive to user experience.
- embodiments of the present invention aim to at least solve one of the technical problems existing in the prior art. To this end, embodiments of the present invention need to provide an image recognition method, an image recognition device, an electronic device, and a computer storage medium.
- performing the feature extraction on the acquired image information in the step S2, the obtaining the first feature information specifically includes:
- the initial coding features are classified according to the preset coding feature class, and the number of each class is counted.
- the final coding feature information is included in the initial coding features.
- the image encoding employs one or more of the following encoding methods: local binary mode, local phase quantization, image feature value statistics.
- the feature classification uses one or more of the following clustering methods: k-means, hierarchical clustering, self-organizing mapping, fuzzy C-means clustering.
- the preset coding feature core is preset or updated in real time by means of an online manner.
- the step S4 is performed in parallel with the step S3 after obtaining the aligned image template.
- the recognition process is ended, and the recognition result is output.
- step S3 when the first feature information and the first feature information in all the registered image templates are inconsistent, the recognition process is ended, and the recognition result is output.
- the method before the step S2, the method further includes:
- step S04 determining whether the number of registration acquisitions reaches a preset threshold; if yes, executing step S05, otherwise returning to step S01;
- step S05 the method includes:
- the image information of the target object is collected by an image acquisition unit, and the image information to be recognized is identified by the steps in the image recognition method of any of the foregoing embodiments.
- An image recognition apparatus includes a processor and a storage unit; and the processor is configured to execute the image recognition method of any of the foregoing embodiments.
- An electronic device includes an image capturing device and a processor; the image capturing device is configured to acquire image information of the target object when the target object is placed on the electronic device; and the processor is configured to execute The image recognition method of any of the above embodiments.
- a computer storage medium stores computer executable instructions for performing the image recognition method of any of the foregoing embodiments.
- the first feature information and the second feature information can be extracted in parallel, which further improves the fingerprint recognition speed.
- the comparison of the first feature information may be performed first, and after the second feature information is extracted, the feature of the second feature information is performed in parallel. The comparison further improves the speed of fingerprint recognition.
- FIG. 1 is a schematic diagram of fingerprint registration using fingerprint recognition as an example in image recognition according to an embodiment of the present invention
- FIG. 2 is a schematic diagram of fingerprint recognition taking fingerprint recognition as an example in image recognition according to an embodiment of the present invention
- FIG. 3 is a schematic flowchart of a registration process of an image recognition method according to an embodiment of the present invention.
- FIG. 4 is a schematic diagram of a fingerprint template stored in an image recognition method according to an embodiment of the present invention.
- FIG. 5 is a schematic flowchart diagram of an embodiment of an identification process of an image recognition method according to an embodiment of the present invention
- FIG. 6 is a schematic flow chart of another embodiment of an identification process of an image recognition method according to an embodiment of the present invention.
- FIG. 7 is a flow chart showing still another embodiment of the identification process of the image recognition method according to the embodiment of the present invention.
- FIG. 8 is a functional block diagram of an image recognition device according to an embodiment of the present invention.
- FIG. 9 is a schematic diagram of comparison of feature information and fingerprint template in feature matching in an image recognition apparatus according to an embodiment of the present invention.
- FIG. 10 is a functional block diagram of a first feature extraction unit in the image recognition device according to the embodiment of the present invention.
- FIG. 11 is a schematic diagram showing a plain fingerprint image and a coding feature distribution obtained by encoding the same according to BSIF encoding in the image recognition apparatus according to the embodiment of the present invention
- FIG. 12 is a fingerprint image of a crepe pattern in an image recognition apparatus according to an embodiment of the present invention and encoded in accordance with BSIF Schematic diagram of the distribution of coding features obtained after encoding;
- FIG. 13 is a plan view showing an embodiment of an electronic device to which an image recognition device according to an embodiment of the present invention is applied;
- Fig. 14 is a functional block diagram showing another embodiment of an electronic device to which the image recognition device according to the embodiment of the present invention is applied.
- first and second are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated.
- features defining “first” or “second” may include one or more of the described features either explicitly or implicitly.
- the meaning of "a plurality" is two or more unless specifically and specifically defined otherwise.
- connection In the description of the present invention, it should be noted that the terms “installation”, “connected”, and “connected” are to be understood broadly, and may be fixed or detachable, for example, unless otherwise explicitly defined and defined. Connected, or integrally connected; may be mechanically connected, or may be electrically connected or may communicate with each other; may be directly connected or indirectly connected through an intermediate medium, may be internal communication of two elements or interaction of two elements relationship. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood on a case-by-case basis.
- the image recognition in the embodiment of the present invention refers to image acquisition of a target object placed at a specified position by using an image sensor, and the collected image is transmitted to a processing system through a flexible printed circuit board or other printed circuit for image recognition, that is, Identify whether the image is registered or registered, or identify the user's identity, and so on.
- the fingerprint image of the user must be registered before the fingerprint image is recognized.
- the user places the finger 200 that needs to be registered in the designated position.
- the fingerprint collecting unit 103 collects the fingerprint of the finger to obtain a fingerprint image.
- the feature extraction unit 101 performs fingerprint feature extraction on the fingerprint image obtained by the fingerprint collection unit 103, obtains fingerprint feature information, and forms a corresponding fingerprint template, and stores it to a predetermined location of the storage unit 102. This is repeated a number of times to form N corresponding fingerprint templates. It should be noted that, since the sensing area of the fingerprint collecting unit 103 is small, the same fingerprint is collected multiple times to form complete fingerprint information. Therefore, assuming that one finger is collected five times and five fingers are collected, a total of 25 fingerprint templates are generated.
- the finger 200 When the user needs to perform fingerprint recognition, the finger 200 is placed at the designated position, and the fingerprint collection unit 103 collects the fingerprint of the finger to obtain a fingerprint image.
- the feature extraction unit 101 performs fingerprint feature extraction on the fingerprint extraction unit 101 to obtain fingerprint feature information to be compared.
- the feature comparison unit 104 compares the fingerprint feature information to be compared with all the fingerprint templates in the storage unit 102, and outputs a comparison result, such as a successful recognition or a recognition failure.
- the fingerprint collection unit 103 herein may include any one or more of an optical fingerprint collection unit, a capacitive fingerprint collection unit, an ultrasonic fingerprint collection unit, a radio frequency fingerprint collection unit, and the like.
- the fingerprint feature information to be compared needs to be compared with all the fingerprint templates in the storage unit 102, the recognition result can be obtained. Therefore, the more the number of fingerprint templates, the longer the fingerprint recognition time is, so that the fingerprint recognition is performed. The speed is slow, which is not conducive to the user experience.
- the present invention proposes a new image recognition method.
- the image recognition method performs feature extraction on the image feature extraction according to different feature extraction rules to obtain different feature information, such as first feature information, second feature information, etc.; when the feature information is compared, First comparing the first feature information with the first feature information in the image registration information, if the comparison is consistent, comparing the second feature information with the second feature information in the registration information, and finally outputting the comparison result . Since the first feature information includes only a small number of features of the image, and the second feature information includes all features of the image, the comparison speed of the first feature information is faster than the second feature information, that is, the image recognition method is improved. Image recognition speed.
- the image information may include fingerprint information, palm print information, ear pattern information, and skin texture information at other suitable locations on the living body. Since the skin texture and cortical structure of the organism have different characteristics, different organisms can be identified according to the characteristics.
- the living body is, for example, a human body, but may not be limited to a human body. In the following embodiments, fingerprint recognition will be described as an example.
- An image recognition method of an embodiment of the present invention may include a registration process and an identification process.
- the registration process the user registers his or her own image information, such as fingerprint information, which will be stored in the form of a fingerprint template for use in the identification process.
- fingerprint information such as fingerprint information
- the pattern template performs feature comparison and outputs recognition results, such as recognition success or recognition failure.
- the registration process specifically includes:
- Step S101 acquiring a fingerprint image to be registered
- the fingerprint image to be registered is acquired by the image sensor.
- the fingerprint sensor Taking the fingerprint sensor as an example, when the user's finger is located on the fingerprint sensor, the fingerprint sensor will collect the fingerprint image of the finger and transmit the collected fingerprint image to the fingerprint recognition system.
- the input interface 111 of the fingerprint recognition system 100 can be electrically connected to the fingerprint sensor through a flexible printed circuit board or other circuit board.
- Step S102 performing feature extraction on the acquired fingerprint image, and acquiring first feature information and second feature information;
- the first feature information and the second feature information reflect the fingerprint feature from different angles, and the feature information amount of the first feature information is less than the feature information amount of the second feature information. Therefore, feature extraction is performed on the acquired fingerprint image according to different feature extraction rules, and the first feature information and the second feature information are obtained.
- the extraction of the first feature information and the extraction of the second feature information may be performed sequentially or in parallel. Moreover, the extraction of feature information in parallel can speed up feature extraction.
- the first feature information is used to describe the fingerprint feature of the user as a whole, and only contains a small amount of feature information describing the characteristics of the user's fingerprint.
- a human finger fingerprint may include three basic types: a concentric circle or a spiral line, which is called a bucket line; an opening on one side of the line, called a striated line; and a striate like a bow, called a bow line.
- different types of fingerprints also differ in the degree of curvature of the texture, the width of the interval of the texture, and the like. Therefore, when the first feature information is extracted, the type of the fingerprint, the degree of curvature of the texture, the interval width of the texture, and the like can be extracted.
- the second feature information is used to accurately describe the uniqueness of the fingerprint, and then includes all the feature information of the fingerprint information, such as the texture of the entire fingerprint. Therefore, when the second feature information extraction is performed, the texture information of the entire fingerprint is extracted.
- first feature information and the second feature information are not limited herein.
- the third feature information, the fourth feature information, and the like may also be extracted as needed.
- Step S103 Form a corresponding fingerprint template according to the first feature information and the second feature information; that is, each fingerprint template includes corresponding first feature information and second feature information.
- Step S104 determining whether the number of registration acquisitions reaches a preset threshold; if yes, executing step S105, otherwise returning to step S101;
- the acquisition is set at least 3 times, that is, the preset threshold is 3. It should be noted that each acquisition is effective, that is, the fingerprint image acquired each time should meet the requirements of definition, finger scanning position and the like. If the currently collected fingerprint image does not meet the requirements, for example, the finger movement causes the captured image to be blurred, the current captured image is discarded, and the user is prompted to re-perform the fingerprint image. collection.
- step S105 all the fingerprint templates are stored.
- all fingerprint templates formed by the registration are stored.
- the difference between the fingerprint templates generated when the same finger is registered is small, when storing, the same portion in each fingerprint template and a portion having a difference between the fingerprint templates may be stored. This will save storage space.
- all the fingerprint templates contain only feature information, and the corresponding fingerprint image cannot be obtained through the feature information, thereby ensuring the information security of the fingerprint template.
- each registered finger has a corresponding fingerprint template library, that is, each fingerprint template has a corresponding finger identifier, and each corresponding fingerprint template library has multiple fingerprint templates.
- the fingerprint template corresponding to the finger A includes the template 1A, the template 2A, and the template 3A.
- the registration process of the above image is not limited to the process described in the foregoing embodiment, and may also include other manners in order to obtain a fingerprint template including the first feature information and the second feature information.
- the image template in the registration process it can be repeatedly used for the image recognition process, thereby saving each image registration process.
- the identifying process may specifically include:
- Step S201 acquiring a fingerprint image to be identified
- the fingerprint image to be identified is acquired by the image sensor.
- the fingerprint sensor when the user's finger is located on the fingerprint sensor, the fingerprint sensor will collect the fingerprint image of the finger and output the collected fingerprint image to the fingerprint recognition system.
- the input interface 111 of the fingerprint recognition system 100 can be electrically connected to the fingerprint sensor through a flexible printed circuit board or other circuit board.
- Step S202 performing feature extraction on the acquired fingerprint image to obtain first feature information and second feature information
- the first feature information and the second feature information reflect the fingerprint feature from different angles, and the feature information amount of the first feature information is less than the feature information amount of the second feature information. Therefore, feature extraction is performed on the acquired fingerprint image according to different feature extraction rules, and the first feature information and the second feature information are obtained.
- the extraction of the first feature information and the extraction of the second feature information may be performed sequentially or in parallel. Moreover, the extraction of feature information in parallel can speed up feature extraction.
- the first feature information is used to describe the fingerprint feature of the user as a whole, and only includes describing the fingerprint feature of the user.
- a small amount of feature information For example, a human finger fingerprint may include three basic types: a concentric circle or a spiral line, which is called a bucket line; an opening on one side of the line, called a striated line; and a striate like a bow, called a bow line.
- different types of fingerprints also differ in the degree of curvature of the texture, the width of the interval of the texture, and the like. Therefore, when the first feature information is extracted, the type of the fingerprint, the degree of curvature of the texture, the interval width of the texture, and the like can be extracted.
- the second feature information is used to accurately describe the uniqueness of the fingerprint, and then includes all the feature information of the fingerprint information, such as the texture of the entire fingerprint. Therefore, when the second feature information extraction is performed, the texture information of the entire fingerprint is extracted.
- Step S203 comparing the first feature information with the first feature information of all the registered fingerprint templates to obtain a fingerprint template that is consistent with the comparison;
- Step S204 comparing the second feature information with the second feature information in the fingerprint template that is aligned, to obtain a comparison result.
- step S204 is performed.
- step S204 is performed in parallel, and after the second feature information is successfully matched, the identification may be stopped, so that the comparison result may be obtained in advance, and the reference may be accelerated. Identify the speed.
- the first feature information is coded feature information obtained by performing coded clustering processing on the fingerprint image.
- the first feature information in the fingerprint template is coded feature information.
- the identification process may specifically include:
- Step S301 acquiring a fingerprint image to be identified
- Step S302 performing feature extraction on the acquired fingerprint image to obtain coding feature information and second feature information
- Step S303 comparing the coded feature information with the coded feature information in all the registered fingerprint templates to obtain a fingerprint template that is consistent in comparison
- Step S304 comparing the second feature information with the second feature information in the fingerprint template that is aligned, to obtain a comparison result.
- the process of obtaining the encoded feature information may include: performing image coding on the fingerprint image to obtain an initial coding feature; classifying the initial coding feature, and counting the number of each class to form a final coding feature information.
- the encoding method may include Local Binary Pattern (LBP), Local Phase Quantization (LPQ), and Binaryized Statistical Image Features (BSIF).
- LBP Local Binary Pattern
- LPQ Local Phase Quantization
- BSIF Binaryized Statistical Image Features
- Feature categorization methods may include k-means (k-means), hierarchical clustering, Self-Organizing Maps (SOM), Fuzzy C-means (FCM) clustering, etc., and the number of clusters may be For fixed values, of course, you can also flexibly set according to the actual situation.
- the initial coding feature is compared with the preset coding feature class core by using a distance metric or the like, and the coding feature is merged to the class with the smallest distance. Then count the number of each class, and finally get a statistical histogram, the final coding feature.
- the preset coding feature class core includes a cluster center value or a cluster mean value of the feature, a feature range value of the cluster, and the like.
- the preset coding feature core is pre-computed and saved to the image recognition device for reuse in feature classification.
- the preset coding feature class core can also be updated in real time through an online manner to improve the previously set coding feature class.
- the preset coding feature class core can also be obtained by processing the registered fingerprint template. For example, the fingerprint image in the registered fingerprint template is image-encoded to obtain a coding feature; then the feature features are clustered to obtain a coding feature core.
- the encoded feature core is obtained by using the registered fingerprint template processing
- the coding feature obtained by performing feature classification statistics according to the coding feature class is closer to the coding feature of the registered fingerprint template, so that when the feature comparison is performed, not only the acceleration is accelerated. Compare the speed and ensure the accuracy of the comparison.
- the method may further include:
- Step S205 preprocessing the acquired fingerprint image.
- the fingerprint image may be subjected to certain preprocessing, for example, noise processing of the fingerprint image, enhancement processing of the fingerprint image, and the like. If there is noise in the fingerprint image, there will be burrs when extracting features, and there will be many false minutiae points, that is, pseudo-detail points.
- the noise processing of the image may include processing of the spatial domain and processing of the frequency domain, such as averaging or intermediate values of image pixels; frequency domain processing such as low pass filtering.
- the enhancement processing is mainly for highlighting the contrast between the ridge portion and the valley portion of the fingerprint image, for example, by adjusting the gray value of the image pixel, sharpening the fingerprint image, and increasing the outline of the fingerprint image and the sharpness of the line.
- adjusting the gray value of the image pixel sharpening the fingerprint image
- increasing the outline of the fingerprint image and the sharpness of the line there are other ways to deal with it, not to mention here.
- an image recognition apparatus 100 is used to implement the method steps of the above embodiment.
- the image recognition device 100 includes a processing circuit 110, a storage unit 120, a feature extraction unit 130, and a feature comparison unit 140.
- Processing circuit 110 has, for example but not limited to, a microprocessor having an input interface 111 and an output interface 112.
- the input interface 111 is configured to receive image information collected by an image acquisition unit (not shown), such as fingerprint image information collected by the fingerprint collection unit.
- the fingerprint image information received by the input interface 111 may be an analog signal or a digital signal. If the fingerprint image information received by the input interface 111 is an analog signal, when it is sent to the processing circuit 110, it needs to be analog-to-digital converted and converted into a corresponding digital signal.
- the output interface 112 is configured to output a processing result, such as fingerprint identification success or fingerprint recognition failure, etc., and the processing result may be displayed by driving the display screen through the display driving circuit, or by displaying the indicator light, or performing voice prompting through the speaker.
- the processing circuit 110 outputs the corresponding fingerprint image information to the feature extraction unit 130, so that the feature extraction unit 130 performs feature extraction on the fingerprint image to obtain corresponding feature information.
- the feature information may include first feature information and second feature information, the first feature information and the second feature information are feature information that reflects fingerprint characteristics from different angles, and the feature information amount of the first feature information is smaller than the second feature. The amount of characteristic information of the information is small.
- the first feature information is used to describe the fingerprint feature of the user as a whole
- the second feature information is used to accurately describe the texture of the fingerprint, including all feature point information describing the texture of the ridge portion, due to the portion of the valley in the fingerprint and the position of the portion of the ridge.
- the position of the valley portion of the fingerprint can be determined by determining the position of the ridge portion of the fingerprint.
- the first feature information may also include all feature point information describing the texture of the valley portion, or all feature point information of the grain of the valley portion and the ridge portion.
- the first feature information and the second feature information may also be other suitable fingerprint information.
- the fingerprint template stored in the storage unit 120 corresponds to the first feature information and the second feature information including the registered fingerprint.
- the difference between the fingerprint templates generated when the same finger is registered is small, when storing, the same portion in each fingerprint template and a portion having a difference between the fingerprint templates may be stored. This will save storage space.
- all the fingerprint templates contain only feature information, and the corresponding fingerprint image cannot be obtained through the feature information, thereby ensuring the information security of the fingerprint template.
- the feature comparison unit 140 compares the first feature information extracted by the first feature extraction unit 131 with the first feature information of the registered N fingerprint templates to obtain a comparison.
- the fingerprint template for example, M fingerprint templates, M ⁇ N; the second feature information extracted by the second feature extraction unit 132 is compared with the second feature information in the fingerprint template that is aligned.
- the output comparison results such as recognition success or recognition failure. If the first feature information is compared with the first feature information in all the registered fingerprint templates, no comparison is obtained.
- the fingerprint template directly outputs the comparison result, that is, the second feature information is no longer compared.
- the unmatched fingerprint template can be quickly filtered, and the second feature information is avoided from being compared with all the fingerprint templates in the storage unit 120, thereby saving the comparison time of the second feature information. , improve the speed of fingerprint recognition.
- the comparison of the first feature information may be performed first. After the second feature information is extracted, the second feature information is compared, thereby further improving the fingerprint recognition speed.
- the feature extraction unit 130 may include a first feature extraction unit 131 and a second feature extraction unit 132.
- the first feature extraction unit 131 performs feature extraction on the fingerprint information by using a preset first feature extraction rule to obtain first feature information.
- the first feature information is used to describe the fingerprint feature of the user as a whole, and only contains a small amount of feature information describing the characteristics of the user's fingerprint.
- a human finger fingerprint may include three basic types: a concentric circle or a spiral line, which is called a bucket line; an opening on one side of the line, called a striated line; and a striate like a bow, called a bow line.
- the first feature extraction unit 131 may extract first feature information such as the type of the fingerprint, the degree of curvature of the texture, and the interval width of the texture.
- the second feature extraction unit 132 performs feature extraction on the fingerprint information by using a preset second feature extraction rule to obtain second feature information.
- the second feature information is used to accurately describe the uniqueness of the fingerprint. Therefore, the second feature information includes, but is not limited to, feature point information of each stripe path in the collected fingerprint image, for example, location information of each feature point and the feature. The eigenvalue of the point.
- the feature extraction unit 130 may further include a third feature extraction unit (not shown), and the third feature extraction unit performs feature on the fingerprint information by using a preset third feature extraction rule. Extracting, obtaining third feature information.
- the third feature information is used to describe several detailed feature points of the fingerprint, such as a bifurcation point, a termination point, a center point, and a triangle point, and the feature information amount of the third feature information is less than the feature information amount of the second feature information. However, there is more feature information than the first feature information. Therefore, after the comparison of the first feature information by the feature comparison unit 140, the first fingerprint template that is aligned is obtained, and the third feature information in the first fingerprint template that matches the third feature information and the comparison is performed.
- Performing an alignment obtaining a second fingerprint template consistent with the comparison, and comparing the second feature information with the second fingerprint template that is aligned, to obtain a comparison result, such as a successful recognition or a recognition failure.
- a comparison result such as a successful recognition or a recognition failure.
- the feature comparison unit 140 may include a first feature comparison unit and a second feature comparison unit.
- the first feature comparison unit is used for feature comparison of the first feature information
- the second feature comparison unit is used for feature comparison of the second feature information. Since the first feature information is extracted faster than the second The feature information is extracted at a high speed. Therefore, after the first feature information is extracted, the first feature comparison unit can perform feature comparison on the first feature information to obtain a matching fingerprint template.
- the second feature comparison unit may perform feature matching on the fingerprint template in which the second feature information is consistent with the comparison, without waiting for the first feature information to end the feature comparison with all the fingerprint templates.
- the feature comparison of the feature comparison of the first feature information with the second feature information can also be processed in parallel, thereby speeding up the feature comparison, that is, improving the fingerprint recognition speed.
- the first feature information is coded feature information obtained after performing coded clustering processing on the fingerprint image.
- the first feature information in the fingerprint template is coded feature information.
- the first feature extraction unit 131 may include an image encoding module 1311 and a feature categorization statistics module 1312 .
- the image encoding module 1311 is configured to perform image coding on the fingerprint image to obtain a coding feature.
- the feature classification statistics module 1312 is configured to perform feature classification on the coding features, and count the number of each class to form final coding feature information.
- the encoding method may include Local Binary Pattern (LBP), Local Phase Quantization (LPQ), and Binaryized Statistical Image Features (BSIF).
- LBP Local Binary Pattern
- LPQ Local Phase Quantization
- BSIF Binaryized Statistical Image Features
- the encoding may be performed by using one of the encoding methods, or may be encoded by using multiple encoding methods, as long as the encoding rule of the first feature information in the fingerprint template is consistent with the encoding rule of the first feature information in the fingerprint to be detected. can.
- Feature categorization methods may include k-means (k-means), hierarchical clustering, Self-Organizing Maps (SOM), Fuzzy C-means (FCM) clustering, etc., and the number of clusters may be For fixed values, of course, you can also flexibly set according to the actual situation.
- the coding feature obtained by the image coding module 1311 is compared with the preset coding feature core by using a distance metric or the like, and the coding feature is merged into the class with the smallest distance.
- the feature categorization statistics module 1312 then counts the number of each class, and finally obtains a statistical histogram, the final coding feature.
- the preset coding feature class core includes a cluster center value or a cluster mean value of the feature, a feature range value of the cluster, and the like.
- the preset coding feature core is pre-computed and saved to the image recognition device for reuse in feature classification.
- the preset coding feature class core can also be updated in real time through an online manner to improve the previously set coding feature class.
- the preset coding feature class core can also be obtained by processing the registered fingerprint template. For example, the fingerprint image in the registered fingerprint template is image-encoded to obtain a coding feature; then the feature features are clustered to obtain a coding feature core.
- the encoded feature core is obtained by using the registered fingerprint template processing
- the coding feature obtained by performing feature classification statistics according to the coding feature class is closer to the coding feature of the registered fingerprint template, so that when the feature comparison is performed, not only the acceleration is accelerated. Compare the speed and ensure the accuracy of the comparison.
- FIG. 11 is a fingerprint image of a parallel texture and a feature distribution after BSIF encoding the fingerprint image
- FIG. 12 is a fingerprint image of a curved texture, and BSIF encoding the fingerprint image.
- Characteristic distribution The fingerprint images shown in FIG. 11 and FIG. 12 only reflect the characteristics of the fingerprint as a whole, that is, the first feature information including only the fingerprint information. It can be seen from the feature distributions in FIG. 11 and FIG. 12 that the difference between the parallel grain and the curved grain is obvious, and thus the feature comparison is performed by the coding feature, thereby further improving the comparison speed, that is, the fingerprint recognition speed.
- the fingerprint image may be subjected to certain preprocessing, for example, noise processing of the fingerprint image, enhancement processing of the fingerprint image, and the like. If there is noise in the fingerprint image, there will be burrs when extracting features, and there will be many false minutiae points, that is, pseudo-detail points.
- the noise processing of the image may include processing of the spatial domain and processing of the frequency domain, such as averaging or intermediate values of image pixels; frequency domain processing such as low pass filtering.
- the enhancement processing is mainly for highlighting the contrast between the ridge portion and the valley portion of the fingerprint image, for example, by adjusting the gray value of the image pixel, sharpening the fingerprint image, and increasing the outline of the fingerprint image and the sharpness of the line.
- adjusting the gray value of the image pixel sharpening the fingerprint image
- increasing the outline of the fingerprint image and the sharpness of the line there are other ways to deal with it, not to mention here.
- the image recognition device described above may be integrated as a processing chip, disposed separately from the image acquisition unit. In this way, the design of the image recognition device can be performed independently, thereby reducing the design cost.
- the image recognition device described above may also be integrated with the image acquisition unit as an image recognition chip, such as a fingerprint recognition sensor. In this way, the fingerprint recognition sensor collects fingerprints and performs fingerprint recognition internally. Even if the terminal main system applied by the fingerprint recognition sensor has a security threat, the biological information is still safe, thereby ensuring the security of the biological information.
- the image recognition device described above can be applied to implement a corresponding function on the smart terminal, for example, the image recognition device recognizes the user identity, and after the recognition succeeds, the user is unlocked, the application is started, the online payment is performed, and the like.
- the smart terminal can be a consumer electronic product or a home-based electronic product or a vehicle-mounted electronic product.
- consumer electronic products such as mobile phones, tablets, notebook computers, desktop monitors, computer integrated machines and other electronic products using biometric identification technology.
- Home-based electronic products such as smart door locks, televisions, refrigerators, wearable devices and other electronic products that use biometric technology.
- Vehicle-mounted electronic products such as car navigation systems, car DVDs, etc.
- the image recognition device can be integrated with the image acquisition unit as a chip, such as a fingerprint sensor chip, a collection fingerprint collection function and a fingerprint matching function; the image recognition device can also integrate a separate processing chip, that is, the image recognition device is integrated in the chip. All or part of a component.
- an electronic device 500 is provided with an image capture device 501 that collects image information and an image recognition device 100 according to any of the above embodiments.
- the electronic device may also be configured with an image capture function.
- An image recognition chip combined with an image matching function.
- the image capturing device 501 can be a photoelectric sensing module, a capacitive sensing module, and of course, an imaging device.
- the image capture device 501 collects image information of the target object, such as a fingerprint image, and transmits the acquired image information to the image recognition device 100.
- the image recognition device 100 recognizes the image information and outputs a recognition result such as recognition success or recognition failure.
- the image recognition apparatus 100 adopts a new recognition processing technique, at the time of feature extraction, feature extraction is performed on the image information according to different angles, and the first feature information and the second feature information are obtained, and the feature information amount of the first feature information is obtained.
- the first feature information is first compared with all the registered fingerprint templates to obtain a matching fingerprint template, and the fingerprints that are inconsistent are removed.
- the template is then compared with the fingerprint template that matches the alignment, thereby speeding up the feature comparison, that is, the image recognition speed.
- the electronic device 500 is a mobile phone, and the front surface of the mobile phone is provided with a display device 400 , and the image capturing device 501 or the image recognition chip is disposed under the front cover of the electronic device 500 .
- the image capture device 501 or the image recognition chip may also be disposed on the display device 400.
- the image capture device 501 can also be integrated as an image recognition chip, or the image capture device 501 can also be integrated with the image recognition device 100 as an image recognition chip, correspondingly disposed on the front, back, and sides of the electronic device 500. The position may be exposed to the outer surface of the electronic device 500 or may be disposed inside the electronic device 500 and adjacent to the outer casing.
- the electronic device 600 when the image recognition device is applied to the smart terminal, the existing structure of the smart terminal may be utilized, and some structures of the image recognition may be added.
- the electronic device 600 includes a processor 601, a memory 602, a display unit 603, a user input unit 604, a power source 605, and a communication unit 606.
- the memory 602 is used to store all data on the smart terminal 600 that needs to be stored, such as external data and internal processing data.
- the memory 602 can include an internal memory unit and an external memory unit.
- Display unit 603 includes, but is not limited to, an LCD, a TFT-LCD, an OLED, a flexible display, and the like.
- the user input unit 604 can generate input data according to a command input by the user to control various operations of the smart terminal 600.
- the user input unit 604 allows the user to input various types of information, and may include a button, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel, a shaker. Rod and so on.
- a touch panel is superimposed on the display unit 603 in a layer form, a touch screen may be formed.
- the button in the user input unit 604 It may include a virtual button disposed on the touch panel, or a physical button disposed in a non-display area, such as a Home button, a power button, and the like.
- the power source 605 is used to provide the working power required for the smart terminal to operate, and to provide the standby power required to maintain the standby state of the smart terminal.
- the communication unit 606 may include a communication interface such as USB, Type-C, etc.; of course, may also include a wireless communication interface such as GPRS, WCDMA, wifi, radio frequency, Bluetooth, infrared, and the like. It should be noted that FIG. 14 only exemplifies some components of the electronic device 600, and may also include other functional components, such as a camera, a microphone, a speaker, etc., to implement functions required by the user.
- the electronic device 600 is further provided with an image acquisition device 601 and an image recognition device.
- the structure of the image recognition device is similar to that of the image recognition device 100 of the above embodiment, but only in the image recognition device 100.
- the processing circuit 110 and the storage unit 120 are shared with the processor 601 and the memory 602 in the electronic device 600, and other structures of the image recognition device 100 may be stored in the memory 602 or in a separate storage medium in the form of a software program, such as an instruction code.
- the existing structure of the smart terminal can be utilized, and only the software structure of the image recognition can be added, thereby greatly reducing the manufacturing cost of the image recognition.
- the image capturing device 601 can be a photoelectric sensing module, a capacitive sensing module, and of course an imaging device.
- the configuration of the image acquisition device 601 in the electronic device 600 can be referred to the previous embodiment as an example, and details are not described herein again.
- the image capture device 601 collects image information of the target object, such as a fingerprint image, and transmits the acquired image information to the image recognition device 602.
- the image recognition device 602 processes the image information, it recognizes the image information and outputs a recognition result such as recognition success or recognition failure.
- the image recognition device adopts a new recognition processing technology, at the time of feature extraction, feature extraction is performed on the image information according to different angles, and the first feature information and the second feature information are obtained, and the feature information ratio of the first feature information is obtained.
- the second feature information has a small amount of feature information. Therefore, when the feature comparison is performed, the first feature information is first compared with all the registered fingerprint templates to obtain a matching fingerprint template, and the fingerprint template that is inconsistent is removed. Then, the second feature information is compared with the fingerprint template that is aligned, thereby speeding up the feature comparison, that is, the image recognition speed.
- each unit in the above embodiment may be integrated into one processing unit, or two or more units may be integrated.
- the above integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.
- the units integrated in the above embodiments may also be stored in a computer readable storage medium if they are implemented in the form of software functional modules and sold or used as separate products. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in part contributing to the prior art.
- the computer software product is stored in a storage medium and includes instructions for causing a smart terminal (consumer electronics, home electronics, or vehicle-mounted electronic product) to perform all or part of the methods of the various embodiments of the present invention .
- first and second are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated.
- features defining “first” or “second” may include at least one of the features, either explicitly or implicitly.
- the meaning of "a plurality” is at least two, such as two, three, etc., unless specifically defined otherwise.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Collating Specific Patterns (AREA)
Abstract
Description
Claims (14)
- 一种图像识别方法,其特征在于,所述方法包括以下步骤:S1,获取待识别的图像信息;S2,对所获取的图像信息进行特征提取,获得第一特征信息和第二特征信息;S3,将第一特征信息与注册的图像模板中的第一特征信息进行比对,获得比对一致的图像模板;S4,将第二特征信息与比对一致的图像模板中的第二特征信息进行比对,获得识别结果。
- 如权利要求1所述的图像识别方法,其特征在于,所述步骤S2中对所获取的图像信息进行特征提取,获得第一特征信息具体包括:对所获取的图像信息进行图像编码,获得初始编码特征;按照预设的编码特征类心对初始编码特征进行特征归类,并统计每个类的数目,形成最终的编码特征信息。
- 如权利要求2所述的图像识别方法,其特征在于,所述图像编码采用如下一种或多种编码方法:局部二值模式、局部相位量化、图像特征值统计。
- 如权利要求2所述的图像识别方法,其特征在于,所述特征归类采用如下一种或多种聚类方法:k均值、层次聚类、自组织映射、模糊C均值聚类。
- 如权利要求2所述的图像识别方法,其特征在于,所述预设的编码特征类心为预先设置或者通过在线的方式实时更新。
- 如权利要求1所述的图像识别方法,其特征在于,所述步骤S4在获得比对一致的图像模板后,与步骤S3并行执行。
- 如权利要求6所述的图像识别方法,其特征在于,所述步骤S4中当第二特征信息比对成功,则结束识别流程,并输出识别结果。
- 如权利要求6所述的图像识别方法,其特征在于,所述步骤S3中,当所述第一特征信息与注册的所有图像模板中的第一特征信息均比对不一致,则结束识别流程,并输出识别结果。
- 如权利要求1所述的图像识别方法,其特征在于,所述步骤S2之前还包括:S5,对获取的图像信息进行预处理。
- 一种图像识别方法,其特征在于,所述方法包括以下步骤:S01,获取待注册的图像信息;S02,对获取的图像信息进行特征提取,获取第一特征信息和第二特征信息;S03,根据第一特征信息和第二特征信息,形成相应的图像模板;S04,判断注册采集次数是否达到预设阈值;是则执行步骤S05,否则返回执行步骤S01;S05,将所有的图像模板进行存储,以用于对待识别的图像信息进行识别。
- 如权利要求10所述的图像识别方法,其特征在于,所述步骤S05之后包括:通过一图像采集单元对目标物体的图像信息进行采集,采用如权利要求1-9任一项所述的图像识别方法中的步骤对待识别的图像信息进行识别。
- 一种图像识别装置,其特征在于,所述图像识别装置包括处理器和存储单元;所述处理器用于执行如权利要求1-9任一项所述的图像识别方法;或者用于执行如权利要求10或11所述的图像识别方法。
- 一种电子装置,其特征在于,所述电子装置包括图像采集装置和处理器;所述图像采集装置用于在目标物体放置于电子装置上时,采集所述目标物体的图像信息;所述处理器用于执行如权利要求1-9任一项所述的图像识别方法;或者用于执行如权利要求10或11所述的图像识别方法。
- 一种计算机存储介质,其特征在于,所述计算机存储介质存储有计算机可执行指令,所述计算机可执行指令用于执行权利要求1-9任一项所述的图像识别方法;或者用于执行权利要求10或11所述的图像识别方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2017/085233 WO2018213946A1 (zh) | 2017-05-20 | 2017-05-20 | 图像识别方法、图像识别装置、电子装置及计算机存储介质 |
CN201780000357.1A CN107278308A (zh) | 2017-05-20 | 2017-05-20 | 图像识别方法、图像识别装置、电子装置及计算机存储介质 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2017/085233 WO2018213946A1 (zh) | 2017-05-20 | 2017-05-20 | 图像识别方法、图像识别装置、电子装置及计算机存储介质 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018213946A1 true WO2018213946A1 (zh) | 2018-11-29 |
Family
ID=60076513
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2017/085233 WO2018213946A1 (zh) | 2017-05-20 | 2017-05-20 | 图像识别方法、图像识别装置、电子装置及计算机存储介质 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN107278308A (zh) |
WO (1) | WO2018213946A1 (zh) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110222789A (zh) * | 2019-06-14 | 2019-09-10 | 腾讯科技(深圳)有限公司 | 图像识别方法及存储介质 |
CN112330728A (zh) * | 2020-11-30 | 2021-02-05 | 维沃移动通信有限公司 | 图像处理方法、装置、电子设备以及可读存储介质 |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108416262A (zh) * | 2018-01-25 | 2018-08-17 | 杭州电子科技大学 | 一种基于多特征值的指纹图像特征匹配算法 |
CN110199295A (zh) * | 2019-04-04 | 2019-09-03 | 深圳市汇顶科技股份有限公司 | 指纹识别的方法、装置和电子设备 |
TWI792017B (zh) * | 2020-07-01 | 2023-02-11 | 義隆電子股份有限公司 | 生物特徵的辨識系統及辨識方法 |
CN111860279A (zh) * | 2020-07-14 | 2020-10-30 | 武汉企秀网络科技有限公司 | 图像识别方法及装置、计算机存储介质 |
WO2024030105A1 (en) * | 2022-08-02 | 2024-02-08 | Havelsan Hava Elektronik San. Ve Tic. A.S. | Multi-stage fusion matcher for dirty fingerprint and dirty palm |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101079102A (zh) * | 2007-06-28 | 2007-11-28 | 中南大学 | 基于统计方法的指纹识别方法 |
CN101145198A (zh) * | 2007-09-21 | 2008-03-19 | 清华大学 | 指纹识别中确定性编码方法与系统 |
CN101482916A (zh) * | 2008-01-08 | 2009-07-15 | 祥群科技股份有限公司 | 手指热像的身份辨识方法 |
CN101604385A (zh) * | 2009-07-09 | 2009-12-16 | 深圳大学 | 一种掌纹识别方法和掌纹识别装置 |
US20120257802A1 (en) * | 2011-04-07 | 2012-10-11 | Kwon Dongjin | Apparatus and method for generating representative fingerprint template |
CN105814585A (zh) * | 2016-03-17 | 2016-07-27 | 深圳信炜科技有限公司 | 指纹处理方法、指纹处理装置、指纹识别系统及电子设备 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101540000B (zh) * | 2008-03-20 | 2011-07-27 | 中国科学院自动化研究所 | 基于纹理基元统计特性分析的虹膜分类方法 |
CN109800741B (zh) * | 2015-11-13 | 2023-07-14 | Oppo广东移动通信有限公司 | 指纹注册方法、装置和终端设备 |
CN106055961B (zh) * | 2016-05-31 | 2019-02-05 | Oppo广东移动通信有限公司 | 一种指纹解锁方法及移动终端 |
CN106096585A (zh) * | 2016-06-29 | 2016-11-09 | 深圳市金立通信设备有限公司 | 一种身份验证方法以及终端 |
CN208689589U (zh) * | 2017-05-20 | 2019-04-02 | 深圳信炜科技有限公司 | 图像识别系统及电子装置 |
CN107358144A (zh) * | 2017-05-20 | 2017-11-17 | 深圳信炜科技有限公司 | 图像识别系统及电子装置 |
CN107358145A (zh) * | 2017-05-20 | 2017-11-17 | 深圳信炜科技有限公司 | 图像传感器及电子装置 |
-
2017
- 2017-05-20 CN CN201780000357.1A patent/CN107278308A/zh active Pending
- 2017-05-20 WO PCT/CN2017/085233 patent/WO2018213946A1/zh active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101079102A (zh) * | 2007-06-28 | 2007-11-28 | 中南大学 | 基于统计方法的指纹识别方法 |
CN101145198A (zh) * | 2007-09-21 | 2008-03-19 | 清华大学 | 指纹识别中确定性编码方法与系统 |
CN101482916A (zh) * | 2008-01-08 | 2009-07-15 | 祥群科技股份有限公司 | 手指热像的身份辨识方法 |
CN101604385A (zh) * | 2009-07-09 | 2009-12-16 | 深圳大学 | 一种掌纹识别方法和掌纹识别装置 |
US20120257802A1 (en) * | 2011-04-07 | 2012-10-11 | Kwon Dongjin | Apparatus and method for generating representative fingerprint template |
CN105814585A (zh) * | 2016-03-17 | 2016-07-27 | 深圳信炜科技有限公司 | 指纹处理方法、指纹处理装置、指纹识别系统及电子设备 |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110222789A (zh) * | 2019-06-14 | 2019-09-10 | 腾讯科技(深圳)有限公司 | 图像识别方法及存储介质 |
CN110222789B (zh) * | 2019-06-14 | 2023-05-26 | 腾讯科技(深圳)有限公司 | 图像识别方法及存储介质 |
CN112330728A (zh) * | 2020-11-30 | 2021-02-05 | 维沃移动通信有限公司 | 图像处理方法、装置、电子设备以及可读存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CN107278308A (zh) | 2017-10-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2018213946A1 (zh) | 图像识别方法、图像识别装置、电子装置及计算机存储介质 | |
CN107209855B (zh) | 通过指纹识别认证用户 | |
US9141844B2 (en) | System and method for three-dimensional biometric data feature detection and recognition | |
US9202104B2 (en) | Biometric information correction apparatus, biometric information correction method and computer-readable recording medium for biometric information correction | |
WO2010119500A1 (ja) | 生体情報登録装置、生体情報登録方法及び生体情報登録用コンピュータプログラムならびに生体認証装置、生体認証方法及び生体認証用コンピュータプログラム | |
KR101632912B1 (ko) | 지문 인식을 이용한 사용자 인증 방법 | |
CN105659253B (zh) | 指纹提取方法和装置 | |
US10552596B2 (en) | Biometric authentication | |
CN111201537A (zh) | 在指纹分析中通过机器学习来区分活体手指与欺骗手指 | |
CN105303174B (zh) | 指纹录入方法及装置 | |
CN107077279B (zh) | 一种压力检测的方法及装置 | |
El_Rahman | Multimodal biometric systems based on different fusion levels of ECG and fingerprint using different classifiers | |
CN107358144A (zh) | 图像识别系统及电子装置 | |
CN107408208B (zh) | 用于对用户的生物测量进行分析的方法和指纹感测系统 | |
CN107358145A (zh) | 图像传感器及电子装置 | |
WO2018213947A1 (zh) | 图像识别系统及电子装置 | |
Xie et al. | Fingerprint quality analysis and estimation for fingerprint matching | |
JP6241230B2 (ja) | 生体情報判定装置及びプログラム | |
WO2018213945A1 (zh) | 图像传感器及电子装置 | |
Yu et al. | Fingerprint image preprocessing based on whole-hand image captured by digital camera | |
Khalil et al. | Authentication of fingerprint biometrics acquired using a cellphone camera: a review | |
Patel et al. | Fingerprint matching using two methods | |
Sehgal | Palm recognition using LBP and SVM | |
Zhang et al. | 3D fingerprint reconstruction and recognition | |
US11460928B2 (en) | Electronic device for recognizing gesture of user from sensor signal of user and method for recognizing gesture using the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17911034 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17911034 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 27/05/2020) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17911034 Country of ref document: EP Kind code of ref document: A1 |