CN107690648B - Image preview method and device based on iris recognition - Google Patents
Image preview method and device based on iris recognition Download PDFInfo
- Publication number
- CN107690648B CN107690648B CN201680006931.XA CN201680006931A CN107690648B CN 107690648 B CN107690648 B CN 107690648B CN 201680006931 A CN201680006931 A CN 201680006931A CN 107690648 B CN107690648 B CN 107690648B
- Authority
- CN
- China
- Prior art keywords
- image
- pattern
- iris
- background image
- infrared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/197—Matching; Classification
Abstract
The utility model provides an image preview method and device based on iris recognition, which relates to the field of iris recognition and is used for solving the problem that the iris pattern displayed in real time on a preview interface is the eyeball black-and-white physiological image shot by an iris camera in the process of image preview such as iris registration or recognition in the prior art. The method comprises the following steps: acquiring an infrared image acquired by an infrared lens; determining the user type of the shot object according to the iris parameters of the iris pattern under the condition that the infrared image contains the iris pattern; acquiring a non-infrared image matched with the user type of a shot object, wherein the non-infrared image contains a replacement pattern of an iris pattern, and the position of the replacement pattern in the non-infrared image is determined by the position of the iris pattern in the infrared image; the non-infrared image is displayed in an image preview area.
Description
Technical Field
The application relates to the technical field of iris recognition, in particular to an image preview method and device based on iris recognition.
Background
At present, along with the increasing attention paid to the security and the practicability of the identity authentication, more and more electronic devices (especially portable electronic devices) are equipped with the iris recognition function. The iris recognition technology is based on the iris in the eye for identity recognition, the iris is an annular part located between a black pupil and a white sclera, the iris of each person cannot change after being formed in the fetal development stage, and the iris contains detail characteristics of spots, filaments, crowns, stripes, crypts and the like which are staggered with one another, so that the iris of each person has uniqueness, and the uniqueness of the identity recognition by adopting the iris recognition technology is determined.
The existing iris recognition technology needs an additional infrared camera (which can be integrated with a common forward camera, but is still equivalent to two in terms of light path and technology, and is only combined in physical structure) and an infrared light supplement lamp (which illuminates the face and eyes with infrared light) on hardware, then the infrared camera collects eyeball images of a user, and the shot eyeball images are processed into a template for storage or comparison by an algorithm. However, in the process of image preview such as iris registration or iris recognition, the eyeball image captured by the iris camera is a black-and-white physiological image of the eyeball, and thus the user feels uncomfortable.
Disclosure of Invention
The embodiment of the application provides an image preview method and device based on iris recognition, which are used for solving the problem that in the prior art, in the process of image preview such as iris registration or iris recognition, the iris pattern displayed in real time on a preview interface is a black-and-white eyeball physiological image shot by an iris camera.
In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:
in a first aspect, an image preview method based on iris recognition is provided, including:
acquiring an infrared image acquired by an infrared lens;
determining the user type of a shot object according to the iris parameters of the iris pattern under the condition that the infrared image contains the iris pattern;
acquiring a non-infrared image matched with the user type of the shot object, wherein the non-infrared image contains a replacement pattern of the iris pattern, and the position of the replacement pattern in the non-infrared image is determined by the position of the iris pattern in the infrared image;
displaying the non-infrared image in the image preview area.
In a second aspect, an image preview device based on iris recognition is provided, including:
the acquisition module is used for acquiring an infrared image acquired by the infrared lens;
the determining module is used for determining the user type of the shot object according to the iris parameters of the iris pattern under the condition that the infrared image acquired by the acquiring module contains the iris pattern;
the acquisition module is further used for acquiring a non-infrared image matched with the user type of the shot object, wherein the non-infrared image contains a replacement pattern of the iris pattern, and the position of the replacement pattern in the non-infrared image is determined by the position of the iris pattern in the infrared image;
and the control module is used for displaying the non-infrared image acquired by the acquisition module in the image preview area.
In a third aspect, an image preview device based on iris recognition is provided, which structurally comprises a processor configured to support the device to execute corresponding functions in the method. The apparatus may further comprise a memory, coupled to the processor, storing computer software code for the above-described iris recognition based image preview apparatus, including a program designed to perform the above-described aspects.
In a fourth aspect, a computer storage medium is provided for storing computer software instructions for an iris recognition based image preview apparatus, which includes program code designed to execute the iris recognition based image preview method of the above aspect.
In a fifth aspect, a computer program is provided, which is directly loadable into an internal memory of a computer and contains software codes, and which, when loaded and executed by the computer, is capable of implementing the image preview method based on iris recognition according to the above aspect.
In a sixth aspect, a robot is provided, which includes the image preview device based on iris recognition according to the third aspect.
According to the scheme, under the condition that the infrared image collected by the infrared lens contains the iris pattern, the user type of the shot object is determined according to the iris parameters of the iris pattern, then the non-infrared image matched with the user type of the shot object is obtained based on the user type, the non-infrared image contains the replacement pattern of the iris pattern, then the non-infrared image is displayed in the image preview area, and the non-infrared image is an attractive image which can meet the individual requirements of the user and is selected based on the user type, so that the shot object is prevented from watching the infrared image containing the iris pattern. Meanwhile, the position of the replacement pattern of the iris pattern in the non-infrared image is determined by the position of the iris pattern in the infrared image, namely, the position of the replacement pattern in the non-infrared image moves along with the movement of the position of the iris pattern in the infrared image within a period of time; the user can adjust the eyeball (also can be a face) of a shot person in real time or adjust the shooting direction of the infrared lens by watching the position of the replacement pattern in the non-infrared image of the preview area so as to finish eyeball alignment, and then the infrared lens can acquire the infrared image which needs to be used in the processes of iris registration, identification, unlocking and the like. Therefore, the scheme reduces the conflict emotion of the user on the infrared iris pattern in the previewing process on the premise of ensuring that the user normally finishes requirements of iris registration, iris identification, iris unlocking and the like.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a method for previewing an image based on iris recognition according to an embodiment of the present disclosure;
FIG. 2a is a schematic diagram of a non-infrared image including an alternative pattern to an iris pattern displayed in an image preview area according to an embodiment of the present application;
FIG. 2b is a schematic illustration of another non-infrared image containing an alternative pattern to an iris pattern displayed in an image preview area according to an embodiment of the present application;
fig. 3 is a flowchart of another method for previewing an image based on iris recognition according to an embodiment of the present disclosure;
fig. 4a is a schematic diagram illustrating a non-infrared image displayed in an image preview area by a jigsaw puzzle according to an embodiment of the present disclosure;
fig. 4b is a schematic diagram illustrating a non-infrared image displayed in an image preview area by an eyeball capture technology according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an image previewing apparatus based on iris recognition according to an embodiment of the present disclosure;
fig. 6 is a schematic structural diagram of another image previewing apparatus based on iris recognition according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of another image previewing apparatus based on iris recognition according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Some of the terms referred to in this application are explained below to facilitate the understanding of the reader:
the iris is a fabric-shaped circular ring-shaped part with various colors and is positioned between a black pupil and a white sclera of an eye, the iris has abundant and different texture patterns, the diameter of the iris of a person is generally between 11 mm and 12 mm, the iris of each person does not change after being formed in the fetal development stage, the iris contains a plurality of mutually staggered detailed characteristics such as crowns, crystallines, filaments, spots, structures, crypts, rays, wrinkles, stripes and the like, and the detailed characteristics determine the uniqueness of the iris characteristics and the uniqueness of identity recognition.
The iris recognition is based on the iris in eyes for identity recognition, generally needs four steps, is divided into iris pattern acquisition, image preprocessing, iris feature extraction and feature storage (during registration) or feature matching (during recognition), and is mainly applied to security equipment (such as access control and the like) and places with high confidentiality requirements. The iris pattern acquisition means that the whole eye of a person is shot by using an infrared lens to obtain an infrared iris pattern; the image preprocessing refers to preprocessing operations such as image smoothing, edge detection, image separation and the like on the shot iris pattern; the iris feature extraction is to extract the unique detail feature points of the iris from the iris pattern through a specific algorithm and encode the unique detail feature points; the characteristic matching refers to comparing and verifying the extracted characteristic code of the iris detail characteristic with the characteristic code of the iris detail characteristic of the iris pattern stored in the database in advance so as to achieve the aim of identification.
The "infrared lens" is an infrared camera, and usually appears in a pair with an infrared light generator (e.g., an infrared fill-in lamp) for generating infrared light to illuminate the face and eyes of a subject, and then the infrared lens captures the face and eyes of the subject illuminated by the infrared light, so as to obtain an infrared image, usually a black-and-white or greenish image, including an eyeball image of the subject.
The "non-infrared lens" is a lens other than an infrared camera, for example, a general front camera in a smart phone, and the present application does not limit this.
The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship. The term "plurality" herein means two or more, unless otherwise specified.
It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
In the present embodiment, unless otherwise specified, "a plurality" means two or more.
In the embodiments of the present invention, "of", "corresponding" and "corresponding" may be mixed, and it should be noted that the intended meaning is consistent when the difference is not emphasized.
The technical solutions provided by the embodiments of the present application will be described below with reference to the drawings of the specification of the embodiments of the present application. It is to be understood that only a few embodiments, but not all embodiments of the present application are described. It should be noted that some or all of the technical features of any of the technical solutions provided below may be combined and used to form a new technical solution without conflict.
The basic principle of the technical scheme provided by the embodiment of the application is as follows: in the process of image preview such as iris registration or identification, if an infrared image acquired by an infrared lens contains an iris pattern, determining the user type of a shot object based on the iris parameters of the iris pattern, selecting a non-infrared image containing a replacement pattern of the iris pattern matched with the user type for the iris pattern, and displaying the non-infrared image in an image preview area according to the position of the iris pattern in the infrared image, thereby preventing the shot object from viewing the infrared image containing the iris pattern.
The execution subject of the image preview method based on iris recognition provided by the embodiment of the application can be an image preview device based on iris recognition or a terminal device which can be used for executing the image preview method based on iris recognition. The image preview device based on iris recognition may be a Central Processing Unit (CPU) in the terminal device, a combination of the CPU and hardware such as a memory, or may be another control Unit or module in the terminal device.
For example, the terminal device may be a Personal Computer (PC), a netbook, a Personal Digital Assistant (PDA), a server, etc. that analyzes an infrared image acquired by an infrared lens by using the method provided in the embodiment of the present application, or the terminal device may be a PC, a server, etc. that is installed with a software client, a software system, or a software application that can process an infrared image acquired by an infrared lens by using the method provided in the embodiment of the present application, and a specific hardware implementation environment may be in a general computer form, or in an ASIC form, or in an FPGA form, or in some programmable expansion platform, such as an xtensia platform of tenlica, etc.
Based on the above, an embodiment of the present application provides an image preview method based on iris recognition, as shown in fig. 1, the method includes the following steps:
101. and acquiring an infrared image acquired by the infrared lens.
Illustratively, after an application based on iris recognition in the terminal device is started, the application can control to turn on the infrared lens and further control to turn on the infrared light supplement lamp, and at the moment, the infrared lens can acquire an infrared image in real time aiming at a shot object.
102. When the iris pattern is included in the infrared image, the user type of the subject is determined based on the iris parameters of the iris pattern.
The iris pattern of the infrared image in the embodiment of the present application is a partial image of the infrared image, and the partial image includes an iris pattern or an eyeball pattern.
The iris parameters of the iris pattern in the embodiments of the present application include, but are not limited to: the diameter or radius of the iris, the iris color, iris characteristic information, etc. Each user type appearing in the embodiment of the application has a corresponding user type identifier corresponding to the user type identifier. In the embodiment of the present application, the user types may be divided according to ages (for example, children, adults, and the elderly), or according to genders (for example, women, and men), which is not limited herein, and may be divided according to specific needs in practical applications, which is not limited herein.
For example, since the iris sizes of users of different ages are not the same, embodiments of the present application may determine the age of the user based on the diameter or radius of the iris in the iris parameters of the iris pattern. Meanwhile, when the user type of the object to be photographed is determined according to the iris parameters of the iris pattern, the embodiment of the present application may also collect the local user information of the object to be photographed, for example, request the personal terminal of the object to be photographed for the identity information thereof, or, if the image preview device based on iris recognition implementing the solution provided by the embodiment of the present application is the personal terminal of the user to be photographed, the terminal may collect the user information thereof from the inside of the terminal itself, and then may determine the user type of the object to be photographed based on the collected identity information. Wherein, the user local information includes: user attribute parameters such as user age information and gender information.
103. A non-infrared image matching a user type of a subject to be photographed is acquired, the non-infrared image containing a replacement pattern of an iris pattern.
The replacement patterns of the iris patterns in the embodiment of the application comprise patterns capable of indicating the positions of eyeballs of the user, so that the user can conveniently move based on the patterns, and further the iris patterns of the user can be displayed at proper positions of the image preview area.
In this embodiment, since the position of the replacement pattern of the iris pattern in the infrared image in the non-infrared image is determined by the position of the iris pattern in the infrared image, when the photographed object moves, the position of the replacement pattern of the iris pattern in the non-infrared image moves along with the photographed object due to the change of the position of the photographed object in the image capturing area of the infrared lens, so that the photographed object can complete eyeball alignment, and thus, while it is ensured that the infrared iris pattern does not appear in the image preview area, it is also ensured that the user completes the iris registration and recognition process, and the conflicting emotion of the user is reduced.
Referring to the schematic position diagrams of the alternative iris pattern in the non-infrared image shown in fig. 2a and 2b, the alternative iris pattern b1 of the iris pattern a1 in the infrared image a has the same position in the non-infrared image b as the iris pattern a1 in the infrared image a.
The non-infrared image (e.g., a background image or an alternative pattern of an iris pattern hereinafter) in the embodiment of the present application corresponds to at least one user type, for example, the non-infrared image may represent a mapping relationship between an image identifier of the non-infrared image and an identifier of the user type, where the image identifier of the non-infrared image is an image name of the non-infrared image or other identifier that can uniquely represent the non-infrared image.
For example, the alternative patterns of the iris pattern in the embodiments of the present application may be pre-stored non-infrared images (e.g., cartoon patterns or other warm tone patterns) or non-infrared iris patterns captured by a non-infrared lens when the infrared lens captures the infrared image.
Illustratively, the non-infrared image including the iris pattern in the embodiment of the present application includes a background image of the image preview area and a replacement pattern of the iris pattern, where the background image and the replacement pattern are both non-infrared images.
Based on this, as shown in fig. 3, step 103 may be specifically performed according to the following steps:
103a, acquiring a background image of an image preview area matched with the user type of the shot object and a replacing pattern of the iris pattern.
For example, before step 102 is executed, a plurality of background images and replacement patterns that are non-infrared images may be pre-stored in a local database, and correspondingly, image parameters of each background image and replacement pattern are also stored in the database, where the image parameters include an image identifier of the image, an identifier of a user type to which the image belongs (for example, if the image is a cartoon, since the image may be configured for all user types, at this time, the identifier of the user type to which the image belongs is a plurality of identifiers), and basic attribute information (for example, an image size, an image format, and the like) of the image. It should be noted that the local database also stores a corresponding relationship index between the image identifier of each background image and replacement pattern and the identifier of the corresponding user type. Thus, in step 102, the apparatus may directly retrieve an index containing the user type identifier of the object from the database, and determine the background image and the image identifier of the replacement pattern corresponding to the user type identifier of the object based on the index, so as to obtain the corresponding background image and the replacement pattern based on the background image and the image identifier of the replacement pattern.
Based on this, before implementing step 103a, the present embodiment further includes the following steps:
a1, judging whether the background image and the replacement pattern corresponding to the user type of the shot object are stored in the database.
Specifically, after step a1 is executed, if it is determined that the background image and the replacement pattern corresponding to the user type of the object to be photographed have already been stored in the database, the index corresponding to the user type of the object to be photographed is directly retrieved from the database, and the background image and the replacement pattern corresponding to the user type of the object to be photographed are found based on the index; if the background image and the alternative pattern corresponding to the user type of the shot object are not stored in the database, a non-infrared image which is possibly liked by the user type of the shot object can be captured from the network and used as the alternative pattern of the background image and the iris pattern.
Further, if it is determined that the database does not store the background image and the replacement pattern corresponding to the user type of the object, after step 103a is executed, for convenience of subsequent use, the user type of the object and the background image and the replacement pattern matching the user type of the object may be stored in the database in a corresponding manner, and an index of a corresponding relationship between the user type of the object and the background image and the replacement pattern matching the user type of the object may be created.
104. And controlling the non-infrared image to be displayed in the image preview area.
Illustratively, as shown in fig. 3, based on the step 103a, the step 104 specifically includes the following steps:
104a, acquiring the position of the iris pattern in the infrared image as the position to be displayed of the replacement pattern of the iris pattern in the image preview area. For example, the position of the iris pattern in the infrared image may be the coordinates of the center point of the iris pattern in the infrared image; coordinates of at least one edge point (preferably a plurality) of the iris pattern in the infrared image.
104b, displaying the background image in the image preview area, and displaying the replacement pattern on the upper layer of the background image at the position to be displayed.
In the embodiment, when the replacement pattern is controlled to be displayed at the position to be displayed, the replacement pattern can be directly superimposed and displayed on the background image, namely, a technology that one image is suspended and displayed on the other image is adopted; or replacing the part corresponding to the position to be displayed in the background image with the replacement pattern, and displaying the replaced background image, that is, replacing the part corresponding to the position to be displayed in the background image with the replacement pattern, synthesizing the replacement pattern and the background image into a new image, and displaying the new image. Of course, this embodiment may also combine the replacement pattern with the background image to form an image before displaying the background image and the replacement pattern, and then directly display the combined image in the preview area, which is not limited herein.
Further, before step 104b, the method further comprises:
c1, acquiring a first ratio, wherein the first ratio is the ratio of the area of the iris pattern to the area of the infrared image.
And C2, determining the size of the replacement pattern of the iris pattern according to the first ratio, and enabling the ratio of the area of the replacement pattern of the iris pattern to the area of the background image to be the first ratio.
Based on step C2, step 104b may be specifically realized by the following processes: and displaying the replacement pattern of the iris pattern on the upper layer of the background image at the position to be displayed according to the size of the determined replacement pattern of the iris pattern. In this way, the user can see the size of the iris pattern through the screen, so that the user can perceive the distance between the user and the screen of the terminal device to adjust the distance between the terminal device and the shot object.
Illustratively, the background image has a positioning mark, the position of the positioning mark in the background image is the position where the iris recognition program expects the iris to be, and the positioning mark may be a certain specific pattern, for example, a black dot, a pattern with the same shape as the replacement pattern, or the like. From the view point of the user, the replacement pattern of the iris pattern can gradually move to the positioning mark under the eyeball alignment operation of the user, so that the infrared image with clearer iris detail characteristics can be obtained through the eyeball alignment operation, then the iris detail characteristics are extracted from the infrared image and stored to finish registration, or the iris detail characteristics are used for carrying out characteristic comparison to finish the identification process. Further, when the matching is successful as a result of the recognition, the unlocking of the terminal device, the starting of some applications in the terminal device, or the starting of some specific functions (e.g. payment) of some applications in the terminal device may be further controlled.
For example, after the background image is displayed in the image preview area, the alternative pattern of the infrared eye image can be displayed at the position of the indication image by adjusting the distance and the up, down, left and right directions of the user, which is equivalent to aligning the eyes to the correct position in the iris pattern. For example, referring to fig. 4a, the background image of the image preview area is a cartoon image (which is only an example, and the size, shape, and pattern of the image are not limited herein), and the replacement pattern of the infrared eye image is the same as the corresponding image of the two circles, and the user can adjust the distance and position of the user until the replacement pattern of the iris image is displayed in the two circles missing from the cartoon image, or, referring to fig. 4b, the background image of the image preview area is a non-infrared image and two star icons (which is only an example and the size, shape, and pattern of the image are not limited herein) are displayed, and the user can adjust the distance and position of the user until the replacement pattern of the iris image is displayed at the position of the star icon, so as to facilitate eye alignment, further, the alternative pattern of the infrared iris pattern may be configured as the star icon pattern.
Of course, because the iris recognition process has a certain degree of coverage for the distance and the upper, lower, left and right directions, it is possible that the iris authentication is completed before the iris recognition process is completely aligned. The cartoon puzzle mode is mainly used for guiding the eyes of the user to the optimal recognition position.
Of course, there are many different ways of presentation besides the puzzle or alignment described above, which essentially derive the real-time location of the eye by eye capture techniques and guide the user to move the eye location to the location area desired by the iris program.
Optionally, the scheme provided in the embodiment of the present application may further add a background image setting option and a replacement pattern setting option in an image setting interface of the client, and based on this, the scheme further includes the following steps:
d1, opening an image configuration interface including a background image setting option and a replacement pattern setting option.
D2, acquiring a first user instruction, and setting the selected background image as the background image of the image preview area according to the instruction of the first user instruction, wherein the first user instruction is generated when the user clicks the background image setting option; or acquiring a second user instruction, and setting the selected replacement pattern as the replacement pattern of the iris pattern according to the instruction of the second user instruction, wherein the second user instruction is generated when the user clicks the replacement pattern setting option.
Illustratively, after opening an image configuration interface, a user enters a background picture setting option in the image configuration interface, selects a background picture to be configured, selects 'save', saves the selected background picture to a specified directory, and then obtains the background picture for display directly under the directory in the subsequent process of image preview such as iris registration or identification; or, after opening the image configuration interface, the user enters the alternative pattern setting option in the image configuration interface, selects "save" after selecting the alternative pattern to be configured, saves the alternative pattern to the specified directory, and then acquires the alternative pattern as the iris pattern to be displayed in the image preview area in the subsequent process of image preview such as iris registration or iris recognition.
For example, the selected background image may be the background image acquired in step 103 and matching with the user type of the object to be photographed, or the background image selected by the user from the database according to the preference of the user; the selected alternative image may be the alternative image acquired in step 103 and matching with the user type of the object to be photographed, or the alternative image selected by the user from the database according to the preference of the user.
It should be noted that, since there is no requirement for the solution provided by the embodiment of the present application to correspond to light, the solution provided by the embodiment of the present application can be used when the light is sufficient or insufficient.
Therefore, the scheme acquires the real-time position of human eyes through an eyeball capturing technology (through infrared images), then does not display the real-time infrared preview image on an image preview area of a screen, but displays a non-infrared image containing an infrared iris pattern, so that when the infrared image containing the iris pattern is prevented from being watched by a shot object, the eyeball alignment process in the iris registration or recognition process can be completed, the self-photographing image under the infrared light does not need to be faced any more, the conflict emotion of a user is avoided, and the user experience is greatly improved.
The foregoing describes a scheme provided in an embodiment of the present application, mainly in terms of an image preview apparatus based on iris recognition and a terminal to which the apparatus is applied. It is understood that the apparatus comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art would readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, the image preview device based on iris recognition may be divided into function modules according to the above method, for example, each function module may be divided according to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation.
The following describes embodiments of the apparatus provided by embodiments of the present application, which correspond to the embodiments of the method provided above. It should be noted that, for the following explanation of the related contents in the embodiments of the apparatus, reference may be made to the above-mentioned embodiments of the method.
Fig. 5 is a schematic diagram showing a possible configuration of the image preview device based on iris recognition according to the above embodiment, in a case where the function modules are divided for each function, and the image preview device based on iris recognition 3 includes: the device comprises an acquisition module 31, a determination module 32, a control module 33, a storage module 34 and a processing module 35. The acquisition module 31 is used for supporting the image previewing device based on iris recognition to execute steps 101 and 103 in fig. 1, the determination module 32 is used for supporting the image previewing device based on iris recognition to execute step 102 in fig. 1, and the control module 33 is used for supporting the image previewing device based on iris recognition to execute step 104 in fig. 1; the storage module 34 is used for supporting the image previewing device based on iris recognition to realize the process of pre-storing a plurality of background images and alternative patterns in a database and establishing an index containing the user type and the corresponding relationship between the background images and the alternative patterns; further, the obtaining module 31 is specifically configured to support the image previewing apparatus based on iris recognition to perform step 103a in fig. 3, the control module 32 is configured to support the image previewing apparatus based on iris recognition to perform steps 104a and 104b in fig. 3, further, the obtaining module 31 is further configured to support the image previewing apparatus based on iris recognition to implement step C1 in the foregoing, and the determining module 32 is further configured to support the image previewing apparatus based on iris recognition to implement step C2 in the foregoing; further, the obtaining module 31 is further configured to support the image previewing apparatus based on iris recognition to implement the step D2 in the foregoing, and the processing module 35 is configured to support the image previewing apparatus based on iris recognition to implement the steps D1 and D2 in the foregoing. All relevant contents of each step related to the above method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again.
In a hardware implementation, the obtaining module 31, the determining module 32, and the controlling module 33 may be processors. The storage module 34 may be a memory, and all programs corresponding to the actions executed by the image previewing apparatus based on iris recognition may be stored in the memory of the image previewing apparatus based on iris recognition in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
In the case of using an integrated unit, fig. 6 shows a schematic diagram of a possible structure of the image preview device based on iris recognition according to the above-described embodiment. The image preview device 4 based on iris recognition includes: a processor 41, a memory 42, a system bus 43, and a communication interface 44. The memory 42 is configured to store computer executable codes, the processor 41 is connected to the memory 42 through the system bus 43, and when the apparatus is running, the processor 41 is configured to execute the computer executable codes stored in the memory 42 to perform any one of the image preview methods based on iris recognition provided in the embodiments of the present application, for example, the processor 41 is configured to support the image preview apparatus based on iris recognition to perform all the steps in fig. 1 and 3 and/or other processes used in the technology described herein, and the specific image preview method based on iris recognition may refer to the following description and the related processes in the drawings, and is not described herein again.
Embodiments of the present application also provide a storage medium, which may include a memory 42.
The embodiment of the present application further provides a computer program, which can be directly loaded into the memory 42 and contains software codes, and the computer program can be loaded into and executed by a computer to implement the image preview method based on iris recognition.
The processor 41 may be a single processor or may be a collective term for a plurality of processing elements. For example, the processor 41 may be a Central Processing Unit (CPU). The processor 41 may also be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), field-programmable gate arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, etc., which may implement or execute the various illustrative logical blocks, modules, and circuits described in connection with the present disclosure. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The processor 41 may also be a dedicated processor that may include at least one of a baseband processing chip, a radio frequency processing chip, and the like. The processor 41 may also be a combination of computing functions, e.g., comprising one or more microprocessors, a combination of a DSP and a microprocessor, or the like. Further, the dedicated processor may also include chips having other dedicated processing functions of the apparatus.
The steps of the methods described in connection with the present disclosure may be embodied in hardware or may be embodied in software instructions executed by a processor. The software instructions may be comprised of corresponding software modules that may be stored in Random Access Memory (RAM), flash memory, Read Only Memory (ROM), Erasable Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), registers, a hard disk, a removable hard disk, a compact disc read only memory (CD-ROM), or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. Of course, the storage medium may also be integral to the processor. The processor and the storage medium may reside in an ASIC. In addition, the ASIC may reside in a terminal device. Of course, the processor and the storage medium may reside as discrete components in a terminal device.
The system bus 43 may include a data bus, a power bus, a control bus, a signal status bus, and the like. In the present embodiment, the various buses are illustrated in FIG. 6 as system bus 43 for clarity of illustration.
The communication interface 44 may specifically be a transceiver on the device. The transceiver may be a wireless transceiver. For example, the wireless transceiver may be an antenna of the device, or the like. The processor 41 is configured to perform data interaction with other devices through the communication interface 44, for example, if the apparatus is a module or a component in the terminal device, such as data interaction with a display module of the terminal device, and control the display module to display a non-infrared image or an infrared image in an image preview area.
Fig. 7 is a schematic diagram showing a possible configuration of the image preview apparatus based on iris recognition according to the above embodiment, when the image preview apparatus based on iris recognition according to the above embodiment is a terminal device. The device includes: a processor 51, a memory 52, a system bus 53, a communication interface 54, an infrared lens 55, and a display unit 56, wherein the processor 51 is connected to the infrared lens 55 (for example, via the bus) so as to obtain an infrared image captured by the infrared lens 55 for image processing, and meanwhile, the processor 51 is also connected to the display unit 56 for controlling the display unit 56 to display the image.
It should be noted that, the descriptions of the processor 51, the memory 52, the system bus 53, and the communication interface 54 in this embodiment may refer to the descriptions in the corresponding embodiment of fig. 7, and are not repeated here.
The display unit 56 may be used to display information input by the user or information provided to the user and various menus of the terminal. The Display unit 56 may include a Display panel, and optionally, the Display panel may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch screen may cover the display panel, and when the touch screen detects a touch operation thereon or nearby, the touch screen transmits the touch operation to the processor 51 to determine the type of the touch event, and then the processor 51 provides a corresponding visual output on the display panel according to the type of the touch event.
The embodiment of the application also provides a robot, which comprises the image previewing device based on the iris recognition corresponding to the images in the figures 6 and 7.
Those skilled in the art will recognize that in one or more of the examples described above, the functions described herein may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.
Finally, it should be noted that: the above-mentioned embodiments, objects, technical solutions and advantages of the present application are further described in detail, it should be understood that the above-mentioned embodiments are only examples of the present application, and are not intended to limit the scope of the present application, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the present application should be included in the scope of the present application.
Claims (9)
1. An image preview method based on iris recognition is characterized by comprising the following steps:
acquiring an infrared image acquired by an infrared lens;
determining the user type of a shot object according to the iris parameters of the iris pattern under the condition that the infrared image contains the iris pattern;
pre-storing a background image and a replacement pattern in a database, and establishing an index containing the corresponding relation between the user type and the background image and the replacement pattern;
judging whether a background image and a replacement pattern corresponding to the user type of the shot object are stored in a database; specifically, if it is determined that the background image and the replacement pattern corresponding to the user type of the object to be photographed have been stored in the database, an index corresponding to the user type of the object to be photographed is directly retrieved from the database, and the background image and the replacement pattern having a correspondence relationship with the user type of the object to be photographed are found based on the index;
acquiring a non-infrared image matched with the user type of the shot object, wherein the non-infrared image comprises the following steps: acquiring a background image of the image preview area and a replacement pattern of the iris pattern, wherein the background image is matched with the user type of the shot object, and the background image and the replacement pattern are both non-infrared images; the non-infrared image containing a replacement pattern for the iris pattern, the location of the replacement pattern in the non-infrared image being determined by the location of the iris pattern in the infrared image;
opening an image configuration interface, wherein the image configuration interface comprises a background image setting option and a replacement pattern setting option;
acquiring a first user instruction, and setting a selected background image as a background image of the image preview area according to an instruction of the first user instruction, wherein the first user instruction is generated when a user clicks the background image setting option; alternatively, the first and second electrodes may be,
acquiring a second user instruction, and setting a selected replacement pattern as a replacement pattern of the iris pattern according to the instruction of the second user instruction, wherein the second user instruction is generated when a user clicks the replacement pattern setting option;
displaying the non-infrared image within the image preview area, including: acquiring the position of the iris pattern in the infrared image as the position to be displayed of the replacement pattern of the iris pattern in the image preview area;
and displaying the background image in the image preview area, and displaying the replacement pattern on the upper layer of the background image at the position to be displayed.
2. The method of claim 1, wherein after acquiring the non-infrared image matching the user type of the subject, the method further comprises:
and if the database does not store the background image and the replacement pattern corresponding to the user type of the shot object, correspondingly storing the user type of the shot object and the background image and the replacement pattern matched with the user type of the shot object into the database, and establishing an index containing the user type of the shot object and the corresponding relation between the background image and the replacement pattern matched with the user type of the shot object.
3. The method of any of claims 1-2, wherein the replacing pattern of the iris pattern is displayed at the position to be displayed, before being displayed on an upper layer of the background image, the method further comprising:
obtaining a first ratio; the first ratio is the ratio of the area of the iris pattern to the area of the infrared image;
and determining the size of the replacement pattern of the iris pattern according to the first ratio, so that the ratio of the area of the replacement pattern of the iris pattern to the area of the background image is the first ratio.
4. An image preview device based on iris recognition, comprising:
the acquisition module is used for acquiring an infrared image acquired by the infrared lens;
the storage module is used for pre-storing the background image and the replacement pattern in the database and establishing an index containing the corresponding relation between the user type and the background image and the replacement pattern; judging whether a background image and a replacement pattern corresponding to the user type of the shot object are stored in a database; specifically, if it is determined that the background image and the replacement pattern corresponding to the user type of the object to be photographed have been stored in the database, an index corresponding to the user type of the object to be photographed is directly retrieved from the database, and the background image and the replacement pattern having a correspondence relationship with the user type of the object to be photographed are found based on the index;
the determining module is used for determining the user type of the shot object according to the iris parameters of the iris pattern under the condition that the infrared image acquired by the acquiring module contains the iris pattern;
the acquiring module is further configured to acquire a non-infrared image matched with the user type of the photographed object, and includes: acquiring a background image of the image preview area and a replacement pattern of the iris pattern, wherein the background image is matched with the user type of the shot object, and the background image and the replacement pattern are both non-infrared images; the non-infrared image containing a replacement pattern for the iris pattern, the location of the replacement pattern in the non-infrared image being determined by the location of the iris pattern in the infrared image;
the processing module is used for opening an image configuration interface, and the image configuration interface comprises a background image setting option and a replacement pattern setting option;
the acquisition module is further used for acquiring a first user instruction;
the processing module is further configured to set a selected background image as the background image of the image preview area according to the instruction of the first user instruction acquired by the acquisition module, where the first user instruction is generated when the user clicks the background image setting option;
alternatively, the first and second electrodes may be,
the acquisition module is further used for acquiring a second user instruction;
the processing module is further configured to set a selected replacement pattern as a replacement pattern of the iris pattern according to the instruction of the second user instruction acquired by the acquisition module, where the second user instruction is generated when the user clicks the replacement pattern setting option
The control module is used for displaying the non-infrared image acquired by the acquisition module in the image preview area, and comprises: acquiring the position of the iris pattern in the infrared image as the position to be displayed of the replacement pattern of the iris pattern in the preview area;
and displaying the background image in the image preview area, and displaying the replacement pattern on the upper layer of the background image at the position to be displayed.
5. The apparatus of claim 4, wherein:
the storage module is further configured to, if it is determined that the background image and the replacement pattern corresponding to the user type of the object to be photographed are not stored in the database, store the user type of the object to be photographed and the background image and the replacement pattern matching the user type of the object to be photographed into the database in a corresponding manner.
6. The apparatus according to any one of claims 4-5, wherein:
the acquisition module is further used for acquiring a first ratio; the first ratio is the ratio of the area of the iris pattern to the area of the infrared image;
the determining module is further configured to determine the size of the replacement pattern of the iris pattern according to the first ratio acquired by the acquiring module, so that a ratio of an area of the replacement pattern of the iris pattern to an area of the background image is a first ratio.
7. An image preview apparatus based on iris recognition, the apparatus comprising: a memory for storing computer-executable code for controlling the processor to perform the iris recognition based image preview method of any one of claims 1 to 3, and a processor.
8. A computer storage medium storing computer software instructions for an iris recognition-based image preview apparatus, comprising program code configured to perform the iris recognition-based image preview method of any one of claims 1 to 3.
9. A robot comprising the image preview device based on iris recognition according to claim 7.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2016/102723 WO2018072178A1 (en) | 2016-10-20 | 2016-10-20 | Iris recognition-based image preview method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107690648A CN107690648A (en) | 2018-02-13 |
| CN107690648B true CN107690648B (en) | 2022-03-04 |
Family
ID=61152334
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201680006931.XA Active CN107690648B (en) | 2016-10-20 | 2016-10-20 | Image preview method and device based on iris recognition |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107690648B (en) |
| WO (1) | WO2018072178A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111045618A (en) * | 2018-10-15 | 2020-04-21 | 广东美的白色家电技术创新中心有限公司 | Product display method, device and system |
| CN112153272B (en) * | 2019-06-28 | 2022-02-25 | 华为技术有限公司 | Image shooting method and electronic equipment |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1221504A (en) * | 1996-06-06 | 1999-06-30 | 英国电讯有限公司 | Personal identification |
| CN1898679A (en) * | 2003-12-18 | 2007-01-17 | 萨甘安全防护公司 | Method and device for iris recognition |
| CN101557757A (en) * | 2007-01-15 | 2009-10-14 | 德米特瑞·伊夫格涅维奇·安托诺夫 | Iris identification method |
| CN101727665A (en) * | 2008-10-27 | 2010-06-09 | 广州飒特电力红外技术有限公司 | Method and device for fusing infrared images and visible light images |
| CN103024338A (en) * | 2011-04-08 | 2013-04-03 | 数字光学欧洲有限公司 | Display device with image capture and analysis module |
| CN103417196A (en) * | 2013-08-23 | 2013-12-04 | 中山大学 | Venous visualizer and visualizing method |
| CN103777252A (en) * | 2014-02-24 | 2014-05-07 | 黄晓鹏 | Hazardous article detecting device and detection method |
| CN103860147A (en) * | 2014-03-28 | 2014-06-18 | 广州中国科学院先进技术研究所 | Method for manufacturing double-lens multi-spectral imaging lens set and vein display system thereof |
| CN104688184A (en) * | 2014-12-05 | 2015-06-10 | 南京航空航天大学 | Vein imaging method for visible-light skin images |
| CN105956538A (en) * | 2016-04-26 | 2016-09-21 | 乐视控股（北京）有限公司 | Image rendering apparatus and method based on an RGB camera and iris camera |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8031258B2 (en) * | 2006-10-04 | 2011-10-04 | Omnivision Technologies, Inc. | Providing multiple video signals from single sensor |
| CN104796594B (en) * | 2014-01-16 | 2020-01-14 | 中兴通讯股份有限公司 | Method for instantly presenting special effect of preview interface and terminal equipment |
| US20160019420A1 (en) * | 2014-07-15 | 2016-01-21 | Qualcomm Incorporated | Multispectral eye analysis for identity authentication |
| KR102287751B1 (en) * | 2014-09-25 | 2021-08-09 | 삼성전자 주식회사 | Method and apparatus for iris recognition of electronic device |
| KR20160050755A (en) * | 2014-10-31 | 2016-05-11 | 삼성전자주식회사 | Electronic Device and Method for Recognizing Iris by the same |
| CN105611153B (en) * | 2015-12-21 | 2019-09-24 | 联想(北京)有限公司 | Image processing method and electronic equipment |
| CN105676565A (en) * | 2016-03-30 | 2016-06-15 | 武汉虹识技术有限公司 | Iris recognition lens, device and method |
| CN106027900A (en) * | 2016-06-22 | 2016-10-12 | 维沃移动通信有限公司 | Photographing method and mobile terminal |
| CN106022322A (en) * | 2016-07-25 | 2016-10-12 | 武汉虹识技术有限公司 | Iris identification device and locking device |
-
2016
- 2016-10-20 WO PCT/CN2016/102723 patent/WO2018072178A1/en active Application Filing
- 2016-10-20 CN CN201680006931.XA patent/CN107690648B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1221504A (en) * | 1996-06-06 | 1999-06-30 | 英国电讯有限公司 | Personal identification |
| CN1898679A (en) * | 2003-12-18 | 2007-01-17 | 萨甘安全防护公司 | Method and device for iris recognition |
| CN101557757A (en) * | 2007-01-15 | 2009-10-14 | 德米特瑞·伊夫格涅维奇·安托诺夫 | Iris identification method |
| CN101727665A (en) * | 2008-10-27 | 2010-06-09 | 广州飒特电力红外技术有限公司 | Method and device for fusing infrared images and visible light images |
| CN103024338A (en) * | 2011-04-08 | 2013-04-03 | 数字光学欧洲有限公司 | Display device with image capture and analysis module |
| CN103417196A (en) * | 2013-08-23 | 2013-12-04 | 中山大学 | Venous visualizer and visualizing method |
| CN103777252A (en) * | 2014-02-24 | 2014-05-07 | 黄晓鹏 | Hazardous article detecting device and detection method |
| CN103860147A (en) * | 2014-03-28 | 2014-06-18 | 广州中国科学院先进技术研究所 | Method for manufacturing double-lens multi-spectral imaging lens set and vein display system thereof |
| CN104688184A (en) * | 2014-12-05 | 2015-06-10 | 南京航空航天大学 | Vein imaging method for visible-light skin images |
| CN105956538A (en) * | 2016-04-26 | 2016-09-21 | 乐视控股（北京）有限公司 | Image rendering apparatus and method based on an RGB camera and iris camera |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018072178A1 (en) | 2018-04-26 |
| CN107690648A (en) | 2018-02-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6417676B2 (en) | Information processing apparatus, information processing method, eyewear terminal, and authentication system | |
| KR102420100B1 (en) | Electronic apparatus for providing health status information, method for controlling the same, and computer-readable storage medium | |
| US10617301B2 (en) | Information processing device and information processing method | |
| KR102277212B1 (en) | Apparatus and method for iris recognition using display information | |
| US20150186708A1 (en) | Biometric identification system | |
| WO2018153311A1 (en) | Virtual reality scene-based business verification method and device | |
| CN103106401B (en) | Mobile terminal iris recognition device with human-computer interaction mechanism | |
| CN104933344A (en) | Mobile terminal user identity authentication device and method based on multiple biological feature modals | |
| CN111480333B (en) | Light supplementing photographing method, mobile terminal and computer readable storage medium | |
| US11380138B2 (en) | Device and method for touchless palm print acquisition | |
| JP3802892B2 (en) | Iris authentication device | |
| CN204791017U (en) | Mobile terminal users authentication device based on many biological characteristics mode | |
| JP2015090569A (en) | Information processing device and information processing method | |
| KR20120139100A (en) | Apparatus and method for security management using face recognition | |
| CN208013970U (en) | A kind of living creature characteristic recognition system | |
| CN105320941A (en) | Biometric identification apparatus based on fusion of iris and human face and biometric identification method using apparatus | |
| JP2012065719A (en) | View line detection device, view line detection method, view line-detecting computer program and mobile terminal | |
| CN107690648B (en) | Image preview method and device based on iris recognition | |
| JP7226477B2 (en) | Information processing system, information processing method and storage medium | |
| CN107223255B (en) | Image preview method and device based on iris recognition | |
| CN110889356A (en) | Method and device for unlocking AR glasses based on infrared camera and AR glasses | |
| CN104573660A (en) | Method for precisely positioning human eyes by SIFT point descriptor | |
| CN106557738A (en) | A kind of long-distance iris identification device | |
| KR100608307B1 (en) | The method and system for recognition human face | |
| CN210539527U (en) | Nail beautifying device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |