CN217935747U - Filter array, image sensor, camera module and identification equipment - Google Patents

Abstract

The utility model provides a filter array, image sensor, camera module and identification equipment relates to biological identification technical field. The filter array includes: an infrared light pixel unit and a visible light pixel unit; the infrared pixel unit is used for transmitting infrared light, and the visible pixel unit is used for transmitting visible light; the infrared pixel units and the visible light pixel units are mutually spaced to form a rectangular array, each infrared pixel unit is adjacent to at least one visible light pixel unit, and each visible light pixel unit is adjacent to at least one infrared pixel unit. The filtering array can simultaneously pass through infrared light and visible light, so that a single camera module can simultaneously acquire an infrared light image and a visible light image.

Description

Filter array, image sensor, camera module and identification equipment

Technical Field

The disclosure relates to the technical field of biological identification, in particular to a filter array, an image sensor, a camera module and identification equipment.

Background

In order to improve the reliability and the safety of identity recognition, various identity recognition technologies are tried to be added in the prior art, and the fusion collection of the palm print and the palm vein can be realized in a short time under the same gesture of a user, so that the method becomes a good multi-mode identity recognition combination.

Acquiring palmprint and palmar vein bimodal information, wherein a double-camera scheme is usually adopted, one lens adopts a monochromatic visible light (or RGB) camera to acquire palmprint information, and the other lens adopts an Infrared (IR) camera to acquire palmar vein information; or a single visible light camera is matched with a movable infrared filter to acquire the palm print information and the palm vein information at different time intervals.

But above-mentioned scheme all has the structure complicacy, and the assembly degree of difficulty is great, is unfavorable for problems such as miniaturization and miniaturized design.

Disclosure of Invention

The utility model provides a filter array, image sensor, camera module and identification equipment can solve there is the structure complicacy in current palm line and palm vein bimodal information acquisition scheme, and the assembly degree of difficulty is great, is unfavorable for the problem of miniaturation and miniaturized design.

The technical scheme is as follows:

in one aspect, a filter array is provided, the filter array comprising: an infrared light pixel unit and a visible light pixel unit;

the infrared light pixel unit is used for transmitting infrared light, and the visible light pixel unit is used for transmitting visible light;

the infrared pixel units and the visible light pixel units are mutually spaced to form a rectangular array, each infrared pixel unit is adjacent to at least one visible light pixel unit, and each visible light pixel unit is adjacent to at least one infrared pixel unit.

In another aspect, an image sensor is provided, which includes the filter array of the present disclosure, and a photosensitive element; the filter array is positioned on the light inlet side of the photosensitive element.

On the other hand, a camera module is provided, camera module includes: the image sensor of the present disclosure, and a lens assembly; the lens assembly is located on the light inlet side of the image sensor.

In another aspect, an identification device is provided, which includes the camera module of the present disclosure, a housing and a control assembly;

the camera module is positioned at the top of the shell; the camera module is used for collecting palm print information and palm vein information;

the control assembly is located inside the shell and electrically connected with the camera module, and the control assembly is used for controlling the camera module.

The beneficial effect that technical scheme that this disclosure provided brought includes at least:

the filtering array can allow infrared light to penetrate through the infrared light pixel unit on the filtering array, allow visible light to penetrate through the visible light pixel unit, enable the filtering array to simultaneously pass through infrared light and visible light, enable a single camera module with the filtering array to simultaneously acquire infrared light images and visible light images under the condition that an optical filter does not need to be switched, can simplify the structure of a palm print and palm vein bimodal information acquisition scheme, reduce the assembly difficulty and the production cost, and is favorable for the miniaturization and miniaturization development of identification equipment.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is apparent that the drawings in the description below are only some embodiments of the present disclosure, and it is obvious for those skilled in the art that other drawings may be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a filter array provided in an embodiment of the present disclosure;

fig. 2 is a schematic structural diagram of a filter array according to another embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of a filter array according to another embodiment of the present disclosure;

fig. 4 is a schematic structural diagram of an image sensor provided in an embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of a camera module according to an embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of an identification device provided in an embodiment of the present disclosure.

The reference numerals in the figures are denoted respectively by:

100. a filter array; 200. an image sensor; 300. a camera module;

1. an infrared light pixel unit;

2. a visible light pixel unit;

21. a red sub-pixel unit; 22. a green sub-pixel unit; 23. a blue sub-pixel unit;

3. a photosensitive element;

4. a lens assembly;

5. a demosaicing unit;

6. a housing.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

In the description of the present disclosure, it is to be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," "circumferential," and the like are used in the orientations and positional relationships indicated in the drawings for convenience in describing the present application and for simplicity in description, and are not intended to indicate or imply that the referenced devices or elements must have a particular orientation, be constructed and operated in a particular orientation, and are therefore not to be considered limiting of the present disclosure.

In the related art, two cameras are needed to collect palm print and palm vein information, so that a large space is needed for placing a camera module, in order to realize identity authentication after multi-mode fusion, image information collected by the two cameras needs to be subjected to palm feature extraction, palms of two pictures are subjected to image alignment in a certain geometrical relationship, and identity recognition work can be initiated only after the palms are confirmed to be the same palm.

In order to reduce the problems caused by the later multi-image registration, many schemes attempt to acquire the visible light palm print picture and the infrared light palm vein picture in a time-sharing manner through one lens. In the conventional viewing mode, a motor is adopted to drive an infrared filter module to move, so that the switching between visible light image acquisition and infrared light image acquisition is realized.

In the former scheme, the number of required camera modules is large, and a large amount of image processing is required; the mechanical structure in the latter solution leads to increased difficulty in assembling the device and has adverse effects on structural reliability, service life, and reaction switching speed.

To this, this disclosure provides a filter array, can pass through infrared light and visible light simultaneously for the collection of infrared light image and visible light image is realized simultaneously to the single camera module who is equipped with this filter array, can simplify the structure, reduces the assembly degree of difficulty and manufacturing cost, is favorable to the miniaturization and the miniaturized development of discernment equipment.

To make the objects, technical solutions and advantages of the present disclosure more apparent, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

Fig. 1 is a schematic structural diagram of a filter array 100 provided in an embodiment of the present disclosure, and only a 3 × 3 array is taken as an example in the drawing, but the filter array 100 of the present disclosure is not limited to the illustrated shape and size. Fig. 2 is a schematic structural diagram of a filter array 100 according to another embodiment of the present disclosure.

In one aspect, as shown in fig. 1 and fig. 2, the present embodiment provides a filter array 100, where the filter array 100 includes: an infrared pixel unit 1 and a visible light pixel unit 2; the infrared pixel unit 1 is used for transmitting infrared light, and the visible pixel unit 2 is used for transmitting visible light.

The infrared light pixel units 1 and the visible light pixel units 2 are spaced from each other to form a rectangular array, each infrared light pixel unit 1 is adjacent to at least one visible light pixel unit 2, and each visible light pixel unit 2 is adjacent to at least one infrared light pixel unit 1.

The filtering array 100 of the embodiment can allow infrared light to pass through the infrared light pixel unit 1 thereon, and allow visible light to pass through the visible light pixel unit 2, so that the filtering array 100 can simultaneously pass through infrared light and visible light, and thus, a single camera module 300 equipped with the filtering array 100 can simultaneously acquire infrared light images and visible light images without switching optical filters, thereby simplifying the structure of a palm print and palm vein dual-mode information acquisition scheme, reducing the assembly difficulty and the production cost, and facilitating the miniaturization and miniaturization development of identification equipment.

In this embodiment, a filter array 100 including a plurality of infrared pixel units 1 and a plurality of visible light pixel units 2 is provided, so that the filter array 100 is arranged in a matrix shape at intervals between the infrared pixel units 1 and the visible light pixel units 2, where the infrared pixel units 1 only allow infrared light to pass through, the visible light pixel units 2 only allow visible light to pass through, and the other side of the filter array 100 can form a plurality of infrared primitives and a plurality of visible light primitives which are arranged in a matrix shape at intervals and periodically, where the plurality of infrared primitives form a pair of infrared mosaic images together, and the plurality of visible light primitives form a pair of visible mosaic images together, thereby implementing a function of simultaneously generating two images.

The infrared light mosaic image and the visible light mosaic image can be reconstructed using a demosaicing algorithm (or a demosaicing algorithm) in the related art. Demosaicing (also written de-mosaicing, demosaicing, or debayoring) is a digital image processing algorithm that can reconstruct a full-Color image from incomplete Color samples output from photosensitive elements 3 covered with a Color Filter Array (CFA). The demosaicing algorithm is also called Color filter array interpolation (CFA interpolation) or Color reconstruction (Color reconstruction).

For example, a simple interpolation method is used to perform a direct operation using the adjacent homochromatic pixel values. Also for example, the value of the difference pixel is calculated by averaging two or four adjacent pixels using bilinear interpolation.

The demosaicing algorithm description is only an example, and does not mean that one or more of the filter arrays 100 of the present embodiment must be used, and the filter array 100 of the present embodiment may use any algorithm disclosed in the prior art to generate the infrared light image and the visible light image.

In other possible implementation manners, the infrared light image is a palm vein image, and the visible light image is a palm print image, so that the filtering array 100 of the embodiment can be used to simultaneously acquire palm vein information and palm print information, and a single camera is endowed with a function of performing dual-mode information acquisition.

The palm vein information is one of vein information, and the palm vein is a vein system in the palm of the human body. When the palm vein is used for identity authentication, the image characteristics of the palm vein are acquired, and the characteristics exist only when the palm is living. In this system, the palm of the non-living body is not provided with the vein image features and thus cannot be identified, and thus cannot be counterfeited.

The palm print information refers to various kinds of line information from the end of a finger to the surface of the palm of the wrist, and many characteristics can be used for identity recognition: such as lines, wrinkles, fine texture, ridge endings, bifurcation points, etc. The form of the palmprint is controlled by the genetic gene, and even if the epidermis is peeled off for some reason, the new palmprint line still maintains the original structure. Each person has different palmprint lines, and even if the person is a twin, their palmprints are similar but not identical. The identity of a person can be determined by using the line features, point features, texture features and geometric features of the palm prints.

The dual-mode identity recognition by using the palm vein information and the palm print information has the advantages of simple recognition operation, high safety and the like.

In a specific Application, the demosaicing operation may be performed by the image sensor 200, or may be calculated by another Signal Processing device externally connected to the image sensor 200, such as a Central Processing Unit (CPU), another general-purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA), or another Programmable logic device, a discrete Gate or transistor logic device, a discrete hardware component, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

As shown in conjunction with fig. 1 and 2, in some embodiments, at least one infrared pixel cell 1 is adjacent to four visible pixel cells 2, respectively; at least one visible light pixel cell 2 is adjacent to four infrared light pixel cells 1, respectively.

Therefore, in this embodiment, the visible light value of the infrared light pixel unit 1 can be calculated by using the values of the four adjacent visible light pixel units 2, and the visible light value of the visible light pixel unit 2 can be calculated by using the values of the four adjacent infrared light pixel units 1, which is beneficial to improving the accuracy of each pixel point, improving the definition of the obtained infrared light image and the visible light image, improving the accuracy of palm vein information and palm print information, and improving the accuracy and the identification efficiency of identity identification.

In some possible implementations, each infrared light pixel cell 1 except the boundary region is adjacent to four visible light pixel cells 2, respectively; each visible light pixel cell 2 except for the boundary region is adjacent to four infrared light pixel cells 1, respectively. Thereby ensuring that better infrared and visible light transmission can be achieved within the entire light transmission range of the filter array 100.

As shown in fig. 2, in some embodiments, the infrared light pixel unit 1 and the visible light pixel unit 2 are rectangular and equal in size. Therefore, the same light receiving area of the infrared pixel unit 1 and the visible light pixel unit 2 is ensured, and the accuracy of the demosaicing operation is facilitated.

Fig. 3 is a schematic structural diagram of a filter array 100 according to another embodiment of the present disclosure.

As shown in fig. 3, in some embodiments, the visible light pixel unit 2 includes at least one of a red sub-pixel unit 21, a green sub-pixel unit 22, and a blue sub-pixel unit 23. The visible light pixel unit 2 is used for generating a visible light image through visible light, the image is used for performing palm print information comparison, the palm print information comparison is usually performed by a machine, so the visible light pixel unit 2 can be a monochrome pixel, that is, a monochrome image is generated for performing the palm print information comparison.

For another example, the visible light pixel unit 2 is a single red sub-pixel unit 21, or the visible light pixel unit 2 is a single green sub-pixel unit 22, or the visible light pixel unit 2 is a single blue sub-pixel unit 23, or the visible light unit is a combination of the red sub-pixel unit 21 and the green sub-pixel unit 22, and so on. The visible light pixel unit 2 of the present embodiment can be theoretically formed by any combination of the red sub-pixel unit 21, the green sub-pixel unit 22, and the blue sub-pixel unit 23.

In some embodiments, as shown in fig. 3, the visible light pixel unit 2 includes one red sub-pixel unit 21, two green sub-pixel units 22 and one blue sub-pixel unit 23, and the one red sub-pixel unit 21, two green sub-pixel units 22 and one blue sub-pixel unit 23 form an RGGB array.

In this embodiment, in order to improve the definition and the imaging effect of the visible light pixel unit 2, the RGGB array includes one red sub-pixel unit 21, two green sub-pixel units 22, and one blue sub-pixel unit 23. An RGGB array, also known as a Bayer filter, is arranged such that 50% of the filter array 100 is green, 25% is red, and the other 25% is blue, and is therefore also referred to as RGBG, GRGB, or RGGB. The filter array 100 is widely applied to a single-chip digital image sensor 200 used in digital cameras, video recorders, scanners and the like, and an imaging algorithm is mature.

Each sub-pixel unit only filters and records one of three colors of RGB (red, green and blue), and the information obtained from the single sub-pixel unit cannot completely express the composition values of the red, green and blue colors. In order to obtain a full-color image, different demosaicing algorithms can be used to interpolate the red, green and blue component values of each pixel. These algorithms use surrounding pixels of the same color to estimate the component value of a particular pixel.

In some embodiments, the infrared light pixel cell 1 allows passage of infrared light in the wavelength range of 750nm to 14um; the visible light pixel unit 2 allows the wavelength range of the transmitted visible light to be 880nm to 380nm.

As shown in fig. 2, in some embodiments, the visible light pixel unit 2 is a white pixel unit, which can transmit visible light of any color.

According to the filtering array 100 disclosed by the invention, the infrared pixel units 1 at pixel level are added on the basis of the original monochromatic light filtering array 100 and are arranged in a focusing manner, so that the original RGGB pixels are changed into an IR-W-W-IR arrangement mode, the W white pixel units are responsible for collecting visible light, and the IR infrared pixel units 1 are responsible for collecting infrared light. Since four visible light pixel units 2 surround each infrared light pixel unit 1, the gray scale information of the visible light of the infrared light pixel unit 1 can be accurately derived through the reading of the visible light intensity of the four visible light pixel units 2.

Similarly, when an infrared image is shot, the gray information of the infrared light corresponding to the visible light pixel unit 2 is well estimated through the four infrared light pixel units 1 surrounding the visible light pixel unit 2, so that accurate infrared image information is constructed. The light efficiency of the sensor for infrared rays is also at the maximum receiving efficiency due to the maximized increase of the proportion of the infrared light pixel unit 1 pixels in the pixel arrangement.

On the other hand, as shown in fig. 4, the present embodiment provides an image sensor 200, the image sensor 200 includes the filter array 100 of the present disclosure, and the photosensitive element 3; the filter array 100 is located on the light-incoming side of the photosensitive element 3.

Alternatively, the photosensitive element 3 includes an Image Signal Processor (ISP) chip for implementing Image processing.

The image sensor 200 of the present embodiment, using the filter array 100 of the present disclosure, can simultaneously realize the acquisition of an infrared light image and a visible light image, that is, can be used for collecting multi-bimodal information of a palm vein and a palm print.

As shown in connection with fig. 4, in some embodiments, the image sensor 200 further comprises a demosaicing unit 5; the demosaicing unit 5 is configured to determine the visible light value of the infrared light pixel unit 1 region and the infrared light value of the visible light pixel unit 2 region by using a demosaicing algorithm.

The image sensor 200 of the present embodiment receives the infrared light transmitted by the infrared pixel unit 1 in the filter array 100, and uses the demosaicing unit 5 to obtain an infrared light image, receives the visible light transmitted by the visible light pixel unit 2, and uses the demosaicing unit 5 to obtain a visible light image, so that the camera module 300 using the image sensor 200 can realize two image acquisitions by one-time shooting, and further makes multi-bimodal identification of the palm veins and the palm prints possible.

On the other hand, as shown in fig. 5, the present embodiment provides a camera module 300, where the camera module 300 includes: the image sensor 200 of the present disclosure, and the lens assembly 4; the lens assembly 4 is located on the light entrance side of the image sensor 200.

The camera module 300 of this embodiment, using the image sensor 200 of this disclosure, can realize the collection of infrared light image and visible light image simultaneously, can be used for palm vein and palm print many bimodal information collection promptly.

On the other hand, as shown in fig. 6, the present embodiment provides an identification device, which includes the camera module 300 of the present disclosure, as well as the housing 6 and the control component; the camera module 300 is positioned at the top of the shell 6; the camera module 300 is used for collecting palm print information and palm vein information; the control assembly is located inside the shell 6 and electrically connected with the camera module 300, and the control assembly is used for controlling the camera module 300.

The identification device of this embodiment, using the camera module 300 of the present disclosure, the camera module 300 can simultaneously realize multi-bimodal information acquisition of the palm vein image and the palm print image, and the identification device performs bimodal identity identification quickly, accurately and safely by using the palm vein information and the palm print information.

The identification equipment only needs one camera module 300, has a simple structure and is beneficial to the miniaturization and miniaturization development of the identification equipment; single camera module 300 once shoots and acquires two kinds of information, and information acquisition is efficient, is favorable to improving identification efficiency, improves the product experience of identification equipment.

Optionally, the control component may have a plurality of candidate identity information stored therein. Illustratively, the control component is a Central Processing Unit (CPU) that can implement image Processing.

Through the electric connection of control assembly and camera module 300, control assembly can acquire the identity information that camera module 300 sent, and through the contrast of identity information and candidate identity information, control assembly can judge the target identity that this identity information corresponds.

For example, the identification device provided in the embodiment of the present application may be used in at least one of a payment scenario and an identity authentication scenario.

For example, the recognition device scans palm print information and palm vein information to realize contactless mobile payment, so that the payment efficiency can be improved; for another example, the identification device scans the palm print information and the palm vein information to realize the non-contact identity authentication and improve the accuracy of the identity authentication.

After the identification equipment acquires the identity information, image processing can be carried out on the identity information so as to realize identity authentication.

Optionally, the identification device is internally provided with an image processor, and the control component can acquire the processing of the image processor on the identity information through the electrical connection between the image processor and the control component, so as to realize the authentication and judgment of the identity information.

In an alternative implementation scenario, the image processor may also be located on an external device of the recognition device. The image processor is illustratively located on an external computer, and a communication link is provided between the identification device and the external computer through which the identity information can be sent to the image processor. At this time, the external interface has a data transmission function, and the identification device can be connected with an external computer by using the external interface so as to transmit identity information.

It is noted that, as used herein, references to "a plurality" or "at least one" mean one or more, and references to "a plurality" or "at least two" mean two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

In the description of the present specification, reference to the description of the terms "certain embodiments," "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples" means that a particular feature, structure, material, or characteristic described in connection with the embodiments or examples is included in at least one embodiment or example of the present disclosure.

The above description is intended only to illustrate the present disclosure, and not to limit the present disclosure, and any modification, equivalent replacement, or improvement made within the spirit and principle of the present disclosure should be included in the scope of the present disclosure.

Claims (10)

1. A filter array, characterized in that the filter array (100) comprises: an infrared light pixel unit (1) and a visible light pixel unit (2);

the infrared light pixel unit (1) is used for transmitting infrared light, and the visible light pixel unit (2) is used for transmitting visible light;

the infrared light pixel units (1) and the visible light pixel units (2) are mutually spaced to form a rectangular array, each infrared light pixel unit (1) is adjacent to at least one visible light pixel unit (2), and each visible light pixel unit (2) is adjacent to at least one infrared light pixel unit (1).

2. The filter array according to claim 1, wherein at least one of the infrared light pixel cells (1) is adjacent to four of the visible light pixel cells (2), respectively; at least one visible light pixel unit (2) is adjacent to four infrared light pixel units (1) respectively.

3. Filter array according to claim 1, wherein the infrared light pixel cells (1) and the visible light pixel cells (2) are rectangular and equal in size.

4. A filter array according to claim 1, wherein the visible light pixel cells (2) are white pixel cells.

5. A filter array according to claim 1, wherein the visible light pixel element (2) comprises at least one of a red sub-pixel element (21), a green sub-pixel element (22), a blue sub-pixel element (23).

6. A filter array according to claim 5, wherein the visible light pixel cell (2) comprises one red sub-pixel cell (21), two green sub-pixel cells (22) and one blue sub-pixel cell (23), and one red sub-pixel cell (21), two green sub-pixel cells (22) and one blue sub-pixel cell (23) form an RGGB array.

7. An image sensor, characterized in that the image sensor (200) comprises a filter array (100) according to any one of claims 1-6, and a light-sensitive element (3); the filter array (100) is positioned on the light inlet side of the photosensitive element (3).

8. An image sensor as claimed in claim 7, characterized in that the image sensor (200) further comprises a demosaicing unit (5); the demosaicing unit (5) is used for determining the visible light value of the infrared light pixel unit (1) area and the infrared light value of the visible light pixel unit (2) area by using a demosaicing algorithm.

9. The camera module is characterized in that the camera module (300) comprises: the image sensor (200) of claim 7 or 8, and the lens assembly (4); the lens assembly (4) is positioned on the light inlet side of the image sensor (200).

10. An identification device, characterized in that it comprises a camera module (300) according to claim 9, and a housing (6) and a control assembly;

the camera module (300) is positioned at the top of the shell (6); the camera module (300) is used for collecting palm print information and palm vein information;

the control assembly is located inside the shell (6), the control assembly is electrically connected with the camera module (300), and the control assembly is used for controlling the camera module (300).

Images