JP2020129175A - Three-dimensional information generation device, biometric authentication device, and three-dimensional image generation device - Google Patents

Abstract

To provide a three-dimensional information generation device, a biometric authentication device, and a three-dimensional image generation device which allow reducing the burden of calculation for acquiring three-dimensional information on the basis of an image captured by an imaging apparatus.SOLUTION: The three-dimensional information generation device, the biometric authentication device, or the three-dimensional image generation device of this invention comprises: a projector 3 which projects a near infrared optical pattern; an imaging apparatus 5 capable of receiving near infrared light; a facial region identification unit 102 which identifies a region of a face by detecting organs of the face on the basis of an image of a capture object captured by the imaging apparatus 5; and a three-dimensional information acquisition unit 60 which generates three-dimensional information about a portion corresponding to the region of the face identified by the facial region identification unit 102, in a near infrared image of the capture object which is captured by the imaging apparatus 5 with the optical pattern projected.SELECTED DRAWING: Figure 11

Description

The present invention relates to a three-dimensional information generation device, a biometric authentication device and a three-dimensional image generation device.

Generally, a biometric authentication device that performs face authentication or iris authentication using near infrared light is known. In such a biometric authentication device, near infrared light is projected onto a face, projected, photographed by a dedicated camera, and image-processed to extract a feature amount, which is compared with a pre-registered individual feature amount. Authenticate by that.

In recent years, biometric authentication such as iris authentication using a camera and face authentication has also been adopted in mobile devices such as smartphones. For the face authentication or the iris authentication, a unique illumination projection device, imaging device, and authentication algorithm are used, and efforts are being made to increase the acceptance rate of others and the rejection rate of others by improving the accuracy of authentication.

Further, as a method of analyzing the shape of an object from an image, for example, a sampling moire method described in Patent Document 1 is known.

JP, 2011-174874, A

Cesar D. Perciante et al., "Wrapping-free phase retrieval with applications to interferometry, 3D-shape profiling, and deflectometry", Applied optics/Vol.54, No.10/1 April 2015.

By the way, in the case where three-dimensional information is acquired for the entire range of an image captured by the imaging device in the state where the infrared light from the projection device is projected, there is a portion where the infrared light from the projection device cannot reach. , There is a case where the calculation for obtaining the three-dimensional information is difficult to converge due to the information from the part where the phase is greatly shifted. The number of calculations may increase.

The present invention has been made in view of the above circumstances, and a three-dimensional information generation device, a biometric authentication device, and a three-dimensional image generation device that can reduce the burden of calculation for obtaining three-dimensional information based on an image captured by an imaging device. The purpose is to provide.

In order to achieve the above object, the three-dimensional information generation device of the present invention comprises:
A projection device that irradiates a near infrared optical pattern,
An imaging device capable of receiving near infrared light,
A face area identification unit that identifies a face area by detecting a facial organ based on an image of an imaging target captured by the imaging device;
In the near-infrared image of the imaging target imaged by the imaging device in the state where the optical pattern is illuminated, three-dimensional information is generated for a portion corresponding to the face area specified by the face area specifying unit. And a three-dimensional information acquisition unit.

According to such a configuration, the face area identifying unit identifies the face area in the image captured by the image capturing device, and the three-dimensional information acquiring unit selects the near-infrared image captured by the image capturing device. Three-dimensional information is generated for a portion corresponding to the face area specified by the face area specifying unit. That is, when the three-dimensional information acquisition unit generates the three-dimensional information based on the near-infrared image captured by the image capturing apparatus, the three-dimensional information acquisition unit only needs to perform calculation on the face area portion, and the portion outside the face area ( For example, it is not necessary to calculate the background part). Therefore, in the calculation for generating the three-dimensional information, it is possible to remove the influence of the part outside the face region, speed up the convergence in the calculation, and stabilize the solution, and the burden of the calculation. Can be reduced.

The image used by the face area identification unit to identify the face area may be a near infrared image or a visible light image (visible image). That is, the imaging device may be capable of receiving visible light or may not be capable of receiving visible light as long as it can receive near-infrared light.

A biometric authentication device of the present invention includes the three-dimensional information generation device and an iris authentication unit,
The face area identification unit identifies the eye position in the detection,
The iris authentication unit acquires the iris information about the eyes in the near-infrared image based on the near-infrared image and the information about the position of the eyes specified by the face area specifying unit. Good.

According to such a configuration, the iris authentication unit, when acquiring the iris information of the eye shown in the near-infrared image, based on the information of the eye position specified by the face area specifying unit, the iris information. To get. Therefore, in the calculation for acquiring the iris information, only the eyes need be calculated, and the processing load for the calculation can be reduced. In particular, in the case where the optical pattern for acquiring the three-dimensional information is also radiated to the part of the human eye as an imaging target, when acquiring the iris information for iris authentication, the optical pattern of the optical pattern Although it is desirable to remove the influence, the calculation range can be narrowed even when the calculation related to the removal is performed, so that the processing load for the calculation can be reduced.

Further, in the above configuration of the present invention, the iris authentication unit may perform the iris authentication by removing the influence of the optical pattern irradiated when the near-infrared image is captured by a spatial filter process.

According to such a configuration, the iris authentication unit performs the iris authentication by removing the influence of the optical pattern irradiated at the time of capturing the near-infrared image by the spatial filtering process, and thus the accuracy of the iris authentication can be improved. it can.

A three-dimensional image generation device of the present invention includes the three-dimensional information generation device or the biometric authentication device,
A three-dimensional image generation unit that generates a three-dimensional image,
A transmission unit for transmitting the three-dimensional image generated by the three-dimensional image generation unit to a communication partner,
The imaging device is capable of receiving visible light,
The three-dimensional image generation unit may generate the three-dimensional image based on the three-dimensional information generated by the three-dimensional information acquisition unit and a visible image captured by the imaging device.

With such a configuration, the three-dimensional image generation unit generates a three-dimensional image based on the three-dimensional information generated by the three-dimensional information acquisition unit. Here, since the three-dimensional information generated by the three-dimensional information acquisition unit is the three-dimensional information about the portion corresponding to the face area, the information of the portion corresponding to the background in the image captured by the imaging device is not included. Not included. Therefore, the 3D image generated by the 3D image generation unit does not include information such as the background imaged by the imaging device. Therefore, information regarding the background and the like is not sent to the communication partner. Further, since the three-dimensional image generation unit generates a three-dimensional image based on the three-dimensional information and the visible image, the three-dimensional image is generated based on the three-dimensional information and coloring is performed based on the visible image. be able to. Therefore, it is possible to generate a three-dimensional image (avatar) that reproduces the face of a person as an imaging target. As described above, according to this configuration, since it is possible to generate an avatar and send only the information of the avatar that does not include the background information to the communication partner, while protecting the privacy of the user of the three-dimensional image generation device, It is possible to enable communication between a user and a communication partner user.

According to the three-dimensional information generation device, the biometric authentication device, or the three-dimensional image generation device of the present invention, it is possible to reduce the burden of calculation for obtaining the three-dimensional information based on the image captured by the imaging device.

It is an exploded perspective view showing a biometrics authentication device concerning a 1st embodiment of the present invention. FIG. 3 is a diagram showing an optical filter of the same. FIG. 3 is a diagram for explaining an array pattern of color filters of the same. FIG. 3 is a block diagram of the biometric authentication device. FIG. 8 is a diagram for explaining a process related to acquisition of phase information in the same. FIG. 8 is a diagram for explaining a process related to acquisition of phase information in the same. FIG. 8 is a diagram for explaining a process related to acquisition of phase information in the same. FIG. 6 is a diagram for explaining the same process performed by the biometric authentication device. FIG. 9 is a diagram for explaining the relationship between the number of iterations and an error in the iterative method when obtaining three-dimensional information from the phase information. It is an exploded perspective view showing a pixel of a photomask concerning a 2nd embodiment of the present invention. It is a block diagram of a biometrics authentication system concerning a 3rd embodiment of the present invention. FIG. 6 is a diagram for explaining a process of identifying a face area and acquiring three-dimensional information in the same. FIG. 11 is a diagram for explaining a process of identifying the positions of eyes and performing iris authentication. It is a block diagram of a three-dimensional image generation device concerning a 4th embodiment of the present invention. FIG. 7 is a diagram for explaining a process of generating a three-dimensional face image.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
As shown in FIG. 1, the biometric authentication device 1 of the present embodiment includes a projection device 3 that irradiates a near-infrared optical pattern, and an imaging device 5 that can receive the near-infrared light. In addition, near infrared means a wavelength band of about 800 to 2500 nm.

The projection device 3 irradiates an object (hereinafter, simply referred to as an object) to be imaged by the imaging device 5 with a predetermined optical pattern. Further, the imaging device 5 captures an object (reflection image of the optical pattern) on which the optical pattern is projected from the projection device 3. Then, the biometric authentication device 1 performs face authentication and iris authentication based on the image captured by the imaging device 5. In the biometrics authentication system 1 of the present embodiment, the projection device 3 irradiates a person's face or eyes with a predetermined optical pattern, and the imaging device 5 photographs the person's face or eyes irradiated with this optical pattern. To do. However, the object to be imaged is not limited to this, and biometric authentication may be performed based on the image of another object to be imaged.

The projection device 3 includes a circuit board 10, a near-infrared LED 11, a beam shaping lens 12, a bracket 13, a photomask 14, a focus actuator (VCM) 15, and a projection lens 16.

The near-infrared LED 11 is a light source that emits near-infrared light, and is mounted on the circuit board 10. The light from the near-infrared LED 11 is shaped by the beam shaping lens 12, passes through the photomask 14, and is emitted from the projection device 3 via the projection lens 16.

As shown in FIG. 2, the photomask 14 has a first transmissive area 14a for generating an optical pattern for face authentication and a second transmissive area 14b for generating an optical pattern for iris authentication. In other words, the photomask 14 has a first transmissive area 14a for generating an optical pattern for acquiring the three-dimensional information of the face and a second transmissive area 14b for generating an optical pattern for acquiring the iris information. Have The photomask 14 is supported by the bracket 13 and positioned with respect to the circuit board 10, the beam shaping lens 12, the projection lens 16 and the like.

The first transmissive region 14a is formed so that light can be applied to the object in a grid pattern. Specifically, in the first transmissive region 14a, a light transmissive portion 20 (illustrated in white in FIG. 2) formed in a slit shape that is long in one direction (longitudinal direction) crosses the one direction. They are formed side by side at equal intervals in the direction (lateral direction). In other words, the light transmission parts 20 are arranged in a grid pattern in the first transmission region 14a. Therefore, the light from the near-infrared LED 11 that has passed through the first transmission region 14a becomes a lattice-shaped optical pattern and travels toward the object.
The first transmissive region 14a does not have to generate a lattice-shaped optical pattern, and needs only to be able to generate an optical pattern that enables acquisition of three-dimensional information of an object. For example, the optical pattern may be a pattern composed of a plurality of dots. Further, in the present embodiment, the optical pattern generated by the first transmissive region 14a is configured to project vertical stripes on the face of a person who is an object, but it is oblique to the object. It may be configured to project stripes or horizontal stripes.

The second transmissive region 14b is formed so that light can be substantially uniformly applied to a predetermined portion of the object. Specifically, the second transmission region 14b is, for example, a region for irradiating the eyes with light. The second transmissive region 14b is formed by disposing the light transmissive portion 20 so as to cross a part of the first transmissive region 14a. In other words, the second transmissive region 14b is formed such that a part of the first transmissive region 14a is opened. Therefore, the light from the near-infrared LED 11 that has passed through the second transmission region 14b travels toward the target object so as to illuminate a predetermined portion of the target object substantially uniformly.
Note that the second transmissive region 14b may be a single cohesive region as shown in FIG. 2, and for example, the second transmissive region 14b shown in FIG. One transparent region 14a) may be formed and divided into two regions. That is, for example, the second transmissive region 14b may be configured by one light transmissive portion 20 that irradiates light to both eyes (see the near-infrared image 70 in FIG. 8), and for each eye. It may be configured by two light transmitting portions that emit light (see the near infrared image 70 in FIG. 5). Further, the second transmission region 14b does not need to be capable of irradiating the predetermined portion of the object with light substantially uniformly. That is, in the present embodiment, the light is formed so as to be able to emit light substantially uniformly in order to easily perform the iris authentication. However, an optical pattern suitable for the iris authentication is provided in accordance with the process related to the iris authentication. It suffices that it is formed so that it can be irradiated with.

In the photomask 14 of the present embodiment, by etching a glass plate, a portion that allows light to pass therethrough (light transmitting portion 20: shown in white in FIG. 2) and a portion that does not pass light (light non-transmitting portion 21: FIG. 2 is shown in black) and thereby a first transmissive region 14a and a second transmissive region 14b are formed. In other words, in the photomask 14, the first transmission region 14a that generates an optical pattern that enables acquisition of three-dimensional information and the second transmission region 14b that generates an optical pattern that enables acquisition of iris information are in the same plane. It is located in.
The material of the photomask 14 is not limited to glass and the manufacturing method is not limited to etching, as long as it can generate the above-mentioned predetermined optical pattern. In addition, the portion that does not allow light to pass does not have to completely block light, and may be any portion that reduces the amount of light that is projected onto the object relative to the portion that allows light to pass.

The light from the near-infrared LED 11 that has passed through the photomask 14 and has a predetermined pattern is emitted from the projection device 3 via the projection lens 16. The projection lens 16 adjusts the focus of the optical pattern projected on the object. The focus actuator 15 is moved from the projection device 3 by moving the projection lens 16 in a direction approaching the photomask 14 (direction moving away from the object) or in a direction moving away from the photomask 14 (direction approaching the object). Adjust the focus of the emitted light.

The image pickup device 5 is capable of receiving visible light and near infrared light and taking an image. Further, the image pickup device 5 is arranged so as to be able to receive an optical pattern emitted from the projection device 3 and reflected by hitting an object, so as to be capable of photographing. As shown in FIG. 1, the image pickup device 5 includes a circuit board 30, an image sensor 31, a bracket 32, an optical filter 33, a focus actuator 34, and an image pickup lens 35.

The image sensor 31 is mounted on the circuit board 30. Light enters the image sensor 31 via the imaging lens 35 and the optical filter 33. Then, the image sensor 31 converts this light into an electric signal.

The imaging lens 35 adjusts the focus of light that enters the imaging device 5 and goes toward the image sensor 31. The focus actuator 34 moves to the imaging device 5 by moving the imaging lens 35 in a direction approaching the image sensor 31 (direction moving away from the object) or in a direction moving away from the image sensor 31 (direction approaching the object). Adjust the focus of incoming light. The optical filter 33 is, for example, a short-pass filter or a band-pass filter, and is a filter that blocks light of a predetermined wavelength that is unnecessary for face recognition and iris recognition. The optical filter 33 is supported by the bracket 32 and positioned with respect to the circuit board 30 and the image sensor 31.

The image sensor 31 is an RGB-IR sensor capable of capturing a near infrared image and a visible image. The image sensor 31 has a color filter 31a shown in FIG. In the image sensor 31, light reaches the light receiving element via the color filter 31a. The color filter 31a has four types of regions of red R, green G, blue B, and infrared IR. Then, these four types of regions are arranged in the arrangement shown in FIG. Specifically, four types of regions are arranged at the same ratio, and each region is arranged at equal intervals.
The arrangement of the four types of regions of the color filter 31a is not limited to that shown in FIG. 3, and color filters of other arrangements may be used. However, it is preferable to include both the region of each color of visible light and the region of IR.

The region of each color of visible light (red R, green G, blue B) of the color filter 31a transmits light in a wavelength band corresponding to each color. In addition, each color region of visible light also transmits light in the infrared wavelength band. The infrared IR region transmits light in the near infrared wavelength band. Therefore, the image sensor 31 can capture a visible image based on visible light and a near infrared image based on near infrared light.

The circuit board 10 of the projection device 3 and the circuit board 30 of the imaging device 5 may be one board. Alternatively, the circuit board 10 and the circuit board 30 may be arranged in the same plane. The object-side surface (front surface) of the projection device 3 and the object-side surface (front surface) of the imaging device 5 may be arranged in the same plane. The projection device 3 and the imaging device 5 may be arranged adjacent to each other with their axes parallel to each other. Further, the projection device 3 and the imaging device 5 may not be separate modules, but may be a single integrated module.

Next, the processing performed by the biometric authentication device 1 will be described. Note that this processing is stored in advance in the image sensor 31, various processors mounted on the circuit board 30 or another board, hardware such as an information storage medium such as ROM and RAM, or ROM. It is realized by software or the like including a predetermined program. Moreover, it is not necessary to perform all the processes in the same circuit, and the circuits that perform each process may be different. Further, one process may be performed by a plurality of circuits.

Further, personal information, which is necessary for biometric authentication and is information for identifying and authenticating an individual, is assumed to be registered in advance. In this embodiment, three-dimensional face information and iris information are registered as personal information. Then, the three-dimensional information of the face acquired by the biometric authentication device 1 is compared with the three-dimensional information of the face registered in advance, and the iris information acquired by the biometric authentication device 1 and the iris registered in advance. Authentication is performed by comparing the information with.
The personal information registered in advance may be stored in an information storage medium in the biometric authentication device 1 or in an information storage medium such as a server connected to the biometric authentication device 1 via a network. May be.

FIG. 4 shows a block diagram of the biometric authentication device 1.
The biometric authentication device 1 includes a RAW image acquisition unit 50, an image separation unit 51, a demosaic processing unit 52, a visible image output unit 53, a three-dimensional information acquisition unit (phase information calculation unit) 60, and a face authentication unit 61. And an iris authentication unit 62.

The RAW image acquisition unit 50 acquires the RAW image (RAW data) captured by the image sensor 31. Next, the image separation unit 51 separates the RGB component (visible light component) and the IR component (infrared component) of the RAW data acquired by the RAW image acquisition unit 50.

Then, in the subsequent stage, a process of generating a visible image (RGB image: image based on visible light) based on the RGB component and/or the IR component output from the image separation unit 51, and the three-dimensional information ( A process of extracting a three-dimensional image) to perform face authentication and a process of extracting iris information (iris image) to perform iris authentication are executed.

First, the process of generating a visible image will be described.
The demosaic processing unit 52 performs demosaic processing based on the RGB components output from the image separation unit 51 to generate a visible image (RGB image). Further, as described above, since each color region of the visible light of the color filter 31a is configured to also transmit light in the infrared wavelength band, it is output from the image separation unit 51 when performing the demosaic process. Based on the IR component of the visible light, a process of removing the IR component mixed through each region of visible light is also performed. Then, the visible image output unit 53 outputs the visible image generated by the demosaic processing unit 52.

Next, a process of extracting three-dimensional information will be described with reference to FIG. This processing is performed by the three-dimensional information acquisition unit 60.
The first transmission region 14 a is assumed to generate a vertical stripe lattice-shaped optical pattern (lattice pattern), and the lattice pattern is projected from the projection device 3. At this time, a near-infrared light obtained by projecting a grid pattern from the projection device 3 onto the face of a person as an object, capturing the image with the image sensor 31, and separating the RGB component and the IR component by the image separating unit 51. The image 70 (image based on near-infrared light) is as shown in FIG. 5 or 8. The near-infrared image 70 obtained by projecting the lattice pattern in this way will be referred to as a lattice image 70. An image of the lattice of the lattice pattern included in the lattice image 70 will be referred to as a lattice image.

Regarding the brightness of the grid image 70 obtained at this time, the brightness profile (brightness information a) in the direction intersecting the grid (striped pattern) of the grid pattern (for example, the line A portion shown in FIG. 5) is expressed by the following formula (1). It is represented by. Here, the brightness information a corresponds to a lattice image.

The three-dimensional information acquisition unit 60 performs the following processing on the obtained lattice image.
First, the differential (difference) of the brightness information a of the image is obtained to obtain local extreme values (maximum and minimum) (local maximum value and local minimum value). Next, the upper envelope b and the lower envelope c of the luminance information a are calculated based on the obtained extreme value. Then, normalization is performed by the difference value between b and c, A(x, y) and B(x, y) in Expression (1) are effectively deleted, and the signal d of only the lattice pattern shown in Expression (2) To get

Next, when the signal d is transformed by multiplying it by cos(ωx) and −sin(ωx) corresponding to the carrier wave of the lattice pattern, the following equations (3) and (4) are obtained.

Since the second term on the right side of both I _c and I _s is an oscillating term, when integrated or averaged for one period, it becomes almost zero at a small change in φ, and the average value of the first term remains. That is, equations (5) and (6) are obtained.

The integration and addition in equations (5) and (6) are for integrating and adding one cycle of ωx, respectively, and the upper line represents the average of one cycle.

That is, when I′(x, y)×cos(ωx) is calculated as in Expression (3), the carrier wave vibrating at ω corresponds to moire fringes (vertical stripes in the lattice pattern) as shown in FIG. The fluctuation of the reference line appears. At this time, if the integration (averaging) is performed in the section e shown in FIG. 6, the carrier wave can be erased and only the moire fringe f can be taken out. The upper and lower envelopes may be detected and the intermediate value may be set to f.

From the results of Expressions (5) and (6), the phase of the lattice pattern resulting from the height of the detected object (object) is obtained as shown in Expression (7). In other words, the phase information corresponding to the height of the face is obtained.

Then, the three-dimensional information acquisition unit 60 generates the phase difference image 76 based on the phase information thus obtained (see FIGS. 7 and 8). Further, the three-dimensional information acquisition unit 60 analyzes the three-dimensional information from the phase information included in the phase difference image 76 by a known method, and generates a three-dimensional image 78 as an image having the three-dimensional information. In other words, the three-dimensional information acquisition unit 60 extracts (generates) three-dimensional information from the IR component of the image captured by the imaging device 5 and outputs it.
As described above, the three-dimensional information is acquired from the lattice image 70 and the three-dimensional image 78 is generated.
The process of extracting the three-dimensional information from the image captured by the image capturing device 5 does not necessarily have to be performed by the above-described calculation, and may be performed by various known methods. For example, the sampling moire method may be used.

The process of generating the three-dimensional image 78 will be described below with reference to FIGS. 7 and 8. That is, the image 71 is obtained by obtaining the signal d from the luminance information a of the lattice image 70. Next, the signal d is multiplied by cos(ωx) and −sin(ωx) respectively to be transformed (see the equations (3) and (4)), and the image 72 and the image 73 are respectively obtained. Next, the image 74 and the image 75 are obtained by taking the average of each of I _c and I _s (see Formula (5) and Formula (6)). Then, the phase difference image 76 is obtained based on the images 74 and 75. Then, a three-dimensional image 78 is obtained based on the phase difference image 76.

When the three-dimensional image 78 is obtained by calculation, for example, the phase difference image 76 is scanned vertically and horizontally from the center, and the point where the change in the phase difference is approximately ±π is regarded as a discontinuous point and the phase is ±π. Is added to perform an operation to obtain a continuous phase (unwrap processing). At this time, even if a singular point (a point at which the phase does not return to the original even if the point goes around and is unwrapped) is ignored.
By performing the iterative calculation using the phase difference information thus obtained as the initial solution of the iterative method (for example, the conjugate gradient method), the problem of a large number of calculations in the iterative method can be alleviated.
Specifically, as in Non-Patent Document 1, partial differential equations in the form of Poisson's equations such as equations (7) to (8) are constructed.

When the partial differential is approximated by the forward (backward) difference, the left side of the equation (8) is expressed by a linear equation as in the equation (11), and becomes m×n linear simultaneous equations.

When this is solved by an iterative method such as the conjugate gradient method, it takes time to converge if 0 is set as an initial value for φ, but if the value is close to a solution to some extent, the calculation time is naturally shortened. In other words, when the phase information is converted into three-dimensional information, the phase connection for eliminating the phase discontinuity is performed at least once and the approximate solution of the three-dimensional information is obtained by the iterative method with the result as the initial solution. Therefore, the number of iterations in the iterative method can be reduced.
FIG. 9 shows the relationship between the number of iterations and the error in one embodiment. The dotted line represents the change in error due to the number of iterations, calculated with the initial value of φ in the above equation set to zero. Generally, the error decreases with the number of iterations as indicated by the dotted line, but in the conventional calculation method, about 430 iterations were required until the target error (1E-6) was reached. On the other hand, according to the above method, the number of iterations until the initial solution reaches the point A and the target error (1E-6) is achieved is reduced to substantially 180 times as indicated by the solid line.
Further, in the case of a gradual change in time in a moving image, it is possible to accelerate convergence by using the information of the immediately preceding frame as an initial solution in the next frame.

The face authentication unit 61 performs face authentication based on the three-dimensional information acquired by the three-dimensional information acquisition unit 60. Specifically, the face authentication unit 61 extracts the feature amount from the 3D image 78 generated by the 3D information acquisition unit 60. Then, the extracted feature amount is compared with the feature amount of the three-dimensional information of the face registered in advance as the personal information, and the object photographed by the imaging device 5 is specified by the registered personal information. It is determined whether or not it matches the individual If they match, the authentication succeeds, and if they do not match, the authentication fails. In other words, the face authentication unit 61 compares the three-dimensional information obtained from the near-infrared image captured by the imaging device 5 with the three-dimensional information of the face registered in advance to perform the face authentication.
A well-known technique may be used as a method of determining whether the person is a registered person based on the three-dimensional information.

Further, the face authentication unit 61 may perform face authentication using not only the three-dimensional information but also the information of the visible image 80. In this case, for example, the face authentication unit 61 discriminates the arrangement of face parts (eyes, nose, mouth, etc.) from the visible image 80 output from the visible image output unit 53, and preregisters this as personal information. It is determined whether or not the target object imaged by the imaging device 5 matches the individual specified by the registered personal information, by comparing the information of the disposition of the face parts that has been registered.
When three-dimensional information and visible image information are used for face authentication, when it is determined that the object and the individual specified by the personal information do not match in the determination based on any of the information, face authentication fails. Become. In other words, face authentication is successful when both the three-dimensional information and the visible image information match the registered personal information.

Next, a process of extracting iris information will be described.
The second transmissive area 14b generates an optical pattern (iris authentication pattern) that irradiates a predetermined portion of the object with light substantially uniformly, and the iris authentication pattern is projected from the projection device 3. To do. At this time, a substantially uniform light emitted from the near-infrared LED 11 and transmitted through the second transmission region 14b is radiated to the eyes of the person as the predetermined portion. The near-infrared image 70 obtained by projecting the iris authentication pattern from the projecting device 3, capturing the image with the image sensor 31, and separating the RGB component and the IR component by the image separating unit 51 is shown in FIG. It looks like the one shown in. The near-infrared image 70 obtained by projecting the iris authentication pattern in this manner will be referred to as an iris authentication image 70.
In the photomask 14 of the present embodiment, since the first transmissive region 14a and the second transmissive region 14b are arranged in the same plane, the grid pattern and the iris authentication pattern are simultaneously irradiated, and the grid The image and the iris authentication image are acquired at the same time. That is, the lattice image and the iris authentication image are the same image. Then, based on this image, face authentication and iris authentication are performed. However, the image for face recognition and the image for iris recognition may be acquired separately. Further, when the face authentication image and the iris authentication image are acquired separately, the iris authentication image may be an image in which only the iris portion of the object is captured.

Further, the biometric authentication device 1 may include a projection location instruction unit (not shown) that indicates a portion on which the iris authentication pattern is projected. For example, when the biometric authentication device 1 is built in a mobile terminal, the projection location instruction unit projects the iris authentication pattern on the image captured by the in-camera or the imaging device 5 and displayed on the screen of the mobile terminal. It is also possible to superimpose and display a frame indicating a portion to be displayed. In this case, the user can make the iris authentication pattern hit the eyes by adjusting his/her eyes to be displayed in the frame, and can correctly perform the iris authentication. Further, the biometric authentication device 1 may include a detection unit (not shown) that detects the position of the eyes. For example, the detection unit determines whether the eye is located at the position where the iris authentication pattern is projected, and when the eye is located at the position where the iris authentication pattern is projected, the iris authentication is performed from the projection device 3. The image capturing device 5 may capture an image of the eye on which the usage pattern is projected.

The iris authentication unit 62 performs iris authentication based on iris information obtained from the iris authentication image 70 and iris information registered in advance as personal information. In the iris authentication, for example, phase information is extracted by performing FFT (Fast Fourier Transform) on an image (iris image) obtained by cutting out a portion in which the iris of an object is reflected from the iris authentication image 70, and extracting the POC. By the (phase-only correlation method), the iris image included in the iris authentication image 70 is correlated with the registered iris image, and the iris authentication is performed based on this correlation information.
The iris authentication method is not limited to the above-mentioned method, and may be appropriately selected from various known authentication methods. Alternatively, the iris image obtained by cutting out the portion of the iris authentication image 70 showing the iris of the object may be coded, and the iris image may be authenticated by collating it with a code registered in advance as personal information.

In each of the face authentication and the iris authentication, the personal information to be compared may be one piece or plural pieces of personal information. For example, when the biometric authentication device 1 of the present embodiment is built in a mobile terminal and is used for a purpose of determining whether or not the owner of the mobile terminal and unlocking the mobile terminal, the personal information is stored in the mobile terminal. The information of one owner who has been taken, and compares this information with the features extracted from the image taken by the imaging device 5 to see if the taken object corresponds to the owner of this mobile terminal. You may judge whether or not. Further, for example, when the biometrics authentication system 1 of the present embodiment is installed near a door of a building and is used for the purpose of unlocking the door by determining whether or not the person is related to the building, The information is the information of a plurality of persons related to the building stored in the server, and the information of each of the plurality of persons is compared with the characteristics extracted from the image captured by the image capturing device 5, and the information is captured. It may be determined whether the object corresponds to any of the plurality of persons or does not correspond to anyone.

According to the biometric authentication device 1 of the present embodiment, the projection device 3 that irradiates the near infrared optical pattern and the imaging device 5 that can receive the near infrared light are provided. It is possible to simultaneously irradiate an optical pattern for acquiring three-dimensional information and an optical pattern for acquiring iris information. Then, the imaging device 5 captures an image of the object illuminated by the optical pattern from the projection device 3. Therefore, the three-dimensional information of the face and the information of the iris can be acquired from the image captured by the imaging device 5. Therefore, both face authentication and iris authentication can be performed.

The projection device 3 also includes a near-infrared LED 11 as a light source that emits near-infrared light, and a first transmissive region that generates an optical pattern for acquiring three-dimensional face information from the light from the near-infrared LED 11. And a projection lens 16 and a photomask 14 in which a second transmission region for generating an optical pattern for acquiring iris information from the light of the near-infrared LED 11 is arranged in the same plane. Therefore, it is possible to generate an optical pattern for acquiring the three-dimensional information of the face and an optical pattern for acquiring the information of the iris with one photomask 14 and to irradiate these two optical patterns at the same time.

Further, in a state where the lattice-shaped optical pattern at equal intervals is irradiated, the local maximum value and the local minimum value of the substantially sinusoidal lattice image photographed by the image pickup device 5 are calculated to make the amplitude of the sine wave constant. After that, the sine wave and the cosine wave of substantially the same cycle are multiplied, and each one cycle is integrated, then the division is performed and the arctangent operation is performed to calculate the phase information corresponding to the face height. Since the phase information calculation unit (three-dimensional information acquisition unit) 60 is provided, the phase information can be calculated by a simple process.

In addition, a face authentication unit 61 that performs face authentication based on the information obtained from the visible image 80 and the three-dimensional information obtained from the near infrared image 70 is provided, and the imaging device 5 serves as the image sensor 31 and the visible image 80. Since the image sensor 31 has the RGB-IR sensor capable of capturing the near-infrared image 70 and the near-infrared image 70, the single image sensor 31 can capture the visible image 80 and the near-infrared image 70. Then, face recognition can be performed based on the visible image 80 and the near-infrared image 70 captured by the image sensor 31. Therefore, for example, face authentication can be performed more accurately than in the case of performing face authentication based on only the three-dimensional information obtained from the near infrared image 70.

(Second embodiment)
The biometric authentication device 1 according to the present embodiment is different from the biometric authentication device 1 according to the first embodiment mainly in the configuration of the photomask. Therefore, this point will be described below, and the biometric authentication device 1 according to the first embodiment will be described. Descriptions of similar configurations will be omitted or simplified.

The photomask 14 of the biometric authentication device 1 according to the present embodiment is configured by arranging a plurality of pixels 92 (unit blocks) shown in FIG. 10 vertically and horizontally. Each pixel 92 of the photomask 14 is formed by sandwiching a liquid crystal display element 93 between two polarizing plates 94. Light transmission/non-transmission of each pixel 92 is switched by ON/OFF of a voltage applied to the liquid crystal display element 93 of each pixel 92. For example, a voltage is applied to a pixel for which light is desired to be blocked and a voltage is not applied to a pixel for which light is allowed to pass, whereby the arrangement of the light transmitting section 20 corresponding to the optical pattern desired to be generated is realized. In other words, the photomask 14 can change the optical pattern according to the applied signal.

With such a configuration, it is possible to switch the pattern of the photomask 14. Therefore, in the first embodiment, the projection device 3 irradiates the optical pattern for acquiring the three-dimensional information of the face and the optical pattern for acquiring the information of the iris at the same time. In the second embodiment, these optical patterns can be sequentially irradiated. That is, for example, a predetermined signal is applied to the photomask 14 so that an optical pattern for acquiring the three-dimensional information of the face can be generated, and then another signal is applied to the photomask 14 to obtain the iris information. It is possible to sequentially irradiate two optical patterns by setting a state in which an optical pattern for acquiring is generated.

In this case, in the state where the optical pattern for acquiring the three-dimensional information of the face is irradiated, the face authentication is performed based on the image captured by the imaging device 5, and the optical pattern for acquiring the iris information is irradiated. In this state, the iris authentication may be performed based on the image taken by the image pickup device 5.

Further, in the photomask 14 of the present embodiment, as in the photomask 14 of the first embodiment, signals are transmitted so that the first transmission region 14a and the second transmission region 14b are arranged in the same plane. It may be applied. In such a case, for example, the shape of the first transmissive region 14a or the position of the second transmissive region 14b may be changed according to the shape or state of the object. For example, the position of the second transmissive region 14b may be changed according to the position of human eyes. Specifically, the biometric authentication device 1 includes a detection unit (not shown) that detects the eye position, and a signal applied to the photomask 14 in accordance with the eye position detected by the detection unit. May be changed to adjust the position of the second transmissive region 14b so that light suitable for iris authentication is projected on the eyes.
Note that such a detection unit that detects the position of the eyes can be realized by applying a conventionally known object recognition technique.

In the biometric authentication device 1 according to the present embodiment, the projection device 3 includes the photomask 14 whose optical pattern can be changed by the applied signal. Therefore, by changing the signal applied to the photomask 14, the optical pattern is changed. Can be changed. Therefore, the optical pattern can be changed according to the type of authentication, the state of the object to be photographed, and the like.

The biometric authentication device of the present invention may be used not only for user authentication in a mobile device such as a smartphone, but also for user authentication by being installed in a car, or installed in a building and used for authentication of persons involved. May be. In addition to the above, the present invention can be applied to any device or apparatus that requires biometric authentication and can be used for any application that requires biometric authentication.

(Third Embodiment)
The main difference between the biometric authentication device of the present embodiment and the biometric authentication device of the first or second embodiment is the processing mainly performed by the biometric authentication device. Therefore, this point will be described below, and The description of the same configuration as that of the second embodiment will be omitted or simplified.

The photomask 14 of the biometric authentication device 1 of the present embodiment does not have the second transmissive area 14b, and substantially the entire surface thereof is the first transmissive area 14a. That is, in the photomask 14 of the first embodiment shown in FIG. 2, the first transmissive region 14a is not shaped like an opening, and the light transmissive portions 20 are arranged in a grid pattern over substantially the entire surface. It is arranged. Then, the light from the near-infrared LED 11 becomes a lattice-shaped (vertical stripe) optical pattern, and the optical pattern is projected onto the entire face (including the eyes) of a person as an object.
In the biometrics authentication system 1 of the present embodiment as well, a photomask having a second transmissive region 14b like the photomask of the first embodiment may be used as the photomask 14, and the second embodiment may be used. A photomask whose optical pattern can be changed by an applied signal, such as a photomask of a form, may be used.

As shown in FIG. 11, the biometric authentication device 1 of the present embodiment includes a face area specifying unit 102. The face area specifying unit 102 specifies a face area based on the visible image 80 output from the visible image output unit 53, and generates a mask image 150 indicating the face area (see FIG. 12).

The face area identification unit 102 detects a facial organ (landmark) from the visible image 80 by machine learning. Here, the facial organs are, for example, the eyes, the nose, the mouth, and the like that make up the human face. The face area specifying unit 102 may detect all of eyes, nose, and mouth, but may detect any one of them. In order to acquire the iris information of the eyes, it is preferable that at least the eyes are included in the organs detected by the face area specifying unit 102.

As shown in FIG. 12, a plurality of points 152 on the visible image 80, which indicate respective facial organs, are obtained as information by the face detection by the face area identifying unit 102. Next, the face area specifying unit 102 extracts the contour of the face using the outermost points among the plurality of points 152 indicating the eyes, the nose, and the mouth. Specifically, the face area specifying unit 102 surrounds the plurality of points 152 by a line passing slightly outside the outermost points among the plurality of points indicating the eyes, the nose, and the mouth, respectively. The face area 153 is specified. That is, the face area specifying unit 102 determines the face area 153 so as to surround the eyes, nose, and mouth. In other words, the face area specifying unit 102 sets the range including the eyes, nose, and mouth as the face area 153. In this way, the face area identifying unit 102 identifies the face area 153 based on the information on the detected facial organs.
Among the plurality of points 152 indicating the facial organs, the plurality of points 152a indicating the eyes include a point indicating the outer corner of the eye, a point indicating the inner corner of the eye, and one or more points on the upper edge of the eye. , And one or more points at the lower edge of the eye.

Next, the face area specifying unit 102 generates the mask image 150 based on the information on the extracted face area 153. Specifically, the mask image is generated as a binary image in which the specified face area 153 (area including eyes, nose, and mouth) is “1” and the outside of the face area 153 is “0”. ..

Note that various known techniques can be applied to the detection of the facial organs and the identification of the face area by the face area identification unit 102. For example, as a machine learning algorithm for detecting a face organ and specifying a face region, open software Dlib or the like may be used. The face area specifying unit 102 does not necessarily need to specify the face area 153 based on the detection results of the eyes, nose, and mouth. For example, by using a known technique, even if the nose or mouth is covered with a mask, the face area can be specified. Therefore, using such a technology, the face area can be specified. May be. The face area specifying unit 102 may specify the face area based on the near-infrared image 70 instead of the visible image 80, and based on both the visible image 80 and the near-infrared image 70. The face area may be specified.

The three-dimensional information acquisition unit 60 in the biometric authentication device 1 of the present embodiment extracts the three-dimensional information from the IR component of the image captured by the imaging device 5, as in the biometric authentication device 1 of the first embodiment. (Generate) and output. In the generation of this three-dimensional information, the processing load is reduced by using the mask image 150.

Specifically, the three-dimensional information acquisition unit 60 performs the above-described calculation for extracting the three-dimensional information from the near-infrared image 70 (grid image 70) (for example, as described above, a numerical value is obtained by the conjugate gradient method). When obtaining a solution, etc.), calculation is performed only for the portion of the near-infrared image 70 that corresponds to the portion that is "1" in the mask image 150, and the portion that is "0" in the mask image 150. Do not calculate the part corresponding to. By doing so, in the calculation for extracting the three-dimensional information, the influence of the portion other than the face such as the background is removed. Therefore, for example, when a numerical solution is obtained by the conjugate gradient method, the convergence is fast and the solution is stable.

Next, acquisition of iris information using the detection result of the face organs by the face area specifying unit 102 will be described.
The face area identification unit 102 outputs coordinate information on the visible image 80 of a point 152a corresponding to an eye among the plurality of points 152 indicating each facial organ. As shown in FIG. 13, the iris authentication unit (iris information acquisition unit) 62 specifies the eye position on the near infrared image 70 as the iris authentication image based on the coordinate information, and the near infrared image is obtained. An image of the eye area (eye area image 156) is extracted from 70. In other words, the eye area is specified by using the plurality of points 152a indicating the eyes, and the image 156 of the eye area is extracted. At this time, the eye area can be made as small as possible by specifying the eye area by a line that passes through the outer points of the plurality of points 152a indicating the eye, and the processing load related to iris authentication can be reduced. Things can be done. Then, by detecting a circle from the extracted eye region image 156 by Hough transform or the like, an image of an iris or a pupil can be obtained (a circle 154a indicating the outer shape of the iris and a circle 154b indicating the outer shape of the pupil. Is shown in FIG. 13.).

In the iris authentication, the extracted eye area image 156 (iris image) is mapped from polar coordinates to orthogonal coordinates and compared with an iris image (original image 157) that is registered in advance as personal information, or the iris code is used. It is known to convert to and authenticate. However, when an optical pattern for obtaining three-dimensional information is projected on the eye part, there is a possibility that direct comparison or binarization may be hindered due to the influence of the optical pattern. Therefore, in the biometric authentication device 1 of the present embodiment, the iris authentication unit 62 performs pre-processing to remove stripes due to the optical pattern from the extracted eye area image 156, and then performs coordinate conversion (removing vertical stripes). The vertical stripe removed image 158 is generated, and then the vertical stripe removed image 158 is subjected to coordinate conversion). The pre-processing here may be, for example, filter processing using Fourier transform, brightness uniformization processing using the periodicity of stripes, or other processing. That is, the iris authentication unit 62 may perform the iris authentication by removing the influence of the optical pattern irradiated when the near infrared image 70 is captured by the spatial filter process.

Regarding the correlation of luminance between the eye area image 156 and the original image 157, a graph 160 showing the correlation when the pre-processing is not performed is shown in the upper right of FIG. 13, and the graph showing the correlation when the pre-processing is performed. 161 is shown in the lower right of FIG. As shown in FIG. 13, when the pre-processing for removing the influence of the optical pattern is not performed, the correlation coefficient R ² =0.0032 for the luminance between the eye area image 156 and the original image 157, whereas When pre-processing is performed, R ² =0.9158, which shows that a high correlation is obtained. By performing the preprocessing in this way, it is possible to increase the correlation of the luminance between the eye area image 156 and the original image 157, and improve the accuracy of iris authentication. That is, the accuracy of the acquired iris information is increased by performing pre-processing on the eyes imaged by the imaging device 5 before acquiring the information about the iris such as the brightness, and the iris information acquired in this way is The accuracy of iris authentication can be improved by comparing with iris information registered in advance as personal information.

Note that the developed image 159 shown in FIG. 13 is an image obtained by developing the eye area image 156, the original image 157, and the vertical stripe removal image 158. In the biometric authentication device 1 of the present embodiment, each image is thus displayed. Although the processing related to the expansion and the authentication is performed, the method of expanding and authenticating the image in the iris authentication is a well-known technique, and thus the description thereof is omitted here. Further, the authentication may be performed without expanding the image.

The biometric authentication device 1 (three-dimensional information generation device) of the present embodiment includes a projection device 3 that irradiates a near-infrared optical pattern, an imaging device 5 that can receive near-infrared light, and an imaging device 5. A face area specifying unit 102 that detects a facial organ based on the image of the imaged target and specifies a face area, and a near-infrared image of the imaged object that is imaged by the imaging device 5 in a state where the optical pattern is irradiated. Of these, a three-dimensional information acquisition unit 60 that generates three-dimensional information about a portion corresponding to the face area identified by the face area identification unit 102. Therefore, the face area identifying unit 102 identifies the face area in the image captured by the image capturing apparatus 5, and the three-dimensional information acquiring unit 60 identifies the face area in the near infrared image captured by the image capturing apparatus 5. Three-dimensional information is generated for the portion corresponding to the face area specified by the specifying unit 102. That is, when the three-dimensional information acquisition unit 60 generates three-dimensional information based on the near-infrared image picked up by the image pickup device 5, the three-dimensional information acquisition unit 60 only needs to perform calculation on the face area portion, and the three-dimensional information outside the face area. It is not necessary to perform calculation for a part (eg background part). Therefore, in the calculation for generating the three-dimensional information, it is possible to remove the influence of the part outside the face region, speed up the convergence in the calculation, and stabilize the solution, and the burden of the calculation. Can be reduced.

Further, in the biometrics authentication system 1 of the present embodiment, the face area identification unit 102 identifies the eye position in the detection of the facial organs, and the iris authentication unit 62 uses the near-infrared image and the face area identification unit 102. The iris information about the eyes in the near-infrared image is acquired based on the specified eye position information. Therefore, the iris authenticating unit 62 acquires the iris information based on the eye position information specified by the face area specifying unit 102 when acquiring the iris information about the eyes in the near-infrared image. Therefore, in the calculation for acquiring the information of the iris, it is necessary to perform the calculation only for the eye portion, and the processing load for the calculation can be reduced. In particular, in the case where the optical pattern for acquiring the three-dimensional information is also radiated to the part of the human eye as an imaging target, when acquiring the iris information for iris authentication, the optical pattern of the optical pattern Although it is desirable to remove the influence, the calculation range can be narrowed even when the calculation related to the removal is performed, so that the processing load for the calculation can be reduced.

In addition, the iris authentication unit 62 removes the influence of the optical pattern irradiated at the time of capturing the near-infrared image by the spatial filter processing, and authenticates the iris. Therefore, the accuracy of iris authentication can be improved.

The image sensor 31 is a sensor including infrared pixels, and the number of pixels is preferably 8 megapixels or more. Since the number of pixels is 8 megapixels or more, iris authentication can be performed with high accuracy. Further, even if the number of pixels is 8 megapixels or more, the eye area image 156 is cut out from the image captured by the imaging device 5 to perform the iris authentication, so that the processing load related to the iris authentication can be reduced and the processing can be performed at high speed. it can.

(Fourth Embodiment)
Next, a case where the configuration for acquiring three-dimensional information in the biometric authentication device according to the third embodiment is applied to a device that generates a three-dimensional face image will be described.

In addition to the configuration of the biometric authentication device 1 according to the third embodiment, the three-dimensional image generation device 120 is generated by the three-dimensional image generation unit 122 and the three-dimensional image generation unit 122 as shown in FIG. And a transmission unit 124 that transmits a three-dimensional image (three-dimensional face image) to a communication partner. As shown in FIG. 15, the three-dimensional image generation unit 122 generates the three-dimensional information (three-dimensional image 78) extracted by the three-dimensional information acquisition unit 60 and the visible image 80 output from the visible image output unit 53. Based on this, the three-dimensional face image 170 is generated.
The three-dimensional image generation device 120 may not include the face authentication unit 61 or the iris authentication unit 62 and may not perform face authentication or iris authentication.

The three-dimensional image generation unit 122 generates a three-dimensional face image 170 based on the three-dimensional image 78 based on the depth information as the three-dimensional information output from the three-dimensional information acquisition unit 60 and the visible image 80. .. Depth information (phase information) is obtained from the near-infrared image 70 to form a three-dimensional image 78, and color information of the visible image 80 (red R, green G of the color filter 31a in the image sensor 31, A three-dimensional face image 170 is obtained by using the information obtained based on the light that has passed through the blue B area.
Here, the generation of the three-dimensional image 78 based on the depth information may be performed by the three-dimensional information acquisition unit 60 or the three-dimensional image generation unit 122. For example, when the three-dimensional image 78 is constructed from the depth information, the three-dimensional face image 170 may be colored by performing coloring or the like using the color information of the visible image 80 at the same time.

The three-dimensional face image 170 generated by the three-dimensional image generation unit 122 is transmitted to the communication partner as avatar information. Here, the communication partner is a device connected to the three-dimensional image generation apparatus 120 via a network. For example, the three-dimensional image generation device 120 is incorporated in a computer such as a personal computer or a smartphone (mobile terminal), or is externally attached, and the transmission unit 124 is a three-dimensional image generation unit in a computer as a communication partner. The three-dimensional face image 170 generated at 122 is transmitted.

The other party's computer that has acquired the three-dimensional face image 170 causes the display to display the three-dimensional face image 170 as a so-called avatar. That is, according to the three-dimensional image generation apparatus 120 of the present embodiment, the three-dimensional face image 170 as an avatar, which is generated based on the captured face of the person, is transmitted to the communication partner, and the user of the communication partner Can communicate with. The 3D image generating apparatus 120 as described above can be used for various purposes such as video chat (video call), social networking service, and game.

The 3D image generation apparatus 120 of the present embodiment includes a 3D image generation unit 122 that generates a 3D image, a transmission unit 124 that transmits the 3D image generated by the 3D image generation unit 122 to a communication partner, The imaging device 5 is capable of receiving visible light, and the three-dimensional image generation unit 122 converts the three-dimensional information generated by the three-dimensional information acquisition unit 60 into a visible image imaged by the imaging device 5. Based on this, a three-dimensional image is generated.

In the three-dimensional image generation device 120 of this embodiment, the mask image 150 is used in generating three-dimensional information. Therefore, the three-dimensional information generated by the three-dimensional information acquisition unit 60 is only the three-dimensional information of the face area portion, and does not include the information such as the background portion of the image captured by the imaging device 5. Therefore, the three-dimensional face image 170 generated by the three-dimensional image generation unit 122 does not include information such as the background imaged by the imaging device 5. Therefore, the user of the three-dimensional image generation apparatus 120 can communicate with the other party without the other party knowing the information regarding the background of the imaging environment of the user.

1 Biometrics authentication device 3 Projection device 5 Imaging device 11 Near infrared LED (light source)
14 Photomask 31 Image sensor 60 3D information acquisition unit 61 Face authentication unit 62 Iris authentication unit 102 Face area identification unit 120 3D image generation device 122 3D image generation unit 124 Transmission unit

Claims (4)

A projection device that irradiates a near infrared optical pattern,
An imaging device capable of receiving near infrared light,
A face area identification unit that identifies a face area by detecting a facial organ based on an image of an imaging target captured by the imaging device;
In the near-infrared image of the imaging target imaged by the imaging device in the state where the optical pattern is illuminated, three-dimensional information is generated for a portion corresponding to the face area specified by the face area specifying unit. A three-dimensional information acquisition device, comprising: a three-dimensional information acquisition unit. The three-dimensional information generation device according to claim 1, and an iris authentication unit,
The face area identification unit identifies the eye position in the detection,
The iris authenticating unit may acquire iris information about an eye shown in the near-infrared image based on the near-infrared image and information on the position of the eye identified by the face area identifying unit. Characteristic biometric authentication device. The biometric authentication device according to claim 2, wherein the iris authentication unit performs an iris authentication by removing the influence of the optical pattern irradiated when the near-infrared image is captured by a spatial filter process. A three-dimensional information generation device according to claim 1 or a biometrics authentication device according to claim 2 or 3,
A three-dimensional image generation unit that generates a three-dimensional image,
A transmission unit for transmitting the three-dimensional image generated by the three-dimensional image generation unit to a communication partner,
The imaging device is capable of receiving visible light,
The three-dimensional image generation unit generates the three-dimensional image based on the three-dimensional information generated by the three-dimensional information acquisition unit and a visible image captured by the imaging device. Dimensional image generation device.