IT202100026369A1 - SYSTEM FOR SAFE ACQUISITION OF PHOTOGRAPHS OF HUMAN FACES - Google Patents

Description

TITLE

?System for secure acquisition of photographs of human faces?

DESCRIPTION

Field of application of the invention

The present invention refers to a system for the secure acquisition of photographs of human faces.

State of the art

In order to be able to issue an identity document, license or a particular permit, it is required by the authorities. competent authorities, an official photo of the applicant's face. This photo must be able to offer guarantees of acceptance, i.e. it must comply with very precise and detailed international specifications as per international regulation ICAO 09303.

Due to a particular criminal phenomenon called ?MORPHING?, briefly described below, institutional bodies such as Embassies, Registries, Motor Vehicle Authorities, Police Headquarters and generally authorized bodies tend to no longer accept the notes ?passport photo? already? printed documents that the applicant generally delivers when requesting a document.

The need? therefore being able to equip each document issuing office with a specific technology that allows the "live" photo to be acquired. of the applicant and which provides all guarantees of acceptance and compatibility? to current regulations.

The difficulty? to acquire a photo that complies with the regulations? linked to many technical/practical aspects. We summarize the technical-qualitative characteristics that a photo must have in accordance with the ICAO standard for documents:

? The face must cover 70-80% of the photo from the base of the chin to the forehead;

? quality? of the image (resolution);

? uniform lighting;

? absence of shadows on the face;

? surface of the photographed face;

? facial position;

? color photos;

? neutral expression and closed mouth;

? eyes open and clearly visible;

? white background and with uniform light;

absence of flash reflections on the face and elimination of the "red eye" effect;

? focus adequate for the required sharpness;

? direct gaze towards IDBOX;

? size: 35-40 mm;

? print on high quality paper? and high definition;

? face well centered and not in profile;

? photo without other objects or people in the background.

The ?MORPHING?, ? one of the first digital effects developed by the film industry and consists of fluid, gradual and seamless transformation? between two images of different shapes, which can be objects and above all, for the field of application of the present invention, faces.

The fraudulent ?Face Morphing attack? is implemented using ?morphed? images, obtained from the combination of faces belonging to different identities. This attack requires that at the time of identity verification, the image saved within the document corresponds to the one acquired live (live) more closely. of a single subject, making s? that not only the owner, but also others can identify with the same document (even up to 8 different identities). The idea behind the attack? therefore that a subject, who is presumed to be wanted by the authorities? or to which the authorities? don't give the chance? to leave the country of origin, you find a person with a face similar to him.

The document issued? perfectly legal but fraudulent. In technical/operational language, this type of counterfeit document takes the acronym of ?F.O.D.? Fraudulently Obtained Documents or ?F.O.G.? Fraudulently obtained genuine document. The fraudulent action does not consist in altering the content of the document, but the attempt to deceive the official in charge at the moment of issuing the document by providing a morphed photo already? printed, with an action equivalent to that which is normally carried out when requesting a document (Passport, Identity Card, Driving License, Visa/Residence Permit, etc.).

The document issued superer? what? all the integrity checks? carried out at the control gates.

? it has been demonstrated that:

1 ? possible to create a realistic image with morphing;

2 The transformed image? capable of deceiving the controller;

3 Cutting-edge facial recognition algorithms can be fooled.

Are known, at the current state of the art, a variety? of systems and methods of photographic acquisition of a person's face, necessary for obtaining any identity document. One of the most popular methods? known? through the paid services of a professional photographer, who makes his subjective skills available, in order to acquire the best photo of the requesting subject. The photographer must comply with the ICAO regulations described above, but as there is no live monitoring system during the procedure implemented in the photographic studio, no? an obligation on the part of the final recipient of the photo to verify the resulting photo with appropriate software that it corresponds to ICAO regulations? complies with what is required by law only by visual deduction by the photographer or end user.

This relationship between customer and service provider? essentially based on mutual trust. While ? I notice that the photo of a face? a very relevant personal biometric data, which is placed on any identity document? anywhere in the world, and which today allows automatic transit at borders (e-gates) or with manual verification by an operator, access to banking, insurance and identity services. digital, etc., or in general what can? be used by the police forces for the identification of the subject for civil and criminalistic purposes. If this data is not supported by certified data and consolidated procedures at national and European level, I will leave? certainly room for fraudulent behavior by bad intentions (e.g. morphing).

Various systems, including automatic ones, are also known for acquiring the image of a face, think of the well-known photo booths scattered across the territory. But even in this case, the procedures for verifying the photo's compliance with current legislation are not explicitly applied.

Ultimately, also consider the ease? for anyone, to be able to generate the passport photo necessary for issuing an identity document on their own, through the most common and accessible technological systems on the market: PCs, Smartphones, Tablets, now equipped with high-performance cameras and software capable of simulating the capabilities by a professional photographer. This last mode? ? certainly the most? suitable, also through the enormous amount of accompanying editing applications, for the manipulation of photographic data, in order to camouflage one's identity in a studied way.

Summary of the invention

Therefore the purpose of the present invention is? that of proposing a system for the safe acquisition of photographs of human faces aimed at overcoming all the aforementioned drawbacks.

The system for the safe acquisition of photographs of human faces which is the object of the invention has the objective of eliminating the component of human error or manipulation, transferring and requirements entirely on technology.

The system object of the invention generates a high quality digital image of a human face, compliant with the following international directives and guidelines:

? Annex - Commission Implementing Decision C(2018) 7774 of 30 November 2018 ? Annex 3 - Commission Implementing Decision C(2018) 7767 of 30 November 2018 ? ICAO Technical Report Portrait Quality (reference facial images for MRTD) v.1 ? ICAO 93037th Edition

? ISO 19794-5:2011 - Frontal Image Type;

? Commission Implementing Decision (EU) 2019/329 of 25 February 2019.?. The system ? ergonomic and easy to use, ? able to adapt to public administration offices, minimizing impacts on logistics and the surface, it presents a stable, robust solution and preferably with an anchoring system for maximum safety.

? the object of the present invention is a system for the secure acquisition of photographs of human faces comprising:

- two or more? digital cameras, designed to acquire the image of a face, said cameras being of the color type, equipped with a specific angular aperture and a sensitivity? such as to obtain a minimum number of pixels in the interocular distance of the face;

- a lighting system including LED illuminators;

- an aid system for the correct positioning of the face comprising light indicators positioned around said two or more? digital cameras and at least one speaker; - an electronic control circuit, power supply and HUB of said system;

- one or more? first rigid column supports integrating said digital cameras, and capable of maintaining said two or more cameras in vertical reciprocal position at a given mutual distance;

- one or more? second rigid column supports for said lighting system, said second rigid column supports being connected in front of said one or more first rigid column supports, rotatable between a position suitable for hiding said cameras and a position suitable for placing said illuminators laterally to said cameras;

- at least one support and containment support for said system, capable of supporting said system in a vertical position;

- said electronic circuit comprising the following software means, suitable for operating in succession:

- means for selecting the camera between said two or more? digital cameras, more? suitable for acquiring a photo of the person's face, determining a selected camera that presents the best centering of the face with respect to it;

- means for activating said aid system for the correct positioning of the face in front of said selected camera, providing visual indications by activating said light indicators and sound indications through said at least one speaker suitable for obtaining the movement of the face until it is centered in front of said camera selected and at the correct distance from said selected camera;

- means for measuring brightness? of the environment in which he is positioned said face, and to activate said lighting system in order to maximize uniformity? of illumination of said face;

- means for taking a photograph of said face when said means for activating said aid system provide an indication of the face being centered.

? particular object of the present invention is a system for the secure acquisition of photographs of human faces, as better described in the claims, which form an integral part of the present description.

Brief description of the figures

Further purposes and advantages of the present invention will be clear from the following detailed description of an example of implementation of the same (and its variants), and with reference to the attached drawings given purely for explanatory and non-limiting purposes, in which:

in figures 1.1 to 4 examples of implementation of the system object of the invention are represented;

figures 5 and 6 represent possible provisions of the system towards people subject to facial photography;

in figure 7? a possible embodiment of the system to assist the correct positioning of the face around a camera is represented;

in figure 8? a possible arrangement of the system on a desk is represented.

The same reference numbers and letters in the figures identify the same elements or components.

Detailed description of implementation examples

In the following, some examples of implementation of the system for the secure acquisition of photographs of human faces which are the object of the invention will be described, which are given by way of example only, but many variations of it are possible.

With particular reference to figures 1.1? 4, the collaborative photographic acquisition system for photographing a subject's face for purposes of enrollment, basically includes:

? two or more? digital cameras 1, which acquire the image of the face;

? a 2 LED lighting system;

? an aid system for the correct positioning of the face 3;

? an electronic control circuit, power supply and HUB;

? rigid column supports 5 and 6 for digital cameras 1 and lighting system 2 respectively;

? a support and containment support 4.

The various components are described below.

Two implementation solutions are preferably shown:

A first solution includes two digital cameras 1 in the column (Figures 1.1, 2.1), preferably for desk application, and a second solution includes three or four digital cameras 1 in the column (Figures 1.2, 3, 4), preferably for floor application. Are the cameras integrated on one or more? rigid column elements 5, while the LED lighting system 2 includes pairs of emitters positioned at the ends? of further rigid column elements 6. The cameras are in a reciprocal vertical position, so as to facilitate the use of the system in front of people of different heights who can therefore advantageously occupy the same position.

Preferably the rigid column elements 5 and 6 are connected to each other centrally so that the rigid element 6, which supports the LED lighting system 2, can rotate in front of the rigid element 5, which supports the cameras 1, between two positions, an opening position at an angle less than 90? (Figures 3, 4), which highlights cameras 1, and the other front one (Figure 2.1) which hides cameras 1. The opening position has an angle such as to position the illuminators laterally to the cameras in order to obtain a correct parallax and avoid negative frontal illumination of the face.

? is it possible to connect more? pairs of rigid elements 5 and 6 in columns, for example two (Figures 1.2, 3, 4), so that photographs of the faces of people of different heights can be correctly taken.

Two types of support 4 of the system are preferably provided: one (4?) for fixing to a desk (Figures 1.1, 2.1, 8), another (4??) with a stand for resting on the ground (Figures 1.2, 2.2, 3 , 4).

With reference to figure 7, the system to assist the correct positioning of the face 3 includes luminous visual indicators positioned around each camera 1, preferably eight in number.

? also preferably there is at least one loudspeaker 8 integrated into a rigid column element 5. In a variant it could be integrated into a rigid column element 6. The luminous visual indicators and the loudspeaker are suitable to guide the subject in real time to assume the correct inclination of the face and eyes, for an optimal photographic shot.

The LED lighting system 2 allows you to improve photo acquisition by illuminating the face of the person standing in front of the system.

The electronic control, power and HUB circuit? integrated into the system, for example in rigid element 5, and includes software that allows the management:

? of light (LED lighting system);

? cameras;

? of the aid system for the correct positioning of the face;

? of the ICAO verification of the photo.

The system ? modular; therefore, ? a single object that can? assume different configurations.

As mentioned above, ? It is possible to vertically join two systems by stacking and electrical connection in order to obtain a device with three or more? cameras for capturing a photo of a person's face in an upright position. The philosophy behind the operation? that of having a column/totem of cameras to cover the required shooting ranges and angles. The subject places himself in front of the system; the arrows on the correct face positioning aid system 3 will light up red or green in relation to the correct positioning of the face, with the aim of guiding the subject to assume the correct position of the face. The arrows will turn green when the criteria required by the ICAO standard for document photography are met, and therefore the subject will be able to place your face in a fixed position. So, can you? be taken the photograph that could? be automatically transferred to a storage system, for example held by the authority. In conjunction with the visual indications, a vocal synthesizer, included in the electronic circuit, will reproduce? the same indications via speaker 8, in different languages, also as an aid to blind subjects, and for greater understanding by the subject of the visual signals emitted.

Figure 4 highlights three views of the system in the variant with a floor stand and with two pairs of stacked rigid column elements 5 and 6.

Figures 5 and 6 show two practical applications of using the system in front of people of whom ? It is necessary to acquire the photo of the face, respectively in an upright position with the variant of the system with floor stand, and in a sitting position with the variant of the desk system.

In order to generate a photo compliant with the ICAO standard, the software? able to:

? integrate with the correct face positioning aid system, to indicate to the subject the correct positioning of the face and gaze;

? integrate with the LED lighting system for intensity management? bright depending on the brightness? the environment and the color of the subject's skin;

? integrate with cameras.

Below are some indications of the values of the sizes of the various elements constituting the system, in an illustrative and non-limiting sense.

Weights and dimensions of individual components

Total weight: 1.6 kg.

? Camera / illuminator module: 800gr - 54.5cm x 8.5cm x 7.54cm (height x width x depth?)

? Desk tripod: 800gr, maximum dimensions when closed 49.5cm, when open it occupies a surface of 40x40

? Bracket with desk vice: 800gr, height 49.6cm

Materials used: ABS and Aluminium.

As regards the electronic control, power and HUB circuit, this supervises the management of the light panels and the panels to assist in positioning the face, and? structured to perform the following functions:

? Generation of the voltages necessary for the operation of the system<, >so that the power present on the input USB is used to enable the power supply of the entire system which is derived from the 24vdc input.

? 5VDC power load on USB input 1 mA.

? Management and control of the light modules, i.e. the intensity? brightness of the light modules via pulse width modulation (PWM) ? USB hub, as a concentrator for all USB ports? Cameras, USB Host port, USB control card port, voice module which allows you to send voice messages to the user to appropriately position the face are connected to it.

? Management of the device command protocol

? Hosts and controls the voice module

As regards the LED lighting system 2, the following values can be used:

As regards digital cameras, they are preferably of the AF color camera type, 12 M pixels or higher, FOV 75?, with a mutual distance of approximately 35 cm. More? generally, different values of these quantities are possible, in order to satisfy the requirements of the ICAO standard that the cameras have a sensitivity? such as to guarantee generating a minimum value of number of pixels in the interocular distance of the face of the person to be photographed, also compatibly with the distance at which the person is placed with respect to the acquisition system, preferably between 100 cm and 70 cm.

As regards the visual indicators 2 positioned around the cameras, these can be of the LED type shaped like panel indicators with variable green/red color light.

The system includes software means capable of activating the following procedure when interacting with a user:

1) The system selects the most suitable camera? suitable for acquiring a photo of the person's face in relation to their height (for example from 100 to 200 cm). There are no moving parts or the need? that an operator places the camera at the best height, but the software carries out a procedure to check the presence of a face in the video frame of the different cameras present in the device and activates the lowest camera? suitable for acquisition according to ICAO specifications, i.e. the one that guarantees the best centering of the face with respect to it.

2) The system provides the subject with visual and vocal indications for the correct positioning of the face in front of the camera. The integrated indicator lights and speakers allow, through processing by the software, to guide the person in the right positioning. For example, the red color indicates incorrect positioning that needs to be modified, while the green color indicates correct positioning that can be modified. standing still. For example, the voice synthesizer, via the speaker, emits vocal indications that guide the subject in moving the face for correct centering.

The procedures of the two aforementioned points allow you to overcome the following problems:

to. Subjectivity? of the individual or operator to determine the right position of a face, which must instead respect very stringent parameters, to comply with ICAO regulations.

b. The possibility? both deaf and blind people to use the system independently

c. The possibility? to give multilingual directions to people of different ethnic groups.

In fact, the speech synthesis software integrated into the system allows an operator to select the different languages available.

3) Based on the position of the face and the brightness? environmental, the software regulates the intensity? of light emitted by the lighting system for the best photographic acquisition. Preferably the intensity? luminous emitted will be? greater by the illuminator more? near the activated camera, while one or more? other more illuminators? far from the activated camera will they be able to emit intense light? smaller, in order to avoid shadow areas and maximize uniformity? of face illumination.

4) The software automatically checks the correct positioning of the individual in front of the camera and the compliance of the live image of the face with all the requirements of the ICAO standard, and then automatically proceeds with the acquisition of the photo and archiving to file system.

Further details on the software procedures implemented are given below.

For image analysis and verification of the parameters dictated by the ICAO standard, the software uses self-contained libraries. known, such as OpenCv (https://opencv.org/) and Dlib (http://dlib.net/). By applying the elements of said libraries, the software in succession:

- carries out the evaluation indicated in point 1) above, i.e. activates the cameras in sequence, and chooses the one that represents the face of the person in the highest position? centered with respect to the angular shooting opening;

- performs the evaluation indicated in point 2) above, i.e. analyzes the pixels of the image coming from the chosen camera, and evaluates positioning, centering and orientation of the face, activating the visual and vocal indicators, as mentioned above, in order to obtain any movements of the person's face which must be as visible as possible centered and oriented parallel to the system as possible. It also evaluates the interocular distance as a number of pixels (mentioned above), giving indications of the correct distance of the face from the camera. In particular, a too small number of pixels indicates that the subject is too far from the camera, while a too large number of pixels indicates that the subject is too close. - carries out the evaluation indicated in point 3) above, i.e. evaluates the illumination of the face and controls the lighting system in order to obtain correct illumination and avoid areas of shadow or excessive light.

- finally takes a photograph of the subject's face.

As described above, the system is preferably presented in the two versions of desk application and with floor stand.

The features? that are obtained in the desk version are essentially the following: ? Optical and acoustic interaction to indicate to the subject the correct positioning of the face and gaze;

? fast acquisition operation (maximum 5 seconds from the start of the procedure) ? Uniform background behind the framed subject, according to the standards reported above; ? Connectivity? Ethernet and USB which allows it to be physically placed anywhere;

? the frontal acquisition of face images at different heights, with operational from 30cm to 110cm.

? Automatisms in face acquisition

? Transportable system with trolley case

The features? that are obtained in the version with floor stand are essentially the following:

? Optical and acoustic interaction to indicate to the subject the correct positioning of the face and gaze;

? fast acquisition operation (max 5 seconds from the start of the procedure) ? Uniform background behind the framed subject, according to the standards reported above; ? Connectivity? Ethernet and USB which allows it to be physically placed anywhere;

? the frontal acquisition of face images at different heights, with operational from 100cm to 220cm

? Automatisms in face acquisition

Constructive variations to the non-limiting example described are possible, without however departing from the scope of protection of the present invention, including all equivalent embodiments for a person skilled in the art.

The elements and characteristics illustrated in the different preferred embodiments can be combined with each other without departing from the scope of protection of the present invention.

The advantages deriving from the application of the present invention are clear, for example the following.

Differently from a common webcam or digital camera, the system object of the invention presents in particular the following peculiarities:

? Ease? of use through a simple application;

? Speed? acquisition (about 2 seconds from when the subject is well positioned); ? Automatic compatibility check? ICAO ;

? Can also be used by non-expert personnel;

? Possibilities? to photograph people from 100 cm to 200 cm tall;

? Acquisition of hundreds of photos in a few seconds, to identify the best one;

? Autofocus;

? Self-monitoring of face covering;

? Color photos;

? Full High Resolution;

? Inter Eye Distance: 240, 120 and 90 pixels;

? Direct and immediate quality control, to obtain only ICAO photos;

? indications on the correct positioning of the subject to be photographed through a vocal synthesizer (voice guide in multiple languages);

? Optical interaction to indicate to the subject the correct positioning of the face and gaze (luminous LED indicators);

? Having integrated several cameras, the solution identifies the subject's face automatically and enables the best positioned camera;

? Automatic background removal. Possibilities? default background insertion;

? The lighting system? automatic and adaptable: it automatically adjusts the quantity? of light based on the color of the skin, clothes and the light present in the environment;

? The system signals when the photo is not ? ICAO compatible;

? Easily transportable;

? Easily connected to any computer through a USB cable;

? Very low consumption (works in very low voltage with reduced consumption, max 30W); ? Possibilities? to be integrated into any software platform.

From the above description, the technician in the field? capable of realizing the object of the invention without introducing further construction details.

Claims (7)

1. System for securely capturing photographs of human faces comprising: - two or more? digital cameras (1), designed to acquire the image of a face, said cameras being of the color type, equipped with a specific angular aperture and a sensitivity? such as to obtain a minimum number of pixels in the interocular distance of the face; - a lighting system including LED illuminators (2); - an aid system for the correct positioning of the face (3) comprising light indicators positioned around said two or more? digital cameras (1) and at least one speaker (8); - an electronic control circuit, power supply and HUB of said system; - one or more? first rigid column supports (5) integrating said digital cameras (1), and suitable for maintaining said two or more cameras in vertical reciprocal position at a given mutual distance; - one or more? second rigid column supports (6) for said lighting system (2), said second rigid column supports being connected in front of said one or more? first rigid column supports (5), rotatable between a position suitable for hiding said cameras and a position suitable for placing said illuminators laterally to said cameras; - at least one support and containment support (4) for said system, capable of supporting said system in a vertical position; - said electronic circuit comprising the following software means, suitable for operating in succession: - means for selecting the camera between said two or more? digital cameras (1), more? suitable for acquiring a photo of the person's face, determining a selected camera that presents the best centering of the face with respect to it; - means for activating said aid system for the correct positioning of the face in front of said selected camera, providing visual indications by activating said light indicators and sound indications through said at least one speaker (8) aimed at obtaining the movement of the face until it is centered in front to said selected camera and to the correct distance with respect to said selected camera; - means for measuring brightness? of the environment in which he is positioned said face, and to activate said lighting system (2) in order to maximize uniformity? of illumination of said face; - means for taking a photograph of said face when said means for activating said aid system provide an indication of the face in the correct position. 2. System as in claim 1, wherein said two or more? digital cameras (1) are of the AF color camera type 12 M pixels or higher, FOV 75?, called mutual distance ? of about 35 cm, and said correct distance? between 100 cm and 70 cm. 3. System as in any of the preceding claims, wherein said indicator lights positioned around said two or more? digital cameras (1) are shaped like panel indicators with variable green/red color light, said means for activating said aid system for the correct positioning of the face in front of said selected camera by controlling the production by each of said light indicators , of said red light in case of incorrect position of said face, or of said green light in case of correct position of said face. 4. System as in any of the previous claims, wherein said means for activating said lighting system control said LED illuminators so that the most close to said selected camera emit a light of certain intensity, and at least some of said LED illuminators more? far from said selected camera emit a light of intensity? less than said specific intensity. 5. System as in any of the previous claims, in which said means for activating said system to aid the correct positioning of the face in front of said selected camera analyze the pixels of the image coming from said selected camera in order to evaluate positioning, centering and orientation of the face, and evaluating said interocular distance as a number of pixels, and determining an excessive distance of said face from said selected camera if said number of pixels ? less than a certain value, or resulting in excessive proximity of said face from said selected camera if said number of pixels ? greater than that specific value. 6. System as in any of the previous claims, in which said at least one support and containment support (4) includes means for fixing to a desk of said system, or pedestal means for resting said system on the ground. 7. System as in any of the previous claims, wherein at least one loudspeaker (8) is said? integrated into one of said first or second rigid column supports.