FR3085520A1 - AUGMENTED REALITY VIEWING METHOD OF IDENTITY DOCUMENT, USE, DEVICE AND SYSTEM IMPLEMENTING SAID METHOD - Google Patents

Abstract

Method (E) for augmented reality viewing of an identity document (2) presented by a person, comprising: - a step of acquiring an image of a scene comprising the document, - a step of detecting a marker (21) present on said document, - a step of obtaining a synthetic image associated with said document from said detected marker, - a step of generating an image in augmented reality, comprising the acquired image and said computer-generated image, - a step of displaying said image in augmented reality.

Description

Method for actually viewing an identity document, use, device and system implementing said method

Technical area

The invention relates to the field of methods for verifying the identity of a person from an identity document.

State of the art

When checking the identity of a person from an identity document, a means of recognizing the person is the observation of a photograph of the face of the person who is present on the identity document.

However, the person's face may have changed since the photograph presented on the document was taken.

Identity verification can then be carried out using other evidence provided by the person, which then requires communication with a central station and lengthens the duration of identity verification.

In particular, patent FR2925201A1 proposed a solution for ensuring real-time control of access to an event, transport or service, or of the authenticity of an access ticket or of documents issued by a authority, consists of:

- first of all, to acquire specific data from the person wishing to have this access or the document, if necessary simultaneously with the payment of access or obtaining rights;

-to store this own data in the form of an electronic file in a database managed by the authority exercising access control or the issuance of the document, and to associate this file with an identifier specific to said person, this step constituting final title validation;

-to control the effective access of said person during his presentation to the event or to the service or to control the authenticity of the document held by said person by comparison of the personal data of the person acquired during his presentation or by visualization on foot of it or an element related to it with the file stored in the database.

Statement of the invention

An object of the invention is in particular to remedy all or part of the aforementioned drawbacks.

Firstly, a method of issuing an identity document is proposed, comprising the following steps:

Acquisition of a three-dimensional image of the bust of the person to be identified

Recording on a server of an encrypted digital file of said three-dimensional image associated with a unique identifier of the identity document and with textual information identifying said person

Production of a physical identity document including printing:

o Said textual identification information and a photograph corresponding to the three-dimensional image of the person to be identified o of a marker, in particular a graphic marker, for example a QRCode, or digital, for example in a memory of an RFID component or NFC, calculated from said unique identifier.

For each person to be identified, we will thus have:

an identification document, for example a card, kept by the person, to allow the control of his identity of a digital duplicate of this information, recorded in an encrypted form on a server, of a link, under the form of a marker, allowing a controller to gather and control the information appearing on the document presented by the person to be identified on the one hand, and the information downloaded from the server thanks to the marker appearing on the physical document and allowing '' establish via a computer application of the control equipment, a secure session with the server and finally a three-dimensional image downloadable on the control equipment, allowing the controller to verify the identity between the person to be checked and his recorded three-dimensional representation on the server during the production of the identity document.

According to a first aspect of the invention, there is provided a method for augmented reality viewing of an identity document presented by a person, comprising:

a step of acquiring an image of a scene comprising the document,

- a step of detecting a marker present on the document,

a step of obtaining the image of the identity document recorded on the server, in association with said document from said marker,

a step of generating an augmented reality image, comprising the acquired image and the image received from the server, a step of displaying said pair of augmented reality images.

The controller thus has on the display screen of a smart phone or a tablet, in juxtaposition, the acquired image of the card presented by the person to be checked, for example with the phone's camera, and the "official" image downloaded from the server. The controller can then check the conformity of the two images by a human comparison or by a computer application executed by the smartphone and ensuring an image comparison to highlight any discrepant areas.

In the present description, an identity document can be a driving license, a passport, a consular card, a national identity card, a specific document allowing access control, a business card.

In the present description, a marker can be any graphic element present on the document which can then be sought or detected during the detection step. For example, the marker can be a code, a 2D code, preferably a QR Code. Alternatively, the marker can be an RFID tag, preferably passive. The marker can also be a particular predetermined mark, embossed or not.

Advantageously, the synthetic image associated with the identity document may include a digital image of the identity document, or be constituted by a scan or a photograph of the physical document at the time of manufacture, before delivery to the person concerned and with a view to its recording on the server, or a synthetic image reconstructed with the photograph of the person and the textual information.

The two-dimensional image can result from a simple photograph, or from a processing of the three-dimensional image.

In this case, the augmented reality image comprises on the one hand the acquired image presenting the identity document and a synthetic image comprising a digital image of the identity document. It is thus possible to compare the identity document presented and the digital image associated with this document.

The falsification of an identity document then requires skills not only in falsification of secure documents, but also in modification of secure database when such a database is used and in modification of blockchain when basic registration fingerprints secure data is saved in a block chain.

According to one possibility, the synthetic image associated with the document includes a representation of the person. Also, this representation may differ from a representation otherwise present on the identity document. Advantageously, it is possible to change the representation of the synthetic image over time, without the need to edit a new identity document.

Advantageously, the representation of the person can be a three-dimensional representation of the person.

Preferably, in addition to the representation of the person, the synthetic image may include an indication of at least one remarkable identification point on the representation of the person. A remarkable point of identification can be a mole, a scar, in particular an acne or chickenpox scar, a freckle, a birthmark. The method then makes it possible not only to update the representation of the person without having to change the identity document, but also offers comfort of identification by making it possible to confuse the person by remarkable identification points in addition to his physiognomy.

According to one possibility, the synthetic image associated with the identity document differs according to the orientation of the document. The orientation of the document can be determined from the acquired image of the document.

For example, when the identity document can have two sides, one called the front, the other called the back. Still by way of example, the method can obtain and display a synthetic image comprising the digital image of the identity document when the front side is presented, and the method can obtain and display a synthetic image comprising a representation of the person when the back side is shown. Also, the invention proposes the use of a method of actually viewing an augmented identity document presented by a person according to the first aspect of the invention, or one or more of its improvements, for the control of identity of the person from said identity document.

According to yet another aspect of the invention, an augmented reality display device of an identity document presented by a person is proposed, comprising:

an image acquisition means configured to acquire an image of a scene comprising the document, a detection means configured to detect the presence of a marker present on the document, a means of obtaining a synthetic image associated with said document from said marker, a generation means configured to generate an augmented reality image, comprising the acquired image and the synthetic image, an image display means configured to display the augmented reality image .

The image acquisition means can be an image sensor, for example an image sensor of a smart phone.

The detection means can be a microprocessor configured to carry out a detection of the presence of a marker on an image, for example a microprocessor of a smart phone, for the English smartphone.

The means for obtaining a synthetic image associated with the document may include a microprocessor configured to obtain said synthetic image from a database. The database can be secured.

Data fingerprints registered in the database can be registered on a blockchain, for English blockchain.

The database can be located remotely from the microprocessor. The obtaining means may include a communication channel, preferably wireless, between the microprocessor and the database. The communication channel can implement secure communication protocols. The database can be saved on a cloud-type medium.

The generation means configured to generate the augmented reality image can be a microprocessor configured to generate an image from two other images, for example a microprocessor of a smart phone.

The display means can be a display such as a screen, for example a screen of a smart phone.

According to yet another aspect of the invention, there is proposed a system for augmented reality viewing of an identity document presented by a person, comprising:

a smart phone having a screen, an image sensor, a calculation unit and means for transmitting and receiving wireless data, a data server comprising means for interrogating a cloud-type database and wireless data transmission and reception means, a display device according to the preceding aspect of the invention, or one or more of its improvements.

According to this aspect of the invention:

the image sensor is the means of acquiring images of the viewing device, the means of obtaining the viewing device comprises the calculation unit as well as the means for transmitting and receiving wireless data from the telephone smart and data server, the calculation unit of the smart phone is the image generation means of the viewing device, the screen is the display means of the viewing device.

Description of the figures

Other advantages and particular features of the invention will appear on reading the detailed description of implementations and embodiments which are in no way limitative, with reference to the appended drawings in which:

FIG. 1 diagrammatically represents an embodiment of a system according to the invention, FIG. 2 diagrammatically represents an embodiment of a device according to the invention, FIG. 3 diagrammatically represents an embodiment of a method according to the invention.

Description of embodiments

Since the embodiments described below are in no way limitative, it is possible in particular to consider variants of the invention comprising only a selection of described characteristics, subsequently isolated from the other described characteristics, if this selection of characteristics is sufficient to confer a technical advantage or to differentiate the invention from the state of the prior art. This selection includes at least one characteristic, preferably functional, without structural details, or with only part of the structural details if this part only is sufficient to confer a technical advantage or to differentiate the invention from the state of the prior art. .

In the figures, an element appearing in several figures retains the same reference.

In FIG. 1 is shown an embodiment of a system 1 for actually displaying an augmented identity document 2 presented by a person 3.

System 1 includes:

a smart phone 4, implemented by an agent 5, a data server 6, a cloud-type database 7.

The smart phone has a screen 41, an image sensor 42, a calculation unit 43 and means 44 for wireless transmission and reception of data.

The data server 6 includes interrogation means 61 of the database? and means 62 for transmitting and receiving wireless data.

The transmission and reception means of the smart phone 4 and the data server 6 are configured to exchange data with one another by means of a secure data exchange protocol, for example by a virtual private network of VPN type, for English virtual private network.

As illustrated in FIG. 2, the different parts of the system 1 form a device 100 for augmented reality viewing of an identity document presented by a person, comprising:

an image acquisition means 102 configured to acquire an image of a scene comprising the document 2, a detection means 104 configured to detect the presence of a marker 21 (FIG. 1) present on the document 2, a means obtaining 106 a synthetic image associated with the document 2 from the marker 21, a means 108 for generating an image configured to generate an image in augmented reality, comprising the acquired image and the synthetic image, image display means 110 configured to display said augmented reality image.

The image sensor 42 is the means 102 for acquiring images from the display device 100.

The means 104 for obtaining the display device 100 comprises the calculation unit 43 as well as the means 44 and 62 for transmitting and receiving wireless data from the smart phone 4 and the data server 6.

The calculation unit 43 of the smart phone 4 is the image generation means 108 of the display device 100.

The screen 41 of the smart phone is the display means 110 of the display device.

During the original production of an identity document, a digital twin of the identity document is generated and is recorded in the database ?, preferably in encrypted form.

The agent 5 can, before implementing an embodiment of a method E according to the invention, download and install on his mobile phone 4 (or on a dedicated terminal) an application which allows him to view the actually increased content. Distribution of the application may be limited to authorized agents.

This application allows a law enforcement officer, for example, to check the identity document (driver's license, identity card or passport or consular card) which is presented to him in the following manner.

During a step E1, the agent acquires an image 11 of a scene comprising the identity document.

During a step E2, the method comprises:

a step of detecting the marker 21 present on the document 2, a step of obtaining a synthetic image 12, or 12 ′, associated with the document 2 from the detected marker 21, a step of generating an image in augmented reality 13, or 13 ', comprising the acquired image 11 and the synthetic image 12, or 12', a step of displaying the image 13, or 13 ', in augmented reality.

As illustrated in the figure, the result of step E2 may differ depending on the face presented of the identity document 2.

When the front of the identity document 2 is presented, the synthetic image 12 includes the digital twin of the identity document, present in the database 7.

The digital twin of the identity document is obtained, upon detection of the marker 21, by sending a request to the data server 6 which interrogates the database 7.

As mentioned, the digital twin can preferably be encrypted, in which case the application is configured to decrypt the encrypted digital twin.

In image 13 are thus represented both the identity document as well as the digital twin of the identity document.

The comparison of the two documents, supposed to be identical, can then be carried out by the agent.

Furthermore, the application can include an automated comparison function of the two documents. Any differences between the two documents, called differentiating zones, can be directly represented, on one and / or the other of the documents.

The differentiating zones can be represented, by a frame, a highlight or a different lighting.

When the back of the identity document 3 is presented, the synthetic image 13 ′ comprises a three-dimensional representation of the person. Also, the augmented reality image 13 then includes the back of the identity document 3 as well as the synthetic image 13 '.

In addition, the synthetic image 13 ′ further comprises two indications of two remarkable identification points P1, P2 on the representation of the person.

Point PI indicates a scar at the person's right cheekbone, while point P2 indicates a mole at the person's left ear.

Of course, the invention is not limited to the examples which have just been described and numerous modifications can be made to these examples without departing from the scope of the invention. In addition, the different characteristics, forms, variants and embodiments of the invention can be associated with each other in various combinations as long as they are not incompatible or mutually exclusive of each other.

Claims (9)

Claims 1 - Method (E) of augmented reality viewing of an identity document (2) presented by a person (3), comprising: 5 - a step of acquiring an image (11) of a scene comprising the document, a step of detecting a marker (21) present on said document, a step of obtaining a synthetic image ( 12,12 ') associated with said document from said detected marker, a step of generating an augmented reality image (13,13'), 10 comprising the acquired image and said synthetic image, a step of displaying said image in augmented reality. 2 - Method according to claim 1, wherein the synthetic image (12) associated with the identity document comprises a digital image of said identity document (2). 3 - Method according to any one of the preceding claims, in which the synthetic image (12 ') associated with the document comprises a representation of said person. 20 4 - Method according to the preceding claim, wherein the representation of the person is a three-dimensional representation of the person. 5 - Method according to claim 3 or 4, wherein the synthetic image further comprises an indication of at least one remarkable identification point (P1, P2) on the representation of the person. 6 - Method according to any one of the preceding claims, wherein the synthetic image associated with the document differs according to the orientation of the identity document. 7 - Use of an augmented reality viewing method of an identity document presented by a person according to any one of the preceding claims for the identity control of the person from said identity document. 8 - Device (100) for augmented reality display of an identity document (2) presented by a person, comprising: an image acquisition means (102) configured to acquire an image of a scene comprising the document, .10 - detection means (104) configured to detect the presence of a marker (21) present on said document means for obtaining (106) a synthetic image associated with said document from said marker, means for generating (108) an image configured to generate a 15 augmented reality image, comprising said acquired image and said synthetic image, image display means (110) configured to display said augmented reality image. 209 - Augmented reality display system for an identity document presented by a person, comprising: a smart phone (4) having a screen (41), an image sensor (42), a calculation unit (43) and means (44) for transmitting and receiving wireless data, 25 - a data server (6) comprising means for interrogation (61) of a database (7) of the cloud type and means (62) for transmitting and receiving wireless data, a device ( 100) of display according to the preceding claim, in which: The image sensor is the means for acquiring (102) images from the display device, the means for obtaining (104) from the display device comprises the calculation unit as well as the transmission means and wireless data reception from smartphone and data server, the calculation unit of the smart phone is the means for generating (108) the image of the display device, - The screen is the display means (110) of the display device. 10 - Method for issuing an identity document (2) comprising the following steps: acquisition of a three-dimensional image of the bust of the person to be identified, recording on a server of an encrypted digital file of said three-dimensional image associated with a unique identifier of the identity document and with textual information identifying said person, manufacture of '' a physical identity document including the printing: o of said textual identification information and of a photograph corresponding to the three-dimensional image of the person to be identified o of a marker, in particular a graphic, for example a QRCode, or digital, for example in a memory of an RFID component or NFC, calculated from said unique identifier.