EP4252125A1 - Dispositif et procédé d'authentification d'un utilisateur d'un casque de réalité virtuelle - Google Patents
Dispositif et procédé d'authentification d'un utilisateur d'un casque de réalité virtuelleInfo
- Publication number
- EP4252125A1 EP4252125A1 EP21840647.8A EP21840647A EP4252125A1 EP 4252125 A1 EP4252125 A1 EP 4252125A1 EP 21840647 A EP21840647 A EP 21840647A EP 4252125 A1 EP4252125 A1 EP 4252125A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- user
- virtual reality
- authentication
- reality headset
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/36—User authentication by graphic or iconic representation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
Definitions
- the invention relates to the authentication of a user of a virtual reality headset.
- Authentication makes it possible to legitimize the request for access to a device (computer, smartphone, connected object, etc.) or to a service (website, application, cloud, video on demand - or VoD for "video on demand” in English, teleconference, collaborative space, etc. by a person in order to authorize access to the resources (system, communication network, applications, content, etc.) of the device or service.
- a device computer, smartphone, connected object, etc.
- a service website, application, cloud, video on demand - or VoD for "video on demand" in English, teleconference, collaborative space, etc. by a person in order to authorize access to the resources (system, communication network, applications, content, etc.) of the device or service.
- authentication consists of verifying the identity of the person requesting access to the device or service by verifying access data such as a password, data provided by an identification document such as a smart card, an electronic certificate..., biometric data (fingerprints, iris, face), a signature or a gesture.
- the type of access data generally depends on the degree of security of the device or service to be accessed and the device used to provide this access data.
- biometric data has long been limited due to sensors not available on the communication devices and high computational costs during the recognition of these biometric data.
- headset connected to a computer such as the Oculus RiftTM and the HTC ViveTM
- stand-alone headset such as the Oculus QuestTM
- a keyboard and/or a mouse are often available to allow the user to enter their login/password.
- the user experience is degraded because the user must switch from the computer to the headset at the time of authentication.
- the user must, to enter his login/password to access his personal documents in order to share some of them with the other participants, take off his headset, i.e. "exit of the meeting even if the headset remains connected to it. Indeed, the user not only will no longer see or hear what is happening in the virtual meeting, but will also no longer be able to participate until he has put his headset back on.
- the virtual reality experience should be immersed in the headset at all times.
- the user does not have a physical keyboard to easily enter authentication information. Admittedly, it is possible to display a virtual keyboard to allow the user to enter their authentication information, but the interaction is not as natural as with a real keyboard, causing authentication errors.
- One of the aims of the present invention is to provide improvements over the state of the art.
- An object of the invention is a device for authenticating a user of a virtual reality headset, the authentication device comprising an analyzer capable of verifying whether an image relating to at least one element of a real environment captured by the virtual reality headset corresponds to a reference datum stored in association with an identifier of the user of the virtual reality headset.
- the use of the virtual reality headset can be linked to the room in which the headset is located.
- the authentication will possibly be a function not of a password made up of letters or numbers but of objects. Objects corresponding to images of these objects picked up according to directions looked by the user to compose the object password.
- the authentication device comprises a model generator of elements of a real environment, the model generator is capable of determining a model of the element corresponding to the captured image.
- the analysis is carried out not on an image but on one or more models generated from the image: the model is in particular a plan of the part, a plan of one or more objects identified in the part...
- the use of model rather than images makes it possible to reduce the computational costs for verification.
- the authentication device includes a computer capable of implementing image recognition, the computer provides one result from among the following:
- the analyzer is based on data obtained from the image captured with greater precision, thus reducing authentication errors (in particular the hotel room phenomenon, i.e. a room similar, which would possibly generate erroneous authentications: false positives, with a system in particular based on a simple modeling of the real environment and/or of one or more objects found there).
- the authentication device comprises a controller of at least one sensor of the virtual reality headset, the controller being capable of triggering the sensor supplying an image of an element of a real environment captured to the authentication device.
- the camera can be triggered by the authentication device, in particular when the camera is oriented in a predetermined direction, in particular associated with the reference data or when the framing of the real environment by the camera corresponds to that of the image of the data. reference. This avoids human authentication errors.
- the authentication device comprises a generator of guide information according to the identifier of the user, the generator supplies the guide information to the virtual reality helmet, the guide information is able to be used to orient the virtual reality headset in a direction associated with the user's identifier.
- the camera is positioned in the same direction as that which allowed the memorization of the reference data, thus reducing the costs of analysis calculations and refusals of authentication.
- false negatives related to the fact that, for example, the captured image will be slightly offset on one side compared to the image used by the reference data omitting an element: furniture, component of the room (window, door, corner, hanger).
- the analyzer is able to check whether a series of images relating to elements of a real environment captured corresponds to a series of reference data stored in association with an identifier of a user requiring authentication.
- the use of a series of images makes it possible to use as authentication data a word that is not alphanumeric or a sentence that is not made up of words but of images or objects present in the real environment.
- the password according to the invention could be a chair, a plant, a door and an animal appearing on a poster, all of these elements being in the room, that is to say the environment real.
- the virtual reality headset can only be used in the rooms for which the user has registered.
- the element is one of the following elements:
- the reference data is at least one type of data among the following:
- Another object of the invention is a method for authenticating a user of a virtual reality headset, the authentication method comprising
- the user identifier is stored in association with several distinct reference data corresponding to distinct real environments.
- the verification includes a comparison among the following:
- An object of the invention is also a device for recording a user of a virtual reality headset, the recording device comprising a recorder of reference data in association with an identifier of the user of the headset virtual reality, the reference datum corresponding to an image relating to at least one element of a real environment captured by the virtual reality headset during recording.
- Another object of the invention is a virtual reality headset comprising:
- a device for recording a user of a virtual reality headset capable of memorizing, in association with an identifier of the user of the virtual reality headset, a first reference datum, the reference datum corresponding to an image relating to at least one element of a real environment captured by the virtual reality headset during recording, and
- an authentication device capable of verifying whether an image relating to at least one element of a real environment captured by the virtual reality headset corresponds to the reference datum stored in association with the identifier of the user of the headset virtual reality.
- An object is still a method for registering a user of a virtual reality headset, the registration method comprising
- - storing in association with an identifier of the user of the virtual reality headset a first reference datum, the reference datum corresponding to an image relating to at least one element of a real environment captured by the virtual reality headset during the record.
- the recording method comprises, during a first use of the virtual reality headset in a second real environment, a repetition of the memorization step for the user for a second reference datum.
- the various steps of the method according to the invention are implemented by computer software or program, this software comprising software instructions intended to be executed by a data processor of a authentication device and/or a recording device and being designed to control the execution of the various steps of this method.
- the invention therefore also relates to a program comprising program code instructions for the execution of the steps of the authentication method and/or a registration method when said program is executed by a processor.
- This program can use any programming language and be in the form of source code, object code or intermediate code between source code and object code such as in a partially compiled form or in any other desirable form.
- FIG. 1 a simplified diagram of an authentication device according to the invention
- FIG. 2a a simplified diagram of a first mode of implementation of the authentication device according to the invention
- FIG. 2b a simplified diagram of a second mode of implementation of the authentication device according to the invention
- FIG. 3 a simplified diagram of a user registration process according to the invention
- FIG. 4 a simplified diagram of an authentication method according to the invention
- FIG. 5a a simplified diagram of a first example of reference data used by the authentication device according to the invention
- Figure 5b a simplified diagram of a second example of reference data used by the authentication device according to the invention.
- virtual reality helmet any type of helmet or glasses comprising multimedia content reproducers, such as: screen(s), loudspeaker(s), etc. and allowing interaction of a user wearing the helmet with the multimedia content either directly by means of the helmet (for example the helmet being equipped with interaction buttons and/or one or more sensors: camera, microphone allowing the user wearing the headset to control interaction with the content reproduced by the headset.
- multimedia content reproducers such as: screen(s), loudspeaker(s), etc.
- virtual reality headset is meant a virtual reality and/or augmented reality headset.
- Figure 1 illustrates a simplified diagram of an authentication device according to the invention.
- the authentication device 1, 21 is a device capable of authenticating a user U of a first virtual reality headset 2.
- the authentication device 1, 21 of a user U of a virtual reality headset 2 comprises a analyzer 11 capable of verifying whether an image relating to at least one element of a real environment ir erc captured by the virtual reality headset 2 corresponds to reference datum dr_vm stored in association with an identifier uid of the user U of the headset 2 virtual reality.
- the reference datum dr_vm has been stored prior to the implementation of authentication by the authentication device 1, 21 and/or prior to an access request triggering authentication by the authentication device 1, 21 according to the invention.
- the stored value dr_vm has been stored by a user recorder 7, 27 during a first access to a product or service requiring authentication.
- the authentication device 1, 21 comprises at least one receiver 10 of an icd image captured by the helmet 2.
- the receiver 10 receives the icd captured image coming, in particular, from a sensor 22, such as a camera, a 360° camera, an IR camera, etc. helmet 2 implemented in particular directly in helmet 2,
- the authentication device 1, 21 comprises a model generator 15, 115 of elements of a real environment.
- the model generator 15, 115 is able to determine a model imo of the element corresponding to the captured image icd.
- the template generator 15, 115 uses a template base 16, 116 to determine the imo template.
- the authentication device 1, 21 comprises a computer 14, 114 capable of implementing image recognition.
- the computer 14, 114 notably performs image processing on the captured image icd.
- the computer 14, 114 executing image processing by image recognition is able to provide the model generator 15, 115 or directly to the analyzer at least one model of an element mo(elt) present in the captured image icd.
- the model generator 15, 115 generates a model of the real environment imo using one or more element models mo(elt) provided by the computer 14, 114.
- the computer 14, 114 compares by implementing image recognition the captured image icd and the image stored as reference datum dr vm.
- the computer 14, 114 provides a result from among the following:
- the result of the verification is in particular a precise correspondence rate (for example with pixel-by-pixel comparison, with color verification, etc.) or a coarse correspondence rate (for example with comparison of contrast lines, etc.).
- the authentication device 1, 21 comprises a controller 12, 112 of at least one sensor 22 of the virtual reality headset 2.
- the controller 12, 112 is capable of triggering the sensor 22 providing an icd image of an element of a real environment captured erc to the authentication device 1, 21.
- the controller 12, 112 includes a comparator (not shown) able to compare a datum picked up by the helmet 2 with respect to a framing datum ded associated with the reference datum dr_vm of the user U.
- the framing datum ded is a geographical orientation (30°N for example) or an angle with respect to a reference point in real space (15° with respect to the user's axis U with the door).
- the helmet 2 comprises at least one gyroscope able to provide an angle to True North or to a landmark.
- the authentication device 1 will provide guide information ig to the helmet 2.
- the helmet 2 will reproduce the guide information ig either on the screen 20 of the helmet 2 or at least headphones speakers 2. The guide information ig will ask the user U, for example, to position himself facing the landmark or with his back to the landmark.
- the guide information ig will control the movement of the camera 22 of the helmet 2 until the latter is positioned opposite the reference point. Then, the user U will move or the controller 12 will command the movement of the camera 22. The controller 12 will then compare the angle of the captured datum de to the stored framing datum ded. When the angle of the captured datum de corresponds to the memorized framing datum ded, the controller 12 will trigger the capture of the image icd.
- the data captured from is an image captured by the camera 22 of the helmet 2 and the framing data ded is either the reference data dr_vm, or constituted by one or more landmarks in the image which is a function dr vm reference data.
- the controller 12 verifies whether the capture position of the captured image ccf is that of the image of the reference datum dr_vm and/or if the reference point(s) of the reference datum dr_vm are present in the data captured from. As soon as the verification is positive, the controller 12 triggers the camera 22 which captures the icd image allowing authentication. The camera 22 then provides the captured image icd to the authentication device 1, 21, and more specifically to the analyzer 11, 110.
- the authentication device 1, 21 comprises a generator 19, 119 of guidance information ig(uid) according to the user identifier uid.
- the generator 19, 119 supplies the guidance information ig to the virtual reality headset 2.
- the guidance information ig is able to be used to orient the virtual reality headset 2 in a direction dir associated with the identifier of the user uid.
- the guide information ig can be reproduced by the headset 2, for example by the screen 20 or loudspeakers (not shown).
- the guidance information ig allows the capture of a series of images ⁇ icd(n ) ⁇ n .
- the guidance information will ask the user to first look at a chair, frame, window, etc.
- the element is one of the following:
- dr_vm reference data is at least one of the following data types:
- Figure 1 illustrates a particular embodiment of a recording device 7, 27 of a user U of a virtual reality headset 2.
- the recording device 7, 27 and the authentication device 1, 21 are implemented in an electronic device (not shown) such that certain implemented elementary devices (10, 70), (12 , 112, 72), (13, 113, 73), (14, 114, 74), (15, 115, 75), (16, 116, 76) in this electronic device are shared by the recording device 7 , 27 and the authentication device 1, 21.
- the recording device 7.27 and the authentication device 1, 21 both use at least one common device among the following: the captured image receiver 10.70, the model generator 15,115,75 , the image recognition computer 14,114,74, the controller 12,112,72, etc.
- the recording device 7,27 comprises a recorder 18, 78 of dr_vm reference data in association with an identifier uid of the user U of the virtual reality helmet 2, the dr_vm reference data corresponding to a relative image im to at least one element of a real environment captured by the virtual reality headset 2 during recording.
- the recording device 7, 27 comprises a coupler 17, 77 associating the identifier uid of the user U with the reference datum dr vm.
- the coupler 17, 77 is connected to the recorder 18, 78 to which it supplies the pair identifier-reference data (dr_vm, uid).
- the recording device 7.27 comprises at least one receiver 70 of an image captured icm by the helmet 2.
- the receiver 10 receives the captured image icm originating, in particular, from a sensor 22, such as a camera, a 360° camera, an IR camera, etc. helmet 2 implemented in particular directly in helmet 2,
- the recording device 7.27 comprises a model generator 75 of elements of a real environment.
- the model generator 75 is able to determine a model imo of the element corresponding to the captured image icm.
- the template generator 75 uses a template base 76 to determine the imo template.
- the recording device 7.27 includes a computer 74 capable of implementing image recognition.
- the computer 74 notably performs image processing on the captured image icm.
- the computer 74 executing image processing by image recognition is able to provide a model generator 75 or directly to the coupler 17, 77 at least one model of an element im present in the captured image icm .
- the model generator 75 generates a model of the real environment imo using one or more models of elements mo(elt) provided by the computer 74.
- the recording device 7.27 comprises a controller 72 of at least one sensor 22 of the helmet 2 of virtual reality.
- the controller 72 is capable of triggering the sensor 22 providing an image icm or a series of images ⁇ icm(n) ⁇ n to the recording device 7.27.
- the footprint of the real environment can be an image systematically centered on the door of the room where the user U is located, or an image systematically taken when the user U is in a starting position of immersion planned in the real environment (suitable seat, secure area, etc.).
- controller 72 sends headset 2 a recording request reg_rq.
- the user thus provides an identifier uid then orders the recording of the image icm or of the series of images ⁇ icm(n) ⁇ n to be memorized as a “password”.
- the recording request reg_rq guides the camera 22 and/or the user U in recording the images icm.
- a lth series of reference data ⁇ dr_vml(n) ⁇ n i...N corresponding respectively to a first, a second, ... a lth real environment in which the user U uses the helmet 2.
- the authentication by "fingerprint" of the real environment allows the user U to use the helmet in more than one distinct real environment.
- the virtual reality headset 2 includes:
- a recording device 27 of a user U of a virtual reality headset 2 capable of memorizing, in association with an identifier uid of the user U of the virtual reality headset 2, a reference datum dr_vm, the reference datum corresponding to an image relating to at least one element of a real environment captured by the virtual reality headset 2 during recording, and
- an authentication device 21 capable of verifying whether an image ir erc relative to at least one element of a real environment captured by the virtual reality headset 2 corresponds to the stored reference datum dr_vm in association with the identifier uid of virtual reality headset 2 user U.
- FIG. 1 illustrates the case of an autonomous virtual reality headset 2, that is to say embedding the operating device (not shown) of the headset, for example in the form of a processor executing instructions implementing implements a method of exploitation.
- the operating device comprises in particular a multimedia content calculator modified according to at least one multimedia content read in a content base and at least one interaction datum captured or detected.
- the content is a video game, audio and/or video content, interactive multimedia content, etc.
- FIGS 2a and 2b show different implementations of the authentication device 1, 21 according to the invention, in particular as illustrated by Figure 1.
- FIG. 2a illustrates a simplified diagram of a first mode of implementation of the authentication device 1, 21 according to the invention.
- the authentication device 61 is implemented in an electronic device 6 possibly remote from the helmet 2. If the electronic device 6 is remote, it is connected to the helmet 2 via a communication network 3w, in particular a extended communication network or WAN for Wide Area Network in English such as an Internet network, a mobile communication network...
- a communication network 3w in particular a extended communication network or WAN for Wide Area Network in English such as an Internet network, a mobile communication network...
- the electronic device 6 is in particular a personal electronic device placed at the home of the user U or a professional electronic device placed at the office of the user U while the user U with the headset 2 is located remotely, in particular in a residence secondary school, a rental, a hotel or on the premises of a partner, etc. , or a service provision server, such as a website, an application, a content provider (video on demand, Cloud, etc.)...
- the electronic device 6 comprises an access provision device 62.
- the user U uses the helmet 2 to request access to a service or a product from an access provision device, for example the device 62.
- the access provision device 62 requires the auth req authentication of the user U to the authentication device 61 according to the invention.
- Authentication device 61 receives at least one icd image. Then, the authentication device 61 checks whether the image relating to the real environment ir_erc (possibly consisting of the captured image received icd) corresponds to the reference datum dr_vm associated with the user U.
- the electronic device 6 comprises a user recording device 67.
- the recording device 67 records a reference datum dr_vm in association with a user identifier uid for example in a user base (not illustrated).
- the authentication device 61 retrieves the dr_vm reference datum which it uses to implement the verification in the user base in which it was previously recorded in association with the user identifier uid by the recording device 67.
- the authentication device 61 activates the access provision device 62.
- the access provider device 62 then gives access to the product or service to the first electronic device 2. For example, the access provider device 62 sends a reproduction signal to the headset 2 which reproduces the accessed service and/or an interaction menu with the product or service accessed. Thus, the headset 2 makes it possible to transmit an interaction signal si to the access provision device 62 as a function of the reproduction signal sr reproduced by the headset 2.
- Figure 2b illustrates a simplified diagram of a second mode of implementation of the authentication device 241 according to the invention.
- the authentication device 241 is implemented either in an electronic device 24 of which the headset 25 is a peripheral, or directly in a virtual reality system 2 comprising a peripheral 25, such as a virtual reality.
- the helmet 25 is connected to the electronic device 24 via a communication network 3L, in particular a local communication network composed either of a wired connection, in particular of the Ethernet or USB type, or either by a local wireless network.
- Either the augmented reality system 2 or the electronic device 24 comprises - an authentication device 241 of the user of the virtual reality headset 25 capable of verifying whether an image relating to at least one element of a real environment ir erc captured by the virtual reality helmet 25 corresponds to a reference datum dr_vm stored in association with an identifier uid of the user U of the virtual reality helmet 25.
- the electronic device 24 is in particular a personal computer or a tablet ... equipped with one or more peripherals: reproduction interface(s) such as a screen 21 e and, where appropriate, a helmet 25 (comprising in particular a screen 21c and a sensor 22, such as a camera); input interface(s) such as a 23c keyboard, a 23s mouse, etc.
- reproduction interface(s) such as a screen 21 e and, where appropriate, a helmet 25 (comprising in particular a screen 21c and a sensor 22, such as a camera); input interface(s) such as a 23c keyboard, a 23s mouse, etc.
- the user U uses the helmet 25 to request access to a service or a product from an access provision device.
- the access provision device requires authentication auth req from the user U to the authentication device 241 according to the invention.
- the authentication device 241 receives at least one icd image. Then, the authentication device 61 checks whether the image relating to the real environment ir_erc (possibly consisting of the captured image received icd) corresponds to the reference datum dr_vm associated with the user U.
- the authentication device 241 activates the access provision device.
- the access provision device then gives access to the product or service to the virtual reality system 2 which reproduces the access provision using at least the headset 25.
- the virtual reality system 2 comprises a user recording device 247.
- the recording device 247 records a reference datum dr_vm in association with an identifier of the user uid for example in a user base (not shown).
- the authentication device 241 retrieves the dr_vm reference datum which it uses to implement the verification in the user base in which it was previously recorded in association with the user identifier uid by the recording device 247.
- FIG. 3 illustrates a simplified diagram of a method for registering a user U according to the invention.
- the registration process U_REG of a user U of a virtual reality headset CER comprises - storing MEM in association with an identifier uid of the user U of the virtual reality headset 2 a first reference datum dr_vm1, the first datum reference dr_vm1 corresponding to a relative image ir erc at least one element of a first real environment captured by the virtual reality headset 2 during recording.
- a reference datum dr_vm corresponding to a relative image ir erc has at least one element of a real environment.
- Figure 1 uses this generic notation rather than those associated with a first reference datum dr_vm1, a second reference datum dr_vm2... a lth reference datum dr vml , and respectively with a first, a second... a lth environment real.
- the captured image icm received by the recording method U_REG is stored MEM directly or indirectly. In the case where the captured image is stored directly, the reference datum dr_vm consists of the captured image icm.
- the recording process U_REG comprises, during a first use of the virtual reality headset 2 in a second real environment, a repetition of the memorization step for the user U for a second reference datum dr_vm2.
- the U_REG registration process includes
- the user registration process U_REG includes the creation of access ACC_CREA, in particular when the access process implements the steps of the registration process U_REG.
- the recording process includes a user identifier request UID_REQ which sends an identification message uid_mssg to the user U.
- the identification message uid_mssg is in particular capable of being reproduced by a reproduction interface.
- the user Following the reproduction of the identification message uid_mssg, the user provides an input interface, such as an input interface: keyboard, mouse, stylus, touch screen... or a sensor: camera, microphone... .a user identifier uid.
- the user identifier uid is in particular a name, a nickname, an email address, an identifier of the user's terminal such as a telephone number, etc.
- the U_REG recording method comprises an input of the user identifier UID_ENT receiving a signal uid_cpt from the input interface comprising a user identifier uid.
- the capture PIMG_CPT of at least image relative im to at least one element of a first real environment includes a request to supply the access code, also called authentication code, PIMG_REQ which sends a registration message an authentication code pimg mssg intended for the user U.
- the message for recording an authentication code pimg mssg is in particular capable of being reproduced by a reproduction interface.
- the recording method U_REG comprises a reception PIMG_REC of at least one captured image icm.
- the capture PIMG_CPT comprises the reception PIMG_REC of at least one captured image icm.
- the recording method U_REG comprises a modeling MD_GN of the captured image icm and/or of one or more elements present in the captured image icm.
- capture PIMG_CPT comprises modelization MD_GN.
- the recording process U_REG comprises image recognition IMG_RCG of the captured image icm and/or of one or more elements present in the captured image icm.
- the PIMG_CPT capture includes the IMG_RCG image recognition.
- the MD_GN modeling determines one or more models of the captured image and/or elements of the captured image as a function of irgd recognition data provided by the IMG_RCG image recognition.
- the IMG_RCG image recognition recognizes one or more elements of the captured image according to imd models provided by the MD_GN modeling.
- the PIMG_CPT capture provides a relative image im depending on the captured image received icm and/or the results imd, irgd of one or more treatments applied to this captured image received icm such as MD_GN modeling, image recognition IMG_RCG, etc
- the U_REG recording process includes a location capture LOC_CPT.
- a location capture LOC_CPT the U_REG recording process
- the recording process U_REG comprises a reception LOC_REC of a first location datum posml corresponding to the first real environment prior to the recording MEM of the first reference datum dr_vm1.
- the storage MEM then includes the recording of the first reference datum dr_vm1 and the first location datum posml in association with the user identifier uid.
- the first location datum posml and the first reference datum dr_vm1 are linked together in particular in the form of a couple.
- the location capture LOC_CPT comprises the reception of location data LOC_REC.
- the recording method U_REG comprises a request LOC_REQ for location data which sends a request pos_rq to the headset CER, in particular in the form of a command intended for a location sensor of the headset (GPS sensor, NFC sensor or sensor of QRCode, etc. for example).
- a location sensor of the headset GPS sensor, NFC sensor or sensor of QRCode, etc. for example.
- each real environment in particular each room of an office building, can be equipped with an NFC tag and/or equipped with a QRCode identification.
- the location capture LOC_CPT includes the location data request LOC_REQ.
- the recording method U_REG comprises a recording of the access code ACC_REG which comprises the storage MEM.
- the authentication device 1 according to the invention and/or an access provision device 62 implements the steps of the U_REG recording method.
- One embodiment of the U_REG registration method is in particular a program comprising program code instructions for the execution of the steps of the U_REG registration method and, optionally, of an authentication method when said program is executed by a processor.
- Figure 4 illustrates a simplified diagram of an authentication method according to the invention.
- the authentication method U_AUTH of a user U of a CER virtual reality headset comprises
- PIMG_VF if an image relative ir erc to at least one element of a real environment captured by the virtual reality headset CER corresponds to a dr_vm reference data stored in association with an identifier uid of the user U of the headset of virtual reality CER.
- the identifier uid of the user U is stored in association with several distinct reference data dr_vm1, dr_vm2...dr_vml corresponding to distinct real environments.
- the PIMG_VF check includes a comparison among the following:
- the authentication method U_AUTH comprises a determination PIMG_CLC of the relative image ir erc to at least one element of a real environment captured.
- the U_AUTH authentication process includes
- the U_AUTH authentication process includes
- the PIM_REC recovery of a captured image is a reception of an icd captured image transmitted by the helmet 2.
- the recovery of the relative image PIMG_CLC comprises the reception of the captured image PIMG_REC.
- the U_AUTH authentication method includes a request PIMG_REQ for providing the access code, also called authentication code, which sends a message for providing an authentication code pimg mssg to the user U
- the message for supplying an authentication code pimg mssg is in particular capable of being reproduced by a reproduction interface.
- the PIMG_REQ access code supply request is triggered pimg trg by the UID_ENT retrieval of the user identifier uid.
- the recovery PIMG_LD of at least one image relating to at least one element of a real environment captured ir erc comprises a request PIMG_REQ for supplying the access code, also called authentication code, which sends a message of guidance ig mssg intended for the user U.
- the guidance message ig mssg is in particular capable of being reproduced by a reproduction interface.
- the authentication method U_AUTH comprises a modeling MD_GN of the captured image icd and/or of one or more elements present in the captured image icd.
- determination PIMG_CLC comprises modelization MD_GN.
- the authentication method U_AUTH comprises image recognition IMG_RCG of the captured image icd and/or of one or more elements present in the captured image icd.
- the determination PIMG_CLC includes the image recognition IMG_RCG.
- the MD_GN modeling determines one or more models of the captured image and/or elements of the captured image as a function of irgd recognition data provided by the IMG_RCG image recognition.
- the IMG_RCG image recognition recognizes one or more elements of the captured image according to imd models provided by the MD_GN modeling.
- the PIMG_CPT capture provides a relative imd image depending on the received captured image icd and/or the imd, irgm results of one or more treatments applied to this received captured image icd such as MD_GN modeling, IMG_RCG image recognition, etc
- the U_AUTH authentication process includes
- the U_AUTH authentication process includes
- the - read DR_RD at least one dr_vm reference datum, the dr_vm reference datum being used by the PIMG_CMP verification.
- the reading DR_RD of a reference data item is performed according to the identifier of the user uid and, possibly a position picked up posd by the helmet 2.
- the recovery of reference data DR_LD comprises reading reference data.
- DR_RD reading is triggered dr trg by entering the user identifier UID_ENT.
- reading DR_RD sends a request for associated reference data dr_req ⁇ uid) to a memory device such as a user database BDU, also called user base, in which reference data has been previously stored.
- a memory device such as a user database BDU, also called user base, in which reference data has been previously stored.
- the DR_RD read receives reference data associated with dr_vm from the BDU user database.
- the DR_RD read transmits reference data associated pcr_vm read to the verification of the access code PIMG_VF.
- the request to supply the access code PIMG_REQ generates a guidance message ig mssg according to the reference data dr_vm read.
- the user U can be guided by the guide message ig mssg to obtain the relative images ir erc constituting the access code.
- a method for accessing a service or a device receives an access request acc_req (not shown).
- the access request triggers an authentication request auth req prior to providing access by the access method.
- the authentication method U_AUTH includes receiving an authentication request AUTH_REC (not shown).
- the authentication method U_AUTH includes a user identifier request UID_REQ which sends an identification message uid_mssg to the user U.
- the identification message uid_mssg is in particular able to be reproduced by a reproduction interface .
- the user identifier request UID_REQ is notably triggered by the authentication request auth req.
- the user Following the reproduction of the identification message uid_mssg, the user provides an input interface, such as an input interface: keyboard, mouse, stylus, touch screen... or a sensor: camera, microphone... .a user identifier uid.
- the user identifier uid is in particular a name, a nickname, an email address, an identifier of the user's terminal such as a telephone number, etc.
- the authentication method U_AUTH comprises an input of the user identifier UID_ENT receiving a signal uid_cpt from the input interface comprising a user identifier uid.
- the authentication process U_AUTH comprises a reception of at least one captured image PIMG_REC.
- PIMG_LD recovery includes the reception of at least one PIMG_REC captured image.
- the authentication process U_AUTH comprises a verification of the access code PIMG_VF which comprises the verification of reference data PIMG_CMP.
- the PIMG_COMP reference data check indicates a nauth authentication failure.
- the reference data check PIMG_COMP receives a stored reference data dr_vm from the read DR_RD.
- the nauth authentication failure terminates SPT_AUTH the U_AUTH authentication process.
- the STP_AUTH authentication closure sends a failure message reproduced by the CER headset to the user.
- the authentication closure STP_AUTH reinitializes the authentication process U_AUTH which then starts again with the user identifier request UID_REQ and/or the access code recovery PIMG_LD and/or the request to provide the authentication code PIMG_REQ.
- the successful authentication indication ok auth is provided to an AXP access method (not shown), in particular an AXP access method having sent the authentication request auth req to the authentication method U_AUTH.
- the successful authentication indication ok auth triggers validation of an AX_VLD access to a service or device.
- an AXP access method (not shown), such as an AXP access method having sent the authentication request auth req to the authentication method U_AUTH, comprises the access validation AX_VLD.
- the AX_VDL access validation controls ax_cmd the AXP access by the device requiring access, in our invention the first electronic device D', to a device or service.
- the authentication device 1 according to the invention and/or an access provision device 62 implements the steps of the authentication method U_AUTH.
- An embodiment of the U_AUTH authentication method is a program comprising program code instructions for the execution of the steps of the U_AUTH authentication method when said program is executed by a processor.
- FIGS 5a and 5b show the implementation of the authentication device 1, 21 according to the invention, in particular as illustrated by Figure 1, for different types of reference data.
- Figure 5a illustrates a simplified diagram of a first example of reference data used by the authentication device 1, 21 according to the invention.
- FIG. 5a illustrates the case where the reference data DR stored as access code in the user base 16 in association with the user identifier uid comprises an image of at least least a part of the environment or a modeling of a part of the environment, or even a plan of a part of the environment.
- the reference datum DR constituted by a modeling of the environment comprises a modeling of objects 01, 02, 03, 04, such as a window model F reproduced twice (for the first and second objects 01 and 02) on the plane of the reference datum DR of figure 5a, a sofa model M corresponding to the third object of the plane of the reference datum DR of figure 5a, and a door model P corresponding to the fourth object 04 of the reference datum DR of FIG. 5a.
- the user U wearing a virtual reality headset 2 identifies himself uid. Then, he positions himself in the environment to provide his access code in the form of an “image password” also called “environment fingerprint”.
- Camera 22 of helmet 2 photographs the real environment ER composed of a door PR, two windows FR1 and FR2 and a sofa MR.
- the ird image captured by the helmet 2 is transmitted to the authentication device 1 which has retrieved the reference data dr(uid) corresponding to the user.
- the authentication device 1 verifies whether these two pieces of information: reference datum dr(uid) corresponding to the user and captured image ird.
- the authentication device implements image recognition to compare the two pieces of information, or even models the captured image ird before comparing it to the reference data when the reference datum dr(uid) is a model.
- Figure 5b illustrates a simplified diagram of a second example of reference data used by the authentication device 1, 21 according to the invention.
- Figure 5b illustrates the case of an access code composed of a series of images or patterns taken in a predetermined order.
- the series of reference data previously stored in association with the user U indicates that the access code is a series of four images in our example.
- the user U is invited to provide his image access code without further indication.
- the user must, as with an alphanumeric password, remember the number of images used and each object stored in the access code.
- the authenticating user will place himself to photograph the component objects are image access code.
- he photographs by means of the camera 22 of the helmet 2 a window in a first time t0, a chair C in a second time t1, a painting in a third time t2 and a plant in a fourth time t3.
- the helmet 2 can be used with this same code in a real environment other than that used for the user's registration, provided that the objects are found. of the image access code in this new real environment.
- the user registers in his office where these four photographed elements are then modeled to serve as reference data for the memorized access code. Then, he uses his helmet in his living room: instead of the office window, he captures an image of the living room French window; instead of the desk chair, he picks up an armchair there; instead of the poster of a planisphere, he captures a picture of an impressionist painting; and instead of a cactus, he captures an image of a shrub or even a tree (through the window).
- the authentication device 1 receiving these four images successively, models them as a window, seat, table, plant and compares them to the reference data.
- the authentication is therefore successful and access is authorized.
- the user U can be guided to provide his image access code: number of images requested, see type of object.
- the authentication device can ask the user to photograph a window F, a chair C or a seat, a painting T or a detail of a painting, and a plant P either without specifying the order or in the required order.
- the reference data will preferably be composed of an image captured framed on the objects selected by the user to compose his access code in order to reinforce the security of the access code.
- the authenticating user will place himself to photograph the same window, the same chair, the same table and the same plant as when he registered.
- the authentication device 1 will for example perform image recognition to compare the images captured with the reference data.
- a real object allowing authentication is a personal object, such as a bag, a jewel, a tattoo, etc.
- a personal object such as a bag, a jewel, a tattoo, etc.
- the user will be able to authenticate everywhere since the authentication will be based on the capture of a personal object or even a series of personal objects or not.
- the user will be able to authenticate more quickly since, the object securing the authentication being personal, the capture of a single object will eventually suffice for authentication.
- the principle of the invention is to use a capture of reality possible on certain virtual reality headsets to manage to transparently authenticate the user.
- a virtual reality application asking to be authenticated
- the cameras start filming reality
- the application asks the user to look around.
- the application can represent in virtual reality the directions that the user's gaze must cover and those already observed.
- the application determines the properties of the room surrounding the user: position of the walls, color of these, position of the frames, position and size of flat surfaces such as desks or shelves, the position of screens, ... From this information, the application can define a partial map of the room surrounding the user.
- this map and a unique identifier of the headset are saved to create a fingerprint of this place, and the user associates it with his account (by identifying himself with a conventional means, other than the invention).
- mapping requires different precision depending on the recognized elements: a significant correspondence will for example be expected for the position or the color of the walls and furniture (desk or shelf type), while a certain displacement tolerance will for example be accepted for items like a screen
- the invention also relates to a support.
- the information carrier can be any entity or device capable of storing the program.
- the medium may include a storage medium, such as a ROM, for example a CD ROM or a microelectronic circuit ROM or else a magnetic recording medium, for example a floppy disk or a hard disk.
- the information medium can be a transmissible medium such as an electrical or optical signal which can be conveyed via an electrical or optical cable, by radio or by other means.
- the program according to the invention can in particular be downloaded onto a network, in particular of the Internet type.
- the information carrier may be an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the method in question.
- module can correspond either to a software component or to a hardware component.
- a software component corresponds to one or more computer programs, one or more sub-programs of a program, or more generally to any element of a program or software capable of implementing a function or a function set as described above.
- a hardware component corresponds to any element of a hardware assembly capable of implementing a function or a set of functions.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Computing Systems (AREA)
- Automation & Control Theory (AREA)
- User Interface Of Digital Computer (AREA)
- Collating Specific Patterns (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR2012408A FR3116919A1 (fr) | 2020-11-30 | 2020-11-30 | Dispositif et procédé d’authentification d’un utilisateur d’un casque de réalité virtuelle |
| PCT/FR2021/052118 WO2022112727A1 (fr) | 2020-11-30 | 2021-11-29 | Dispositif et procede d'authentification d'un utilisateur d'un casque de realite virtuelle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4252125A1 true EP4252125A1 (fr) | 2023-10-04 |
Family
ID=74592150
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP21840647.8A Pending EP4252125A1 (fr) | 2020-11-30 | 2021-11-29 | Dispositif et procédé d'authentification d'un utilisateur d'un casque de réalité virtuelle |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US12462009B2 (fr) |
| EP (1) | EP4252125A1 (fr) |
| CN (1) | CN116491106A (fr) |
| FR (1) | FR3116919A1 (fr) |
| WO (1) | WO2022112727A1 (fr) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN120317636B (zh) * | 2025-06-13 | 2025-09-05 | 南京安元达电子科技有限公司 | 一种基于图像识别的fpc柔性电路板智能生产系统 |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180060554A1 (en) * | 2016-08-31 | 2018-03-01 | Redrock Biometrics, Inc. | Blue/violet light touchless palm print identification |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9811650B2 (en) * | 2014-12-31 | 2017-11-07 | Hand Held Products, Inc. | User authentication system and method |
| EP3502939B1 (fr) * | 2016-08-19 | 2023-06-14 | Tencent Technology (Shenzhen) Company Limited | Procédé d'authentification basé sur une scène de réalité virtuelle, dispositif de réalité virtuelle et support de stockage |
| US11273236B2 (en) * | 2016-09-07 | 2022-03-15 | Case Western Reserve University | Engineered tissue constructs |
| CN206301289U (zh) * | 2016-11-29 | 2017-07-04 | 阿里巴巴集团控股有限公司 | Vr终端设备 |
| CN106873159A (zh) * | 2017-02-27 | 2017-06-20 | 阿里巴巴集团控股有限公司 | 虚拟现实头戴设备 |
| CN107122642A (zh) * | 2017-03-15 | 2017-09-01 | 阿里巴巴集团控股有限公司 | 基于虚拟现实环境的身份认证方法及装置 |
| CN107508826B (zh) * | 2017-09-14 | 2020-05-05 | 阿里巴巴集团控股有限公司 | 基于vr场景的认证方法、装置、vr终端及vr服务端 |
| JP2019105885A (ja) * | 2017-12-08 | 2019-06-27 | セイコーエプソン株式会社 | 頭部装着型表示装置、情報処理装置、情報処理システム、及び頭部装着型表示装置の制御方法 |
| FR3081572A1 (fr) * | 2018-06-22 | 2019-11-29 | Orange | Procede et systeme d'authentification d'un utilisateur porteur d'un dispositif d'immersion |
| US11830318B2 (en) * | 2019-10-31 | 2023-11-28 | 8 Bit Development Inc. | Method of authenticating a consumer or user in virtual reality, thereby enabling access to controlled environments |
| US11606697B2 (en) * | 2020-08-03 | 2023-03-14 | Bank Of America Corporation | Electronic system for construction and detection of spatial movements in a VR space for performance of electronic activities |
-
2020
- 2020-11-30 FR FR2012408A patent/FR3116919A1/fr not_active Ceased
-
2021
- 2021-11-29 EP EP21840647.8A patent/EP4252125A1/fr active Pending
- 2021-11-29 CN CN202180079248.XA patent/CN116491106A/zh active Pending
- 2021-11-29 WO PCT/FR2021/052118 patent/WO2022112727A1/fr not_active Ceased
- 2021-11-29 US US18/254,967 patent/US12462009B2/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180060554A1 (en) * | 2016-08-31 | 2018-03-01 | Redrock Biometrics, Inc. | Blue/violet light touchless palm print identification |
Also Published As
| Publication number | Publication date |
|---|---|
| US20240012898A1 (en) | 2024-01-11 |
| FR3116919A1 (fr) | 2022-06-03 |
| US12462009B2 (en) | 2025-11-04 |
| WO2022112727A1 (fr) | 2022-06-02 |
| CN116491106A (zh) | 2023-07-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230188521A1 (en) | Secure authorization for access to private data in virtual reality | |
| US11017070B2 (en) | Visual data processing of response images for authentication | |
| JP6494119B2 (ja) | モバイル装置に接続して電子キーを供給し、アクセスを管理するためのシステムおよび方法 | |
| RU2735617C2 (ru) | Способ, устройство и система отображения информации | |
| CN113014863B (zh) | 认证用户的方法及系统以及计算机可读记录介质 | |
| US9479914B2 (en) | Intuitive computing methods and systems | |
| US12118069B1 (en) | Real-world object-based image authentication method and system | |
| US10579783B1 (en) | Identity authentication verification | |
| TW202008197A (zh) | 身份驗證及帳戶資訊變更方法和裝置 | |
| US20230162439A1 (en) | Methods and systems for provisioning a virtual experience based on reaction data | |
| US11977714B2 (en) | Methods and systems for provisioning a collaborative virtual experience | |
| WO2019017178A1 (fr) | Procédé et appareil d'identification dynamique d'un utilisateur d'un compte pour l'affichage d'images | |
| WO2022151667A1 (fr) | Procédé et appareil de traitement de ressources, et dispositif électronique, support de stockage et produit-programme informatique | |
| WO2023049081A1 (fr) | Techniques pour fournir un trousseau numérique pour des objets physiques | |
| WO2022112727A1 (fr) | Dispositif et procede d'authentification d'un utilisateur d'un casque de realite virtuelle | |
| US10572636B2 (en) | Authentication by familiar media fragments | |
| US11232638B1 (en) | System and method for creating links to superimposable digital media content messages viewable on an electronic device | |
| US12189732B1 (en) | Audio token-based authentication method and system | |
| US12118140B2 (en) | Methods and systems for provisioning a virtual experience based on user preference | |
| KR102527809B1 (ko) | 예술작품 관련 음원 제공 방법 | |
| FR3111503A1 (fr) | Dispositif et procédé d’authentification d’un utilisateur d’un premier dispositif électronique connecté à un deuxième dispositif électronique | |
| FR3136082A1 (fr) | Procédé de gestion de la restitution d’au moins un contenu par un terminal, terminal et programme d’ordinateur correspondants. |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20230608 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| RAP3 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: ORANGE |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Free format text: PREVIOUS MAIN CLASS: G06F0021310000 Ipc: H04L0009400000 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04L 12/28 20060101ALI20250604BHEP Ipc: H04L 9/40 20220101AFI20250604BHEP |
|
| 17Q | First examination report despatched |
Effective date: 20250624 |