JP7339569B2 - Head-mounted display device, authentication method, and authentication program - Google Patents

Description

The present invention relates to a head-mounted display device, an authentication method, and an authentication program.

User authentication may be performed when activating an information processing apparatus or when accessing a computer network or the like. Only when this user authentication is successful, use of the information processing device and access to the computer network are allowed.

For user authentication, for example, input of a password via a keyboard is required. However, user authentication with higher security has also been developed in order to prevent leakage of passwords by using a keyboard.

As user authentication with high security, Patent Document 1 discloses that the line of sight of a user gazing at an image displayed on a screen is detected, the image that the user is gazing at is detected based on the line of sight, and the detected image is authenticated. A display system is disclosed that performs user authentication as information.

JP-A-2005-149326

In recent years, a head mount display (HMD), in which a display is mounted on the user's head, has started to spread. In head-mounted display devices, it is assumed that user authentication that detects the line of sight of the user as described in Patent Document 1 will be used, but authentication with higher security is required.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a head-mounted display device, an authentication method, and an authentication program capable of performing authentication with higher security.

In order to solve the above problems, the head-mounted display device, authentication method, and authentication program of the present invention employ the following means.

In order to solve the above problems, a "head-mounted display device" according to one aspect of the present invention is a head-mounted display device in which a display is mounted on the user's head so that the user can visually recognize the display. face direction detection means for detecting the user's face direction; sight line detection means for detecting the user's line of sight; and an authentication object used for authentication is displayed in the image display area according to the user's operation, and the line-of-sight detection means detects that the user's line of sight is aligned with the authentication object. and authentication means for performing authentication when detected.

In order to solve the above-described problems, an "authentication method" according to one aspect of the present invention provides a face orientation method that detects the orientation of the user's face by attaching a display to the user's head so that the user can visually recognize the orientation. An authentication method for a head-mounted display device comprising detection means and line-of-sight detection means for detecting a line-of-sight of said user, wherein an object is displayed in an image display area of said display according to a detection result by said face direction detection means. and an authentication object used for authentication is displayed in the image display area according to the user's action, and the line-of-sight detecting means detects that the user's line of sight is aligned with the authentication object. and a second step of authenticating if the

In order to solve the above-described problems, an "authentication program" according to one aspect of the present invention includes a display mounted on the user's head so that the user can visually recognize the face orientation for detecting the orientation of the user's face. A head-mounted display device having detection means and a line-of-sight detection means for detecting the user's line of sight changes an object displayed in an image display area of the display according to a detection result by the face direction detection means. and an authentication object used for authentication is displayed in the image display area according to the user's operation, and the line-of-sight detecting means detects that the user's line of sight is aligned with the authentication object. It functions as an authentication means for performing authentication in the case.

Various technical limitations may be added to the above "head-mounted display device" as exemplified below. Also, technical limitations to the same effect may be added to the processing steps performed by the "authentication method" and the functions of the "authentication program".

The authentication object is not displayed in the image display area at the start of authentication, but is displayed in the image display area by the user's operation.

An authentication display area is set in the image display area, and the authentication means causes the authentication object to be displayed in the authentication display area in accordance with an action of the user, and the user's line of sight to the authentication object. Authentication is performed when the line-of-sight detecting means detects that

The user's action is the user's turning of the face or the user's movement of the authentication object.

The authentication means performs authentication based on a detection result by the line-of-sight detection means and a detection result by the face direction detection means.

The authentication object is displayed on the display when a real, pre-registered identifying object is displayed on the display.

The authentication object is an existing identifier displayed on the display.

The authentication means starts an authentication operation when it is detected that the user looks at the authentication object for a predetermined time or more, and detects that the user looks away from the authentication object for a predetermined time or more. Assume that the user ends the authentication operation when

The authentication means starts or ends the authentication operation when the user blinks a predetermined number of times or more within a predetermined period of time.

The authentication means starts or ends the authentication operation when it is detected that the user has made a predetermined movement of the head.

Advantageous Effects of Invention According to the present invention, it is possible to perform authentication with higher security using a head-mounted display.

1 is a configuration diagram of a display system according to a first embodiment of the present invention; FIG. FIG. 3 is a schematic diagram showing an image display area of the HMD according to the first embodiment of the present invention; 1 is a functional block diagram showing an electrical configuration of an HMD according to a first embodiment of the invention; FIG. FIG. 4 is a schematic diagram showing user authentication using the HMD according to the first embodiment of the present invention; FIG. 4 is a schematic diagram showing an authentication display area according to the first embodiment of the present invention; 4 is a flow chart showing the flow of user authentication processing according to the first embodiment of the present invention; FIG. 10 is a schematic diagram showing user authentication using the HMD according to the second embodiment of the present invention; FIG. 11 is a schematic diagram showing user authentication using an HMD according to the third embodiment of the present invention; FIG. 11 is a functional block diagram showing the electrical configuration of an HMD according to a third embodiment of the invention; It is a flow chart which shows a flow of user authentication processing concerning a 3rd embodiment of the present invention.

An embodiment of a head-mounted display device, an authentication method, and an authentication program according to the present invention will be described below with reference to the drawings.

[1. First Embodiment]
A first embodiment of the present invention will be described below.

[1-1. Configuration of display system]
FIG. 1 is a configuration diagram of a display system 10 according to this embodiment.

The display system 10 includes a head mounted display (Head Mount Display, hereinafter referred to as “HMD”) 12 and a server 14 .

The HMD 12 is provided with a display 16 such as an LCD (Liquid Crystal Display) on the user's head so that the user can visually recognize it. The display 16 is fixed to the user's head by an elastic band 18, as an example.

The appearance of the HMD 12 shown in FIG. 1 is an example, and the display 16 is positioned in front of both eyes. Also, the image may be viewed with one eye instead of the one with both eyes. Also, the HMD 12 may be of a transmissive type that allows the user to see the outside world or a non-transmissive type that does not allow the user to see the outside world. The image displayed on the display 16 by the HMD 12 may be virtual reality (VR) or augmented reality (AR). Note that VR is displayed on the display 16 of the HMD 12 according to this embodiment.

The HMD 12 and server 14 can transmit and receive information via a communication line 20 . The HMD 12 may have a communication function for directly accessing the communication line 20, or may access the communication line 20 via another information processing device such as a mobile phone terminal.

The server 14 stores various information such as programs to be executed by the HMD 12, and transmits/receives information to/from the HMD 12 as necessary.

As shown in FIG. 2, the HMD 12 is provided with an image display area 22 on the display 16 so as to cover the user's field of vision. Various images (also called objects) are displayed in the image display area 22 . Note that the image display area 22 according to the present embodiment substantially matches the visual field range of the user wearing the HMD 12 .

The HMD 12 according to the present embodiment performs user authentication when the user activates the HMD 12, and allows user operations when the user authentication is successful. An authentication object 24 that is an object used for user authentication is displayed in the image display area 22 . User authentication is performed when the line-of-sight detection unit 32 (see FIG. 3) provided in the HMD 12 detects that the user's line of sight is aligned with the authentication object 24 .

As an example, the authentication object 24 according to the present embodiment is formed of a plurality of elements (hereinafter referred to as “authentication elements”) 26 that are regarded as successful authentication when at least one or more of them are visually recognized. Further, in user authentication according to the present embodiment, authentication is successful when a plurality of authentication elements 26 are visually recognized in a predetermined order. Alternatively, the condition for successful authentication may be the length of time the user continues to visually recognize the authentication element 26 . Note that the authentication object 24 may be a single image instead of being formed by a plurality of authentication elements 26 .

[1-2. Functional block diagram of HMD]
FIG. 3 is a functional block diagram showing the electrical configuration of the HMD 12 according to this embodiment.

In addition to the display 16 , the HMD 12 includes a face orientation detection section 30 , a line of sight detection section 32 , a main control section 34 , a storage section 36 and a communication section 38 .

The face direction detection unit 30 includes, for example, an acceleration sensor and a gyro sensor, and detects the face direction of the user wearing the HMD 12 .

The line-of-sight detection unit 32 includes, for example, a camera that captures an image of the user's eye, and detects the user's line of sight based on the result of capturing the image of the user's eye.

The main control unit 34 is, for example, a CPU (Central Processing Unit), a microprocessor, a DSP (Digital Signal Processor), etc., and controls the operation of the entire HMD 12 .

The storage unit 36 is composed of, for example, a RAM (Random Access Memory), a DRAM (Dynamic Random Access Memory), a flash memory, or the like, and is used as a work area when executing processing based on various programs by the main control unit 34, Various data such as images and programs used for processing by the main control unit 34 are stored.

The communication unit 38 has a function of connecting to the communication line 20, and is, for example, a NIC (Network Interface Controller), and connects to a communication network such as a mobile phone network. Note that the communication unit 38 has a function of connecting to a wireless LAN (Local Area Network), a function of connecting to a wireless WAN (Wide Area Network), a function of connecting to a wireless LAN (Local Area Network), a function of connecting to a wireless WAN (Wide Area Network), or a short-range communication such as Bluetooth (registered trademark), instead of or together with the NIC. It may have a function of enabling wireless communication, infrared communication, and the like.

The display 16, face orientation detection unit 30, line of sight detection unit 32, main control unit 34, storage unit 36, and communication unit 38 are electrically connected to each other via a system bus. Therefore, the main control unit 34 displays an image on the display 16, performs various processes using the detection results of the face direction detection unit 30 and the line of sight detection unit 32, accesses the storage unit 36, and performs various communications via the communication unit 38. Access to the network and other terminals can be performed. In addition to the above configuration, the HMD 12 is provided with a speaker and an earphone jack for outputting sound, a USB (Universal Serial Bus) connector for transmitting and receiving data to and from other information processing devices, and the like.

Also, the HMD 12 can be connected to a controller by wire or wirelessly, and can be operated by a user using the controller.

The main controller 34 includes an image display controller 40 and an authentication processor 42 . Each unit included in the main control unit 34 is implemented by a program stored in the storage unit 36 .

The image display control unit 40 outputs data indicating an image (object) to be displayed in the image display area 22 to the display 16 . Also, the image display control unit 40 changes the object displayed in the image display area 22 according to the detection result of the face direction detection unit 30 .

The authentication processing unit 42 executes processing related to user authentication.

[1-3. User authentication according to the first embodiment]
User authentication according to this embodiment will be described.

User authentication according to the present embodiment is performed when the authentication object 24 is displayed in the image display area 22 according to the user's action, and the line-of-sight detection unit 32 detects that the user's line of sight is aligned with the authentication object 24. Authenticate.

FIG. 4 is a schematic diagram showing user authentication according to the present embodiment, and schematically shows an image space 44 displayed by the HMD 12. As shown in FIG. Since the HMD 12 according to this embodiment displays virtual reality (VR), the image space 44 shown in FIG. 4 is a VR space. A region surrounded by a dashed line in FIG. 4 is the entire image space 44 that can be visually recognized by the user wearing the HMD 12 by moving the head. On the other hand, the area surrounded by solid lines is the image space 44 displayed in the image display area 22, which is the area actually viewed by the user wearing the HMD 12. FIG.

As shown in FIG. 4A, although the authentication object 24 exists in the image space 44, it is not displayed in the image display area 22 when user authentication starts. Therefore, the user causes the authentication object 24 existing in the image space 44 to be displayed in the image display area 22 as shown in FIG. 4B by changing the direction of the face.

Furthermore, in the user authentication according to this embodiment, an authentication display area 22A is set in the image display area 22. FIG. The image display area 22 is pseudo-divided into an authentication display area 22A and a non-authentication display area 22B, as shown in FIG. User authentication is performed when the authentication object 24 is displayed in the authentication display area 22A.

When the authentication object 24 is displayed in the image display area 22, a display prompting the user to display the authentication object 24 in the authentication display area 22A may be performed. For example, the HMD 12 blinks the authentication display area 22A, displays characters or arrows, or makes an audio announcement to prompt the user to put the authentication object 24 into the authentication display area 22A.

Also, the division of the authentication display area 22A shown in FIG. 5 is an example, and other divisions may be used. Further, the non-authentication display area 22B may not be provided in the image display area 22, and the entire image display area 22 may be the authentication display area 22A.

Then, the HMD 12 determines whether or not the authentication is successful depending on whether or not the result of line-of-sight detection by the line-of-sight detection unit 32 matches the registered line-of-sight information for authentication. The authentication line-of-sight information is generated when the user visually recognizes the authentication object 24 in order to register the information, and is stored in advance in the storage unit 36 .

[1-4. Determination of start or end of authentication operation]
Next, the start or end of authentication operation by the user will be described.

For example, the authentication processing unit 42 starts the authentication operation when the user performs a predetermined operation on the controller connected to the HMD 12, and ends the authentication operation when the user performs another predetermined operation on the controller. do. Note that the predetermined operation on the controller is, for example, clicking a predetermined button.

Then, the line-of-sight detection unit 32 starts detecting the user's line of sight after the authentication processing unit 42 receives the start of the authentication operation by the user. Further, the line-of-sight detection unit 32 ends the user's line-of-sight detection after the authentication processing unit 42 receives the end of the authentication operation by the user. After that, the authentication processing unit 42 determines whether or not the user authentication is successful based on the sight line detection result by the sight line detection unit 32 .

It should be noted that the start or end of the authentication operation by the user may be determined based on the detection result by the line-of-sight detection unit 32 or the face direction detection unit 30 instead of the predetermined operation on the controller.

For example, the authentication processing unit 42 starts the authentication operation by the user when the line-of-sight detection unit 32 detects that the user has directed the line of sight to the authentication object 24 for a predetermined time or longer. Then, the authentication processing unit 42 terminates the user's authentication operation when the line-of-sight detecting unit 32 detects that the user's line of sight is averted from the authentication object 24 for a predetermined period of time or longer. Note that the predetermined time is not the time during which the user unconsciously directs or averts his or her line of sight, but is the time during which it can be determined that the user intentionally performed the action, and is, for example, several seconds.

Further, the authentication processing unit 42 starts or ends the authentication operation when the line-of-sight detection unit 32 detects that the user blinks a predetermined number of times or more within a predetermined time. The predetermined number of times or more within a predetermined period of time is the number of times that can be determined to be the user's intentional blinks, not the user's unconscious blinks. For example, three or more blinks within one second. be.

Further, the authentication processing unit 42 starts or ends the authentication operation when the face orientation detection unit 30 detects that the user has made a predetermined movement of the head. The predetermined motion is, for example, a predetermined number of times in a predetermined direction in a predetermined time, and is the number of times that can be determined to be a motion performed intentionally by the user, not a motion performed unconsciously by the user. For example, it tilts to the right twice per second.

Further, the authentication processing unit 42 starts the authentication operation by the user when it is detected by the line-of-sight detection unit 32 that the user has turned his/her line of sight to a predetermined object displayed on the display 16 for a predetermined time or longer. The user's authentication operation may be terminated when the line-of-sight detection unit 32 detects that the user has directed his line of sight to the object for a predetermined time or longer.

It should be noted that determination of the start or end of any authentication operation is made when the authentication object 24 is displayed in the authentication display area 22A. In addition, when the HMD 12 receives an action indicating the start or end of the authentication operation by the user, the HMD 12 notifies that fact (hereinafter referred to as "authentication start notification" or "authentication end notification"). The authentication start notification or authentication end notification is, for example, displaying a predetermined image on the display 16 or outputting a predetermined sound.

The user recognizes that the authentication operation can be performed by receiving the authentication start notification. Moreover, the user can recognize that the HMD 12 has accepted the authentication operation performed by the user by receiving the authentication end notification.

As described above, the HMD 12 according to the present embodiment accepts the start or end of the authentication operation when the user performs a predetermined action. As a result, the user can perform user authentication at his or her own timing, and erroneous detection of the line of sight performed in user authentication is prevented.

[1-5. User authentication process according to the present embodiment]
FIG. 6 is a flow chart showing the flow of user authentication processing executed by the main control unit 34. A program for executing the user authentication processing is stored in a predetermined area of the storage unit 36 in advance. Note that the user authentication process according to the present embodiment is executed, for example, when the user activates the HMD 12 .

First, at step 100, it is determined whether or not the authentication object 24 is displayed in the authentication display area 22A. Note that the authentication object 24 is not displayed in the authentication display area 22A when the HMD 12 is activated. Therefore, the user moves the head to display the authentication object 24 in the authentication display area 22A.

At step 102, the authentication processing unit 42 determines whether or not the user has performed a predetermined action indicating the start of the authentication operation. In addition, in the case of an affirmative determination, the authentication processing unit 42 notifies the start of authentication.

In step 104, the line-of-sight detection unit 32 performs line-of-sight detection for user authentication.

In the next step 106, the authentication processing unit 42 determines whether or not the user has performed a predetermined action indicating the end of the authentication operation. back to In addition, in the case of an affirmative determination, the authentication processing unit 42 notifies the completion of authentication.

In step 108, the authentication processing unit 42 executes authentication based on the result of line-of-sight detection, after which the user authentication process ends. Specifically, the success or failure of authentication is determined by whether or not the result of line-of-sight detection for the authentication object 24 matches the registered line-of-sight information for authentication. If the authentication succeeds, the user can operate the HMD 12 . On the other hand, if the user authentication fails, the process returns to step 100 and the user authentication process is performed again.

As described above, the HMD 12 according to this embodiment includes the face orientation detection unit 30 that detects the orientation of the user's face, and the line-of-sight detection unit 32 that detects the user's line of sight. , the object displayed in the image display area 22 of the display 16 is changed. Then, the HMD 12 displays the authentication object 24 in the image display area according to the user's operation, and performs user authentication when the line-of-sight detection unit 32 detects that the user's line of sight is aligned with the authentication object 24 .

In this manner, the HMD 12 according to the present embodiment searches for the authentication object 24 and causes the display 16 to display the authentication object 24 by the user moving his/her head. Then, the HMD 12 performs user authentication by detecting the line of sight of the user matched with the displayed authentication object 24, so authentication with higher security can be performed.

Also, the authentication object 24 may be pseudo-movable by the user. In the case of this form, for example, when the authentication object 24 is displayed in the non-authentication display area 22B, the user virtually holds the authentication object 24 by hand and moves the authentication object 24 to the authentication display area 22A. move to The operation of grabbing the authentication object 24 may be performed via a controller connected to the HMD 12 .

Also, a plurality of authentication objects 24 may exist in the image space 44 . In the case of this form, only one of the plurality of authentication objects 24 is registered in advance to be used for user authentication. By moving the user's head, the user finds one registered authentication object 24 and displays it on the display 16 for user authentication.

Also, the authentication object 24 may be moved. In this form, for example, a plurality of authentication objects 24 are displayed on the display 16 while moving. By moving the user's head, the user finds one registered authentication object 24 and displays it on the display 16 for user authentication.

[2. Second Embodiment]
A second embodiment of the present invention will be described below.

[2-1. Configuration of HMD according to Second Embodiment]

The configurations of the display system 10 and the HMD 12 according to the second embodiment are the same as the configurations of the display system 10 and the HMD 12 according to the first embodiment shown in FIGS. 1 to 3, so description thereof will be omitted.

[2-2. User authentication according to the second embodiment]
The authentication processing unit 42 according to the present embodiment performs user authentication based on the result of line-of-sight detection by the line-of-sight detection unit 32 and the face direction detection result by the face direction detection unit 30 . That is, the conditions for user authentication to be successful are that the user visually recognizes the authentication object 24 and that the face orientation is the orientation that has been registered in advance.

The directions registered in advance are, for example, up, down, right, and left. In the example of FIG. 7, authentication is successful when the direction of the face detected by the face detection unit 30 and the direction of the line of sight detected by the line of sight detection unit 32 are opposite to each other.

As a result, the HMD 12 according to this embodiment can perform user authentication with higher security.

[3. Third Embodiment]
A third embodiment of the present invention will be described below.

[3-1. Configuration of HMD According to Third Embodiment]

The configurations of the display system 10 and the HMD 12 according to this embodiment are the same as the configurations of the display system 10 and the HMD 12 according to the first embodiment shown in FIGS.

The image displayed on the display 16 by the HMD 12 according to this embodiment is AR. For this reason, a camera 56 whose details will be described later is provided on the front surface of the HMD 12 and acquires an image (hereinafter referred to as a "real space image") of the surroundings of the user wearing the HMD 12 (hereinafter referred to as a "real space"). AR is realized by displaying an object together with a real space image on the display 16 .

[3-2. User authentication according to the third embodiment]
As shown in FIG. 8, the HMD 12 according to the present embodiment displays the authentication object 24 when the pre-registered identifying object (hereinafter referred to as "registered identifying object") 50 is displayed on the display 16. 16. The registered identifying object 50 is, for example, an existing object or the like, and characteristic portions such as shape and color for specifying the registered identifying object 50 are stored in the storage unit 36 . The characteristic portion of the registered identifying object 50 is extracted by performing image analysis on the real space image acquired when registering the registered identifying object 50 .

In the example of FIG. 8, the registered identifier 50 is the monitor 54 placed on the desk 52 , and when the monitor 54 is displayed on the display 16 , the authentication object 24 is displayed on the display 16 . In other words, the initial position of the authentication object 24 is predetermined in real space. That is, the authentication object 24 does not exist in the image space until the registered identifier 50 is displayed in the authentication display area 22A. Therefore, when the registered identifying object 50 is not displayed on the display 16, the user causes the registered identifying object 50 to be displayed on the display 16 by moving the head.

Note that the registered identifier 50 shown in FIG. 8 is an example, and may be other objects such as a clock and a window, but an object whose position does not change in real space is preferable. Also, in the example of FIG. 8, the authentication object 24 is displayed superimposed on the registered identifier 50, but it is not necessary to superimpose them.

When the authentication object 24 is displayed on the display 16, the user moves the head so that the authentication object 24 is displayed in the authentication display area 22A. After displaying the authentication object 24 in the authentication display area 22A, the user performs user authentication by matching the line of sight with the authentication object 24 .

If the registered identifier 50 disappears from the display 16 by moving the user's head after the authentication object 24 is displayed on the display 16, the HMD 12 removes the displayed authentication object 24 from the display 16. It may be hidden, or the authentication object 24 may continue to be displayed to enable user authentication.

FIG. 9 is a functional block diagram showing the electrical configuration of the HMD 12 according to this embodiment. 9 that are the same as those in FIG. 3 are denoted by the same reference numerals as in FIG. 3, and description thereof will be omitted.

The camera 56 is provided on the front surface of the HMD 12 and acquires a real space image of the surroundings of the user.

The image display control unit 40 causes the display 16 to display the real space image acquired by the camera 56 in real time, and causes the display 16 to display a non-existent image (object) superimposed on the real space image.

The camera image analysis unit 58 identifies the object captured by the camera 56 by performing image analysis or the like on the real space image. That is, the real space image is analyzed while being displayed on the display 16 .

The authentication processing unit 42 determines whether or not the object specified by the camera image analysis unit 58 matches the registered identifier 50 by image matching or the like. That is, when the real space image includes an object that matches the registered identifying object 50, the authentication processing unit 42 determines that the registered identifying object 50 is displayed on the display 16, and displays the authentication object 24 on the display. 16.

FIG. 10 is a flowchart showing the flow of user authentication processing according to this embodiment. 10 that are the same as those in FIG. 6 are denoted by the same reference numerals as those in FIG. 6, and the description thereof is partially or wholly omitted.

First, in step 200, the authentication processing unit 42 determines whether or not the registered identifying object 50 is displayed on the display 16, in other words, whether or not the camera 56 has captured an image of the registered identifying object. 202. Note that if the HMD 12 is of a transmissive type and the determination in step 200 is affirmative, the actual registration identifying object 50 is imaged in a predetermined area (for example, the central area) of the imaging range of the camera 56 and is transmitted through the display 16. In this state, the user is directly viewing the identifying object 50 . That is, if the HMD 12 is of a transmissive type, the image captured by the camera 56 may not be displayed on the display 16 .

At step 202 , the authentication processing unit 42 causes the display 16 to display the authentication object 24 , and the process proceeds to step 100 .

From step 100 to step 108, the same processing as the user authentication processing according to the first embodiment is performed. If the user authentication fails, the process returns to step 200 and the user authentication process is performed again.

As described above, the HMD 12 according to the present embodiment realizes AR by displaying an object together with a real space image on the display 16. When the registered identifying object 50 is displayed on the display 16, Display the authentication object 24 on the display 16 .

As a result, the HMD 12 according to this embodiment can perform user authentication with higher security.

A plurality of registered identifiers 50 are registered in advance, and the registered identifiers 50 used for user authentication may be changed for each user authentication or every predetermined number of days. When the registered identifier 50 used for user authentication is changed, information regarding the changed registered identifier 50 is notified to the user's pre-registered e-mail address or the like.

Further, the registered identifier 50 is not limited to an object such as the monitor 54, but may be an identification code such as a bar code or a QR code (registered trademark), a predetermined image, or the like. These identification codes and images may be printed on paper or the like, or may be displayed on a monitor of a personal computer, a mobile information terminal, or the like.

Also, the registered identifying object 50 may be a virtual object displayed on the display 16 instead of an existing object. In this form, the user moves to the registered identifying object 50 in the VR space and causes the display 16 to display it, or holds the registered identifying object 50 in the VR space and causes the display 16 to display it.

Also, the real or virtual registered identifier 50 itself may be the authentication object 24 . In this case, user authentication is performed when the registered identifier 50 is displayed in the authentication display area 22A. Further, when the HMD 12 is of a transmissive type, the user authentication may be performed when the actual registered identifier 50 is imaged in a predetermined area (for example, central area) of the imaging range of the camera 56 .

[4. Other embodiments]
As described above, the present invention has been described using each of the above-described embodiments, but the technical scope of the present invention is not limited to the scope described in the above-described embodiments. Various modifications or improvements can be made to each of the above-described embodiments without departing from the scope of the invention, and the modified or improved forms are also included in the technical scope of the present invention. Also, the above embodiments may be combined as appropriate.

For example, in each of the above embodiments, the HMD 12 includes the authentication processing unit 42 , but the present invention is not limited to this, and the server 14 may include the authentication processing unit 42 . In this form, the detection result detected by the HMD 12 for user authentication is transmitted to the server 14 , and the server 14 performs user authentication based on the received detection result and transmits the authentication result to the HMD 12 .

Further, in each of the above-described embodiments, a mode has been described in which authentication according to the present invention is applied to user authentication performed when the HMD 12 is activated, but the present invention is not limited to this. It may also be applied to user authentication that occurs at the start of software that Also, it may be applied to authentication in a game executed by the HMD 12 . In a form applied to authentication of a game, the HMD 12 performs authentication when it detects that the eyes are aligned with the authentication object 24, and even if a predetermined event occurs when the authentication is successful. good.

In the first and second embodiments, the HMD 12 displays VR, but the present invention is not limited to this, and the HMD 12 may display AR.

Further, the flow of user authentication processing described in each of the above embodiments is also an example, and unnecessary steps may be deleted, new steps added, or the processing order changed within the scope of the present invention. You may

12 HMD (head-mounted display device)
16 display 22 image display area 22A authentication display area 24 authentication object 30 face direction detector (face direction detector)
32 line-of-sight detection unit (line-of-sight detection means)
40 Image display control unit (image display control means)
42 authentication processing unit (authentication means)

Claims (6)

comprising a camera, a display, a processor,
The processor superimposes an object associated with a position in the real space on an image of the real space captured by the camera and causes the display to display the image;
The processor arranges an authentication object used for user authentication outside an authentication area of the display before user authentication,
The processor enables a user authentication operation when the authentication object is displayed in the authentication area,
The processor performs the user authentication when the user authentication operation is possible.
Device. The processor arranges the authentication object in an area not displayed on the display before user authentication.
A device according to claim 1 . The processor changes a display mode of the authentication area when the authentication object is displayed on the display.
3. Apparatus according to claim 2. The display includes the authentication area and a non-authentication area that is not the authentication area,
The processor
disposing the authentication object in the non-authentication area before user authentication;
enabling a user authentication operation when the authentication object is moved to the authentication area by a user's operation;
A device according to claim 1 . a device comprising a camera, a display, and a processor,
superimposing an object associated with a position in the real space on the image of the real space captured by the camera and displaying the image on the display;
Placing an authentication object used for user authentication outside the authentication area of the display before user authentication;
enabling a user authentication operation when the authentication object is displayed in the authentication area;
performing the user authentication when the user authentication operation is possible;
A program for executing a process. A device comprising a camera, a display, and a processor,
superimposing an object associated with a position in the real space on the image of the real space captured by the camera and displaying the image on the display;
Placing an authentication object used for user authentication outside the authentication area of the display before user authentication;
enabling a user authentication operation when the authentication object is displayed in the authentication area;
performing the user authentication when the user authentication operation is possible;
An information processing method characterized by :

Images