WO2019135620A1

WO2019135620A1 - Hmd device and control method therefor

Info

Publication number: WO2019135620A1
Application number: PCT/KR2019/000099
Authority: WO
Inventors: 심우철; 정진영
Original assignee: 삼성전자주식회사
Priority date: 2018-01-04
Filing date: 2019-01-03
Publication date: 2019-07-11
Also published as: KR102411909B1; KR20190083510A

Abstract

An HMD device and a control method therefor are disclosed. The HMD device comprises a communication unit, a display, and a processor configured to control a display to display a second decryption UI on the basis of a first decryption UI displayed on an electronic device when a decryption request for an external electronic device is received, to receive, from the electronic device, the object information selected from the first decryption UI through the communication unit, and to transmit, to the electronic device, a decryption command through the communication unit if the object included in the second decryption UI that is mapped to the received object information matches the pre-stored decryption information, wherein the second decryption UI is a UI in which the display positions of the objects included in the first decryption UI are rearranged.

Description

HMD device and control method thereof

The present disclosure relates to an HMD device and a control method thereof, and more particularly to an HMD device and a control method thereof that perform communication with an external electronic device.

The user must perform an operation of sequentially selecting or dragging specific objects in order to perform an decryption operation of an electronic device or the like. And this operation is done in the same decryption screen. For example, if a user sets the decryption action to a four-digit password, decryption can be done with the same four-digit password unless the user changes the password.

In this case, if the user performs the decryption operation in a public place by the above-described method, his / her password or the like may be exposed to others. In addition, there is an inconvenience that a user is required to perform a password-releasing operation while hiding the display screen so that the user can move to a place that is not exposed to the other person,

Recently, when inputting a numeric password, a method of randomly changing the numeric array is used each time the decryption operation is performed. However, there is a problem in that, if another person sees the moment when the user types by this method, the password may be exposed to the other person.

It is an object of the present disclosure to provide an HMD device and a control method thereof for rearranging and displaying display positions of objects included in an decryption UI of an external electronic device.

In order to achieve the above-mentioned object, the HMD device according to the present embodiment displays a second decryption UI based on a first decryption unlock UI displayed on the electronic device when receiving a decryption request for the communication part, the display and the external electronic device Wherein the control unit receives the object information selected in the first decryption release UI from the electronic apparatus via the communication unit and stores the object included in the second decryption release UI mapped with the received object information in a pre- And a processor for transmitting an decryption command to the electronic device through the communication unit when the decryption information matches the decryption information, wherein the second decryption UI is a UI for displaying the objects displayed in the first decryption UI Lt; / RTI >

In this case, the processor may cause the decryption instruction to be transmitted to the electronic device if the object displayed in the same position as the received object among the objects included in the second decryption release UI coincides with the pre-stored decryption object The communication unit can be controlled.

In addition, the first decryption UI is a two-dimensional UI including a plurality of cells, each of the plurality of cells includes a different identifier, and the second decryption UI includes two Dimensional UI, and the positions of the identifiers included in each of the plurality of cells may be rearranged.

Here, the processor controls the communication unit to receive information on a plurality of identifiers sequentially selected by the user among the plurality of identifiers included in the first decryption release UI, and the identifier included in the second decryption release UI The control unit may control the communication unit to transmit the decryption command to the electronic device if the information corresponding to the received identifier matches the previously stored decryption information.

Also, when the object information selected in the first decryption releasing UI is received through the communication unit, the processor may cause the display unit to display the display in the second decryption UI in order to provide visual feedback to the object displayed at the same position as the received object Can be controlled.

Meanwhile, the first decryption UI includes guide objects for guiding a wheel operation or a drag operation, and the second decryption UI may be configured such that the display positions of guide objects included in the first decryption UI are rearranged UI, wherein the processor, when information corresponding to a wheel operation or a drag operation of a user is received from the electronic device via the communication unit, transmits a guide object corresponding to the received information, To provide visual feedback to the display.

Here, the guide object includes a plurality of identifiers that indicate a predetermined input unit of the wheel operation or the drag operation, and the received information includes a start position and an end position of the wheel operation or the drag operation among the plurality of identifiers And the processor can control the display to provide visual feedback connecting the first and second identifiers respectively corresponding to the start position and the end position.

Also, the first decryption UI includes guide objects for guiding a touch pattern operation, and the second decryption release UI rearranges the display positions of the guide objects included in the first decryption UI, Wherein when the information corresponding to the user's touch pattern manipulation is received from the electronic device through the communication unit, the first decryption UI and the second password Based on the mapping information of the guide objects included in the release UI, identifies whether the received information matches the previously stored touch pattern information,

And to control the communication unit to transmit an decryption command to the electronic device if the received information matches the previously stored touch pattern information.

Meanwhile, the first decryption UI is a UI including a plurality of identifiers provided at predetermined intervals, the second decryption UI is a form in which the positions of the plurality of identifiers are rearranged, The information processing apparatus receives information on a plurality of identifiers sequentially selected by the user among the plurality of identifiers included in the first decryption release UI, and the processor is configured to respond to the received identifier among the identifiers included in the second decryption release UI The control unit can control the communication unit to transmit the decryption command to the electronic device.

Meanwhile, the first decryption UI includes a plurality of levels including the same number of objects, the same number of objects being separated by a predetermined angle, and an object capable of distinguishing the plurality of levels, 2 decryption UI may be a form in which the positions of objects capable of distinguishing the plurality of levels are rearranged.

A method of controlling an HMD device according to an embodiment of the present disclosure includes displaying a second decryption UI based on a first decryption UI displayed on the electronic device when a decryption request for an external electronic device is received, Receiving the object information selected in the first decryption releasing UI from the electronic device, and if the object included in the second decryption UI mapped with the received object information matches the pre-stored decryption information, And the second decryption UI is a UI in which the display positions of objects included in the first decryption UI are rearranged.

In this case, the step of transmitting the decryption command to the electronic device may include: if the object displayed at the same position as the received object among the objects included in the second decryption UI matches the pre-stored decryption object, Decryption command to the electronic device.

The first decryption UI is a two-dimensional UI including a plurality of cells, each of the plurality of cells includes a different identifier, and the second decryption UI includes a second decryption UI having the same shape as the first decryption UI Dimensional UI, and the positions of the identifiers included in each of the plurality of cells may be rearranged. .

The step of transmitting the decryption command to the electronic device may include receiving information on a plurality of identifiers sequentially selected by the user among the plurality of identifiers included in the first decryption release UI, If the information corresponding to the received identifier among the identifiers included in the UI coincides with the stored decryption information, the decryption instructing unit may transmit the decryption command to the electronic device.

On the other hand, when the selected object information is received in the first decryption releasing UI, the second decryption releasing UI can provide visual feedback to the object displayed at the same position as the received object.

Meanwhile, the first decryption UI includes guide objects for guiding a wheel operation or a drag operation, and the second decryption UI may be configured such that the display positions of guide objects included in the first decryption UI are rearranged Providing visual feedback to a guide object corresponding to the received information among guide objects included in the second decryption release UI when information corresponding to a wheel operation or a drag operation of a user is received from the electronic device, As shown in FIG.

In this case, the guide object includes a plurality of identifiers indicating a predetermined input unit of the wheel operation or the drag operation, and the received information includes at least one of a start position of the wheel operation or the drag operation Wherein the step of providing visual feedback to the guide object may provide visual feedback connecting the first and second identifiers respectively corresponding to the start position and the end position.

Meanwhile, the first decryption UI includes guide objects for guiding touch pattern manipulation, and the second decryption UI is configured to rearrange the display positions of the guide objects included in the first decryption UI, Wherein when the information corresponding to the user's touch pattern operation is received from the electronic device, the step of transmitting the decryption instruction to the electronic device comprises: Based on the mapping information of the guide objects included in the UI and the second decryption release UI, identifies whether the received information matches pre-stored touch pattern information, and if the received information matches the previously stored touch pattern information A decryption command may be transmitted to the electronic device.

Meanwhile, the first decryption UI is a UI including a plurality of identifiers provided at predetermined intervals, the second decryption UI is a form in which the positions of the plurality of identifiers are rearranged, Wherein the step of transmitting the command to the electronic device includes receiving information on a plurality of identifiers sequentially selected by the user among the plurality of identifiers included in the first decryption UI, The decryption instruction may be transmitted to the electronic device if the information corresponding to the received identifier coincides with the stored decryption information.

1 is a view for explaining a system of an HMD device and an external electronic device,

2 is a block diagram illustrating an HMD device according to an embodiment of the present disclosure;

3 is a diagram for comparing the decryption release UI displayed on the external electronic device and the HMD device,

4 is a diagram for explaining an operation of a user to select an object,

5 is a diagram for explaining an decryption operation according to an embodiment of the present disclosure;

6 is a diagram for explaining a decryption operation according to another embodiment of the present disclosure;

7 is a view for explaining an operation in which only a guide object is displayed,

8 is a diagram for explaining a decryption operation according to another embodiment of the present disclosure;

FIG. 9 is a diagram for explaining a mapping operation according to the embodiment described in FIG. 8 of the present disclosure;

10 is a view for explaining a wheel operation according to an embodiment of the present disclosure;

11 is a diagram for explaining an operation of releasing a password using wheel operation,

12 is a diagram for explaining a decryption operation according to another embodiment of the present disclosure;

13 is a diagram for explaining a selection operation according to another embodiment of the present disclosure;

FIG. 14 is a diagram for explaining a decryption operation according to another embodiment of the present disclosure; and FIG.

15 is a flowchart of a method of controlling an HMD device according to an embodiment of the present disclosure.

Before describing the present disclosure in detail, a method of describing the present specification and drawings will be described.

It is to be understood that the terminology used herein should be broadly interpreted as encompassing any intentional, legal or technical interpretation of the art, and / And the emergence of new technologies. In addition, some terms are arbitrarily selected by the applicant. These terms may be construed in the meaning defined herein and may be interpreted based on the general contents of this specification and the ordinary technical knowledge in the art without specific terms definition.

In addition, the same reference numerals or signs in the drawings attached to the present specification indicate components or components that perform substantially the same function. For ease of explanation and understanding, different embodiments will be described using the same reference numerals or symbols. That is, even though all of the elements having the same reference numerals are shown in the plural drawings, the plural drawings do not mean one embodiment.

Further, in the present specification and claims, terms including ordinal numbers such as "first "," second ", etc. may be used for distinguishing between elements. These ordinals are used to distinguish between identical or similar components, and the use of such ordinal numbers should not be construed as limiting the meaning of the term. For example, the components associated with such an ordinal number should not be limited in their order of use or placement order by their numbers. If necessary, each ordinal number may be used interchangeably.

As used herein, the singular forms "a", "an" and "the" include plural referents unless the context clearly dictates otherwise. In the present application, the term "includes" Or "configured." , Etc. are intended to designate the presence of stated features, integers, steps, operations, components, parts, or combinations thereof, may be combined with one or more other features, steps, operations, components, It should be understood that they do not preclude the presence or addition of combinations thereof.

These embodiments are capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the description. It is to be understood, however, that it is not intended to limit the scope of the specific embodiments but includes all transformations, equivalents, and alternatives falling within the spirit and scope of the disclosure disclosed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the embodiments of the present invention,

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the claims. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the term "includes" Or "configured." , Etc. are intended to designate the presence of stated features, integers, steps, operations, components, parts, or combinations thereof, may be combined with one or more other features, steps, operations, components, It should be understood that they do not preclude the presence or addition of combinations thereof.

In the embodiments of the present disclosure, terms such as "module," "unit," or " part, "and the like are terms used to refer to components that perform at least one function or operation, Or may be implemented as a combination of hardware and software. It should also be understood that a plurality of "modules "," units ", "parts ", etc. may be integrated into at least one module or chip, . &Lt; / RTI >

Further, in the embodiment of the present disclosure, when a part is connected to another part, this includes not only a direct connection but also an indirect connection through another medium. Also, the meaning that a part includes an element does not exclude other elements, but may include other elements, unless specifically stated otherwise.

1 is a diagram for explaining an electronic system according to an embodiment of the present disclosure.

1, an electronic system includes an HMD device 100 and an electronic device 200. [

An HMD (Head Mounted Display) device 100 is a head-mounted display device. However, the present invention is not limited to the HMD device, and may be implemented by various devices including a small display such as smart glass to provide images in front of the user's eyes.

The HMD device 100 performs communication with the electronic device 200. In particular, the HMD device 100 may provide a UI screen associated with the displayed UI screen based on the information received from the electronic device 200. According to one example, the display attached to the HMD device 100 may be implemented as a transparent display, but is not limited thereto.

The electronic device 200 may be any of a variety of types of electronic devices capable of communicating with the HMD device 100. The electronic device 200 according to one embodiment of the present disclosure may be a smart watch. However, the present invention is not limited thereto, and it may be implemented in various types of electronic devices having a display such as a smart phone, a tablet, and a TV.

The electronic device 200 may provide various decryption release UIs. Here, the decryption release UI may be a UI for releasing the locked state of the electronic device 200 according to an example, but the present invention is not limited to this. For example, a secret number required for an application, The user can input various passwords.

The user's password input in the decryption release UI needs to be secured to other users.

Accordingly, according to one embodiment of the present disclosure, the HMD device 100 changes and provides the decryption UI provided on the electronic device 200, and when the selection information on the decryption UI is received from the electronic device 200, The user can provide security for user input to the decryption UI provided on the electronic device 200 by mapping the selected selection information to the changed UI to perform the decryption operation. Hereinafter, various embodiments for providing security for the decryption operation through the HMD device 100 will be described with reference to the drawings.

2 is a block diagram illustrating an HMD device according to an embodiment of the present disclosure.

Referring to FIG. 2, the HMD device 100 may include a display 110, a communication unit 120, and a processor 130.

The display 110 displays a UI screen. Here, the UI screen may include various content playback screens such as images, moving pictures, text, music, etc., an application execution screen including various contents, a web browser screen, a GUI (Graphic User Interface) screen and the like.

The display 110 may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), a light-emitting diode (LED), a liquid crystal on silicon (LCoS), a digital light processing (DLP) Panel, and the like.

Meanwhile, the display 110 may be configured as a transparent display.

The communication unit 120 may perform a general operation of receiving information from the electronic device 200 or transmitting information to the electronic device 200.

The communication unit 120 is configured to perform communication with various types of external devices according to various types of communication methods. The communication unit may be connected to an external device through a local area network (LAN) or an Internet network, and may be connected to a wireless communication (e.g., Z-wave, 4LoWPAN, RFID, LTE D2D, BLE, GPRS, Weightless, Edge Zigbee , ANT +, NFC, IrDA, DECT, WLAN, Bluetooth, Wi-Fi, Wi-Fi Direct, GSM, UMTS, LTE and WiBRO). The communication unit may include various communication chips such as a Wi-Fi chip, a Bluetooth chip, an NFC chip, a wireless communication chip, and the like. The Wi-Fi chip, the Bluetooth chip and the NFC chip communicate by WiFi, Bluetooth and NFC, respectively.

The wireless communication chip refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3G (3rd Generation), 3rd Generation Partnership Project (3GPP), LTE (Long Term Evolution) Further, the communication unit may include a light receiving unit capable of receiving a control signal (e.g., an IR pulse) from an external device. The user can receive the user command inputted from the electronic device through the communication unit and can transmit the information about the recommended service selected through the communication unit to the external user terminal and can transmit and receive the data with the server through the communication unit.

The communication unit 120 is configured to perform communication with various types of external devices according to various types of communication methods. The communication unit includes a Wi-Fi chip, a Bluetooth chip, a wireless communication chip, and an NFC chip. The processor communicates with various external devices using a communication unit.

Processor 130 controls the overall operation of HMD device 100.

According to one embodiment, the processor 130 may be a digital signal processor (DSP), a microprocessor, a TCON (Time controller), a central processing unit (CPU), an MCU ), An MPU (micro processing unit), a controller, an application processor (AP), a communication processor (CP), an ARM processor, The processor 130 may be implemented as a system on chip (SoC), a large scale integration (LSI) or a field programmable gate array (FPGA) with a built-in processing algorithm.

The processor 130 may receive a decryption request for the external electronic device 200. Here, the decryption request may be received from the external electronic device 200, but may be input via the HMD device 100, as the case may be.

According to one embodiment, the external electronic device 200 may provide a UI (hereinafter referred to as a first decryption UI) for releasing the lock state.

When the decryption request for the external electronic device 200 is received, the processor 130 may generate a second decryption UI that rearranges the display position of the objects included in the first decryption UI. The processor 130 may then control the display 110 to display a second decryption UI on the display 110 of the HMD device 100 to display the newly generated decryption UI.

Processor 130 may display a second decryption UI on display 110 of the HMD device. Specifically, the second decryption release UI may be a UI in which the display positions of the objects included in the first decryption release UI are rearranged. The second decryption releasing UI may be various and will be described later in detail with reference to the drawings.

Meanwhile, the processor 130 may control the display 110 to display the second decryption UI at various positions. For example, the processor 130 may search the electronic device 200 that is capable of communicating with the HMD device 100 to identify the location where the display of the electronic device 200 is displayed. The processor 130 may then display a second decryption UI at a location where the display of the electronic device 200 is identified. In this case, the user can only see the second decryption UI displayed on the display of the electronic device 200. [ The other person only sees the screen displayed on the display of the electronic device 200 and can not see the second decryption UI at all. The other person may refer to a third person who does not wear the HMD device 100.

In addition, the processor 130 may display the second decryption UI regardless of the position of the electronic device 200. [ For example, the display 110 may indicate that the electronic device 200 and the second decryption UI do not overlap. In this case, the user can see both the contents displayed on the display of the electronic device 200 and the second decryption release UI.

Processor 130 may generate various second decryption UIs.

In addition, the processor 130 may control the display 110 to display a second decryption UI based on a first decryption UI displayed on the electronic device. The second decryption release UI may be a UI in which the display positions of the objects included in the first decryption release UI are rearranged.

The processor 130 may generate a second decryption UI 105, which is a new UI based on the first decryption UI 205 that is displayed on the electronic device 200 by default. The processor 130 may then control the display 110 to display a second decryption UI at a location where the first decryption UI of the electronic device 200 is displayed.

3, the processor 130 may display the second decryption UI at a different location than the display of the electronic device 200, as described above.

In the description of the present disclosure, it is described that the second decryption UI of the processor 130 is generated and immediately displayed on the display 110. However, the HMD device 100 may further include a memory (not shown) Information related to the decryption UI can be stored in a memory (not shown). The processor 130 may then generate a new second decryption UI using the information stored in the memory (not shown).

In the above description, the processor 130 generates a new second decryption UI each time a request for decryption is issued. However, in actual implementation, various second decryption < RTI ID = 0.0 > have.

Meanwhile, the processor 130 may receive information related to the password set by the user from the electronic device 200, or may control the communication unit so that the user operates the electronic device 200 to receive the input signal. For example, the processor 130 may receive a signal relating to an operation of the user selecting an object or touching the touch sensor through the communication unit.

This particular manipulation operation may also be accomplished using the physical configuration of the electronic device 200. For example, in a smart watch, the movement of a button or wheel may be included.

When the user selects a specific object by operating a physical component of the electronic device 200, the processor 130 can transmit information about the selected object to the HMD device 100, Can be received.

Meanwhile, the processor 130 may transmit a signal for controlling the electronic device 200 to the electronic device 200 through the communication unit 120. For example, in connection with the decryption operation of the electronic device 200, an HMD device 100 may send an decryption instruction to the electronic device 200.

On the other hand, the processor 130 can compare and map the newly generated second decryption release UI with the first decryption release UI displayed on the electronic device 200. This will be described with reference to FIG.

Specifically, each UI includes at least one object, and the corresponding objects can be matched with each other. For example, the numerals 1 through 9 are nine objects, and the numeric keyboard having nine numerals may be the UI 205. In this case, the UI 205 consisting essentially of nine numbers (objects) displayed on the electronic device 200 may correspond to the first decryption UI, and the processor 130 may arbitrarily change the arrangement of nine numbers A new numeric keypad-shaped UI 105 may be generated, which may correspond to a second decryption UI.

The processor 130 may map the numbers included in the first decryption release UI and the numbers included in the second decryption release UI in correspondence with the positions.

Referring to FIG. 3, it is indicated as 1 in the first decryption clear UI, but may be displayed as 4 in the second decryption clear UI. In this case, the processor 130 may map 4 of the first decryption UI and 1 of the second decryption UI. When the user selects one object of the electronic device 200, the processor 130 can recognize that four objects have been selected using the mapping information.

In this case, if the second decryption releasing UI is displayed on the first decryption releasing UI, if the user can not see the first decryption releasing UI, only the second decryption releasing UI can be seen. Therefore, the user thinks to select four objects, but it can be considered that the other person actually selects one object. Therefore, using this device, the password selected by the user may not be exposed to others.

3, the first decryption UI is displayed on the electronic device 200, but in actual implementation, the first decryption UI may not be displayed at all.

On the other hand, the processor 130 receives the object information selected in the first decryption release UI from the electronic device 200 through the communication unit 120, and determines whether the object included in the second decryption release UI, which is mapped with the received object information, And can transmit an decryption command to the electronic device through the communication unit 120 if the encrypted decryption information matches the stored decryption information.

In this case, the processor 130 can determine that the password is released when the object displayed at the same position as the object received in the second decryption release UI coincides with the pre-stored decryption object.

Referring to FIG. 3, an object included in the second decryption release UI is a UI displayed in the HMD device 100, and the received object may be an object selected in the electronic device 200. [ As described above, the user can operate the electronic device 200 while viewing only the second decryption UI.

Specifically, when the user selects the object 1 of the first decryption UI of the electronic device 200, the processor 130 receives the information about the object selected by the user, It can be recognized that the object (the fourth object of the second decryption UI) is selected. The processor 130 compares the previously stored decrypted object with the information about the recognized object # 4 to determine whether the decrypted object matches the previously decrypted object.

On the other hand, the first decryption releasing UI is a UI including a plurality of identifiers provided at predetermined intervals, and the second decryption releasing UI may be a form in which the positions of a plurality of identifiers are rearranged.

The processor 130 can receive information on a plurality of identifiers sequentially selected by the user among the plurality of identifiers included in the first decryption release UI through the communication unit 120. [

The processor 130 may control the communication unit 120 to transmit an decryption command to the electronic device if the information corresponding to the received identifier among the identifiers included in the second decryption UI matches the previously stored decryption information .

On the other hand, when the processor 130 determines whether or not the encryption is released, a plurality of identifiers can be compared. In this case, the plurality of identifiers may be a plurality of objects.

The first decryption UI generated by the processor 130 is a two-dimensional UI including a plurality of cells, each of the plurality of cells includes a different identifier, and the second decryption UI has the same shape as the first decryption UI Dimensional UI, and the positions of the identifiers included in each of the plurality of cells may be rearranged.

Here, the communication unit 120 receives information on a plurality of identifiers sequentially selected by the user among a plurality of identifiers included in the first decryption releasing UI, and the processor 130 selects one of the identifiers included in the second decryption releasing UI If the information corresponding to the received identifier coincides with the previously stored decryption information, the communication unit 120 can be controlled to transmit the decryption command to the electronic device. In the embodiment of FIG. 3, a plurality of identifiers may correspond to a plurality of numeric objects.

On the other hand, the processor 130 may provide visual feedback to the second decryption UI. Specifically, when the object information selected in the first decryption unlock UI is received through the communication unit 120, the processor 130 displays the displayed object in the second decryption UI, (110). The visual feedback in accordance with one embodiment of the present disclosure is described with reference to FIG.

4 is a diagram for explaining an operation of the user to select an object.

Referring to FIG. 4, a first decryption UI 205 may be displayed on the electronic device 200. However, the processor 130 of the HMD device 100 may display the second decryption UI on the display 110. [ As described above, the processor 130 may display the second decryption UI at various positions, but in the description of FIG. 4, it is assumed that the second decryption UI is displayed at a position that covers the first decryption UI.

That is, the processor 130 may display the second decryption UI on the display 110 to cover the first decryption UI of the electronic device 200, and the user may only see the second decryption UI. In this case, the second decryption UI may be displayed on the display 110 and may not be able to view the first decryption UI. Therefore, based on the same principle, the user may be masked due to the second decryption UI even though he / she tries to touch the electronic device 200. If the user's finger is partially obscured, it may be difficult to identify exactly which portion the user has touched.

Thus, the HMD device 100 in accordance with one embodiment of the present disclosure may display visual feedback on the display 110. [ The visual feedback may mean a UI that indicates which portion the user has touched. Referring to FIG. 4, the second decryption UI is displayed on the HMD device 100, and the object # 1 may be displayed in a different background color 115.

When the user touches the object 4 on the display of the electronic device 200, the processor 130 may receive information about it and provide visual feedback to the corresponding object, May be to change the background color 115 of the corresponding object. Referring to FIG. 4, the background color 115 of the object # 1 of the second decryption release UI corresponding to the object # 4 of the electronic device 200 selected by the user is changed. In this case, the visual feedback may be background color 115.

Further, the guide object can represent a target object that can be selected by the user. 4, the currently selectable guide object may be represented by a thick line 116 surrounding the object. In this case, the processor 130 can distinguish between an operation of selecting and an operation of displaying a selectable object. For example, if the current guide object is displayed as a bold line 116 surrounding the object, the guide object indicated by the thick line 116 can be moved to an object other than the first object when the user turns the wheel. If the user turns the wheel once to the right while the bold line 116 is displayed on the object 1, the bold line 116 can be displayed on the object 2.

The user can grasp what object is currently selectable by the guide object of the bold line 116. [ However, since the other person can not see the operation of the user at all, the decryption operation of the user may not be exposed at all.

4, the visual feedback is described as a case where a user touches a specific portion of the electronic device 200. However, even when a specific button other than a touch is selected or a specific operation is performed, visual feedback can be applied have.

The user can confirm this when the user selects a specific object while receiving the visual feedback. Therefore, it is possible to solve the problem that it is difficult to identify whether some of the above-mentioned finger is selected by the second decryption UI and selects the correct object through the visual feedback and the guide object.

Meanwhile, the HMD device 100 according to an embodiment of the present invention as described above can display a second decryption release UI that can be viewed only by the user. During the decryption operation, the second decryption UI may be displayed differently each time, and the decryption operation of the user may not be exposed to others.

5 is a diagram for explaining an decryption operation according to an embodiment of the present disclosure.

Referring to FIG. 5, the electronic device 200 may be displayed with a numeric arrangement UI 205, which is a first decryption unlocking UI. The HMD device 100 may display the corresponding second decryption UI 105. [ Specifically, the first decryption UI 205 and the second decryption UI 105 may be those in which the first line and the second line are mutually changed. Therefore, the HMD device 100 can map the object corresponding to the position as shown in the table shown in Fig. 5 (a).

Since the user wears the HMD device 100, only the second decryption release UI, not the first decryption release UI, can be seen.

Referring to FIG. 5B, the user can physically select the object 7, the object 4, and the object 1 in the electronic device 200. However, in reality, the user may have selected object 7, object 1, object 4 in order while viewing the second decryption UI.

FIG. 5 (c) is a table for explaining contents in which each device recognizes the operation of the user. Specifically speaking only the numerical value, the external electronic device is selected in the order of 7,4,1. The electronic device 200 can transmit information to the HMD device 100. Then, the HMD device 100 grasps the numbers corresponding to 7,4,1. Using the mapped information as shown in FIG. 5 (a), the user can correspond to the input in the order of 7, 1, and 4. Therefore, the HMD device 100 can compare 7, 1, 4 and pre-stored passwords to check whether they match.

6 is a diagram for explaining a decryption operation according to another embodiment of the present disclosure.

6, the first decryption UI includes guide objects 610, 615, 620, and 625 for guiding a touch pattern operation, and the second decryption release UI includes guide objects 610, 615, 620, and 625 included in the first decryption UI The display position can be rearranged. And a circular circular UI UI 605 displayed on the electronic device 200 can be displayed on the display of the electronic device 200. [ On the other hand, in the actual implementation, the electronic device 200 of the present disclosure may not be displayed on the display of the electronic device 200, but may be already printed on another physical component.

The rearranged guide objects (650, 655, 660, 665) included in the second decryption release UI may differ from the guide objects (610, 615, 620, 625) included in the first decryption release UI in at least one of position, size and interval.

In this case, one of the guide objects may be the UI 670 indicating the start position of the selection. In this case, a specific color can be applied or a specific display can be made to indicate the start position of the operation.

When information corresponding to the user's touch pattern operation is received from the electronic device 200 through the communication unit 120, the HMD apparatus 100 transmits mapping information of guide objects included in the first decryption release UI and the second decryption release UI It is possible to identify whether or not the received information matches the previously stored touch pattern information.

Referring to FIG. 6A, the user can set a password by sequentially selecting 610, 620, 615, and 625 among the

objects

610, 615, 620, and 625 included in the first decryption release UI. The HMD device 100 can be regarded as having an identical password when objects having the shape of the alphabet N are successively selected according to the start position.

Although not shown in FIG. 6, even when the guide object 670 indicating the starting point is displayed at another position, it can be seen that the passwords are consistent when objects having the shape of the alphabet N are successively selected.

Referring to FIG. 6 (c), the HMD device 100 may generate a second decryption UI that generates new guide objects 650, 655, 660, and 655. In this case, the new guide objects 650, 655, 660, and 655 may be positioned differently from the guide objects 610, 615, 620, and 625 of the first decryption UI, and the interval may be narrowed. A guide object 670 can be displayed to know the position of the starting point. A guide object 670 indicating a starting point can be displayed separately and can be displayed as an object having a specific color.

In this case, the user can determine the guide object 670 indicating the start position, and can select the guide object 670 in order of 665, 655, 660, The HMD device 100 can analyze the information on the object corresponding to the selected object and can compare the coded object information with the previously stored coded object information.

Then, the HMD device 100 may control the communication unit 120 to transmit an decryption command to the electronic device if the received information matches the pre-stored touch pattern information.

In addition, the second decryption UI of the HMD device 100 will be displayed as shown in FIG. 6 (c), but only the view of FIG. 6 (b) can be seen at the time of the other person.

In the above description, it is described that the user's operation corresponds to the touch, but in actual implementation, it can be realized by using a wheel.

7 is a view for explaining an operation in which only a guide object is displayed.

FIG. 7A shows the decryption release operation seen from the time of the other person, and FIG. 7B shows the second decryption release UI displayed on the display after the user wears the HMD device 100. FIG.

A circular numeric circular UI 605 displayed on the electronic device 200 may be displayed on the display of the electronic device 200. [ On the other hand, in the actual implementation, the electronic device 200 of the present disclosure may not be displayed on the display of the electronic device 200, but may be already printed on another physical component.

Referring to Fig. 7 (b), a guide object 705 for assisting the user's selection can be displayed. The user can display an arrow-shaped guide object 705 only on the second decryption release UI. And the HMD device 100 can control the display so that the guide object 705 moves in response to a user's operation when the user operates the wheel of the electronic device 200. [ For example, when the user rotates the wheel of the electronic device 200 clockwise, the HMD device 100 can display the guide object 705 to move in the clockwise direction. When the user turns the wheel of the electronic device 200 clockwise, the HMD device 100 can display the guide object 705 to move in the counterclockwise direction.

The user can continuously select 55, 45, 35 objects by referring to the numeric circular UI 605 and the guide object 705. In this case, the user can use the wheel of the electronic device 200. The guide object 705 can be seen only by the user and can not be seen by others. Thus, since the other user can not know where the user is to select the portion, the user may not disclose the password to another person even if the user performs the decryption operation.

8 is a diagram for explaining the decryption operation according to another embodiment of the present disclosure.

8, the HMD device 100 may display a new numeric circular UI 805 in the second decryption UI. In this case, the new numeric circular UI 805 may be changed in numerical arrangement relative to the numeric circular UI 605 displayed in the first decryption UI. Also, background color and font size can be changed in the numeric circular UI. In addition, a UI object 705 may be displayed as a guide object indicating whether or not the currently selectable object is present.

Referring to FIG. 8 (b), the user can sequentially select 55, 45, and 35 using the new numeric circular UI 805 displayed on the guide object and the second decryption release UI.

However, referring to FIG. 8 (a), it is impossible to see which number is selected at the time of another person, and information corresponding to (55, 45, 35) may not be exposed to others.

8, it is described that the guide object 705 is not displayed on the display of the electronic device 200. However, in actual implementation, the guide object 705 may be displayed on the display of the electronic device 200 have. There is a difference between the numeric circular UI 605 displayed in the first decryption clear UI and the new numeric circular UI 805 displayed in the HMD device 100 so that the guide object 705 is displayed on the display of the electronic device 200 The other user can not know the correct password of the user. For example, suppose that the guide object 705 is displayed, although not shown in FIG. 8, the user eventually selects the

password

55,45,35 of the electronic device 200, but the other person has the password of 00,15,30 . Therefore, the other user can not know the password of the user.

FIG. 9 is a diagram for explaining the mapping operation according to the embodiment described in FIG. 8 of the present disclosure.

The HMD device 100 can compare the numeric circular UI 605 included in the first decryption unlock UI with the numeric circular UI 805 included in the second decryption unlocked UI and compare the objects corresponding to the respective positions Can be mapped.

If the user selects 55, 45, or 35 while viewing the second decryption UI as shown in FIG. 8, it may be that 00, 15, or 30 is selected in the entry of the electronic device 200. [ The electronic device 200 may then transmit information for the selected 00,15,30 to the HMD device 100. [ Then, the HMD device 100 maps the received information on 00, 15, and 30 to determine that 55, 45, and 35 are selected. And the HMD device 100 can compare the pre-stored password with 55,45,35.

Referring to FIG. 10 (a), a UI having a plurality of levels or levels can be displayed. Each level can be displayed as a number or as a sequence of expected characters. In addition, each level may include a plurality of objects, and a plurality of objects included in each level may be the same number and arranged at the same angle.

Referring to FIG. 10 (b), if the user has operated the wheel of the electronic device 200 three times in the clockwise direction, the corresponding visual feedback can be displayed. In this case, the corresponding visual feedback may be a form of connecting a plurality of objects included in the same level as shown in FIG. 10 (b).

Specifically, the first decryption release UI includes guide objects for guiding the wheel operation or the drag operation, the second decryption release UI is a UI in which the display positions of the guide objects included in the first decryption release UI are rearranged , The HMD device 100 responds to the received information among the guide objects included in the second decryption release UI when the information corresponding to the wheel operation or the drag operation of the user is received from the electronic device 200 through the communication section 120 Lt; RTI ID = 0.0 > visual feedback < / RTI >

Here, the guide object includes a plurality of identifiers indicating a predetermined input unit of a wheel operation or a drag operation, and the received information includes information indicating a start position and an end position of a wheel operation or a drag operation among a plurality of identifiers, The processor 130 may control the display 110 to provide visual feedback connecting the first and second identifiers respectively corresponding to the start and end positions.

In this case, even if the user operates the wheel of the electronic device 200, the UI as shown in FIG. 10 (b) is displayed only on the user's eyes, so that the other person can not grasp the correct input.

When the user performs a specific operation, the user can move to the next level. Then, the user can input the operation corresponding to the next level, and it is possible to input the operation from the first level to the fourth level by repeating this operation. In FIG. 10, the levels are limited to four in total, but may be less than or greater than four in an exemplary case.

Fig. 11 is a diagram for explaining an operation of releasing the encryption using the wheel operation. Fig.

On the other hand, the first decryption UI includes a plurality of levels including the same number of objects, the same number of objects are separated from each other by a predetermined angle, an object capable of distinguishing between a plurality of levels, The position of the object capable of distinguishing a plurality of levels can be rearranged.

Specifically, FIG. 11A is a diagram for explaining one of various embodiments of the first decryption UI of the electronic device 200. FIG. The visual feedback corresponding to the four levels and the password setting operation of the user can be displayed together. For example, the user may operate the wheel 3 in the clockwise direction (right) in level 1, operate the wheel 3 in the counterclockwise direction (left) in level 2, and the wheel 5 in the clockwise direction You can operate the wheel and operate the 6th wheel from level 4 to counterclockwise (left). And visual feedback corresponding to each operation can be displayed.

The level described above is a set of a plurality of objects connected in a circle having the largest diameter in Fig. 11 (a). One level can mean the largest circle, and the fourth level can mean a circle having the smallest diameter have. The number shown in FIG. 11A may be a guide object indicating a procedure for inputting an operation corresponding to the level. For example, FIG. 11 (a) may refer to a UI for inputting sequentially from the first level corresponding to the largest circle to the fourth level corresponding to the small circle.

On the other hand, FIG. 11 (b) is a view for explaining a second decryption release UI displayed on the display of the HMD device 100. FIG. Unlike the first decryption UI, the order of the levels can be displayed differently. For example, in FIG. 11 (b), it may be a guide object for inputting in order of 1 level, 4th level, 3th level and 2th level, which are the largest causes. In this case, the number object, which is a guide object, is displayed only on the display of the HMD device 100, so that the other person may not know the input order.

The table shown in Fig. 11 (b) may mean the order in which the user has input corresponding to the guide object. Since the level 1 corresponds to the number 1, the user can operate the 3rd wheel to the right. And the number 6 wheel is operated to the left corresponding to the level 4 in which the number 2 is displayed. In the same manner, the fifth wheel can be operated to the right in correspondence with the level 3, and the third wheel can be operated to the left corresponding to the level 2. In this case, although the order in which the level is changed is changed so that the user operates the wheel, the decryption operation of the electronic device 200 can be performed in the same manner.

Thus, the other person can not know the correct password even if the user decrypts the password.

12 is a diagram for explaining the decryption operation according to another embodiment of the present disclosure.

Referring to FIG. 12 (a), a total of four numbers UI can be displayed. And each numeric UI can display visual feedback to tell what the currently selectable numeric object is. For example, in FIG. 12 (a), the 8th level may be highlighted. When the user rotates the wheel of the electronic device 200 in the clockwise direction, the number UI of the first level can also be changed clockwise.

Specifically, in FIG. 12 (a), when the user rotates the wheel once in the clockwise direction at the first level, the 9th object can be displayed where the center visual feedback is displayed. The user may perform a specific operation to input an operation for each level, and the specific operation may be an operation to select a specific button.

On the other hand, Fig. 12 (b) is a maze UI. The user can solve the maze by using left, right, forward, backward, etc. from a specific starting point.

12, the user can use at least one of a touch or a wheel operation.

12 (a) and 12 (b) can be displayed on both the display of the HMD device 100 and the display of the electronic device 200, and displayed on only one of the displays.

13 is a diagram for explaining a selection operation according to another embodiment of the present disclosure.

13 (a) and 13 (b), according to a predetermined command of the user, a specific object is selected at the current level and can be moved to the next level. For example, the predetermined user command may be an operation for selecting a specific button provided in the electronic device 200 as shown in FIG. 13 (a).

As another example, the predetermined user command may be a gesture in which a user wearing the electronic device 200 on the wrist moves his hand in a specific direction (e.g., upward direction), as shown in Fig. 13 (b) .

13 (b), when an event is generated in which the electronic device 200 is moved in the Z-axis direction (or vertical direction) according to the user gesture, a specific object is selected at the current level, Can be moved. For example, when the user moves the electronic device 200 once in the Z-axis direction (or vertical direction), the level can be shifted from the level 1 to the level 2 shown in Fig. 11 (a).

FIG. 14 is a diagram for explaining a decryption operation according to another embodiment of the present disclosure; FIG.

Referring to FIG. 14, the HMD device 100 may perform a first decryption procedure by identifying a user's hand. The HMD device 100 can store different palms for each user in the memory and the HMD device 100 can compare the identified palm and the stored palm to perform the first decryption procedure.

Then, the HMD device 100 can perform the second decryption procedure. One of the plurality of hand gestures may be randomly displayed on the display of the HMD device 100 as shown in FIG. 14 (b). The user must pass the second decryption procedure after taking the hand off gesture displayed on the display continuously after performing the first decryption procedure.

If the user desires to perform the second decryption procedure after the user moves the hand to a range that the HMD device 100 can not recognize after performing the first decryption procedure, the decryption procedure may be canceled altogether. This is to prevent the user from performing the decryption in an abnormal manner such as using a photograph or the like.

The control method of the HMD device 100 according to an embodiment of the present disclosure is characterized in that when a decryption request for the external electronic device 200 is received, a second password based on the first decryption UI displayed on the electronic device 200 And displays the release UI (S1505).

When the object information selected in the first decryption release UI is received from the electronic device 200 (S1510), it is checked whether or not the object included in the second decryption release UI mapped with the received object information matches the previously stored decryption release information (S1515).

Thereafter, if the object included in the second decryption release UI mapped with the object information received in step S1515 matches the previously stored decryption release information, the decryption release command is transmitted to the electronic device (S1520).

In step S1505, the second decryption release UI may be a UI in which the display positions of the objects included in the first decryption release UI are rearranged.

On the other hand, the first decryption UI is a two-dimensional UI including a plurality of cells, each of the plurality of cells includes a different identifier, the second decryption UI is a two-dimensional UI having the same shape as the first decryption UI, The positions of the identifiers included in each of the plurality of cells may be rearranged. .

On the other hand, the first decryption release UI includes guide objects for guiding the touch pattern operation, the second decryption release UI rearranges the display positions of the guide objects included in the first decryption release UI, and one of the guide objects Wherein the step of transmitting the decryption command to the electronic device is a UI indicating a starting position of the touch pattern operation, and when the information corresponding to the user's touch pattern operation is received from the electronic device (200) Based on the mapping information of the guide objects included in the release UI, identifies whether the received information matches the pre-stored touch pattern information, and if the received information matches the pre-stored touch pattern information, transmits a decryption command to the electronic device .

On the other hand, the first decryption UI is a UI including a plurality of identifiers provided at predetermined intervals, the second decryption UI is a reordering of the positions of a plurality of identifiers, Includes receiving information on a plurality of identifiers sequentially selected by a user among a plurality of identifiers included in the first decryption releasing UI and transmitting the information corresponding to the identifier received among the identifiers included in the second decryption releasing UI The encrypted decryption information can be transmitted to the electronic device.

In step S1510 and step S1515, when the object information selected in the first decryption release UI is received, the second decryption release UI can provide visual feedback to the object displayed in the same position as the object received.

On the other hand, the first decryption release UI includes guide objects for guiding a wheel operation or a drag operation, the second decryption release UI is a UI in which display positions of guide objects included in the first decryption release UI are rearranged, When the information corresponding to the user's wheel operation or drag operation is received from the electronic device 200, providing visual feedback to the guide object corresponding to the received information among the guide objects included in the second decryption release UI can do.

In the step S1520, the step of transmitting the decryption command to the electronic device may include decrypting the decryption instruction with the electronic decryption command if the object displayed in the same position as the object received among the objects included in the second decryption- Device.

Meanwhile, the step of transmitting the decryption command to the electronic device may include receiving information on a plurality of identifiers sequentially selected by the user among the plurality of identifiers included in the first decryption releasing UI, The decryption instruction can be transmitted to the electronic device if the information corresponding to the received identifier matches the previously stored decryption information.

In this case, the guide object includes a plurality of identifiers indicating a predetermined input unit of a wheel operation or a drag operation, and the received information includes information indicating a start position and an end position of a wheel operation or a drag operation among a plurality of identifiers , The step of providing visual feedback to the guide object may provide visual feedback connecting the first and second identifiers respectively corresponding to the start position and the end position.

Meanwhile, the methods according to various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed in the existing HMD device 100.

Also, the methods according to various embodiments of the present disclosure described above can be implemented by software upgrading, or hardware upgrading, to existing HMD device 100 alone.

It is also possible that the various embodiments of the present disclosure described above are performed through an embedded server provided in the HMD device 100 or an external server of the HMD device 100. [

Meanwhile, the control method of the HMD device 100 according to the above-described embodiment may be implemented as a program and provided to the HMD device 100. [ In particular, the program including the HMD device 100 control method may be stored in a non-transitory computer readable medium.

Furthermore, the various embodiments described above may be embodied in a computer-readable recording medium, such as a computer or a similar device, using software, hardware, or a combination thereof. In accordance with a hardware implementation, the embodiments described in this disclosure may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ), A processor, microcontrollers, microprocessors, and an electrical unit for carrying out other functions. In some cases, the embodiments described herein may be implemented by processor 130 itself. According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein.

Meanwhile, the computer instructions for performing the processing operations in the HMD device 100 according to the various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium . The computer instructions stored in the non-volatile computer-readable medium cause the particular device to perform processing operations in the former according to various embodiments described above when executed by the processor of the particular device.

Non-transitory computer readable media is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the device. Specific examples of non-transitory computer readable media include CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

While the present invention has been particularly shown and described with reference to preferred embodiments thereof, it is to be understood that the disclosure is not limited to the specific embodiments thereof, It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present disclosure

Claims

In an HMD device,

A communication unit; And

display;

Upon receiving a decryption request for an external electronic device, controls the display to display a second decryption UI based on a first decryption UI displayed on the electronic device,

Via the communication unit, object information selected in the first decryption UI from the electronic device,

And a processor for transmitting an decryption command to the electronic device via the communication unit if the object included in the second decryption UI mapped to the received object information coincides with previously stored decryption information,

And the second decryption UI is a UI in which display positions of objects included in the first decryption UI are rearranged.
The method according to claim 1,

The processor comprising:

And controls the communication unit to transmit the decryption command to the electronic device if an object displayed in the same position as the received object among the objects included in the second decryption UI matches the pre- HMD device.
The method according to claim 1,

Wherein the first decryption UI is a two-dimensional UI including a plurality of cells, each of the plurality of cells includes a different identifier,

Wherein the second decryption UI is a two-dimensional UI having the same shape as the first decryption UI, and the positions of the identifiers included in each of the plurality of cells are rearranged.
The method of claim 3,

The processor comprising:

Controls the communication unit to receive information on a plurality of identifiers sequentially selected by the user among the plurality of identifiers included in the first decryption release UI from the electronic device,

And controls the communication unit to transmit the decryption command to the electronic device if information corresponding to the received identifier among the identifiers included in the second decryption UI matches the previously stored decryption information.
The method according to claim 1,

The processor comprising:

When the object information selected in the first decryption UI is received through the communication unit,

And controls the display to provide visual feedback to objects displayed at the same location as the received object in the second decryption UI.
The method according to claim 1,

The first decryption UI includes guide objects for guiding a wheel operation or a drag operation,

The second decryption release UI is a UI in which the display positions of the guide objects included in the first decryption release UI are rearranged,

The processor comprising:

When receiving information corresponding to a wheel operation or a drag operation of a user from the electronic device through the communication unit, provides visual feedback to a guide object corresponding to the received information among the guide objects included in the second decryption release UI And controls the display.
The method according to claim 6,

The guide object

And a plurality of identifiers indicating a predetermined input unit of the wheel operation or the drag operation,

The received information may include:

And information indicating a start position and an end position of the wheel operation or the drag operation among the plurality of identifiers,

The processor comprising:

And controls the display to provide visual feedback connecting first and second identifiers respectively corresponding to the start position and the end position.
The method according to claim 1,

The first decryption UI includes guide objects for guiding a touch pattern operation,

The second decryption UI is arranged such that a display position of the guide objects included in the first decryption release UI is rearranged and one of the guide objects is a UI indicating a start position of a touch pattern operation,

The processor comprising:

When the information corresponding to the user's touch pattern operation is received from the electronic device via the communication unit, the received information is displayed on the basis of the mapping information of the guide objects included in the first decryption UI and the second decryption UI Whether or not it matches the pre-stored touch pattern information,

And controls the communication unit to transmit an decryption command to the electronic device if the received information matches the previously stored touch pattern information.
The method according to claim 1,

The first decryption UI is a UI including a plurality of identifiers provided at predetermined intervals,

The second decryption UI is a form in which the positions of the plurality of identifiers are rearranged,

Wherein,

Receiving information on a plurality of identifiers sequentially selected by the user among the plurality of identifiers included in the first decryption UI,

The processor comprising:

And controls the communication unit to transmit the decryption command to the electronic device if information corresponding to the received identifier among the identifiers included in the second decryption UI matches the previously stored decryption information.
The method according to claim 1,

The first decryption UI includes a plurality of levels including the same number of objects, the same number of objects being separated by a predetermined angle, and an object capable of distinguishing the plurality of levels,

And the second decryption UI is a form in which the positions of the objects capable of distinguishing the plurality of levels are rearranged.
A method of controlling an HMD device,

When receiving a decryption request for an external electronic device, displaying a second decryption UI based on a first decryption UI displayed on the electronic device;

Receiving selected object information from the electronic device in the first decryption UI; And

And transmitting an decryption command to the electronic device if the object included in the second decryption UI that is mapped to the received object information matches the previously stored decryption information,

Wherein the second decryption UI is a UI in which display positions of objects included in the first decryption UI are rearranged.
12. The method of claim 11,

Wherein the step of transmitting the decryption command to the electronic device comprises:

And transmits the decryption instruction to the electronic device if an object displayed in the same position as the received object among the objects included in the second decryption UI matches the pre-stored decryption object.
12. The method of claim 11,

Wherein the first decryption UI is a two-dimensional UI including a plurality of cells, each of the plurality of cells includes a different identifier,

Wherein the second decryption UI is a two-dimensional UI having the same shape as the first decryption UI, and the positions of the identifiers included in each of the plurality of cells are rearranged.
14. The method of claim 13,

Wherein the step of transmitting the decryption command to the electronic device comprises:

Receiving information on a plurality of identifiers sequentially selected by the user among the plurality of identifiers included in the first decryption releasing UI, and receiving information corresponding to the received identifier among the identifiers included in the second decryption releasing UI And transmits the decryption command to the electronic device if the encrypted decryption information matches the pre-stored decryption information.
12. The method of claim 11,

And providing visual feedback to the object displayed at the same position as the received object in the second decryption UI when the object information selected in the first decryption UI is received.