WO2017099318A1

WO2017099318A1 - Method for authenticating user of head mounted display device and head mounted display device

Info

Publication number: WO2017099318A1
Application number: PCT/KR2016/007218
Authority: WO
Inventors: 야키슨예브헨; 슈르올렉산드르; 김선경; 페르리오프스카게레나; 라에프스키미콜라
Original assignee: 삼성전자 주식회사
Priority date: 2015-12-10
Filing date: 2016-07-05
Publication date: 2017-06-15

Abstract

Disclosed is a method comprising: measuring a characteristic value of the head shape of a user wearing an HMD device, using at least one sensor included in the HMD device; and authenticating whether the user wearing the HMD device has the right to use the HMD device, on the basis of the measured characteristic value and a pre-registered characteristic value of the head shape of an authorized user of the HMD device.

Description

How to authenticate a user of a head mounted display device and a head mounted display device

FIELD The present disclosure relates to wearable display devices, and more particularly to head mounted display (HMD) devices.

In accordance with the trend toward lighter and smaller digital devices, various wearable devices are being developed. The HMD device, which is a type of wearable device, refers to various digital devices that allow a user to wear multimedia contents or experience virtual reality or augmented reality (AR). The HMD device may include various forms for wearing on the head, such as glasses or a helmet.

In using the HMD device, authenticating the user's right to use the HMD device is an important issue for protecting personal information, security, or providing content. The authentication method of the HMD device may be implemented through various methods. For example, the authentication method of the HMD device, the iris authentication algorithm (iris authentication) through the iris scanner that recognizes the iris (iris) of the user wearing the HMD device or the face to recognize the user's face It may be implemented through authentication by face recognition.

An embodiment of the present disclosure provides a method for authenticating a user's right to wear a HMD device, and an HMD device performing the method.

Another embodiment of the present disclosure provides a HMD device for performing a method and method for identifying a specific user among a plurality of users using the HMD device.

The HMD device according to an embodiment of the present disclosure may provide a simple, accurate and reliable biometric authentication method (Biometric authentication method). In addition, the authentication method according to an embodiment of the present disclosure, bar iris recognition sensor or face scanner is not required, it is also advantageous in terms of cost can be reduced additional costs.

Figure 1a is a view for explaining the geometry of the human skull, Figure 1b is a diagram illustrating the shape of the human skull.

2A and 2B are diagrams for describing a method and an HMD device for authenticating a user's right to use, according to an embodiment of the present disclosure.

3 is a block diagram illustrating components of an HMD device according to an embodiment of the present disclosure.

4 is a flowchart illustrating a method of authenticating, by an HMD device, a usage right of a user wearing the HMD device, according to an embodiment of the present disclosure.

5A to 5C are diagrams for describing a method of acquiring characteristic values of a user's head shape when a sensor contacts a user's head according to an embodiment of the present disclosure.

6A to 6C are views illustrating a position where a plurality of sensors included in an HMD device according to an embodiment of the present disclosure and spaced apart from each other are in contact with a user's head.

FIG. 7 is a diagram for describing a method of measuring, by a HMD device, a characteristic value regarding a user's head shape according to an embodiment of the present disclosure.

FIG. 8 is a diagram for describing a method of classifying characteristic values of a user's head shape measured by an HMD device according to an exemplary embodiment of the present disclosure into a plurality of series.

FIG. 9 is a diagram for describing a method of measuring, by a HMD device, a characteristic value regarding a user's head shape according to an embodiment of the present disclosure.

FIG. 10 is a diagram for describing a method of classifying a characteristic value regarding a user's head shape measured by an HMD device according to an exemplary embodiment of the present disclosure into a plurality of series.

FIG. 11 is a diagram for describing a method of measuring, by a HMD device, a characteristic value regarding a user's head shape according to an embodiment of the present disclosure.

FIG. 12 is a diagram for describing a method of classifying characteristic values of a user's head shape measured by an HMD device according to an exemplary embodiment of the present disclosure into a plurality of series.

FIG. 13 illustrates a method in which the HMD device authenticates the user's authority to use the HMD device through a characteristic value of a user's head shape measured from a plurality of sensors spaced apart from each other according to an embodiment of the present disclosure; It is a flow chart.

FIG. 14 is a view illustrating a position where a plurality of sensors included in an HMD device according to an embodiment of the present disclosure and spaced apart from each other are in contact with a user's face.

FIG. 15 is a diagram for describing a method of classifying a feature value regarding a face shape of a user measured by a HMD device according to an exemplary embodiment of the present disclosure into a plurality of series.

FIG. 16A is a perspective view illustrating an HMD device including a conductive sensor measuring characteristic values of a face shape of a user according to an exemplary embodiment of the present disclosure.

FIG. 16B is an enlarged cross-sectional view of a portion of the HMD device shown in FIG. 16A.

17A and 17B are graphs showing characteristic values of a face shape of a user measured by a conductive sensor included in an HMD device according to an exemplary embodiment of the present disclosure.

18A is a perspective view illustrating an HMD device including a light emitting device and a photosensitive device that measure characteristic values of a face shape of a user according to an exemplary embodiment of the present disclosure.

FIG. 18B is an enlarged cross-sectional view of a portion of the HMD device of the HMD device shown in FIG. 18A.

19A and 19B are graphs showing characteristic values of a user's face shape detected by a photo register included in an HMD device according to an embodiment of the present disclosure.

20A is a perspective view illustrating an HMD device including a conductive tube and an electrode for measuring characteristic values relating to a facial shape of a user according to an exemplary embodiment of the present disclosure.

20B is an enlarged cross-sectional view of a portion of the HMD device shown in FIG. 20A.

20C is an enlarged perspective view of the conductive rubber tube and the electrode pad illustrated in FIG. 20A.

21A and 21B illustrate a method of measuring a characteristic value regarding a face shape of a user according to a shape change of a conductive rubber tube according to a case where a user does not wear or wears an HMD device in an embodiment of the present disclosure. Figures for.

22A and 22B are graphs showing characteristic values of a user's face shape detected by an electrode pad included in an HMD device according to an embodiment of the present disclosure.

23A and 23B illustrate a deviation between a characteristic value obtained by measuring a characteristic value regarding a head shape of a user wearing another HMD device over time according to an embodiment of the present disclosure, and a previously registered characteristic value. One graph.

FIG. 24 is a flowchart illustrating a method of authenticating a user's right to use by measuring a characteristic value of a head shape of a user wearing an HMD device according to an embodiment of the present disclosure over time.

FIG. 25 is a flowchart illustrating a method of authenticating a user's right to use by comparing a feature value of a head shape of a user wearing an HMD device according to an embodiment of the present disclosure with a previously stored feature value.

FIG. 26 is a flowchart illustrating a method of identifying a user wearing an HMD device among a plurality of users who use the HMD device according to an embodiment of the present disclosure.

FIG. 27 is a flowchart illustrating a method of identifying a user by comparing feature values of a head shape of a user wearing an HMD device according to an embodiment of the present disclosure with feature values of a plurality of registered users.

28 is a block diagram illustrating components of an HMD device according to an embodiment of the present disclosure.

As a technical means for achieving the above-described technical problem, an embodiment of the present disclosure, at least one sensor for measuring the characteristic value of the head shape of the user wearing the HMD device, a user having the authority to use the HMD device HMD comprising a memory for storing the pre-registered characteristic value of the head shape of the controller and the control unit for authenticating the authority to use the HMD device by the user wearing the HMD device based on the measured characteristic value and the pre-registered characteristic value Provide the device.

For example, the at least one sensor may include at least one of a tension sensor, a pressure sensor, a stress sensor, and a strain sensor.

For example, the at least one sensor may be disposed in a mounting belt that fixes and supports between the HMD device and the skull of the user wearing the HMD device.

For example, the at least one sensor may include a plurality of tension sensors that are spaced apart from each other in the mounting belt and measure the curvature of the skeleton of all or part of the skull of the user wearing the HMD device.

For example, the at least one sensor may be spaced apart from each other in a strap band surrounding the frontal, temporal and occipital bones of the user wearing the HMD device and the HMD device.

For example, the at least one sensor may include a plurality of pressure sensors that measure pressure values in each of the frontal, temporal and occipital bones of the user wearing the HMD device.

For example, the at least one sensor may include a plurality of pressure sensors that are spaced apart from each other in a mask covering a part of the face of the user wearing the HMD device and measure the shape and size of the face skeleton of the user.

For example, the at least one sensor may generate the at least one series by classifying the characteristic values measured for different areas on the skull or the user's face wearing the HMD device according to the measured area.

For example, the controller may select any one of at least one series and determine whether the selected series corresponds to a series of pre-registered characteristic values to authenticate the user's authority to wear the HMD device.

For example, the at least one sensor may continuously measure a characteristic value regarding the shape of the head of the user wearing the HMD device during the authentication time over time.

For example, the controller may calculate a deviation value between the measured characteristic value and the characteristic value stored in the memory according to the number of times the at least one sensor measures the characteristic value during the authentication time, and the calculated deviation value is less than the preset threshold. In this case, the user's right to wear the HMD device may be authenticated.

As technical means for achieving the above-described technical problem, an embodiment of the present disclosure, at least one sensor, at least one sensor for measuring a plurality of characteristic values of the shape of the head of a plurality of users using the HMD device, respectively A first characteristic value relating to a memory storing a plurality of characteristic values relating to the head shape of the plurality of users measured from the first head shape of the first user wearing the HMD device and a plurality of characteristic values stored in the memory, respectively, It provides a HMD device including a control unit for identifying the first user.

For example, the controller calculates a difference value between each of the characteristic values related to the head shape of the first user and the plurality of stored characteristic values, and calculates a characteristic value having a minimum difference value among the plurality of stored characteristic values. Can be determined by value.

As a technical means for achieving the above-described technical problem, an embodiment of the present disclosure, the step of measuring the characteristic value of the head shape of the user wearing the HMD device, and the authority to use the measured characteristic value and the HMD device A method for authenticating a user by an HMD device, comprising authenticating a use right of a user wearing a HMD device, based on a pre-registered characteristic value with respect to a head shape of an authenticated user having an HMD device.

For example, measuring the characteristic value may include measuring the curvature of the skeleton of all or part of the skull of the user wearing the HMD device.

For example, measuring the characteristic value may include measuring a pressure value in each of the frontal, temporal and occipital bones of the user wearing the HMD device.

For example, measuring the characteristic value may include measuring the shape and size of the facial skeleton of the user using at least one sensor.

For example, measuring the characteristic values may include classifying the characteristic values measured with respect to different areas on the skull or the user's face wearing the HMD device into at least one series according to the measured regions. can do.

For example, the authenticating step may include selecting one of at least one series, determining whether the selected series corresponds to a series of pre-registered characteristic values and the selected series, and determining the HMD device. It may include the step of authenticating the use rights of the user wearing the.

For example, the measuring of the characteristic value may include continuously measuring the characteristic value regarding the shape of the head of the user wearing the HMD device during the authentication time with the passage of time.

For example, the authenticating step may include calculating a deviation value between the measured characteristic value and the previously registered characteristic value according to the number of times the characteristic value is measured during the authentication time, and comparing the calculated deviation value with a preset threshold value. And authenticating a use right of the user wearing the HMD device when the deviation value is less than the threshold.

As a technical means for achieving the above-described technical problem, an embodiment of the present disclosure, by using at least one sensor included in the HMD device registers the characteristic values of the head shape of the plurality of users using the HMD device, respectively Acquiring a first characteristic value about a head shape of a first user wearing the HMD device using at least one sensor; and based on the first characteristic value and a plurality of registered characteristic values, the first user. And identifying a user of the HMD device.

For example, the identifying may include calculating a difference value between each of the acquired first characteristic value and the plurality of registered characteristic values, and calculating a characteristic value having a minimum calculated difference value among the plurality of registered characteristic values. 1 may include determining by the user's characteristic value.

As a technical means for solving the above-described technical problem, an embodiment of the present disclosure, a computer-readable recording medium provides a computer-readable recording medium recording a program for executing the above method on a computer. .

Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present disclosure. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted for simplicity of explanation, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, which means that it may further include other components, except to exclude other components unless otherwise stated.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

Referring to FIG. 1A, feature points representing the shape, ie, geometry, of the human skull are indicated. For example, the shape of a human skull can be specified via the Manchester protocol. The shape of a human skull has different characteristics, depending on race and individual, such as fingerprints and irises. For example, the shape, size, and curvature of a skeleton such as a human frontal bone, temporal bone, occipital bone, glabella, supraorbital foramen, etc. are unique to each individual. It includes the features.

Referring to FIG. 1B, the shape of a human head may be schematically illustrated and classified by type. The shape of a human head, ie, the shape of a skull, may mean at least one of the shape, size, skeletal structure, and curvature of the skull. Human skulls can be classified into ellipsoid, spheroid, oviod, pearl-shaped, pentagonoid, rhomboid, wedge, and the like, for example. However, the shape of the human skull is not limited to the listed form.

1A and 1B, the shape of a human head, ie, the shape of a skull, includes different geometrical features for each individual. Therefore, in the HMD device 1000 mounted in physical contact with the head of a person, the sensor may measure a characteristic value of the head shape through a sensor, thereby being used as a method of authenticating a user's right to use.

2A and 2B are diagrams for describing a method of authenticating a user's use authority by the head mounted display apparatus (hereinafter, referred to as an HMD apparatus) 1000 and an HMD apparatus 1000 according to an exemplary embodiment of the present disclosure. The HMD device 1000 is a display device worn on a user's head. In detail, the HMD apparatus 1000, which is a kind of wearable device, refers to various digital devices that allow a user to wear multimedia contents or experience virtual reality or augmented reality.

Referring to FIG. 2A, the HMD device 1000 externally includes a mounting belt 110 that supports a portion of the user's skull in a form surrounding the user's skull, and surrounds the frontal, temporal, and occipital bones of the user. It may include a strap band 120 to support and a mask 130 covering a portion of the face of the user. In one embodiment, the HMD device 1000 may further include other components such as a display unit 710 (see FIG. 28) and a lens 720 (see FIG. 28), which will be described later in the description of FIG. 28. .

The HMD device 1000 includes a plurality of sensors 211 to 214 disposed to be spaced apart from each other in the mounting belt 110, a plurality of sensors 221 to 224 and a mask disposed to be spaced apart from each other in the strap band 120. 130 may further include a plurality of sensors 231 to 234 spaced apart from each other. In an embodiment, the plurality of sensors 211 to 234 may measure characteristic values regarding the shape of the head of the user wearing the HMD device 1000. The head shape of the user may mean a geometrical or structural feature including the size, shape, curvature of the user's skull, the curvature of the skeleton, or the size, shape, curvature of the user's face, the placement of the eyes, nose, or mouth. .

The characteristic value regarding the user's head shape may mean physical and geometrical parameters for geometric and structural features related to the user's head shape. For example, the characteristic values related to the shape of the user's head may include tension values, pressure values, and stress values of the user's skull or the user's face measured using the plurality of sensors 211 to 234. and at least one of geometric parameters including a stress value and a stress value.

In one embodiment, the plurality of sensors 211 to 234 may include at least one of a tension sensor, a pressure sensor, a stress sensor, a strain sensor, a conductive sensor, and a light emitting sensor. It may include, but is not limited due to the examples listed. In one embodiment, the HMD device 1000 measures the curvature user1 of the skull of the user wearing the HMD device 1000 using the plurality of sensors 211 to 214, and registers the measured curvature with the registered authentication. The user's authority may be authenticated as compared with the curvature of the skull of the user (refer to FIG. 2B).

In another embodiment, the HMD device 1000 measures the curvatures of the temporal and posterior bones of the user wearing the HMD device 1000 using the plurality of sensors 221 to 224, and registers the measured curvatures. Compared with the curvature of the user's temporal and laryngeal bones, the user's authority can be authenticated.

The HMD device 1000 measures a feature regarding the shape of the user's head through physical and mechanical measurement methods through physical contact with a part of the user's body, that is, the head, and the feature regarding the registered user's head shape. In comparison, the user's permission can be authenticated.

In detail, the HMD device 1000 measures a characteristic value of a head shape of a user wearing the HMD device 1000 by using the plurality of sensors 211 to 234 included in the HMD device 1000. The HMD device 1000 may authenticate a use right.

In one embodiment, the HMD device 1000 uses a plurality of sensors 211 to 234 included in the HMD device 1000 to obtain characteristic values regarding head shapes of a plurality of users who use the HMD device 1000. The first user may be identified by measuring and registering the measured values, and measuring the characteristic values of the head shape of the first user who wears the HMD device 1000 and comparing them with the plurality of registered characteristic values.

Referring to FIG. 2B, the curvature curves (l _user ₁ , l _user ₂ , l _user ₃ ) of the skulls of the plurality of users measured using the plurality of sensors 211 through 234, and the skulls of the registered authenticated users, respectively. The curvature curve l _{authenticated} is shown. In one embodiment, the HMD device 1000 uses a plurality of sensors 211-214 spaced apart within the mounting belt 110 (see FIG. 2A) to all of the skulls of a plurality of users wearing the HMD device 1000. Or measure the curvature of some of the curves of multiple users (l _user ₁ , l _user ₂ , l _user ₃ ) can be obtained respectively.

The HMD device 1000 may have a curvature curve (l _user ₁ , l _user ₂ , l _user ) of a plurality of users. ₃ ) by comparing the curvature curve (l _{authenticated} ) of the registered user who has been authenticated with the authority to use the HMD device 1000, the authenticated user may be determined among the plurality of users. In one embodiment, the HMD device 1000 can obtain not only the curvature curve of the skull, but also the curvature curves for the temporal and laryngeal bones, and compares the curvature curves for the pre-registered temporal and laryngeal bones with the obtained curvature curves. The user's right to wear the device 1000 may be authenticated.

Recently, in using the HMD device 1000, authentication of a usage right has emerged as an important problem. In particular, authenticating the user's permission to use the HMD device 1000 is important for the protection or security of personal information. In particular, in the case of the HMD device 1000 that is used in common in the family, a problem may occur such that a minor is provided with adult content by using the HMD device 1000, so authentication of the use right is necessary. .

2A and 2B, a plurality of sensors 211 to 234 included in the HMD device 1000 are used to obtain a curvature curve regarding a head shape of a user wearing the HMD device 1000. By authenticating the user's usage rights, a simple, accurate and reliable biometric authentication method can be provided. In addition, the authentication method according to the present embodiment does not require a separate iris recognition sensor or a face scanner, and thus may further reduce costs, which is advantageous in terms of cost.

3 is a block diagram illustrating components of an HMD device 1000 according to an embodiment of the present disclosure.

Referring to FIG. 3, the HMD device 1000 may include a sensor 200, a memory 300, and a controller 400. However, the HMD device 1000 may not only include the listed components but may further include a supporting member including a mounting belt 110, a strap band 120, and a mask 130 (see FIG. 1A).

The sensor 200 may measure a characteristic value regarding a head shape of a user wearing the HMD device 1000. The sensor 200 is disposed on any one of the mounting belt 110, the strap band 120, and the mask 130 (see FIG. 2A), and when the user wears the HMD device 1000 on the head, the head of the user Physical and mechanical contact with The arrangement of the sensor 200 will be described later in the description of FIGS. 6A to 6C, 7, 9, 11, and 14.

In an embodiment, the sensor 200 may measure at least one of a tension value, a pressure value, a stress value, and a stress deformation value for all or part of a skull or face of a user wearing the HMD device 1000. . The sensor 200 may be composed of one sensor or a plurality of sensors. In one embodiment, the sensor 200 may include at least one of a tension sensor, a pressure sensor, a stress sensor, a strain sensor, a conductive sensor, and a light emitting sensor. have.

The memory 300 may store a pre-registered characteristic value regarding a head structure of an authenticated user who has the authority to use the HMD device 1000. In one embodiment, the memory 300 classifies and stores the registered characteristic values for each series of characteristic values obtained from each of the plurality of sensors 200 disposed apart from each other, or the flow of time from the sensor 200. According to the present invention, it is possible to store continuously obtained characteristic values in time series.

In an embodiment, the memory 300 may store characteristic values of head shapes of a plurality of users who use the HMD device 1000 measured by using the sensor 200. The memory 300 classifies and stores a plurality of characteristic values obtained from each of the sensors 200 spaced apart from each other for each series, or a plurality of the plurality of sensors 200 continuously acquired over time from the plurality of sensors 200. The characteristic values of can be stored in time series, respectively.

The memory 300 may include at least one of an internal memory and an external memory.

The built-in memory may be, for example, volatile memory (for example, dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.), nonvolatile memory (for example, one time programmable ROM). ), PROM (Programmable ROM), EPROM (Erasable and Programmable ROM), EEPROM (Electrically Erasable and Programmable ROM), Mask ROM, Flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD). It may include.

For example, the external memory may include at least one of Compact Flash (CF), Secure Digital (SD), Micro Secure Digital (Micro-SD), Mini Secure Digital (Mini-SD), Extreme Digital (xD), and a Memory Stick. It may include.

The controller 400 may authenticate the user's authority to use by comparing the characteristic value of the user's head shape measured by the sensor 200 with a pre-registered characteristic value stored in the memory 300. In an embodiment, the controller 400 may authenticate a user's right to use by comparing a series of characteristic values relating to a user's head shape obtained from the sensor 200 with a series of pre-registered characteristic values.

In another embodiment, the control unit 400 compares the characteristic value of the user's head shape continuously measured with the passage of time from the sensor 200 with the characteristic value registered in the memory 300 in advance. Can be authenticated. A method of authenticating the user who wears the HMD device 1000 by the controller 400 will be described later with reference to FIGS. 13 and 23A to 25.

In another exemplary embodiment, the controller 400 may compare the characteristic values of the head shape of the specific user wearing the HMD device 1000, for example, the first user, with the plurality of characteristic values stored in the memory 300, respectively. You can identify the user. In one embodiment, the controller 400 calculates a difference value between each of the feature values related to the head shape of the first user and the plurality of feature values stored in the memory 300, and the calculated difference value among the plurality of feature values is the minimum. May be determined as the characteristic value of the first user.

The controller 400 may include a CPU having a computing circuit and a logic circuit. In one embodiment, the control unit 400 may be configured as a control module (authentication module) including at least one of the CPU, RAM, ROM, GPU and BUS. In one embodiment, the controller 400 may be implemented as an application processor (AP). In one embodiment, the controller 400 may be implemented with hardware components such as FPGA or ASIC. However, the present invention is not limited thereto, and the controller 400 may include components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, and programs. It may include procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables.

In step S410, the HMD device measures the characteristic value of the head shape of the user wearing the HMD device. In one embodiment, the HMD device comprises a tension value, a pressure value, a stress value and a stress value of the skull or user's face of the user wearing the HMD device. At least one of the geometric parameters including a.

In step S420, the HMD device authenticates the use right of the user wearing the HMD device, based on the property value measured in step S410 and the pre-registered property value for the head shape of the authenticated user of the HMD device. In one embodiment, the pre-registered characteristic value regarding the head shape of the authenticated user of the HMD device may be stored in the HMD device. In one embodiment, the pre-registered characteristic value regarding the head shape of the authenticated user of the HMD device 1000 may be stored in the memory 300.

The HMD device compares the acquired series of characteristic values for the user's head shape with the stored series of registered characteristic values or writes the characteristic values for the user's head shape continuously measured over time to the HMD device. The user's permission can be authenticated against the registered property value.

In one embodiment, the authority to use the user wearing the HMD device is authenticated based on the comparison result described above. The HMD device may authenticate the user's right to use if the measured characteristic value of the user's head shape corresponds to a registered characteristic value.

In addition, the HMD device may authenticate the user's right to use when the difference between the measured characteristic value of the user's head shape and the previously registered characteristic value stored in the HMD device is less than a preset threshold. When the user's right to wear the HMD device is authenticated, the HMD device may perform an operation of displaying multimedia content or providing virtual reality or augmented reality.

On the contrary, when the difference between the measured characteristic value and the pre-registered characteristic value stored in the HMD device is greater than or equal to a preset threshold, the HMD device may reject the user's authorization of use. If authentication of the user's right to wear the HMD device is denied, the HMD device may be turned off without performing a separate operation.

5A to 5C are diagrams for describing a method of acquiring characteristic values of a user's head shape when the sensor 200 contacts the user's head. In the exemplary embodiment illustrated in FIGS. 5A to 5C, the sensor 200 may contact an area of the user's head and sense an electrical resistance value that changes according to the contacted form. In one embodiment, the sensor 200 may be comprised of a strain sensor or a strain gauge. However, the strain gauge is only one example of the sensor 200, and the sensor 200 may include at least one of a tension sensor, a pressure sensor, a stress sensor, a conductive sensor, and a light emitting sensor, and is not limited to the examples listed.

Referring to FIG. 5A, the sensor 200 may include a resistance pattern line 200a and a resistance sensing terminal 200b. The resistance pattern lines 200a may be arranged in a zigzag form in parallel directions. When the HMD device 1000 is mounted on a user's head, the resistance pattern line 200a may vary in length according to the user's head shape. The resistance sensing terminal 200b may convert the change in the length of the resistance pattern line 200a with respect to the unit length of the resistance pattern line 200a into an electrical resistance value, and sense the change in the converted electrical resistance value. In one embodiment, the resistance sensing terminal 200b may sense a change in the electrical resistance value using a Wheatstone Bridge.

5B and 5C, the sensor 200 may detect a change in the electric resistance value due to the shape of the user's head. In the embodiment shown in FIG. 5B, when the head shape of the user is convex upward, the resistance pattern line 200a may be tensioned to increase its length and decrease its width. In this case, the resistance sensing terminal 200b may detect an increase in electrical resistance. In the embodiment shown in FIG. 5C, unlike in FIG. 5B, the shape of the user's head is concave down, and thus the resistance pattern line 200a can be contracted so that the length can be reduced and the width can be increased. In this case, the resistance sensing terminal 200b may sense a decrease in electrical resistance.

In one embodiment of the present disclosure, through the method shown in Figures 5b and 5c to measure the characteristic value of the head shape of the user wearing the HMD device 1000, that is, resistance value, pressure value, stress change value, etc. Can be. However, the contents shown in FIGS. 5A to 5C are merely examples, and the type of the sensor 200 and the characteristic value measuring method using the sensor 200 are not limited to the described contents.

6A to 6C illustrate a plurality of

sensors

211 and 221 to 228 spaced apart from each other in the HMD device 1000 when the HMD device 1000 is mounted on a user's head according to an embodiment of the present disclosure. Is a perspective view and a plan view showing a position where a contact is made in a user's head.

Referring to FIG. 6A, the plurality of

sensors

211 and 221 to 224 may be disposed in one region on the user's skull or in one region of the frontal bone, temporal bone and laryngeal bone. Specifically, when the HMD device 1000 is mounted on the user's head, the first sensor 211 disposed in the mounting belt 110 is disposed in some region on the user's skull to sandwich the user's skin tissue. Can be in contact with the skull. In addition, when the HMD device 1000 is mounted on the user's head, the 2-1 sensor 221 disposed in the strap band 120 is located in the first region adjacent to the glans, and the 2-2 sensor 222 is In the second area on the occipital bone, the 2-3 sensor 223 sensor and the 2-4 sensor 224 are disposed on the third area on the left temporal bone and the fourth area on the right temporal bone, respectively, to intersect the skin tissue of the user. Can be placed in contact with the user's frontal, temporal and occipital bones.

Referring to the plan view of FIG. 6A, the 2-1st sensor 221 and the 2-2nd sensor 222 form a virtual straight line in the y direction, and the 2-3rd sensor 223 and the 2-second sensor are formed. The four sensors 224 may be connected by forming a virtual straight line in the x direction. The first sensor 211 is the intersection of the virtual straight lines formed by the 2-1 sensor 221, the 2-2 sensor 222, the 2-3 sensor 223, and the 2-4 sensor 224, respectively. Can be placed in. In one embodiment, the first sensor 211 and the second-first sensor 221 to the second-4 sensor 224 may be at least one of a tension sensor, a pressure sensor, a stress sensor, a deformation sensor, a conductive sensor, and a light emitting sensor. Can be implemented.

Referring to FIG. 6B, the plurality of

sensors

211 and 221 to 224 may be disposed in one region on the user's skull or in one region of the frontal bone, temporal bone and laryngeal bone. The arrangement of the plurality of

sensors

211 and 221 to 224 illustrated in FIG. 6B is an embodiment in which the positions of the plurality of

sensors

211 and 221 to 224 illustrated in FIG. 6A are moved by a predetermined distance in the clockwise direction.

Specifically, when the HMD device 1000 is mounted on the user's head, the 2-1 sensor 221 disposed in the strap band 120 is located in the fifth region between the glans and the right temporal bone, and the 2-2 sensor. 222 is in the sixth region between the occipital bone and the left temporal bone, the 2-3 sensor 233 is in the seventh region between the tibia and the left temporal bone, and the second-4 sensor 224 is located between the right temporal bone and the occipital bone. Disposed in the eighth area to contact the frontal, temporal and occipital bones of the user with the skin tissue of the user interposed therebetween. The first sensor 211 may be disposed at the same position as that illustrated in FIG. 6A.

Referring to the plan view of FIG. 6B, the 2-1st sensor 221 and the 2-2nd sensor 222 have a predetermined angle between 0 ° and 90 ° in the counterclockwise direction with respect to the x-axis. Form a diagonal, and the 2-3 sensor 223 and the 2-4 sensor 224 are connected to form a virtual diagonal line having a predetermined angle between 90 ° and 180 ° counterclockwise with respect to the x-axis. Can be. As described with reference to FIG. 6A, the first sensor 211 and the second-first sensor 221 to the second-fourth sensor 224 may include a tension sensor, a pressure sensor, a stress sensor, a stress deformation sensor, a conductive sensor, and a light emitting sensor. It may be implemented in at least one of.

Referring to FIG. 6C, the plurality of

sensors

211 and 221 to 228 may be disposed in one region of the user's skull or in one region of the frontal bone, temporal bone and laryngeal bone. The arrangement of the plurality of sensors 211, 221-228 shown in FIG. 6C is an embodiment combining the positions of the plurality of sensors 211, 221-224 shown in FIGS. 6A and 6B. Specifically, when the HMD device 1000 is mounted on the user's head, a total of eight sensors may be disposed in the strap band 120, and the 2-1 th sensor 221 to the 2-8 th sensor 228. ) May be disposed in a counterclockwise direction with the skin tissue of the user interposed on the frontal bone, left temporal bone, laryngeal bone, and right temporal bone of the user. Referring to the plan view shown in FIG. 6C, the 2-1 th sensor 221 to 2-8 th sensor 228 form a virtual straight line in the x direction and the y direction, respectively, and form two virtual diagonal lines. Can be connected. As described with reference to FIG. 6C, the first sensor 211 and the second-first sensor 221 to the second-fourth sensor 224 may include a tension sensor, a pressure sensor, a stress sensor, a stress deformation sensor, a conductive sensor, and a light emitting sensor. It may be implemented in at least one of.

6A to 6C only illustrate an example in which the plurality of

sensors

211 and 221 to 228 are disposed at a specific position of the user's head when the HMD device 1000 is mounted to the user's head. The positions of the sensors 211, 221-228 are not limited to the positions shown in FIGS. 6A-6C. In addition, the number of the first sensor 211, the second-first sensor 221, and the second-eighth sensor 228 is not limited to that shown in FIGS. 6A to 6C.

FIG. 7 is a diagram for describing a method of measuring, by the HMD device 1000, a characteristic value relating to the shape of an upper surface of a skull of a user, according to an embodiment of the present disclosure. FIG. 8 is a diagram illustrating an HMD device 1000 of FIG. 7. It is a figure which shows the Example which classified the characteristic value acquired by the method shown by the series (S1-S6).

Referring to FIG. 7, the HMD device 1000 may include a mounting belt 110 and a plurality of sensors 211 to 214 spaced apart from each other in the mounting belt 110. The plurality of sensors 211 to 214 may be contacted with the skin tissue of the user interposed on all or a portion of the upper surface of the skull of the user.

In one embodiment, the plurality of sensors 211 to 214 may be tension sensors that measure a tension (or tension) value that is changed by the shape, size, or skeletal structure of all or part of the upper surface of the skull of the user. However, the present invention is not limited thereto, and the plurality of sensors 211 to 214 may be pressure sensors or stress sensors that measure pressure values or stress change values that are changed by the shape, size, or skeleton structure of all or part of the upper surface of the skull of the user. , At least one of a deformation sensor, a conductive sensor, and a light emitting sensor.

In one embodiment, the plurality of sensors 211-214 may measure a tension value changed by all or part of the user's upper surface of the skull during a predetermined authentication time to authenticate the user's permission to wear the HMD device 1000. The measured tension values may be classified into a plurality of series and arranged in time series.

Referring to FIG. 8, tension values T _{211_t1} to T _{214_t6} by all or part of the upper surface of the skull of the user obtained from the plurality of sensors 211 to 214 are classified and listed as a plurality of series S1 to S6. . The plurality of series S1 to S6 may be measured during the authentication time and obtained in time series. In detail, the first series S1 may be a set of tension values T _{211_t1} to T _{214_t1} measured at the first time t1 within the authentication time using the plurality of sensors 211 to 214. The second series S2 may be a set of tension values T _{211_t2} to T _{214_t2} measured at the second time t2 within the authentication time using the plurality of sensors 211 to 214. The third series S3 to the sixth series S6 may also be a set of tension values measured at the third time t3 to the sixth time t6, respectively.

The plurality of sensors 211 to 214 measure the curvature of all or part of the user's skull by combining the tension values included in each of the plurality of series S1 to S6, and the curvature curve l ₂₁₀ for the measured curvature. Can be obtained.

The plurality of series S1 to S6 shown in FIG. 8 are not limited to include only tension values, and pressure values obtained by measuring all or part of the upper surface of the skull of the user using the plurality of sensors 211 to 214, It may include any one of a stress value and a stress strain value.

The registration series _Saut has the authority to use the HMD device 1000 using the plurality of sensors 211 to 214 during the registration time, and measures all or part of the upper surface of the skull of the user to be authenticated. It can be a set of tension values.

The registration series _Saut may be stored in the memory 300 (see FIG. 3). In one embodiment, the registration series _Saut may be a series stored and registered in the memory 300 prior to the authentication time. In one embodiment, the controller 400 (refer to FIG. 3) selects one of a plurality of series categorized by the plurality of sensors 211 to 214, and selects a series of registered characteristic values stored in the memory 300. Compared to the series, you can authenticate the user's permissions. Detailed description thereof will be described later in the description with reference to FIG. 12.

FIG. 9 is a diagram for describing a method of measuring, by the HMD device 1000, characteristics of a user's temporal bone and laryngeal bone, according to an embodiment of the present disclosure. It is a figure which shows the Example which classified the characteristic value acquired by the method shown to into the several series.

Referring to FIG. 9, the HMD device 1000 may include a strap band 120 and a plurality of sensors 221 to 224 spaced apart from each other in the strap band 120. The plurality of sensors 221 to 224 may be in contact with the user's skin tissue on the temporal and laryngeal bones of the user. Specifically, the 2-1 sensor 221 is in one region of the left temporal bone of the user, the 2-2 sensor 222 is in one region between the left temporal bone and the occipital bone, and the 2-3 sensor 223 is the occipital bone In one region between the right side and the right temporal bone, the second-4 sensors 224 may be disposed in one area of the right temporal bone. However, the arrangement of the 2-1 sensor 221 to 2-4 sensor 224 is not limited to the position shown in FIG.

In one embodiment, the plurality of sensors 221 to 224 may be tension sensors that measure tension (or tension) values that are changed by the shape, size, or skeletal structure of the temporal and laryngeal bones of the user. However, the present invention is not limited thereto, and the plurality of sensors 221 to 224 may include a pressure sensor, a stress sensor for measuring a pressure value or a stress change value changed by the shape, size, or skeletal structure of the frontal bone, temporal bone, and laryngeal bone of the user. It may be at least one of a deformation sensor, a conductive sensor, and a light emitting sensor, but is not limited to the examples listed.

In one embodiment, the plurality of sensors 221 to 224 may measure the tension value changed due to the shape of the temporal and occipital bones of the user during a predetermined authentication time for authenticating the use authority of the user wearing the HMD device 1000. In addition, the measured tension values may be classified into a plurality of series and arranged in a time series. The plurality of sensors 221 to 224 measure the curvature of the skeletal structure of the temporal and occipital bones of the user by combining the tension values included in each of the plurality of series S1 to S6, and the curvature curve l for the measured curvature l. ₂₂₀ can be obtained.

Referring to FIG. 10, the tension values T _{221_t1} to T _{224_t6} due to the shape of the temporal and occipital bones of the user measured using the plurality of sensors 221 to 224 are classified into a plurality of series S1 to S6. do. The acquisition and classification methods of the plurality of series S1 to S6 are the same as those described with reference to FIG. 8, and thus redundant descriptions thereof will be omitted.

The registration series _Saut has the authority to use the HMD device 1000 by using the plurality of sensors 221 to 224 during the registration time, and the tension value measured for the temporal and laryngeal bones of the user to be authenticated. It may be a set of. Register series is the same as described in Figure 8 of the description of (S _aut) will be omitted.

FIG. 11 is a diagram for describing a method of measuring, by the HMD device 1000, a characteristic value regarding the shape of a skull top, temporal bone, and laryngeal bone of a user, and FIG. 12 is an HMD device 1000 according to an embodiment of the present disclosure. 11 is a diagram illustrating an embodiment in which the characteristic values obtained by the method illustrated in FIG. 11 are classified into a plurality of series.

Referring to FIG. 11, the HMD device 1000 may include a mounting belt 110, a strap band 120, and a plurality of sensors 211 to 224. The first-first sensors 211 to 1-4 sensors 214 may be spaced apart from each other in the mounting belt 110. The second-first sensors 221 to 2-4 sensors 224 may be spaced apart from each other in the strap band 120. The first-first sensor 211 to the first-fourth sensor 214 are the same as the plurality of sensors 211 to 214 shown in FIG. 7, and the second-first sensor 221 to the second-fourth sensor ( 224 is the same as the plurality of sensors 221 to 224 illustrated in FIG. 9, and overlapping descriptions thereof will be omitted.

In one embodiment, the plurality of sensors 211 to 224 are changed due to the shape of the upper surface of the user's skull, the temporal bones of the user and the occipital bone during a predetermined authentication time for authenticating the user's permission to wear the HMD device 1000. The tension values can be measured, and the measured tension values can be classified into a plurality of series and arranged in time series. 11 is a combination of the embodiments shown in FIGS. 7 and 9, and the HMD device 1000 according to the present embodiment uses the plurality of sensors 211 to 224. Measurement of the strain value due to the skeletal shape of the upper, temporal and occipital bones of the user's skull, and time series of the measured tension values within the authentication time to generate a plurality of series (S1 to S6) In addition, by combining the tension values included in each of the plurality of series (S1 to S6), it is possible to measure the curvature of the skeleton structure of the upper, temporal and occipital bones of the user's skull. In addition, the HMD device 1000 may obtain a curvature curve l ₂₁₀ for the upper surface of the skull and a curvature curve l ₂₂₀ for the temporal and laryngeal bones.

Referring to FIG. 12, the tension values T _{211_t1} to T _{224_t6} _according to the shape of the upper surface, temporal bone, and _laryngeal bone of the user measured using the plurality of sensors 211 to 224 may include a plurality of series S1 to S6. Are classified and listed. Specifically, in the embodiment illustrated in FIG. 12, the first series S1 may have a tension value T _{211_t1 based} on the shape of the upper surface of the skull of the user obtained from the plurality of sensors 211 through 214 disposed in the mounting belt 110. To T _{214_t1} ) and tension values T _{221_t1} to T _{214_t1} _according to the shape of the temporal and occipital bones of the user obtained from the plurality of sensors 221 to 224 disposed in the strap band 120. The plurality of series S1 to S6 illustrated in FIG. 12 may be a combination of the plurality of series S1 to S6 illustrated in FIGS. 8 and 10. In other words, in the embodiment illustrated in FIG. 12, the HMD device 1000 measures the curvature of the upper surface of the skull of the user by combining the tension values T _{221_t1} to T _{224_t6} included in the plurality of series S1 to S6. The curvature of the temporal bones and laryngeal bones of the user can be measured. In one embodiment, the HMD device 1000 obtains a curvature curve l _{210 according} to the shape of the upper surface of the skull of the user wearing the HMD device 1000 and a curvature curve l ₂₂₀ due to the temporal and occipital bones of the user. can do.

The plurality of series S1 to S6 illustrated in FIG. 12 are not limited to include only tension values, and characteristics of measuring the upper surface of the skull of the user, the temporal bone, and the occipital bone of the user using the plurality of sensors 211 to 224. Values, such as pressure values, stress values, and stress strain values.

The registration series _{Sa a} is a table of tension values measured for the upper surface of the skull, the temporal bones and the occipital bones of a user who is authorized to use the HMD device 1000 using the plurality of sensors 211 to 224 during the registration time. It can be a set. The registration series _{Sa a is} shown in FIGS. 8 and 10 except for the features including the tension value measured for the upper surface of the skull of the user wearing the HMD device 1000 and the tension value measured for the temporal and laryngeal bones of the user. Since it is the same as the registration series (S _aut ) shown, overlapping description will be omitted.

In operation S1310, at least one sensor included in the HMD device is used to measure characteristic values of different areas on the skull or face of the user wearing the HMD device.

7, 9, and 11, the HMD device 1000 is spaced apart from each other in the plurality of sensors 211 through 214 and the strap band 120 that are spaced apart from each other in the mounting belt 110. It may include a plurality of sensors 221 to 224 disposed. In one embodiment, the characteristic value is the upper surface of the skull of the user wearing the HMD device 1000 using the first-first sensor 211 to the first-fourth sensor 214 of the plurality of sensors 211 to 224. The tension value measured for the shape and / or the tension value measured for the shape of the temporal bone and the occipital bone of the user using the 2-1 th sensor 221 to 2-4 sensor 224 may be referred to. However, the present invention is not limited thereto, and the characteristic value may mean a pressure value or a stress change value for the skull, temporal bone, or laryngeal bone of the user measured from the plurality of sensors 211 to 224.

In operation S1320, the HMD device classifies the measured characteristic values into at least one series.

In one embodiment, the HMD device may measure characteristic values for the upper surface of the skull, the temporal bones of the user and the occipital bone of the user during a predetermined authentication time for authenticating the user's authority to wear the HMD device, and the measured characteristic values Can be classified into a plurality of series. The HMD device may classify the plurality of series according to the time when the characteristic value is measured within the authentication time, and may sort the sorted series in a time series.

In step S1330, the HMD device selects any one of the at least one series. In one embodiment, the HMD device may select any one of a plurality of series (see S1 to S6, FIGS. 8, 10 and 12) classified in time series. In one embodiment, the selected series may include any of the tension values for the user's skull top surface, the user's tension values for the temporal and occipital bones, and combinations thereof, measured at a particular time within the authentication time. .

In operation S1340, the HMD device determines whether the selected series corresponds to a series of pre-registered characteristic values.

In one embodiment, the HMD device may classify the characteristic value of the head shape of the user who is authorized to use the HMD device according to the measured area. For example, in the memory, a tension value measured for at least one of the upper, temporal and occipital bones of the skull of a user who has been authorized to use the HMD device by using a tension sensor is determined according to the upper, temporal and occipital bones of the skull. The sorted series can be stored. In another embodiment, the memory may store a series of the tension values measured for at least one of the top, temporal and occipital bones of the skull of the user who is authorized to use the HMD device by using a tension sensor. have.

In an embodiment, the HMD device may determine whether the series selected in step S1330 among the plurality of series corresponds to a series of pre-registered characteristic values. The HMD device may compare a characteristic value included in the selected series with a characteristic value of a previously registered series. In an embodiment, the HMD device may compare the tension values included in the selected series with the tension values included in the pre-registered series to determine whether the difference value is less than the preset threshold. In one embodiment, the HMD device may compare the tension values included in the selected series with the tension values included in the registered series through a Welch t-test.

In operation S1350, when the HMD device determines that the series selected in operation S1340 corresponds to a series of pre-registered feature values, the HMD device recognizes the user's right to use the HMD device.

In one embodiment, the HMD device calculates a difference between a characteristic value included in the selected series, such as a tension value, and a characteristic value included in a registered series, eg, a registered tension value, and the calculated difference value is a preset threshold. If less, it may be determined that the selected series corresponds to a series of pre-registered characteristic values.

In one embodiment, the control unit 400 (refer to FIG. 28) may provide an electrical signal for instructing to perform the operation of displaying multimedia content or providing virtual reality or augmented reality when the user right of wearing the HMD device is authenticated. It may transmit to the main control unit 900 (see FIG. 28).

In operation S1360, when the HMD device determines that the series selected in operation S1340 does not correspond to a series of pre-registered feature values, the HMD device may reject authentication of the user wearing the HMD device. In one embodiment, the HMD device calculates the difference between the characteristic value included in the selected series and the characteristic value included in the registered series, and if the calculated difference value is greater than or equal to a preset threshold, You can decide not to correspond with the series. In this case, the HMD device may prevent the HMD device 1000 from performing a separate operation. In an embodiment, the controller 400 (see FIG. 28) may transmit an electrical signal to the main controller 900 (see FIG. 28) to turn off the power of the HMD device.

FIG. 14 is a view illustrating a position where a plurality of sensors 231 to 238 included in the HMD device 1000 according to an embodiment of the present disclosure are spaced apart from each other and are in contact with a user's face. FIG. 14 is a diagram illustrating an embodiment in which the HMD device 1000 classifies characteristic values of a user's face shape measured using a plurality of sensors 231 to 238 shown in FIG. 14 into a plurality of series.

Referring to FIG. 14, the HMD device 1000 may include a mask 130 mounted on a part of a face of a user wearing the HMD device 1000 and a plurality of sensors 231 spaced apart from each other in the mask 130. To 238). Although the plurality of sensors 231 to 238 are illustrated as eight in FIG. 14, the number and positions of the plurality of sensors 231 to 238 are not limited as illustrated.

The plurality of sensors 231 to 238 may be in contact with a user's skin tissue on a part of the user's face. The mask 130 may include at least one of a facial skeleton of the user, such as a galbella, a nasal bone, an ethmoid bone, a lacrimal bone, a supraorbital foramen, and an infraorbital foramen. The sensors 231 to 238 are disposed on one, and the sensors 231 to 238 may be disposed on one region of the face skeleton of the user listed.

In one embodiment, the plurality of sensors 231 through 238 may be pressure sensors that measure pressure values that are deformed by at least one of the facial skeleton, such as the cranial, fibula, ethmoid, pubic, orbital and orbital. However, the plurality of sensors 231 to 238 are not limited to the pressure sensor, and the plurality of sensors 231 to 238 may include at least one of a tension sensor, a stress sensor, a stress deformation sensor, a conductive sensor, and a light emitting sensor. have. In one embodiment, the plurality of sensors 231 to 238 may measure the pressure value changed by the face skeleton of the user during a predetermined authentication time for authenticating the use authority of the user wearing the HMD device 1000, and measuring The pressure values can be classified into a plurality of series and listed in a time series.

Referring to FIG. 15, the pressure values P _{231_t1} to P _{238_t6} _according to the shape of the face skeleton of the user obtained from the plurality of sensors 231 to 238 are classified into a plurality of series S1 to S6. The plurality of series S1 to S6 may be measured during the authentication time and obtained in time series. For example, the first series S1 may be a set of pressure values T _{231_t1} to T _{238_t1} measured at the first time t1 within the authentication time using the plurality of sensors 231 to 238. The plurality of sensors 231 to 238 may measure the shape of the skeleton of the face part of the user by combining the pressure values included in each of the series S1 to S6. The plurality of series S1 to S6 shown in FIG. 15 are not limited to include only pressure values, and tension values and stresses obtained by measuring the shape of the skeleton of the face part of the user using the plurality of sensors 231 to 238. It may include any one of a value, a strain value, a resistance value, and light intensity.

The registration series _{Sa aut} is a pressure value that measures the shape of the face skeleton of the user who is the subject of authentication having authority to use the HMD device 1000 by using the plurality of sensors 231 to 238 during the registration time. It may be a set of. The registration series _Sa a is identical to the registration series _{Sa a} described in FIGS. 8, 10 and 12 except for a feature consisting of a set of pressure values relating to the shape of the facial skeleton of the user to be authenticated. Bar overlapping description will be omitted.

The HMD device 1000 may authenticate the use authority of the user wearing the HMD device 1000 through a characteristic value, for example, a pressure value, related to the shape of the facial skeleton of the user measured using the plurality of sensors 231 to 238. Can be. In one embodiment, the controller 400 (see FIG. 3) _classifies the pressure values P _{231_t1} to P _{238_t6} measured from the plurality of sensors 231 to 238 into a plurality of series S1 to S6, By selecting any one of the series (S1 to S6), it is determined whether the selected series corresponds to a pre-registered series stored in the memory 300 (see Fig. 3), it is possible to authenticate the user's usage rights. A detailed description of a method for authenticating a user through a series of characteristic values relating to the shape of a facial skeleton of the user is provided with reference to FIG. 13 except for the positions of the plurality of sensors 231 to 238 and the area and type of the measured characteristic values. Since the description is the same as the description, duplicate description will be omitted.

FIG. 16A illustrates an HMD device 1000 including a plurality of conductive sensors 240-1 through 240-n for measuring characteristic values relating to the shape of a facial skeleton of a user according to an embodiment of the present disclosure. It is a perspective view shown.

Referring to FIG. 16A, the HMD device 1000 may include a mask 130, and the mask 130 may include a mask pad 132 and a plurality of conductive sensors 240-1 through 240-n. Although a plurality of conductive sensors 240-1 through 240-n protrude from the mask pad 132 and are visible in FIG. 16A, this is for convenience of description. The plurality of conductive sensors 240-1 to 240-n may be disposed in the mask pad 132.

The mask pad 132 may directly contact the face of the user when the user wears the HMD device 1000. The mask pad 132 may be made of a conductive foam material. For example, the mask pad 132 may include a conductive polymer having a conductivity including polyacetylene, polyphenylene, and heterocycle POLYMER, carbon black, metal powder, and metal fiber. It may be composed of any one of the conductive materials. However, this is exemplary and the mask pad 132 is not limited to the above materials.

The plurality of conductive sensors 240-1 to 240-n may be disposed in the mask pad 132 and spaced apart by a predetermined interval along the outer edge of the mask pad 132. The plurality of conductive sensors 240-1 to 240-n may be formed of a conductive material. For example, the plurality of conductive sensors 240-1 to 240-n may be formed of a metal material including at least one of copper (Cu), aluminum (Al), nickel (Ni), and iron (Fe). It is not limited to one material. The plurality of conductive sensors 240-1 to 240-n may recognize pressures applied to the plurality of conductive sensors 240-1 to 240-n, and convert the recognized pressure values into electrical resistance values.

In an embodiment, a predetermined current may flow through the mask pad 132. When the user wears the HMD device 1000 and the mask pad 132 is compressed according to the shape of the face skeleton of the user, pressure is applied to the mask pad 132, and the shape of the mask pad 132 is changed according to the applied pressure. It can be modified. Due to the compression of the mask pad 132, the amount of current flowing through the mask pad 132 is changed, and the plurality of conductive sensors 240-1 to 240-n can measure an electric resistance value from the change in the amount of current.

In an embodiment, when the user wears the HMD device 1000, the plurality of conductive sensors 240-1 to 240-n recognize the changed pressure value by contacting the face of the user with the mask pad 132. The changed pressure value can be converted into an electrical resistance value. The HMD device 1000 may store an electric resistance value of a user, which is a target of user authentication, in the memory 300 (see FIG. 3) of the HMD device 1000. In one embodiment, the HMD device 1000 is configured to store the electrical resistance value changed in accordance with the facial skeleton of the user measured by the plurality of conductive sensors 240-1 to 240-n stored in the memory 300 (see FIG. 3). The authority to use can be authenticated against the user's resistance.

FIG. 16B is an enlarged cross-sectional view of the first region 1600 of the mask pad 132 of the HMD device 1000 illustrated in FIG. 16A.

Referring to FIG. 16B, the first conductive sensor 240-1, the second conductive sensor 240-2, and the third conductive sensor 240-3 are disposed in the mask pad 132 at predetermined intervals. The conductive pads 134 may be included in the mask pad 132.

The conductive powder 134 may be made of a metal material or a conductive polymer having current conductivity. For example, the conductive powder 134 may be composed of a metal or a metal plated metal including at least one of copper (Cu), aluminum (Al), nickel (Ni), iron (Fe), and silver (Ag). It is not limited to this.

In an embodiment, when the user wears the HMD device 1000, the conductive powder 134 may change the current value flowing through the conductive powder 134 through the mask pad 132 through the first conductive sensor 240-1. ) And the second conductive sensor 240-2 and the third conductive sensor 240-3. The first conductive sensor 240-1, the second conductive sensor 240-2, and the third conductive sensor 240-3 measure electric resistance values due to pressures changed according to a user's face skeleton through the changed current values. can do.

17A and 17B are graphs showing characteristic values of a shape of a facial skeleton of a user measured by a conductive sensor included in the HMD device 1000 according to an embodiment of the present disclosure.

Referring to FIG. 17A, when the user 1 wears the HMD device 1000, the electric resistance values changed according to the shape of the face skeleton of the user 1 may include the plurality of conductive sensors 1 through N. FIG. Each is shown in the form of a bar graph. For example, the electrical resistance value according to the pressure value changed according to the shape or contour of the face skeleton of the user 1 measured by the first conductive sensor 1 may be the first resistance value R ₁ . Similarly, the electrical resistance value measured according to the shape or contour of the facial skeleton of the user 1 measured by the second conductive sensor 2 may be the second resistance value R ₂ . In one embodiment, the electrical resistance values measured by the plurality of conductive sensors 1 through N may be different values, and the electrical resistance values measured by the plurality of conductive sensors 1 through N constitute one series to form an HMD. It may be stored in the memory 300 (see FIG. 3) of the device 1000.

Referring to FIG. 17B, when the user 2 wears the HMD device 1000, the electric resistance value changed according to the face shape of the user 2 is changed according to the plurality of conductive sensors 1 to N. It can be measured and shown in the form of each bar graph. The electrical resistance value according to the pressure value changed according to the shape of the face skeleton of the user 2 measured by the first conductive sensor 1 is R ₁ ′, which is different from the first resistance value R ₁ of FIG. 17A. It can be another value. Similarly, the electrical resistance value according to the pressure value changed according to the shape of the face skeleton of the user 2 measured by the second conductive sensor 2 is R ₂ ′, and the second resistance value R ₂ of FIG. 17A. It may be different from.

Referring again to FIG. 17A, a line graph of the electric resistance value of user 2 overlaps on the bar graph of the electric resistance value according to the plurality of conductive sensors 1 to N of user 1. Is shown. In one embodiment, the HMD device 1000 stores a series of electrical resistance values according to a plurality of conductive sensors 1 through N of a user to be authenticated, that is, user 1. 3), and when the user 2 wears the HMD device 1000, the user authority may be compared with a series of electrical resistance values of the user 1 previously stored in the memory 300 to authenticate the use authority. Can be. The HMD device 1000 may include a difference between electrical resistance values changed according to the shape of a facial skeleton of a user wearing the HMD device 1000 and electrical resistance values of an authenticated user 1 previously stored in the memory 300. May be calculated for each of the plurality of conductive sensors 1 to N, and when the calculated difference value is smaller than the preset threshold, the usage right may be authenticated.

18A illustrates a plurality of light emitting devices 250-1 to 250-n and a plurality of photosensitive devices 260-1 to 260-n that measure characteristic values regarding a shape of a face skeleton of a user according to an exemplary embodiment of the present disclosure. Is a perspective view of an HMD device 1000 including a).

Referring to FIG. 18A, the HMD device 1000 includes a mask 130, and the mask 130 includes a mask pad 134, a plurality of light emitting devices 250-1 to 250-n, and a plurality of photosensitive devices ( 260-1 to 260-n). The plurality of light emitting devices 250-1 to 250-n and the plurality of photosensitive devices 260-1 to 260-n may be disposed in the mask pad 134.

The mask pad 134 may be made of a translucent foam material that absorbs light. The mask pad 134 may absorb light emitted from the plurality of light emitting devices 250-1 to 250-n.

A plurality of light emitting devices 250-1 to 250-n may be spaced apart from each other by a predetermined interval along the outer edge of the mask pad 134. The plurality of light emitting devices 250-1 to 250-n may be arranged in an array form along the outer edge of the mask pad 134 in the mask pad 134. The plurality of light emitting devices 250-1 to 250-n may be configured as light emitting diodes (LEDs). However, the present invention is not limited thereto and may include at least one of an organic light emitting diode (OLED), a semiconductor laser (LD), and a solid laser. The plurality of light emitting devices 250-1 to 250-n may emit light in the mask pad 134.

The photosensitive elements 260-1 to 260-n may be spaced apart from each other by a predetermined interval in the mask pad 134. The photosensitive elements 260-1 to 260-n may be surrounded by an array of the light emitting elements 250-1 to 250-n along the outer edge of the mask pad 134. In one embodiment, the plurality of photosensitive elements 260-1 to 260-n may be configured as photo resistors (PRs). The photosensitive elements 260-1 to 260-n receive the light emitted from the light emitting elements 250-1 to 250-n and absorbed by the mask pad 134, and the intensity of the received light ( light intensity) can be measured.

FIG. 18B is an enlarged cross-sectional view of the second region 1800 of the mask pad 134 of the HMD device 1000 illustrated in FIG. 18A.

Referring to FIG. 18B, the light emitting device 250 and the photosensitive device 260 may be disposed in the mask pad 134. The light emitting device 250 may be spaced apart from the photosensitive device 260 by a predetermined distance.

In the embodiment illustrated in FIGS. 18A and 18B, when the user wears the HMD device 1000, the face of the user may contact the mask pad 134 so that the mask pad 134 may be compressed. When the mask pad 134 is compressed, the intensity of light emitted from the plurality of light emitting devices 250-1 to 250-n may be reduced. The HMD device 1000 may store the light intensity values measured according to the degree to which the photosensitive elements 260-1 to 260-n are compressed by the mask pad 134 according to the facial skeleton of the user. You can authenticate the usage rights by comparing with the light intensity value of the authenticated user.

19A and 19B are graphs showing characteristic values of a shape of a facial skeleton of a user measured by a plurality of photosensitive elements included in the HMD device 1000 according to an embodiment of the present disclosure.

Referring to FIG. 19A, when the user 1 wears the HMD device 1000, the mask pad 134 (see FIGS. 18A and 18B) is compressed according to the shape of the facial skeleton of the user 1. The intensity of light emitted from the plurality of light emitting elements disposed in the mask pad 134 may be changed. The plurality of photo registers 1 to N may measure the intensity of light emitted from the plurality of light emitting elements, and the measured intensity of light may be shown in the form of a bar graph according to each of the plurality of photo registers 1 to N. FIG. Can be. For example, the intensity of light changed according to the shape of the facial skeleton of the user 1 measured by the first photo register 1 may be a first intensity value I ₁ . Similarly, the light intensity according to the shape of the face skeleton of the user 1 measured by the second photo register 2 may be a second intensity value I ₂ . In one embodiment, the light intensity measured by the plurality of photo registers 1 through N may be different values, and the light intensity measured by the plurality of photo registers 1 through N constitutes a series to form an HMD. It may be stored in the memory 300 (see FIG. 3) of the device 1000.

Referring to FIG. 19B, when the user 2 wears the HMD device 1000, the intensity of light changed according to the shape of the facial skeleton of the user 2 is changed into a plurality of photo registers 1 through N. Referring to FIG. Can be measured and shown in the form of each bar graph. The value measured by the first photoresist 1 according to the shape of the face skeleton of the user 2 is I ₁ ′, which is different from the first intensity value I ₁ of FIG. 19A. Can be. Similarly, the value of the light intensity changed according to the shape of the facial skeleton of the user 2 measured by the second photoresist 2 is I ₂ ′, and the second intensity value I ₂ of FIG. 19A is measured. It may be different from.

FIG. 19A illustrates a light intensity value that is changed according to the shape of the face skeleton of user 1 in which the intensity of light changed according to the face skeleton of user 2 measured by the plurality of photo registers 1 to N is shown in FIG. It is shown as a line graph on the bar graph of. In an exemplary embodiment, the HMD device 1000 may store a series including a light intensity value changed according to a shape of a facial skeleton of a user, ie, user 1, that is, an object to be authenticated, as shown in FIG. 3. If the user 2 wears the HMD device 1000, the user right may be compared with a series of light intensity values of the user 1 previously stored in the memory 300. . The HMD device 1000 may include light intensity values changed according to the shape of a facial skeleton of a user wearing the HMD device 1000 and light intensity values of an authenticated user 1 previously stored in the memory 300. The difference may be calculated for each of the plurality of photo registers 1 to N, and when the calculated difference value is smaller than the preset threshold, the usage right may be authenticated. When the difference is greater than the preset threshold, the usage right may not be authenticated.

20A is a perspective view of an HMD device 1000 including an electrode pad 270 and a conductive rubber tube 280 that measure characteristic values relating to the shape of a facial skeleton of a user according to one embodiment of the present disclosure.

Referring to FIG. 20A, the HMD device 1000 may include a mask 130, and the mask 130 may include a mask pad 132, an electrode pad 270, and a conductive rubber tube 280. In FIG. 20A, the electrode pad 270 and the conductive rubber tube 280 are shown to protrude on the mask pad 132, but this is for convenience of description. The electrode pad 270 and the conductive rubber tube 280 may be configured in plural and may be disposed in the mask pad 132. Since the mask pad 132 is the same component as the mask pad 132 illustrated in FIG. 16A, overlapping description thereof will be omitted.

The electrode pads 270 may extend in the second direction (Y direction) within the mask pad 132 and may be spaced apart by a predetermined interval in the first direction (X direction). The electrode pads 270 may be configured in plural, and current may flow through the electrode pads 270. The plurality of electrode pads 270 adjacent to each other may be disposed to have opposite electrodes. The electrode pad 270 may be formed of a metal material including at least one of copper (Cu), aluminum (Al), nickel (Ni), iron (Fe), silver (Ag), and gold (Au). It is not limited to one material. The conductive rubber tubes 280 may extend in the first direction (X direction) in the mask pad 132 and may be spaced apart by a predetermined interval in the second direction (Y direction). The conductive rubber tube 280 may extend across the electrode pad 270 in a first direction (X direction) on the electrode pad 270. The conductive rubber tube 280 may be formed in a hollow cylindrical shape. The conductive rubber tube 280 may be disposed in contact with the electrode pad 270 on the electrode pad 270. The conductive rubber tube 280 may be made of, for example, a conductive synthetic rubber including at least one of Nitrile Butadiene Rubber (NBR), Epichlorohydrin (ECH), or Ethylene Propylene (ter) Diene Monomer (EPDM), but is not limited thereto. It doesn't happen.

20B is an enlarged cross-sectional view of the third region 2000 of the mask pad 132 of the HMD device 1000 illustrated in FIG. 20A, and FIG. 20C illustrates the electrode pad 270 and the conductive rubber illustrated in FIG. 20A. An enlarged perspective view of the tube 280.

20B and 20C, a plurality of electrode pads 270 may be configured, and adjacent electrode pads 270 of the plurality of electrode pads 270 may be disposed to have electrodes in opposite directions. The conductive rubber tube 280 may be in the form of a hollow cylinder having a ring shape in cross section. The conductive rubber tube 280 may be disposed across the plurality of electrode pads 270 on the electrode pad 270.

The mask pad 132 may be spaced apart from the electrode pad 270 to be in contact with a portion of the conductive rubber tube 280. In one embodiment, the mask pad 132 may be composed of a conductive foam that is conductive.

When the user wears the HMD device 1000 illustrated in FIGS. 20A to 20C, pressure is applied to the mask pad 132, and the shape of the conductive rubber tube 280 is changed due to the pressure applied to the mask pad 132. It can be modified. As the shape of the conductive rubber tube 280 is modified, the size of the contact area between the conductive rubber tube 280 and the electrode pad 270 may change, and the current value flowing through the electrode pad 270 may change. The HMD device 1000 may measure a change in resistance value according to a change in contact interview between the conductive rubber tube 280 and the electrode pad 270. The HMD device 1000 may store, in the memory 300 of the HMD device 1000 (refer to FIG. 3), a resistance value changed according to a shape of a face skeleton of a user who is an object of user authentication. The HMD device 1000 stores the resistance value according to the size of the contact area between the conductive rubber tube 280 and the electrode pad 270 changed according to the shape of the facial skeleton of the user wearing the HMD device 1000. ) Can be used to authenticate the usage rights.

21A and 21B are characteristics of the shape of the face skeleton of the user according to the shape change of the conductive rubber tube 280 when the user does not wear or wears the HMD device 1000 according to an embodiment of the present disclosure, respectively. Figures for explaining how to measure the value.

Referring to FIG. 21A, when the user does not wear the HMD device 1000 (when not wearing), the conductive rubber tube 280 may contact the electrode pad 270 by the first area 280A. In one embodiment, when the electrode pad 270 is in contact with the conductive rubber tube 280 by the first area 280A, the HMD device 1000 determines the resistance value according to the current value flowing in the first area 280A. Can be set to (default).

Referring to FIG. 21B, when the user wears the HMD device 1000 (when worn), the conductive rubber tube 280 is compressed, and the conductive rubber tube 280 has the electrode pad 270 and the second area 280B. As long as it can be contacted. The degree of compression of the conductive rubber tube 280 is different depending on the shape of the face skeleton of the user wearing the HMD device 1000, and thus the size of the second area 280B is different from each other according to each of the plurality of conductive rubber tubes 280. can be different. In one embodiment, when the electrode pad 270 contacts the conductive rubber tube 280 by the second area 280B, the HMD device 1000 may adjust the resistance value according to the current value flowing in the second area 280B. The measurement resistance value with respect to the reference value may be stored in the memory 300 (see FIG. 3).

22A and 22B are graphs showing characteristic values of a user's face shape detected by the electrode pad 270 included in the HMD device 1000 according to an exemplary embodiment of the present disclosure.

Referring to FIG. 22A, when the user 1 wears the HMD device 1000, refer to the conductive rubber tube 280 compressed in the shape of the face skeleton of the user 1 (FIGS. 21A and 21B). ) And resistance values according to the change in the size of the contact area between the electrode pads 270 (see FIGS. 21A and 21B) are shown in the form of bar graphs according to the plurality of electrode pads 1 to N. For example, the resistance value according to the contact area changed according to the shape of the face skeleton of the user 1 measured by the first electrode pad 1 may be the first resistance value R ₁ . Similarly, the resistance value according to the contact area changed according to the shape or contour of the face skeleton of the user 1 measured by the second conductive sensor 2 may be the second resistance value R ₂ . In one embodiment, the resistance values measured at the plurality of electrode pads 1 to N may be different values, and the resistance values measured at the plurality of electrode pads 1 to N constitute one series to form an HMD device ( 1000 may be stored in the memory 300 (see FIG. 3).

Referring to FIG. 22B, when the user 2 wears the HMD device 1000, the conductive rubber tube 280 (see FIGS. 21A and 21B) and the electrode are changed according to the face shape of the user 2. The resistance values according to the contact area sizes with the pads 270 (see FIGS. 21A and 21B) are shown in the form of respective bar graphs according to the plurality of electrode pads 1 to N. The electrical resistance value according to the contact area with the conductive rubber tube changed according to the shape of the face skeleton of the user 2 measured by the first electrode pad 1 is R ₁ ′, and the first resistance value of FIG. 22A ( R ₁ ) may be a different value. Similarly, the resistance value according to the contact area with the conductive rubber tube changed according to the shape of the face skeleton of the user 2 measured by the second electrode pad 2 is R ₂ ′, which is the second resistance value of FIG. 22A. It may be different from (R ₂ ).

Referring to FIG. 22A, a broken line graph of a resistance value of user 2 is overlapped on a bar graph of resistance values according to the plurality of electrode pads 1 to N of user 1. It is. In one embodiment, the HMD device 1000 is adapted to a change in the size of the contact area with the conductive rubber tube measured at each of the plurality of electrode pads 1 to N of a user to be authenticated, that is, user 1. The series including the resistance values according to the present invention is stored in the memory 300 (see FIG. 3), and when the user 2 wears the HMD device 1000, the user 1 stored in the memory 300 is stored. The usage rights can be authenticated against a series of resistance values.

23A and 23B illustrate a characteristic value obtained by measuring a characteristic value regarding a head shape of a user wearing the HMD device 1000 according to an embodiment of the present disclosure over time and a registered characteristic value. Graphs showing the deviations. FIG. 23A is a graph measuring characteristic values of a head shape of a user who is authorized to use the HMD device 1000, and FIG. 23B is a head shape of a user who is not authorized to use the HMD device 1000. It is a graph measuring the characteristic value.

Referring to the graph illustrated in FIG. 23A, the x axis represents the number of times a characteristic value of a head shape of a user wearing the HMD device 1000 is measured from a plurality of sensors included in the HMD device 1000, and the y axis is a measurement. And a deviation value between the registered characteristic value and a pre-registered characteristic value stored in the memory 300 (see FIG. 3) and subject to authentication. In one embodiment, the number of measurements indicated by the x-axis continuously measures characteristic values over the user's head shape over time during a predetermined authentication time at which the HMD device 1000 authenticates the user wearing the HMD device 1000. It can mean the number of times measured. The registered characteristic value may be a characteristic value regarding a head shape of an authenticated user who has the authority to use the HMD device 1000. In one embodiment, the pre-registered characteristic value may be measured at a registration time different from the authentication time. The measured characteristic value is a value obtained by measuring a head shape of a user wearing the HMD device 1000 according to a passage of time during an authentication time using a plurality of sensors, and may be obtained in a linear sequence form.

The graph is shown parallel to the x axis, and may include a reference value A having a value of zero on the y axis and a deviation value B according to the number of measurements. The reference value A may mean a deviation between the pre-registered feature value and the pre-registered feature value. Since the registered characteristic value is the same value over time, the deviation has a value of 0 regardless of the number of measurements over time.

The deviation value B may mean a result obtained by calculating a difference value between the characteristic value measured during the authentication time and the registered characteristic value measured at the registration time through a predetermined algorithm over time. In one embodiment, the deviation value (B) may be a result of calculating a difference value between the measured characteristic value and the pre-registered characteristic value through a dynamic time warping algorithm (DTW). The dynamic time warping algorithm is an algorithm that measures the similarity between two linear sequences that change over time, and can measure the distance between two given sequences quantitatively.

In the embodiment illustrated in FIG. 23A, the deviation value B may have a value less than the preset threshold d _th for the number of measurements within the authentication time. When the difference value d ₁ between the deviation value B and the reference value A in the specific measurement number within the authentication time is less than the threshold value d _th , the controller 400 (see FIG. 3) wears the HMD device 1000. To authenticate the user's permissions.

Referring to the graph shown in FIG. 23B, the x-axis and the y-axis indicate the number of measurements and the deviation value, respectively, and the graph shows the characteristic values and pre-registration regarding the head shape of the user who is not authorized to use the HMD device 1000. It may include a deviation value (C) between the characteristic value. The measurement counts and deviation values, the pre-registered characteristic values and the deviation value calculation algorithms of the x-axis and the y-axis are the same as those described with reference to FIG. 23A, and thus redundant descriptions thereof will be omitted.

Deviation value (C) is a time flow of the difference between the characteristic value measured for the head shape of the user who is not authorized to use the HMD device 1000 during the authentication time and the registered characteristic value measured at the registration time. According to this may mean a result calculated through a predetermined algorithm. In one embodiment, the deviation value C may have a value greater than or equal to a preset threshold d _th for the number of measurements within the authentication time. When the difference value d ₂ between the deviation value C and the reference value A in the specific measurement number within the authentication time is greater than or equal to the threshold value d _th , the controller 400 (see FIG. 3) wears the HMD device 1000. You can deny authentication of the user's permissions.

In step S2410, the characteristic value about the head shape of the authenticated user who has the authority to use the HMD device is measured and registered. In one embodiment, the HMD device may measure the characteristic value of the head shape of the user to be authenticated during the registration time.

In step S2420, the characteristic value of the head structure of the user wearing the HMD device is measured a plurality of times over time during the authentication time. In one embodiment, during the authentication time, the HMD device may continuously measure the characteristic value of the head shape of the user wearing the HMD device over time. In one embodiment, measuring continuously may mean measuring the characteristic value multiple times in time.

In operation S2430, the HMD device compares the measured characteristic value with a previously registered characteristic value.

In an embodiment, the controller 400 (see FIG. 3) may calculate a deviation value between the characteristic value measured during the authentication time and the previously registered characteristic value using the at least one sensor 200 over time. . In one embodiment, the controller 400 may calculate the deviation value through the dynamic time distortion algorithm DTW.

In step S2440, the HMD device authenticates the usage right of the user wearing the HMD device according to the comparison result in step S2430. In an embodiment, the HMD device may authenticate the user's right to use when the deviation value calculated in step S2430 is less than the preset threshold, and may reject the authentication of the user when the deviation value is greater than or equal to the preset threshold. Detailed description thereof will be described later with reference to FIG. 25.

FIG. 25 is a method of authenticating a user's right to use by calculating a deviation value between a feature value related to a head shape of a user wearing an HMD device and a pre-registered feature value over time according to an embodiment of the present disclosure; FIG. This is a flowchart for explaining in detail.

In operation S2510, the HMD device calculates a deviation value between the measured characteristic value and the previously registered characteristic value according to the number of times the characteristic value is measured. In one embodiment, the measured characteristic value is a value obtained by measuring a head shape of a user wearing the HMD device 1000 over a plurality of times, and may be obtained in a linear sequence form. In one embodiment, the HMD device may calculate a deviation value between the characteristic value measured during the authentication time and the previously registered characteristic value using the dynamic time warping algorithm (DTW). The deviation value may be calculated in sequence form over time within the authentication time.

In operation S2520, the HMD device determines whether the deviation value is less than a preset threshold. 23A and 23B together, the calculated deviation value B is less than the preset threshold d _{th for} both positive and negative values compared to the reference value A for the number of measurements within the authentication time. It can be determined whether it has a value. In the case of the embodiment shown in FIG. 23A, the difference value d ₁ of the deviation value B and the reference value A is less than the preset threshold d _th for all the measurement times within the authentication time. In this case, there is a measurement number in which the difference value d ₂ between the deviation value C and the reference value A is greater than or equal to the preset threshold d _th within the authentication time.

In step S2530, the HMD device authenticates the use right of the user wearing the HMD device when the deviation value is less than the predetermined threshold during the authentication time.

Referring to FIG. 23A together, the controller 400 (see FIG. 3) determines that the difference between the deviation value B and the reference value A is less than the preset threshold d _th for every measurement number within the authentication time. It is possible to authenticate the usage rights of the user wearing the device. In one embodiment, the control unit 400 may be configured as a separate module for performing an authentication function, as shown in Figure 28, the control unit 400 is a multimedia content when the user authority of the user wearing the HMD device is authenticated An electrical signal that commands to display or perform an operation of providing virtual reality or augmented reality may be transmitted to the main controller 900 (see FIG. 28).

In operation S2540, the HMD device 1000 rejects authentication of the user wearing the HMD device 1000 when the deviation value is greater than or equal to a preset threshold during the authentication time. Referring to FIG. 23B, the control unit 400 determines that there is a measurement number in which the difference value d2 between the deviation value C and the reference value A is greater than or equal to the preset threshold dth within the authentication time. Authentication of a user wearing the device 1000 may be denied. In an embodiment, the controller 400 may transmit an electrical signal to the main controller 900 (refer to FIG. 28) not to perform a separate operation. In addition, the controller 400 may transmit an electrical signal to the main controller 900 to turn off the power of the HMD device 1000.

In step S2610, the HMD device registers characteristic values relating to the head shapes of the plurality of users who use the HMD device, respectively. In one embodiment, the HMD device may measure and store at least one of the size, shape, skeletal structure, and curvature of the skeleton of all or part of the skull of each of the plurality of users using the HMD device. In another embodiment, the HMD device may measure and store at least one of the size, shape, skeletal structure, and curvature of the skeleton of the temporal and laryngeal bones of each of the plurality of users using the HMD device. Further, in another embodiment, the HMD device may measure and store at least one of the size, shape, structure, and curvature of the facial skeleton of each of the plurality of users using the HMD device.

In one embodiment, the HMD device classifies and stores a plurality of characteristic values obtained by measuring from each of the sensors arranged to be spaced apart from each other for each series, or a plurality of continuously acquired by the passage of time from the plurality of sensors Each characteristic value can be stored in time series.

In operation S2620, the HMD device obtains a first characteristic value regarding a head shape of the first user wearing the HMD device. In one embodiment, the at least one sensor measures a first characteristic value comprising at least one of size, shape, skeletal structure, and curvature for all or part of the skull of the first user, temporal bone, laryngeal bone, and facial skeleton. Can be.

In step S2630, the HMD device compares the first characteristic value with the plurality of registered characteristic values, respectively. In one embodiment, the HMD device may compare the series of characteristic values relating to the shape of the first user's head with a plurality of series each including a plurality of characteristic values stored in the HMD device. In another embodiment, the HMD device may compare the characteristic values of the head shape of the first user continuously measured with the passage of time with a plurality of previously stored characteristic values.

In operation S2640, the HMD device identifies the first user based on the comparison result in operation S2630. According to an embodiment, the HMD device may determine, as the first characteristic value, a characteristic value having a minimum difference value between the plurality of characteristic values and the first characteristic value measured with respect to the head shape of the first user among the plurality of stored characteristic values. have. In one embodiment, the HMD device may identify the first user through the first characteristic value, and provide a customized function for the identified first user, such as a UI setting stored in correspondence with the first characteristic value, providing customized content, and the like. Can be.

The HMD device described with reference to FIG. 26 may provide a user experience (UX) with improved usability by identifying a user wearing the HMD device and providing a user-specific function when there are a plurality of users using the HMD device. Can be. In particular, when the HMD device is used in common or commercially, by identifying the user using the HMD device to provide only the appropriate function, it is possible to improve the security of the common device. In addition, for example, when the HMD device is commonly used by all family members in the home, when the user who is a minor wears the HMD device, adult content is blocked, or content corresponding to age group or gender is implemented. By doing so, the ease of use can be improved.

FIG. 27 illustrates a method of identifying a first user by comparing feature values of a head shape of a first user wearing an HMD device according to an embodiment of the present disclosure with feature values of a plurality of registered users; It is a flow chart.

In operation S2710, the HMD device calculates a difference value between the acquired first characteristic value and each of the plurality of characteristic values previously stored in the HMD device. In an embodiment, the HMD device may calculate a deviation value between the first characteristic value and the plurality of characteristic values using a dynamic time warping algorithm (DTW). Since the method of calculating the deviation value using the dynamic time distortion algorithm has been described with reference to FIGS. 23A, 23B, and 25, overlapping descriptions will be omitted.

In operation S2720, the HMD device determines, as the characteristic value of the first user, the characteristic value having the minimum calculated difference value among the plurality of characteristic values. In an embodiment, the HMD device may select a first characteristic value having a minimum deviation value calculated in step S2110 among a plurality of previously stored characteristic values. In addition, the HMD device may determine the first characteristic value as the characteristic value of the first user.

In operation S2730, the HMD device may identify the first user wearing the HMD device by determining the first characteristic value as the characteristic value of the first user.

FIG. 28 is a block diagram illustrating components of an HMD device 1000 according to an exemplary embodiment.

Referring to FIG. 28, the HMD device 1000 includes a sensor 200, a memory 300, a controller 400, an input / output unit 510, a camera 520, a communication module 600, and a display 710. , A lens 720, a power management module 800, and a main controller 900.

The sensor 200 may include at least one sensor for measuring a characteristic value regarding the shape of a head of a user wearing the HMD device 1000. In one embodiment, the sensor 200 may measure geometric parameters including tension values, pressure values, stress values, and stress deformation values of the skull or user's face of the user wearing the HMD device 1000. In one embodiment, the sensor 200 may include at least one of a tension sensor, a pressure sensor, a stress sensor, a deformation sensor, a conductive sensor, and a light emitting sensor.

In an embodiment, the sensor 200 may include at least one sensor that detects a state of the HMD device 1000 or a state of a surrounding environment of the HMD device 1000. For example, the sensor 200 may detect a proximity sensor that detects whether the user approaches the HMD device 1000, and detects an operation (eg, rotation, acceleration, deceleration, vibration, etc.) of the HMD device 1000. It may include a motion / orientation sensor, an illumination sensor for detecting ambient illumination, a photosensitive sensor for detecting color or spectrum of light, or a combination thereof. The motion / orientation sensor may include at least one of an acceleration sensor, a gravity sensor, a geomagnetic sensor, a gyro sensor, an impact sensor, a GPS, a compass sensor, and an acceleration sensor. For example, the GPS module receives radio waves from a plurality of GPS satellites in orbit of the earth and uses the time of arrival from the GPS satellites to the HMD device 1000 to locate the HMD device 1000. Can be calculated. Except for the above-described features, the sensor 200 is the same as the sensor 200 described with reference to FIG. 3, and thus descriptions thereof will be omitted.

The memory 300 may store a pre-registered characteristic value regarding a head structure of an authenticated user who has the authority to use the HMD device 1000. In one embodiment, the memory 300 classifies and stores the registered characteristic values for each series of characteristic values obtained from each of the plurality of sensors 200 disposed apart from each other, or the flow of time from the sensor 200. According to the present invention, it is possible to store continuously obtained characteristic values in time series. In an embodiment, the memory 300 may store a plurality of characteristic values regarding the shape of the heads of a plurality of users using the HMD device 1000 measured using the sensor 200.

The memory 300 may include at least one of an internal memory and an external memory. The built-in memory may be, for example, volatile memory (for example, dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.), nonvolatile memory (for example, one time programmable ROM). ), PROM (Programmable ROM), EPROM (Erasable and Programmable ROM), EEPROM (Electrically Erasable and Programmable ROM), Mask ROM, Flash ROM, etc.), a hard disk drive (HDD), or a solid state drive (SSD). It may include. For example, the external memory may include at least one of Compact Flash (CF), Secure Digital (SD), Micro Secure Digital (Micro-SD), Mini Secure Digital (Mini-SD), Extreme Digital (xD), and a Memory Stick. It may include. The memory 300 is the same as the memory 300 described with reference to FIG. 3 except for the above-described features, and thus redundant description will be omitted.

The controller 400 may authenticate the user's authority to use by comparing the characteristic value of the user's head shape measured by the sensor 200 with a pre-registered characteristic value stored in the memory 300. In an embodiment, the controller 400 may authenticate a user's right to use by comparing a series of characteristic values relating to a user's head shape obtained from the sensor 200 with a series of pre-registered characteristic values. In another embodiment, the control unit 400 compares the characteristic value of the user's head shape continuously measured with the passage of time from the sensor 200 with the characteristic value registered in the memory 300 in advance. Can be authenticated. In an exemplary embodiment, the controller 400 may compare the characteristic values of the head shape of the specific user, for example, the first user wearing the HMD device 1000, with the plurality of characteristic values stored in the memory 300, respectively, to determine the first value. You can identify the user. In one embodiment, the controller 400 calculates a difference value between each of the feature values related to the head shape of the first user and the plurality of feature values stored in the memory 300, and the calculated difference value among the plurality of feature values is the minimum. May be determined as the characteristic value of the first user. The controller 400 may have the same features as the controller 400 described with reference to FIG. 3.

The input / output unit 510 includes means for receiving an input of a user wearing the HMD device 1000, informing the user of information, receiving data from the outside, or outputting data to the outside. The input / output unit 510 may include at least one speaker 511, at least one microphone 512, at least one button, a connector, a keypad, or a combination thereof. However, embodiments of the present invention are not limited thereto.

The speaker 511 may output a sound corresponding to various data to the outside of the HMD device 1000 under the control of the main controller 900. In addition, the speaker 511 may output a sound corresponding to a function performed by the HMD device 1000. One or more speakers 511 may be disposed at appropriate positions or positions of the HMD device 1000. In one embodiment, the speaker 511 may be implemented in the form of an earphone.

The microphone 512 receives a voice or sound from the outside of the HMD device 1000, generates an electric signal based on the received voice and sound, and generates the generated electric signal. May be output to the main controller 900. The microphones 512 may be arranged one or more in the proper position or positions of the HMD device 1000. Throughout this specification, signals may be referred to alternatively as data, and data may also be referred to as data signals.

The communication module 600 may be a wired, wireless or wired or wireless communication module, and transmits data from the main controller 900 to an external device via wired or wirelessly through an external communication network or standby, or from an electronic device through an external communication network or standby. Data may be received by wire or wirelessly, and the received data may be transferred to the main controller 900. According to an embodiment, the communication module 600 may include at least one of a mobile communication module, a wireless LAN module, and a short range communication module.

The mobile communication module may communicate with an external device through a mobile communication network using at least one antenna under the control of the main controller 900. The mobile communication module transmits or transmits a wireless signal for a voice call, a video call, a short message (SMS) or a multimedia message (MMS) with a mobile phone, smart phone, tablet PC or other communication device having a network address or telephone number such as IP. Can be received.

The wireless LAN module may be connected to the Internet through the wireless AP in the vicinity of the wireless access point (AP) under the control of the main controller 900. The wireless LAN module may support the wireless LAN standard (IEEE802.11x) of the Institute of Electrical and Electronics Engineers (IEEE).

The short range communication module may wirelessly perform short range communication with an external communication device under the control of the main controller 900. The short-range communication scheme may be, for example, BluetoothTM, Infrared Data Association (IrDA), Wi-Fi direct communication, Near Field Communication (NFC), or a combination thereof.

The camera 520 may include a lens system and an image sensor, and may further include a flash. The camera 520 may convert the light input (or photographed) through the lens system into an electrical image signal, and output the converted image signal to the main controller 900. The user may capture a moving image or a still image using the camera 520. In addition, the camera 520 may be used to receive an input through a user's motion or gesture.

The lens system may form an image of a subject by converging light input from the outside. The lens system includes at least one lens, and each lens may be a convex lens, an aspheric lens, or the like. The lens system has symmetry with respect to the optical axis passing through its center, and the optical axis may be defined as the central axis of the lens system. The image sensor may convert an optical image formed on the basis of external light input through the lens system into an electrical image signal. The image sensor may include a plurality of pixel units arranged in an M? N matrix structure. The pixel unit may include a photodiode and a plurality of transistors. The pixel unit accumulates electric charges generated by the input light, and the voltage by the accumulated electric charges may represent illuminance of the input light. In the case of processing an image constituting a still image or a moving picture, the image signal output from the image sensor is composed of a set of voltages (ie, pixel values) output from the pixel units, and the image signal is one frame. (I.e. still images). Also, the frame may be composed of M? N pixels. As an image sensor, a charge-coupled device (CCD) image sensor, a complementary metal-oxide semiconductor (CMOS) image sensor, or the like may be used.

The display 710 may include a display panel and a controller to control the display panel. The display panel may be implemented in various forms such as liquid crystal display (LCD), organic light emitting diodes (OLED) display, active-matrix organic light-emitting diode (AM-OLED), plasma display panel (PDP), and the like. . The display panel may be implemented to be flexible, transparent, or wearable. The display 710 may overlap and display a virtual reality image (VR image) or an augmented reality image (AR image) on an image of a subject photographed by the camera 520. Also, in one embodiment, display 710 may display multimedia content.

The lens 720 may be implemented as a structure detachable from the HMD device 1000. In one embodiment, the lens 720 may not be included in the HMD device 1000, and the HMD device 1000 may include a structure for attaching the lens 720 in place of the lens 720. The user may change the color of the lens 720 of the HMD device 1000 by replacing the lens 720.

The power management module 800 may supply power to the HMD device 1000 under the control of the main controller 900. The power management module 800 may be connected with one or more batteries. In addition, the power management module 800 may supply power input from an external power source to the HMD device 1000 through a wired cable. In one embodiment, when the control unit 400 denies authentication of the user wearing the HMD device 1000, the power management module 800 receives an electrical signal from the main control unit 900 to receive the HMD device 1000. May not power the system.

The main controller 900 includes a sensor 200, a memory 300, a controller 400, an input / output unit 510, a camera 520, a display 710, a lens 720, and a power management module 800. The operation of each of the elements of the HMD device 1000 may be controlled. The main controller 900 may include at least one of a CPU, a RAM, a ROM, a GPU, and a BUS. CPU, RAM, ROM and GPU can be connected to each other via BUS.

The main controller 900 may control an operation of transmitting / receiving an electrical signal between the sensor 200 and the memory 300 and the controller 400. In an exemplary embodiment, when the main controller 900 performs an operation of measuring a characteristic value relating to a head shape of a user wearing the HMD device 1000 by the sensor 200, the pre-registered characteristic value in the memory 300 is performed. And load the loaded characteristic value and the measured characteristic value to the controller 400. However, the present invention is not limited thereto, and the sensor 200, the memory 300, and the controller 400 may transmit / receive electrical signals with each other without the intervention of the main controller 900.

In one embodiment, when the control unit 400 authenticates the usage rights of the user wearing the HMD device 1000, the main control unit 900 may cause the display 710 to display multimedia content or provide virtual reality or augmented reality. The display 710 may be controlled. In addition, in one embodiment, when the control unit 400 rejects the authentication of the user wearing the HMD device 1000, the main control unit 900 does not supply power to the HMD device 1000, the power management module 800 ) Can be controlled.

In one embodiment, the main control unit 900 may perform all the functions performed by the control unit 400. In this case, the main controller 900 may not include the controller 400.

One embodiment of the present disclosure may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by the computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery media.

The foregoing description of the disclosure is provided by way of illustration, and it will be understood by those skilled in the art that the present disclosure may be easily modified into other specific forms without changing the technical spirit or essential features of the present disclosure. will be. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present disclosure is indicated by the appended claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present disclosure. .

Claims

In a head mounted display (HMD) device,

At least one sensor for measuring a characteristic value relating to a shape of a head of a user wearing the HMD device;

A memory for storing a pre-registered characteristic value relating to a head shape of a user having a right to use the HMD device; And

A controller configured to authenticate a user wearing the HMD device to use the HMD device based on the measured characteristic value and the registered characteristic value;

Including, the device.
According to claim 1,

Wherein the at least one sensor is disposed in a mounting belt that secures and supports between the HMD device and the skull of a user wearing the HMD device.
According to claim 1,

The at least one sensor is spaced apart from each other in a strap band surrounding the frontal bone, temporal bone and occipital bone of the user wearing the HMD device, the frontal bone of the user wearing the HMD device, And a plurality of pressure sensors measuring pressure values in each of the temporal and occipital bones.
According to claim 1,

The at least one sensor is spaced apart from each other in a mask covering a part of the face of the user wearing the HMD device, and comprises a plurality of pressure sensors for measuring the shape and size of the face skeleton of the user, the HMD device And classifying the characteristic values measured for different areas on the user's skull or the user's face according to the measured area to generate at least one series.
The method of claim 4, wherein

The controller selects any one of the at least one series and determines whether the selected series corresponds to a series of the registered characteristic values, thereby authenticating a user's authority to wear the HMD device. .
According to claim 1,

And the at least one sensor continuously measures a characteristic value over time over the shape of the head of the user wearing the HMD device during authentication time.
The method of claim 6,

The control unit,

Calculating a deviation value between the measured characteristic value and the characteristic value stored in the memory according to the number of times the at least one sensor measures the characteristic value during the authentication time, and when the calculated deviation value is less than a preset threshold, Authenticating the usage rights of the user wearing the HMD device.
In the method that the HMD device authenticates the user,

Measuring a characteristic value of a head shape of a user wearing the HMD device; And

Authenticating a usage right of a user wearing the HMD device based on the measured characteristic value and a pre-registered characteristic value with respect to a head shape of an authenticated user having the authority to use the HMD device;

Including, the method.
The method of claim 8,

Measuring the characteristic value comprises measuring a curvature of a skeleton of all or part of the skull of a user wearing the HMD device.
The method of claim 8,

Measuring the characteristic value comprises measuring a pressure value in each of the frontal, temporal and occipital bones of a user wearing the HMD device.
The method of claim 8,

The measuring of the characteristic values may include classifying the characteristic values measured with respect to the skull of the user wearing the HMD device or the different areas on the face of the user into at least one series according to the measured area. , Way.
The method of claim 11, wherein

The authenticating step,

Selecting any one of the at least one series;

Determining whether the selected series corresponds to the series of the registered characteristic values and the selected series; And

Based on the determination, authenticating a usage right of the user wearing the HMD device; Including, the method.
The method of claim 8,

Measuring the characteristic value comprises continuously measuring a characteristic value with respect to a head shape of a user wearing the HMD device during an authentication time period over time.
The method of claim 13,

The authenticating step,

Calculating a deviation value between the measured characteristic value and the registered characteristic value according to the number of times the characteristic value is measured during the authentication time;

Comparing the calculated deviation value with a preset threshold value; And

Authenticating a use right of a user wearing the HMD device when the deviation value is less than the threshold; Including, the method.
A computer-readable recording medium having recorded thereon a program for executing the method of claim 8 on a computer.