CN107480490B - Unlocking method and device for head-mounted display and head-mounted display - Google Patents
Unlocking method and device for head-mounted display and head-mounted display Download PDFInfo
- Publication number
- CN107480490B CN107480490B CN201710586692.6A CN201710586692A CN107480490B CN 107480490 B CN107480490 B CN 107480490B CN 201710586692 A CN201710586692 A CN 201710586692A CN 107480490 B CN107480490 B CN 107480490B
- Authority
- CN
- China
- Prior art keywords
- unlocking
- head
- eye
- focus
- distance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Abstract
The invention discloses an unlocking method and device for a head-mounted display and the head-mounted display, wherein the unlocking method comprises the following steps: displaying an unlocking interface and a focus; adjusting the position of the focus on the unlocking interface according to the detected focus position adjusting operation; detecting whether the size of a first eye of a user wearing the head-mounted display is within a set range, if so, then: judging whether the position of the focus on the unlocking interface is located in the unlocking area of the unlocking interface, if so, then: and controlling the head-mounted display to unlock. According to the unlocking method, a user does not need to perform any manual operation, when the focus is in the unlocking area, the unlocking operation of the head-mounted display can be performed only by controlling the size of eyes of the user, and the user experience is improved.
Description
Technical Field
The invention relates to the technical field of head-mounted display unlocking, in particular to an unlocking method and device for a head-mounted display and the head-mounted display.
Background
When the head-mounted display is used, a user can wear the device on the head, and the content displayed on the display screen can be directly seen by eyes. Since the user's finger cannot operate the screen, it is difficult to operate the screen in an unlocking manner such as a pattern or a numeric code according to an unlocking manner on an electronic device such as a mobile phone.
At present, a plurality of mainstream head-mounted displays are directly used after being opened and are not unlocked, but the head-mounted display is also an intelligent terminal, and the inside of the head-mounted display has some user privacy data and sometimes does not want to be seen by others, so that a simple and quick unlocking mode is provided by the scheme, and the head-mounted display is suitable for unlocking.
Disclosure of Invention
It is an object of the present invention to provide a new solution for unlocking a head mounted display.
According to a first aspect of the present invention, there is provided an unlocking method for a head mounted display, comprising:
displaying an unlocking interface and a focus;
adjusting the position of the focus on the unlocking interface according to the detected focus position adjusting operation;
detecting whether the size of a first eye of a user wearing the head-mounted display is within a set range, if so, then:
judging whether the focus on the unlocking interface is located in an unlocking area of the unlocking interface, if so, then:
controlling the head mounted display to unlock.
Optionally, the unlocking method further includes:
and detecting whether the time that the size of the first eye is in the set range exceeds the set time, if so, judging whether the position of the focus on the unlocking interface is located in an unlocking area of the unlocking interface.
Alternatively, the focal position adjusting operation is a head swing operation or an eyeball movement operation.
Optionally, the step of detecting whether the size of the first eye is within a set range includes:
detecting, by a distance sensor disposed on the head mounted display, a vertical distance between the first eye and the distance sensor;
detecting, by a depth camera disposed on the head-mounted display, a distance between an upper eyelid of the first eye and the depth camera as a first distance, and a distance between a lower eyelid of the first eye and the depth camera as a second distance;
calculating a size of the first eye from the first distance, the second distance, and the vertical distance;
and judging whether the size of the first eye is in the set range.
According to a second aspect of the present invention, there is provided an unlocking device for a head-mounted display, comprising:
the display module is used for displaying an unlocking interface and a focus;
the adjusting module is used for adjusting the position of the focus on the unlocking interface according to the detected focus position adjusting operation;
the range detection module is used for detecting whether the size of a first eye of a user wearing the head-mounted display is within a set range;
the position judging module is used for judging whether the position of the focus on the unlocking interface is positioned in an unlocking area of the unlocking interface or not under the condition that the detection result of the range detecting module is yes;
and the unlocking module is used for controlling the head-mounted display to unlock under the condition that the judgment result of the position judgment module is yes.
Optionally, the apparatus further comprises:
the time detection module is used for detecting whether the time that the size of the first eye is in the set range exceeds the set time or not;
the position judging module is further configured to judge whether the position of the focus on the unlocking interface is located in an unlocking area of the unlocking interface when the detection result of the time detecting module is yes.
Alternatively, the focal position adjusting operation is a head swing operation or an eyeball movement operation.
Optionally, the range detection module includes:
a first distance detection unit for detecting a vertical distance between the first eye and a distance sensor provided on the head-mounted display;
a second distance detection unit configured to detect, by a depth camera provided on the head mount display, a distance between an upper eyelid of the first eye and the depth camera as a first distance, and a distance between a lower eyelid of the first eye and the depth camera as a second distance;
a calculation unit for calculating the size of the first eye from the first distance, the second distance and the vertical distance;
and the judging unit is used for judging whether the size of the first eye is in the set range.
According to a third aspect of the invention, there is provided a head mounted display comprising an unlocking device according to the second aspect of the invention.
According to a fourth aspect of the present invention, there is provided a head mounted display comprising a processor and a memory for storing instructions for controlling the processor to perform the unlocking method according to the first aspect of the present invention.
The unlocking method has the advantages that the user does not need to perform any manual operation, when the focus is in the unlocking area, the user can unlock the head-mounted display only by controlling the size of eyes, and the user experience is improved.
Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention.
FIG. 1 is a flow diagram of one embodiment of an unlocking method for a head mounted display in accordance with the present invention;
FIG. 2 is a flow diagram of another embodiment of an unlocking method for a head mounted display according to the present invention;
FIG. 3 is a block and schematic diagram of an exemplary configuration of an unlocking device for a head-mounted display according to the present invention;
FIG. 4 is a block diagram illustrating another exemplary configuration of an unlocking device for a head-mounted display according to the present invention;
fig. 5 is a block schematic diagram of an implementation structure of a head-mounted display according to the present invention.
Detailed Description
Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
In order to solve the problem that the head-mounted display in the prior art cannot realize unlocking operation, an unlocking method for the head-mounted display is provided. The head-mounted display may be a virtual reality head-mounted product such as a virtual reality helmet or virtual reality glasses.
Fig. 1 is a flowchart of an embodiment of an unlocking method for a head-mounted display according to the present invention.
According to fig. 1, the unlocking method comprises the following steps:
and step S110, displaying an unlocking interface and a focus.
Specifically, the unlocking interface can be provided with a picture, an object or a digital button, and the focus floats above the unlocking interface.
And step S120, adjusting the position of the focus on the unlocking interface according to the detected focus position adjusting operation.
The focus position adjustment operation may be, but is not limited to, a head swing operation or an eyeball movement operation or the like.
Taking the head swing operation as an example, the position of the focus on the unlocking interface can be correspondingly adjusted by detecting the up, down, left and right swing of the head of the user. The head swing operation can be recognized from data collected by an inertial sensor or the like.
Taking the eyeball-moving operation as an example, the position of the focus on the unlocking interface can be correspondingly adjusted by detecting the up-down, left-right movement of the eyeball of the user. The eye movement operation can be recognized from an image captured by an image capturing device, such as a camera.
On this basis, in order to avoid the problem that the movement of the left eye eyeball and the right eye eyeball of the user is asynchronous and the focus position may not be adjusted, the position of the focus on the unlocking interface can be correspondingly adjusted by detecting the movement of the left eye eyeball of the user. The position of the focus on the unlocking interface can be correspondingly adjusted by detecting the movement of the eyeball of the right eye of the user. The position of the focus on the unlocking interface can be correspondingly adjusted by detecting the movement of the left eye eyeball or the right eye eyeball of the user according to the position of the focus on the unlocking interface. For example, the unlocking interface may be divided into two parts, and when the focus is located in the first part, the position of the focus on the unlocking interface is correspondingly adjusted by detecting the movement of the left eye eyeball of the user; when the focus is located at the second part, the position of the focus on the unlocking interface is correspondingly adjusted by detecting the movement of the eyeball of the right eye of the user.
Step S130, detecting whether the size of a first eye of a user wearing the head-mounted display is in a set range, if so, executing step S140; if not, the step S120 is continued.
The first eye of the user may be the eye used to control the focus movement, or may be either of the user's two eyes.
The operation of detecting the size of the first eye of the user may employ, but is not limited to, the following embodiments.
Example 1:
in step S131a, a vertical distance between the first eye and the distance sensor is detected by the distance sensor provided on the head-mounted display.
Wherein the distance sensor and the depth camera may be arranged on a plane parallel to the first eye, such that a perpendicular distance between the distance sensor and the first eye may be taken as a perpendicular distance between the depth camera and the first eye.
A step S132a of detecting, as a first distance, a distance between an upper eyelid of the first eye and the depth camera by the depth camera provided on the head mount display; a distance between a lower eyelid of the first eye and the depth camera is detected as a second distance.
In step S133a, the size of the first eye is calculated from the first distance, the second distance, and the vertical distance.
From the two waist lengths and heights of the triangle, the length of the base can be calculated. In a triangle formed by the depth camera, the upper eyelid of the first eye and the lower eyelid of the first eye, the first distance and the second distance are two waist lengths of the triangle, the vertical distance may be the height of the triangle, and the distance between the upper eyelid and the lower eyelid is the length of the base. Therefore, the distance between the upper eyelid and the lower eyelid can be calculated according to the first distance, the second distance and the vertical distance, which is the size of the first eye.
Example 2:
step S131b, an eye image of the first eye captured by a camera provided on the head mounted display.
In step S132b, the distance between the upper eyelid and the lower eyelid of the first eye in the eye image is determined.
In step S133b, the size of the first eye is calculated from the distance between the upper eyelid and the lower eyelid.
The distance between the upper eyelid and the lower eyelid in the eye image is in an equal proportional relationship with the actual distance between the upper eyelid and the lower eyelid. Therefore, the actual distance between the upper eyelid and the lower eyelid can be calculated according to the distance between the upper eyelid and the lower eyelid in the eye image, which is the size of the first eye.
Further, the range of the first eye size may be recorded in advance, for example, the maximum value of the size of the first eye when the first eye is opened to the maximum may be detected, and the range from zero to the maximum value may be used as the size range of the first eye. The size range of the first eye may be further divided into N equal parts, and each part may be labeled, with one of the ranges being the set range. For example, when the size of the first eye is detected to be within a first range, a label corresponding to the first range may be displayed on a display screen of the head-mounted display. Therefore, the user can quickly adjust the size of the first eye to be within the set range in the unlocking process.
On the basis, when the set range is selected, the size of the first eye is not in the set range when the user normally opens and closes the eyes, so that the unlocking difficulty is improved.
Step S140, judging whether the position of the focus on the unlocking interface is positioned in the unlocking area of the unlocking interface, if so, executing step S150; if not, the step S120 is continued.
When the unlocking interface is a picture, the unlocking area can be an object on the picture; when the unlocking interface is a number button, the unlocking area can be any button.
Further, when the position of the focus on the unlocking interface is not located in the unlocking area, words such as "unlocking failed" may also be displayed on the display screen of the head-mounted display to prompt the user to unlock again.
In an embodiment of the present invention, the execution order of step S140 and step S130 may be interchanged. Specifically, after the step S120 is executed, the step S140 may be executed first, and whether the position of the focus on the unlocking interface is located in the unlocking area of the unlocking interface is determined, if yes, the step S130 is executed, and if not, the step S140 is continuously executed; and step S130 is executed again, whether the size of the first eye of the user wearing the head-mounted display is within the set range is detected, if so, step S150 is executed, and if not, step S30 is continuously executed.
And S150, controlling the head-mounted display to unlock.
After the control head mounted display is unlocked, the unlock interface will disappear and enter the user operable interface.
Therefore, according to the unlocking method, a user does not need to perform any manual operation, when the focus is in the unlocking area, the unlocking operation of the head-mounted display can be performed only by controlling the size of the eyes of the user, and the user experience is improved. Moreover, the left eye and the right eye can be used for detection, so that the number of encrypted markers is increased, and the safety of the head-mounted display can be further improved.
Fig. 2 is a flow chart of another embodiment of an unlocking method according to the present invention.
According to fig. 2, this embodiment is based on the embodiment shown in fig. 1, with the addition of step S210 between the execution of steps S130-S140.
Step S210, detecting whether the time that the size of the first eye is within the set range exceeds the set time, if yes, performing step S140, and if no, continuing to perform step S120.
Thus, false detection when the user blinks can be effectively avoided.
Furthermore, the time that the size of the first eye is continuously within the set range can be displayed on the display screen, so that the user can have a clearer time concept in the unlocking process, and the unlocking action of the user can be accelerated.
On the basis, when the time that the size of the first eye is continuously in the set range does not exceed the set time, words such as 'unlocking failure' can be displayed on the display screen of the head-mounted display to prompt the user to unlock again.
Like this, use eyes size, unblock region and time dimension to unblock, maneuverability is strong, can improve the unblock degree of difficulty, and then can improve the security of wearing the display.
Corresponding to the method, the invention also provides an unlocking device for the head-mounted display. Fig. 3 is a block diagram of an embodiment of the unlocking device according to the invention.
Referring to fig. 3, the unlocking apparatus includes a display module 310, an adjustment module 320, a range detection module 330, a position determination module 340, and an unlocking module 350. The display module 310 is used for displaying an unlocking interface and a focus; the adjusting module 320 is configured to adjust a position of the focus on the unlocking interface according to the detected focus position adjusting operation; the range detection module 330 is configured to detect whether a size of a first eye of a user wearing the head-mounted display is within a set range; the position determining module 340 is configured to determine whether a position of the focus on the unlocking interface is located in an unlocking area of the unlocking interface when the detection result of the range detecting module 330 is yes; the unlocking module 350 is configured to control the head-mounted display to unlock if the determination result of the position determining module 340 is yes.
Fig. 4 is a block schematic diagram of another embodiment of the unlocking device for the head-mounted display according to the present invention.
As shown in fig. 4, the unlocking device further includes a time detection module 410 for detecting whether the duration that the size of the first eye is within the set range exceeds the set time. The position determining module 340 is further configured to determine whether the position of the focus on the unlocking interface is located in the unlocking area of the unlocking interface when the detection result of the time detecting module 410 is yes.
Further, the focal position adjusting operation is a head swing operation or an eyeball movement operation.
In one embodiment of the present invention, the range detection module 330 includes: a first distance detection unit 331, a second distance detection unit 332, a calculation unit 333, and a determination unit 334. The first distance detection unit 331 is configured to detect a vertical distance between the first eye and the distance sensor through the distance sensor provided on the head-mounted display; the second distance detection unit 332 is configured to detect, by a depth camera disposed on the head-mounted display, a distance between an upper eyelid of the first eye and the depth camera as a first distance, and detect a distance between a lower eyelid of the first eye and the depth camera as a second distance; the calculating unit 333 is configured to calculate a size of the first eye based on the first distance, the second distance, and the vertical distance; the determining unit 334 is configured to determine whether the size of the first eye is within a set range.
The invention also provides a head-mounted display which comprises the unlocking device for the head-mounted display.
Fig. 5 is a block schematic diagram of an implementation structure of the head-mounted display according to another aspect of the present invention.
According to fig. 5, the head-mounted display 500 comprises a memory 501 and a processor 502, the memory 501 is used for storing instructions for controlling the processor 502 to operate so as to execute the unlocking method for the head-mounted display.
The processor 502 may be, for example, a central processing unit CPU, a microprocessor MCU, or the like. The memory 501 includes, for example, a ROM (read only memory), a RAM (random access memory), a nonvolatile memory such as a hard disk, and the like.
In addition, according to fig. 5, the head-mounted display 500 further comprises an interface device 503, an input device 504, a display device 505, a communication device 506, a speaker 507, a microphone 508, etc. Although a plurality of devices are shown in fig. 5, the head mounted display of the present invention may relate to only some of the devices, such as the processor 501, the memory 502, the display device 505, and the like.
The communication device 506 can perform wired or wireless communication, for example.
The interface device 503 includes, for example, a headphone jack, a USB interface, and the like.
The input device 504 may include, for example, a touch screen, a key, and the like.
The display device 505 is, for example, a liquid crystal display panel, a touch panel, or the like.
The head-mounted display can be a head-mounted virtual reality product such as a virtual reality helmet and virtual reality glasses.
The above embodiments mainly focus on differences from other embodiments, but it should be clear to those skilled in the art that the above embodiments can be used alone or in combination with each other as needed.
The embodiments in the present disclosure are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments, but it should be clear to those skilled in the art that the embodiments described above can be used alone or in combination with each other as needed. In addition, for the device embodiment, since it corresponds to the method embodiment, the description is relatively simple, and for relevant points, refer to the description of the corresponding parts of the method embodiment. The system embodiments described above are merely illustrative, in that modules illustrated as separate components may or may not be physically separate.
The present invention may be an apparatus, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied therewith for causing a processor to implement various aspects of the present invention.
The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
Computer program instructions for carrying out operations of the present invention may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including AN object oriented programming language such as Smalltalk, C + +, or the like, as well as conventional procedural programming languages, such as the "C" language or similar programming languages.
Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.
Having described embodiments of the present invention, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein were chosen in order to best explain the principles of the embodiments, the practical application, or technical improvements to the techniques in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.
Claims (10)
1. An unlocking method for a head-mounted display, comprising:
displaying an unlocking interface and a focus;
adjusting the position of the focus on the unlocking interface according to the detected focus position adjusting operation;
detecting whether the size of a first eye of a user wearing the head-mounted display is within a set range, if so, then:
judging whether the position of the focus on the unlocking interface is located in an unlocking area of the unlocking interface, if so, then:
controlling the head mounted display to unlock;
wherein the focus position adjusting operation is an eyeball movement operation, and the adjusting the position of the focus on the unlocking interface according to the detected focus position adjusting operation includes:
and determining to correspondingly adjust the position of the focus on the unlocking interface by detecting the movement of the left eye eyeball or the right eye eyeball of the user according to the position of the focus on the unlocking interface.
2. The unlocking method according to claim 1, further comprising:
and detecting whether the time that the size of the first eye is in the set range exceeds the set time, if so, judging whether the position of the focus on the unlocking interface is in a preset unlocking area.
3. The unlocking method according to claim 1, wherein the focal position adjustment operation is also a head swing operation.
4. The unlocking method according to claim 1, wherein the step of detecting whether the size of the first eye is within a set range includes:
detecting, by a distance sensor disposed on the head mounted display, a vertical distance between the first eye and the distance sensor;
detecting, by a depth camera disposed on the head-mounted display, a distance between an upper eyelid of the first eye and the depth camera as a first distance, and a distance between a lower eyelid of the first eye and the depth camera as a second distance;
calculating a size of the first eye from the first distance, the second distance, and the vertical distance;
and judging whether the size of the first eye is in the set range.
5. An unlocking device for a head-mounted display, comprising:
the display module is used for displaying an unlocking interface and a focus;
the adjusting module is used for adjusting the position of the focus on the unlocking interface according to the detected focus position adjusting operation;
the range detection module is used for detecting whether the size of a first eye of a user wearing the head-mounted display is within a set range;
the position judging module is used for judging whether the position of the focus on the unlocking interface is positioned in an unlocking area of the unlocking interface or not under the condition that the detection result of the range detecting module is yes;
the unlocking module is used for controlling the head-mounted display to unlock under the condition that the judgment result of the position judgment module is yes;
wherein the focus position adjusting operation is an eyeball movement operation, and the adjusting the position of the focus on the unlocking interface according to the detected focus position adjusting operation includes:
and determining to correspondingly adjust the position of the focus on the unlocking interface by detecting the movement of the left eye eyeball or the right eye eyeball of the user according to the position of the focus on the unlocking interface.
6. The unlocking device of claim 5, further comprising:
the time detection module is used for detecting whether the time that the size of the first eye is in the set range exceeds the set time or not;
the position judging module is further configured to judge whether the position of the focus on the unlocking interface is located in an unlocking area of the unlocking interface when the detection result of the time detecting module is yes.
7. The unlocking device according to claim 5, wherein the focal position adjusting operation is also a head swing operation.
8. The unlocking device of claim 5, wherein the range detection module comprises:
a first distance detection unit for detecting a vertical distance between the first eye and a distance sensor provided on the head-mounted display;
a second distance detection unit configured to detect, by a depth camera provided on the head mount display, a distance between an upper eyelid of the first eye and the depth camera as a first distance, and a distance between a lower eyelid of the first eye and the depth camera as a second distance;
a calculation unit for calculating the size of the first eye from the first distance, the second distance and the vertical distance;
and the judging unit is used for judging whether the size of the first eye is in the set range.
9. A head-mounted display, characterized in that it comprises an unlocking device according to any one of claims 5-8.
10. A head-mounted display comprising a processor and a memory, the memory for storing instructions for controlling the processor to perform the unlocking method according to any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710586692.6A CN107480490B (en) | 2017-07-18 | 2017-07-18 | Unlocking method and device for head-mounted display and head-mounted display |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710586692.6A CN107480490B (en) | 2017-07-18 | 2017-07-18 | Unlocking method and device for head-mounted display and head-mounted display |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107480490A CN107480490A (en) | 2017-12-15 |
| CN107480490B true CN107480490B (en) | 2020-07-24 |
Family
ID=60596160
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710586692.6A Active CN107480490B (en) | 2017-07-18 | 2017-07-18 | Unlocking method and device for head-mounted display and head-mounted display |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107480490B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109145566A (en) * | 2018-09-08 | 2019-01-04 | 太若科技(北京)有限公司 | Method, apparatus and AR glasses based on blinkpunkt information unlock AR glasses |
| CN112558768A (en) * | 2020-12-11 | 2021-03-26 | 上海影创信息科技有限公司 | Function interface proportion control method and system and AR glasses thereof |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150084864A1 (en) * | 2012-01-09 | 2015-03-26 | Google Inc. | Input Method |
| CN102830797B (en) * | 2012-07-26 | 2015-11-25 | 深圳先进技术研究院 | A kind of man-machine interaction method based on sight line judgement and system |
| CN106557672A (en) * | 2015-09-29 | 2017-04-05 | 北京锤子数码科技有限公司 | The solution lock control method of head mounted display and device |
| CN106933349A (en) * | 2017-02-06 | 2017-07-07 | 歌尔科技有限公司 | Unlocking method, device and virtual reality device for virtual reality device |
-
2017
- 2017-07-18 CN CN201710586692.6A patent/CN107480490B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107480490A (en) | 2017-12-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102038639B1 (en) | Touch screen hover detection in augmented reality and / or virtual reality | |
| CN104750249B (en) | Information processing method and electronic equipment | |
| US10466775B2 (en) | Method and apparatus for changing a field of view without synchronization with movement of a head-mounted display | |
| EP3144775B1 (en) | Information processing system and information processing method | |
| US9599825B1 (en) | Visual indicator for transparent display alignment | |
| CN106066537B (en) | Head-mounted display and control method of head-mounted display | |
| US20140157167A1 (en) | Method and Device for Controlling Icon | |
| KR20150090840A (en) | Device and mathod for shielding region of display screen of device | |
| KR20150032019A (en) | Method and apparatus for providing user interface by using eye tracking | |
| US10409446B2 (en) | Information processing apparatus and method for manipulating display position of a three-dimensional image | |
| WO2013046596A1 (en) | Mobile information processing terminal | |
| CN107480490B (en) | Unlocking method and device for head-mounted display and head-mounted display | |
| JP2016082411A (en) | Head-mounted display, image display method and program | |
| US11402646B2 (en) | Display apparatus, display control method, and program | |
| CN114556270A (en) | Eye gaze control of a magnifying user interface | |
| CN104238983B (en) | Control method and electronic equipment | |
| KR101541061B1 (en) | Apparatus and method for guiding the sensory organ movements in portable terminal | |
| CN106970734B (en) | Task starting method and device of display equipment | |
| JP2015103152A (en) | Electronic apparatus and visual line input method | |
| EP3163402A1 (en) | Method for authenticating an hmd user by radial menu | |
| CN111079119A (en) | Verification method, device, equipment and storage medium | |
| US11361064B2 (en) | Access level authentication based on field of view segmentation | |
| JP6686319B2 (en) | Image projection device and image display system | |
| KR102325684B1 (en) | Eye tracking input apparatus thar is attached to head and input method using this | |
| JP6922686B2 (en) | Operating device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |