CN111176547B - Unlocking method and head-mounted electronic equipment - Google Patents

Unlocking method and head-mounted electronic equipment Download PDF

Info

Publication number
CN111176547B
CN111176547B CN201911424860.7A CN201911424860A CN111176547B CN 111176547 B CN111176547 B CN 111176547B CN 201911424860 A CN201911424860 A CN 201911424860A CN 111176547 B CN111176547 B CN 111176547B
Authority
CN
China
Prior art keywords
virtual
head
input
mounted electronic
electronic device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911424860.7A
Other languages
Chinese (zh)
Other versions
CN111176547A (en
Inventor
邓庭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN201911424860.7A priority Critical patent/CN111176547B/en
Publication of CN111176547A publication Critical patent/CN111176547A/en
Application granted granted Critical
Publication of CN111176547B publication Critical patent/CN111176547B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G06F21/6245Protecting personal data, e.g. for financial or medical purposes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Health & Medical Sciences (AREA)
  • Bioethics (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention provides an unlocking method and a head-mounted electronic device, relates to the technical field of communication, and can solve the problem that privacy information of an owner user is leaked after the head-mounted electronic device is unlocked. The scheme comprises the following steps: displaying N virtual objects on a virtual screen in a screen locking state; receiving a first input of a user, wherein the first input is used for determining a target virtual object in the N virtual objects; in response to the first input, unlocking the virtual screen and displaying target information corresponding to the target virtual object; wherein N is a positive integer; the target information includes: first type information or second type information; the first type of information includes user data and the second type of information does not include user data. The method is applied to a scene of unlocking the head-mounted electronic equipment.

Description

Unlocking method and head-mounted electronic equipment
Technical Field
The embodiment of the invention relates to the technical field of communication, in particular to an unlocking method and a head-mounted electronic device.
Background
With the development of communication technology, the application of the method is more and more extensive. Generally, the electronic device may protect user privacy information in the electronic device by encrypting the electronic device.
Currently, only an owner user can use an electronic device when the electronic device is in an encrypted state. If the non-owner user needs to use the electronic equipment, the owner user can trigger the electronic equipment to decrypt firstly, and then the non-owner user can use the electronic equipment.
However, after the host user triggers the decryption of the electronic device, since the non-host user may operate on various objects in the electronic device, the privacy information of the host user may be leaked.
Disclosure of Invention
The embodiment of the invention provides an unlocking method and a head-mounted electronic device, which can solve the problem that privacy information of an owner user is leaked after the head-mounted electronic device is unlocked.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present invention provides an unlocking method, which may be applied to a head-mounted electronic device, where the method includes displaying N virtual objects on a virtual screen in a screen-locked state; receiving a first input of a user, wherein the first input is used for determining a target virtual object in the N virtual objects; and in response to the first input, unlocking the virtual screen and displaying target information corresponding to the target virtual object; wherein N is a positive integer; the target information includes: first type information or second type information; the first type of information includes user data and the second type of information does not include user data.
In a second aspect, an embodiment of the present invention provides a head-mounted electronic device, including: the head-mounted electronic device includes: the device comprises a display module, a receiving module and a processing module. The display module is used for displaying N virtual objects on a virtual screen in a screen locking state; the receiving module is used for receiving a first input of a user after the display module displays the N virtual objects on the virtual screen in the screen locking state, wherein the first input is used for determining a target virtual object in the N virtual objects; the processing module is used for responding to the first input received by the receiving module and unlocking the virtual screen; the display module is also used for displaying target information corresponding to the target virtual object after the processing module unlocks the virtual screen; wherein N is a positive integer; the target information includes: first type information or second type information; the first type of information includes user data and the second type of information does not include user data.
In a third aspect, an embodiment of the present invention provides a head-mounted electronic device, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program, when executed by the processor, may implement the steps of the unlocking method of the first aspect.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of the unlocking method of the first aspect.
In the embodiment of the invention, the head-mounted electronic device can display N (positive integer) virtual objects on the virtual screen in the screen locking state; and receiving a first input of a user (for determining a target virtual object among the N virtual objects); and in response to the first input, unlocking the virtual screen and displaying target information corresponding to the target virtual object; the target information may include: first type information or second type information; the first type of information may include user data and the second type of information does not include user data. By the scheme, when the head-mounted electronic equipment displays N virtual objects on the virtual screen in the screen locking state, the head-mounted electronic equipment can trigger the selected target virtual object (which is a virtual object in the N virtual objects) according to a user (which can be a user of the head-mounted electronic equipment or other users except the user of the head-mounted electronic equipment), unlock the virtual screen and display target information corresponding to the target virtual object; namely, different target virtual objects are triggered and selected by the user, and different information is displayed by the head-mounted electronic equipment; that is, the head-mounted electronic device can display different information in the head-mounted electronic device according to different rights (determined by triggering the selected target virtual object by the user); therefore, normal use of the head-mounted electronic equipment can be guaranteed, privacy information of an owner user can be prevented from being leaked, and safety of information in the head-mounted electronic equipment can be improved.
Drawings
FIG. 1 is a block diagram of a possible operating system according to an embodiment of the present invention;
fig. 2 is a schematic diagram of an unlocking method according to an embodiment of the present invention;
fig. 3 is one of schematic interfaces of an application of an unlocking method according to an embodiment of the present invention;
fig. 4 is a second schematic interface diagram of an application of the unlocking method according to the embodiment of the present invention;
fig. 5 is a third schematic interface diagram of an application of the unlocking method according to the embodiment of the present invention;
fig. 6 is a fourth schematic interface diagram of an application of the unlocking method according to the embodiment of the present invention;
fig. 7 is a fifth schematic interface diagram of an application of the unlocking method according to the embodiment of the present invention;
fig. 8 is a sixth schematic interface diagram of an application of the unlocking method according to the embodiment of the present invention;
fig. 9 is a schematic structural diagram of AR glasses according to an embodiment of the present invention;
fig. 10 is a second schematic structural diagram of AR glasses according to an embodiment of the present invention;
fig. 11 is a second schematic diagram illustrating an unlocking method according to a second embodiment of the present invention;
fig. 12 is a schematic structural diagram of a head-mounted electronic device according to an embodiment of the present invention;
fig. 13 is a hardware schematic diagram of a head-mounted electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The term "and/or" herein is an association relationship describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. The symbol "/" herein denotes a relationship in which the associated object is or, for example, a/B denotes a or B.
The terms "first" and "second," etc. herein are used to distinguish between different objects and are not used to describe a particular order of objects. For example, the first input and the second input, etc. are for distinguishing different inputs, rather than for describing a particular order of inputs.
In the embodiments of the present invention, words such as "exemplary" or "for example" are used to mean serving as examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "e.g.," an embodiment of the present invention is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
In the description of the embodiments of the present invention, unless otherwise specified, "a plurality" means two or more, for example, a plurality of elements means two or more elements, and the like.
Some of the nouns or terms referred to in the claims and the specification of the present application will be explained first.
Augmented Reality (AR) technology: the technology is used for calculating the position and the angle of a camera image in real time and adding a corresponding image, and aims to sleeve a virtual world on a screen in the real world and interact with the virtual world.
A screen locking interface: the virtual screen is displayed on the virtual screen of the head-mounted electronic device when the virtual screen is not unlocked by the head-mounted electronic device.
The screen locking state: the method comprises the steps that the state of a screen locking interface is displayed on a virtual screen of the electronic equipment; namely, the state of the electronic device when the virtual screen of the electronic device displays the content but the virtual screen is not unlocked.
The acquisition range of the camera is as follows: refers to the range of images that the camera can capture of an object (e.g., a person, or an object). For example, assuming that the acquisition range of the camera is range a, the camera may acquire images of objects within range a, but cannot acquire images of objects outside range a.
The embodiment of the invention provides an unlocking method and a head-mounted electronic device, wherein the unlocking method can be applied to the head-mounted electronic device, and the head-mounted electronic device can display N (positive integers) virtual objects on a virtual screen in a screen locking state; and receiving a first input of a user (for determining a target virtual object among the N virtual objects); and in response to the first input, unlocking the virtual screen and displaying target information corresponding to the target virtual object; the target information may include: first type information or second type information; the first type of information may include user data and the second type of information does not include user data. By the scheme, when the head-mounted electronic equipment displays N virtual objects on the virtual screen in the screen locking state, the head-mounted electronic equipment can trigger the selected target virtual object (which is a virtual object in the N virtual objects) according to a user (which can be a user of the head-mounted electronic equipment or other users except the user of the head-mounted electronic equipment), unlock the virtual screen and display target information corresponding to the target virtual object; namely, different target virtual objects are triggered and selected by the user, and different information is displayed by the head-mounted electronic equipment; that is, the electronic device can display different information in the head-type electronic device according to different permissions of the user (determined by triggering the selected target virtual object by the user); therefore, normal use of the head-mounted electronic equipment can be guaranteed, privacy information of an owner user can be prevented from being leaked, and safety of information in the head-mounted electronic equipment can be improved.
The virtual screen in the embodiment of the present invention may be any carrier that can be used to display content projected by a projection device when content is displayed by using AR technology. The projection device may be a projection device using AR technology, such as a head-mounted electronic device in the embodiment of the present invention.
When displaying content on the virtual screen by using the AR technology, the projection device may project a virtual scene acquired by (or internally integrated with) the projection device, or a virtual scene and a real scene onto the virtual screen, so that the virtual screen may display the content, thereby showing an effect of superimposing the real scene and the virtual scene to a user.
In connection with different scenarios of AR technology applications, the virtual screen may generally be a display screen of an electronic device (e.g. a mobile phone), a lens of AR glasses, a windshield of a car, a wall of a room, etc. any possible carrier.
The following describes an exemplary process of displaying content on a virtual screen by using AR technology, by taking the virtual screen as a display screen of an electronic device, a lens of AR glasses, and a windshield of an automobile as examples.
In one example, when the virtual screen is a display screen of an electronic device, the projection device may be the electronic device. The electronic equipment can acquire a real scene in the area where the electronic equipment is located through the camera of the electronic equipment, the real scene is displayed on the display screen of the electronic equipment, then the electronic equipment can project a virtual scene acquired by the electronic equipment (or internally integrated) onto the display screen of the electronic equipment, so that the virtual scene can be displayed in a superposition mode in the real scene, and a user can see the effect of the real scene and the virtual scene after superposition through the display screen of the electronic equipment.
In another example, when the virtual screen is a lens of AR glasses, the projection device may be the AR glasses. When the user wears the glasses, the user can see the real scene in the area where the user is located through the lenses of the AR glasses, and the AR glasses can project the acquired (or internally integrated) virtual scene onto the lenses of the AR glasses, so that the user can see the display effect of the real scene and the virtual scene after superposition through the lenses of the AR glasses.
In yet another example, when the virtual screen is a windshield of an automobile, the projection device may be any electronic device. When the user is located in the automobile, the user can see the real scene in the area where the user is located through the windshield of the automobile, and the projection device can project the acquired (or internally integrated) virtual scene onto the windshield of the automobile, so that the user can see the display effect of the real scene and the virtual scene after superposition through the windshield of the automobile.
Of course, in the embodiment of the present invention, the specific form of the virtual screen may not be limited, for example, it may be a non-carrier real space. In this case, when the user is located in the real space, the user can directly see the real scene in the real space, and the projection device can project the acquired (or internally integrated) virtual scene into the real space, so that the user can see the display effect of the real scene and the virtual scene after superposition in the real space.
The head-mounted electronic device in the embodiment of the invention can be a head-mounted electronic device with an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present invention are not limited in particular.
A software environment to which the unlocking method provided by the embodiment of the present invention is applied is described below by taking a possible operating system as an example.
Fig. 1 is a schematic diagram of a possible operating system according to an embodiment of the present invention. In fig. 1, the architecture of the operating system includes 4 layers, respectively: an application layer, an application framework layer, a system runtime layer, and a kernel layer (specifically, a Linux kernel layer).
The application layer comprises various application programs (including system application programs and third-party application programs) in an operating system.
The application framework layer is a framework of the application, and a developer can develop some applications based on the application framework layer under the condition of complying with the development principle of the framework of the application.
The system runtime layer includes a library (also referred to as a system library) and an operating system runtime environment. The library mainly provides various resources required by the operating system. The operating system runtime environment is used to provide a software environment for the operating system.
The kernel layer is the operating system layer of the operating system and belongs to the lowest layer of the operating system software layer. The kernel layer provides kernel system services and hardware-related drivers for the operating system based on the Linux kernel.
Taking an operating system as an example, in the embodiment of the present invention, a developer may develop a software program for implementing the unlocking method provided in the embodiment of the present invention based on the system architecture of the operating system shown in fig. 1, so that the unlocking method may run based on the operating system shown in fig. 1. That is, the processor or the head-mounted electronic device may implement the unlocking method provided by the embodiment of the present invention by running the software program in the operating system.
An execution main body of the unlocking method provided by the embodiment of the present invention may be the head-mounted electronic device, or may also be a functional module and/or a functional entity capable of implementing the unlocking method in the head-mounted electronic device, which may be specifically determined according to actual use requirements, and the embodiment of the present invention is not limited. The following takes the head-mounted electronic device as an example to exemplarily describe the unlocking method provided by the embodiment of the invention.
In the embodiment of the present invention, when a user (which may be a user of the head-mounted electronic device, i.e. an owner user, or may be a user other than the user of the head-mounted electronic device, i.e. a non-owner user) needs to use a head-mounted electronic device, the user may first trigger the head-mounted electronic device to initialize the operating system of the head-mounted electronic device, after the head-mounted electronic device initializes its operating system, the head-mounted electronic device may display N virtual objects on a virtual screen of the head-mounted electronic device in a lock screen state, so that the user can, via one input, e.g. the first input in an embodiment of the invention, trigger the electronic device to unlock the virtual screen (which may also be referred to as a head mounted electronic device), and displaying target information corresponding to the target virtual object selected by the user input in the head-mounted electronic equipment so that the user can normally use the head-mounted electronic equipment. When the corresponding target information of the target virtual object is the first type of information, the head-mounted electronic device may load operating system data and user data of the head-mounted electronic device, that is, the information displayed by the head-mounted electronic device includes the user data in the head-mounted electronic device; when the target information corresponding to the target virtual object is the second type of information, the head-mounted electronic device may only load the operating system data and not load the user data, that is, the information displayed by the head-mounted electronic device does not include the user data in the head-mounted electronic device; in this way, when the head-mounted electronic device displays N virtual objects on the virtual screen in the screen lock state, since the head-mounted electronic device can trigger the selected target virtual object (which is a virtual object among the N virtual objects) according to the user (which may be a user of the head-mounted electronic device or a user other than the user of the head-mounted electronic device), unlock the virtual screen, and display target information corresponding to the target virtual object; namely, different target virtual objects are triggered and selected by the user, and different information is displayed by the head-mounted electronic equipment; that is, the electronic device can display different information in the head-mounted electronic device according to different permissions of the user (determined by triggering the selected target virtual object by the user); therefore, normal use of the head-mounted electronic equipment can be guaranteed, privacy information of the owner user is prevented from being leaked, and safety of information in the head-mounted electronic equipment can be improved.
The following describes an unlocking method provided by an embodiment of the present invention with reference to various drawings.
As shown in fig. 2, an embodiment of the present invention provides an unlocking method, which may include steps 201 to 203 described below.
Step 201, the head-mounted electronic device displays N virtual objects on the virtual screen in the screen locking state.
Optionally, in the embodiment of the present invention, the N virtual objects may be N AR objects, or may be N VR objects, which may be determined specifically according to actual usage requirements, and the embodiment of the present invention is not limited.
Optionally, in the embodiment of the present invention, N virtual objects are displayed on the virtual screen in the screen locking state, specifically, a screen locking interface is displayed on the virtual screen of the head-mounted electronic device, and the N virtual objects are displayed on the screen locking interface in an overlapping manner.
When the N virtual objects are N AR objects, the background image of the lock screen interface may be a live-action image acquired by the head-mounted electronic device, and the live-action image may be an image acquired by the head-mounted electronic device in real time through a camera of the head-mounted electronic device; that is, the head-mounted electronic device may update the background image of the lock screen interface to the image that it has acquired last time in real time. When the N virtual objects are N VR objects, the background image of the lock screen interface may be an image preset in the electronic device.
Optionally, in this embodiment of the present invention, each virtual object may be any one of the following items: virtual objects, virtual graphics. The virtual object is a virtual image of a real object, and the shape of the virtual image can be any possible shape such as a rectangle, a triangle, a pentagon and the like.
Optionally, in the embodiment of the present invention, the real object may be a door, a fruit, an animal, food, an automobile, a plant (for example, flowers, trees, and the like), a kitchen ware, a dish, an office supply (for example, a key of a keyboard), and the like, and may be determined specifically according to an actual use requirement, which is not limited in the embodiment of the present invention.
Optionally, the number of the N virtual objects may not be limited in the embodiment of the present invention. That is, the N virtual objects may be one virtual object (i.e., N ═ 1), or may be multiple virtual objects (i.e., N > 1), and may be determined according to actual usage requirements, and the embodiment of the present invention is not limited thereto.
Optionally, in the embodiment of the present invention, when N is greater than 1, that is, when the number of the N virtual objects is multiple, the head-mounted electronic device may specifically display all virtual objects in the N virtual objects on the virtual screen in the screen-locked state at the same time (a possible implementation manner); or, a virtual object of the N virtual objects may be displayed on the virtual screen for multiple times to display all virtual objects of the N virtual objects (another possible implementation manner), which may be determined specifically according to actual use requirements, and the embodiment of the present invention is not limited.
The following describes an exemplary implementation of the above-described embodiment and another exemplary implementation of the above-described embodiment.
Possible implementation mode
In the embodiment of the invention, the head-mounted electronic equipment can simultaneously display all the N virtual objects on the virtual screen in the screen locking state.
Optionally, in the embodiment of the present invention, the N virtual objects may be multiple mutually independent virtual objects, or may be N virtual objects in one virtual image, which may be determined specifically according to actual usage requirements, and the embodiment of the present invention is not limited.
For example, taking N virtual objects as N AR objects as an example, when the N virtual objects are a plurality of mutually independent AR objects, as shown in (a) of fig. 3, the N AR objects may be 9 AR dish images displayed on the virtual screen 30; when the above-mentioned N AR objects are N AR objects in one AR image, as shown in (b) of fig. 3, the N AR objects may be 10 AR key images in one AR keyboard image 33 displayed on the virtual screen 30.
Another possible implementation
In this embodiment of the present invention, the head-mounted electronic device may display a virtual object of the N virtual objects on the virtual screen for multiple times (for example, T times may be divided, where T is an integer greater than 1), so as to display all virtual objects of the N virtual objects; namely, the N virtual objects are the sum of the virtual objects displayed by the head-mounted electronic device each time.
In the embodiment of the invention, the number of the displayed virtual objects is at least one in each display process of the virtual objects by the head-mounted electronic equipment.
Step 202, the head-mounted electronic device receives a first input of a user.
The first input may be used to determine a target virtual object of the N virtual objects.
Optionally, in the embodiment of the present invention, the target virtual object may include one virtual object, or may include multiple virtual objects, which may be determined according to actual usage requirements, and the embodiment of the present invention is not limited.
Optionally, in this embodiment of the present invention, when the target virtual object includes a plurality of virtual objects, each of the plurality of virtual objects may correspond to a part of a password input by a user.
In an embodiment of the present invention, the first input may be an air gesture input of a user. Specifically, the first input may be an alternate gesture input performed by a user within an acquisition range of a camera of the head-mounted electronic device.
Optionally, in this embodiment of the present invention, the head-mounted electronic device may determine a projection area of the first input on the virtual screen according to the input parameter of the first input.
In this embodiment of the present invention, the virtual object located in the projection area may be one of the N virtual objects, and the virtual object selected based on the first input of the user may be, for example, a target virtual object.
Optionally, in this embodiment of the present invention, the input parameter of the first input may be an input position of the first input, an input direction of the first input, an input area of the first input, and the like, and may be specifically determined according to an actual use requirement, and the embodiment of the present invention is not limited.
The following description will first exemplify a method for the head-mounted electronic device to select a virtual object based on the input of the user.
In the embodiment of the present invention, each region on the virtual screen of the head-mounted electronic device may correspond to a spatial region within the acquisition range of the camera of the head-mounted electronic device. Accordingly, when a user performs a gesture input within the capture range of the camera of the head-mounted electronic device, the head-mounted electronic device can capture a gesture image of the user through the camera thereof, and since each region on the virtual screen corresponds to a spatial region within the capture range of the camera of the head-mounted electronic device, the head-mounted electronic device can determine a projection region of the gesture image on the virtual screen as a projection region (hereinafter, referred to as a first projection region) of an input region of the gesture input on the virtual screen. After the head-mounted electronic device determines the first projection area, a virtual object of the virtual screen located in the first projection area is a selected virtual object based on the gesture input.
In the embodiment of the invention, as the user can input the spaced gesture in the acquisition range (namely space) of the camera of the head-mounted electronic equipment, the head-mounted electronic equipment is triggered to input the spaced gesture into the virtual object in the projection area on the virtual screen, and the virtual object is determined as the target virtual object; namely, the user sees the virtual object through the head-mounted electronic device, namely, the head-mounted electronic device can be triggered to select the virtual object corresponding to the input through the input in the space, so that the user can see and obtain the virtual object, and the user can see and control the virtual object, thereby improving the convenience of the user operation.
Optionally, in an embodiment of the present invention, in the above one possible implementation manner, the first input may be a single input performed by a user, and the first input may include at least one target sub-input, where each target sub-input may be used to select at least one virtual object in the target virtual objects. In another possible implementation manner, if the head-mounted electronic device displays the N virtual objects on the virtual screen in the screen-locked state for T times, the first input may include T times of sub-inputs, and a sub-input of a different time of the T times of sub-inputs may be an input for a virtual object displayed at a different time; t may be an integer greater than 1.
Optionally, in this embodiment of the present invention, in another possible implementation manner, it is assumed that the head-mounted electronic device may display the N virtual objects on the virtual screen in the screen-locked state for T times, where the N virtual objects are a sum of virtual objects displayed by the head-mounted electronic device for T times; the first input may include T sub-inputs. The step 201 and the step 202 may include the following step a and step B.
And step A, displaying S virtual objects on the virtual screen in the screen locking state by the head-mounted electronic equipment.
And step B, the head-mounted electronic equipment receives the ith sub-input of the user to the first virtual object in the S virtual objects.
The S virtual objects may be virtual objects displayed on the virtual screen in the screen-locked state in the process that the head-mounted electronic device displays the virtual objects for the ith (i is greater than or equal to 1 and less than or equal to T) time, and S may be a positive integer.
Optionally, in this embodiment of the present invention, the first virtual object is a virtual object selected based on the ith sub-input of the user. The first virtual object may be one virtual object of the S virtual objects, or may be multiple virtual objects of the S virtual objects, which may be determined according to actual usage requirements.
It should be noted that, in the embodiment of the present invention, the step a and the step B are illustrated by taking an example that the user performs the ith sub-input on the virtual object displayed by the head-mounted electronic device at the ith time, and in an actual implementation, the user may perform the sub-input on the virtual object displayed by the electronic device at each time.
Optionally, in this embodiment of the present invention, when i < T, each sub-input performed by the user may trigger the electronic device to display the virtual object next time (for example, the (i + 1) th time).
Specifically, when the head-mounted electronic device displays the virtual object on the virtual screen for the first time, the user may trigger the head-mounted electronic device to display the virtual object on the virtual screen for the second time by performing the first sub-input; when the head-mounted electronic equipment displays the virtual object on the virtual screen for the second time, the user can trigger the head-mounted electronic equipment to display the virtual object on the virtual screen for the third time by executing the second sub-input; by analogy, when the head-mounted electronic device displays the virtual object on the virtual screen for the T-1 th time, the user can trigger the head-mounted electronic device to display the virtual object on the virtual screen for the T-1 th time, that is, to display the virtual object for the last time, by performing the sub-input for the T-1 th time. Then, when the head-mounted electronic device displays the virtual object for the tth time, the user may trigger the head-mounted electronic device to unlock the virtual screen and display corresponding information (e.g., target information described below) in the head-mounted electronic device through a primary sub-input (e.g., the tth sub-input), so that the user may normally use the head-mounted electronic device.
In the embodiment of the invention, the displayed virtual object can be input in the process of displaying the virtual object on the head-mounted electronic equipment every time by the user, so that the flexibility of operating the virtual object by the user can be improved.
Optionally, in an embodiment of the present invention, in one possible implementation manner described above, the target virtual object may include: in the first mode, the selected object is triggered based on the at least one target sub-input in the N virtual objects displayed by the head-mounted electronic device. In another possible implementation manner, the target virtual object may include any one of the following items: in the second mode, in the process of displaying the virtual object for T times, the selected virtual object is input based on T times of sub-input of the user; and in the process of displaying the virtual object for the Tth time, the selected object is input for the Tth time based on the user.
The following exemplarily illustrates the target virtual object by the above-described first, second, and third methods, respectively.
In a first mode
Optionally, in this embodiment of the present invention, each of the at least one target sub-input may be used to determine at least one virtual object in the target virtual object.
In this manner, the user can input all the passwords by sequentially selecting the virtual objects among the N virtual objects displayed on the virtual screen, and thus the password can be accurately and efficiently input.
The second method comprises the following steps:
optionally, in this embodiment of the present invention, the head-mounted electronic device may determine, as the target virtual object, an object selected by each of the T sub-inputs.
Optionally, in this embodiment of the present invention, the first virtual object is an object in a target virtual object.
Optionally, in this embodiment of the present invention, if the target virtual object includes X virtual objects, the X virtual objects may include an object selected by T times of sub-input of the user in a process that the head-mounted electronic device displays the virtual objects T times, and X may be an integer greater than or equal to T.
Optionally, in this embodiment of the present invention, each of the T sub-inputs may be used to determine at least one virtual object in the target virtual object.
In this manner, the head-mounted electronic device can determine the virtual object selected based on each sub-input of the user as the object in the target virtual object, so that each time the head-mounted electronic device determines one virtual object in the target virtual object, that is, each virtual object is equivalent to receiving a partial password input by the user, and thus the password reliability of the head-mounted electronic device can be improved.
The third method comprises the following steps:
optionally, in this embodiment of the present invention, the head-mounted electronic device may determine all the objects selected by the last sub-input in the T sub-inputs as the target virtual object.
Optionally, in this embodiment of the present invention, if the target virtual object includes K objects, the K objects may include an object selected based on the tth sub-input of the user during the tth display of the virtual object by the head-mounted electronic device; k may be a positive integer.
In this way, because the head-mounted electronic device can display the virtual objects for multiple times, and the target virtual object is the virtual object displayed last time, the selected object is input based on the last sub-input of the user, that is, no matter how many virtual objects are selected by the user, as long as the virtual object selected last time by the user is correct, the head-mounted electronic device can be triggered to unlock the virtual screen, so that not only can the reliability of the password of the head-mounted electronic device be improved, but also the difficulty of memorizing the password by the user can be reduced, and the human-computer interaction performance can be improved.
Optionally, in an embodiment of the present invention, in another possible implementation manner described above, in a process of displaying a virtual object by the head-mounted electronic device for the ith time, S virtual objects are displayed on the virtual screen in the screen-locked state; after the ith sub-input of the user to the first virtual object, the head-mounted electronic device may further update and display the S virtual objects as P virtual objects, where the S virtual objects and the P virtual objects are different virtual objects in the N virtual objects.
For example, in the embodiment of the present invention, after the step B, the unlocking method provided in the embodiment of the present invention may further include a step C described below.
And step C, the head-mounted electronic equipment responds to the ith sub-input and updates the S virtual objects into the P virtual objects.
The S virtual objects may be virtual objects displayed on a virtual screen in a screen-locked state in an ith virtual object display process of the head-mounted electronic device; the P virtual objects may be virtual objects displayed on a virtual screen in a screen-locked state in an i +1 th display process of the head-mounted electronic device; i is less than T; p may be a positive integer.
Optionally, in this embodiment of the present invention, the head-mounted electronic device updates S virtual objects to P virtual objects, and it may be considered that the head-mounted electronic device is switched from one virtual unlocking scenario (for example, it may be an AR unlocking scenario) to another virtual unlocking scenario (for example, it may be another AR unlocking scenario). Namely, the process of updating and displaying the virtual object at different times by the electronic device is equivalent to the process of showing different virtual unlocking scenes to the user.
The steps A, B and C are described in conjunction with FIG. 4.
For example, in the embodiment of the present invention, the user may trigger the head-mounted electronic device to update and display the displayed AR door image as the AR menu image on the virtual screen in the screen locking state. Specifically, assume that N is 22, S is 10, and P is 12, that is, the N virtual objects include 10 AR gate images and 12 AR dish images; let T be 2; then as shown in fig. 4 (a), during the first time the head mounted electronic device displays the virtual object, 10 AR gate images (i.e., the above-mentioned S virtual objects) may be displayed on the virtual screen 40. Accordingly, after the user performs an empty gesture input, that is, the head-mounted electronic device receives the ith sub-input of the user to the first virtual object of the S virtual objects, the head-mounted electronic device may determine that the projection area of the empty gesture input on the virtual screen is the area 41, and the area 41 includes one AR gate image (that is, the first virtual object), so that the head-mounted electronic device may respond to the empty gesture input, and then, as shown in (b) of fig. 4, the head-mounted electronic device may update 10 AR gates displayed on the virtual screen 40 to 12 AR dishes (that is, the P virtual objects described above), that is, the virtual objects displayed during the process that the electronic device displays the virtual objects for the second time are 12 AR dishes. Thus, the flexibility and the interestingness of the head-mounted electronic equipment for displaying the virtual object can be improved.
Furthermore, 10 AR doors and 12 AR dishes displayed by the electronic device can be regarded as two different virtual unlocking scenes displayed by the head-mounted electronic device to the user, that is, the electronic device can display different virtual unlocking scenes to the user on the virtual screen in the screen locking state for multiple times, so that if the user needs to use the electronic device, the user needs to operate virtual objects in different virtual unlocking scenes to unlock the head-mounted electronic device, which can be triggered, and therefore, the safety of information in the head-mounted electronic device can be improved.
Optionally, in the embodiment of the present invention, before the head-mounted electronic device updates the S virtual objects to the P virtual objects, the state of the first virtual object may also be updated first. For example, taking the first virtual object as the AR door image, assuming that the AR door image is in the closed state before the user performs the ith (i is greater than or equal to 1 and less than or equal to T) sub-input, in the process that the user performs the ith sub-input, the head-mounted electronic device may control the AR door image to be gradually updated and displayed from the closed state to the open state, and in this case, the gesture input of performing the ith sub-input by the user is the input of pushing the door by the user.
In the embodiment of the invention, the user can trigger the electronic equipment to update the virtual object displayed on the virtual screen in the screen locking state through input, so that the flexibility and the interestingness of displaying the virtual object can be improved, and the human-computer interaction performance is improved.
Step 203, the head-mounted electronic device responds to the first input, unlocks the virtual screen, and displays target information corresponding to the target virtual object.
Optionally, in this embodiment of the present invention, the target information may include: first type information or second type information; the first type of information may include user data and the second type of information does not include user data.
Optionally, in this embodiment of the present invention, the user data in the head-mounted electronic device may be data generated during a process in which a user (usually, a user of the head-mounted electronic device, that is, an owner user) uses the head-mounted electronic device; for example, the user data may include: the address book data, the user data and the photos in the application program, and the like may be determined according to actual use requirements, and the embodiment of the present invention is not limited.
In the embodiment of the invention, Z (Z may be a positive integer) unlocking items may be preset in the head-mounted electronic device, and a corresponding relationship between each unlocking item and target information in the head-mounted electronic device is preset.
Optionally, in the embodiment of the present invention, after the head-mounted electronic device determines the target virtual object, the head-mounted electronic device may compare the target virtual object with the Z unlocking items, and determine whether to unlock the virtual screen and target information displayed after unlocking the virtual screen according to a comparison result.
Optionally, in the embodiment of the present invention, the number of preset unlocking items in the head-mounted electronic device is different, and the corresponding manners of the unlocking items and the target information may also be different.
The correspondence between the unlocking item and the target information is exemplarily described below in a first implementation manner and a second implementation manner, respectively.
First implementation
Optionally, in this embodiment of the present invention, in step 203, when Z is equal to 1, that is, when an unlocking item is preset in the head-mounted electronic device, if the target virtual object matches with the unlocking item, the head-mounted electronic device may unlock the virtual screen and display the first type of information; if the target virtual object is not matched with the Z group unlocking item, the head-mounted electronic equipment can unlock the virtual screen and display the second type of information.
When the target information displayed by the head-mounted electronic equipment is first-type information, the head-mounted electronic equipment unlocks a screen and loads user data; in this case, it can be considered that the head mounted electronic apparatus displays information in the head mounted electronic apparatus in the main mode. When the target information displayed by the head-mounted electronic equipment is the second type of information, the head-mounted electronic equipment unlocks the screen but does not load user data; in this case, it can be considered that the head mounted electronic apparatus displays information in the head mounted electronic apparatus in the main mode.
It is understood that the usage rights of the head mounted electronic device in the host mode are greater than the usage rights of the head mounted electronic device in the guest mode. For example, assume that the information in the head mounted electronic device includes: an address book application, an album application, a chat application, a shopping application, address book data, a photograph, chat log data, and shopping log data; then, in the on-machine main mode, after the virtual screen is unlocked by the head-mounted electronic device, the head-mounted electronic device can load an address book application program, an album application program, a chat application program, a shopping application program, address book data, a photo, chat record data and shopping record data, so that a user can view all information in the head-mounted electronic device; in the visitor mode, after the head-mounted electronic device unlocks the virtual screen, the head-mounted electronic device can load an address book application program, an album application program, a chat application program and a shopping application program, but does not load address book data, a photo, chat record data and shopping record data, so that a user can only view information in the head-mounted electronic device, wherein the information does not include user data. I.e. the usage right of the owner mode is greater than the usage right of the guest mode.
Further, in the embodiment of the present invention, when the target information includes the first type of information, the head-mounted electronic device may further display the second type of information; that is, if a user has an authority to view information including user data in the head-mounted electronic device, the user also has an authority to view information not including user data in the head-mounted electronic device. Accordingly, when the target information includes the second type of information, the head-mounted electronic device cannot display only other information except the second type of information in the head-mounted electronic device; that is, if the authority of one user is to check the information that does not include the user data in the head-mounted electronic device, the information that includes the user data in the head-mounted electronic device cannot be checked.
In this implementation, because no matter whether the target virtual object is matched with the unlocking item, the head-mounted electronic device can unlock the virtual screen and display at least part of information in the head-mounted electronic device, so that not only can the normal use of the head-mounted electronic device by the user be ensured, but also the privacy information of the owner user can be prevented from being revealed.
Second implementation
Optionally, in the embodiment of the present invention, when Z is greater than 1, different unlocking items in the Z unlocking items may correspond to different usage rights. Specifically, the target information corresponding to different unlocking items may be completely different or partially different, and may be determined specifically according to actual use requirements, which is not limited in the embodiment of the present invention.
For example, if the target information corresponding to one unlocking item is information a that does not include user data in the head-mounted electronic device, and if the target information corresponding to another unlocking item is information B that does not include user data in the head-mounted electronic device, it indicates that the target information corresponding to the one unlocking item is completely different from the target information corresponding to the another unlocking item; if the target information corresponding to the other unlocking item is information including user data (that is, information with permission to view all information) in the head-mounted electronic device, it indicates that the target information corresponding to the unlocking item is partially different from the target information corresponding to the other unlocking item.
It should be noted that, in the embodiment of the present invention, one owner mode and a plurality of different guest modes may be included, and access permissions in each guest mode may be different, and may be specifically determined according to actual use requirements, which is not limited in the embodiment of the present invention.
For the description of the main mode and the guest mode, reference may be made to the related description in the above first implementation, and details are not repeated here to avoid repetition.
Optionally, in this embodiment of the present invention, if the target virtual object matches a certain unlocking item, the head-mounted electronic device may unlock the virtual screen, and display target information corresponding to the certain unlocking item, that is, execute step 203. If the target virtual object is not matched with each unlocking item in the Z unlocking items, namely the fact that the user does not have permission to access any information in the head-mounted electronic equipment is represented, the head-mounted electronic equipment can display a prompt message to prompt that the virtual screen cannot be unlocked.
Optionally, in the embodiment of the present invention, each unlocking item may include at least one unlocking object, where the at least one unlocking object is at least one virtual object for unlocking the virtual screen.
Optionally, in the embodiment of the present invention, matching the target virtual object with a certain unlocking item may be understood as that the object feature of the target virtual object matches with the object feature of at least one unlocking object in the unlocking item.
Optionally, in this embodiment of the present invention, the object feature of the target virtual object may include at least one of the following: the position of the target virtual object in the virtual screen, the characters corresponding to the target virtual object, the arrangement sequence of the target virtual object and the category of the target virtual object.
The position of the target virtual object in the virtual screen is the display position of the target virtual object in the virtual screen. The characters corresponding to the target virtual object can be any possible characters such as numbers, letters, symbols and the like. The arrangement order of the target virtual objects may be an arrangement order of the target virtual objects in the target region of the virtual screen.
Optionally, in the embodiment of the present invention, when the object feature of the target virtual object is a character corresponding to the target virtual object, each virtual object in the target virtual object may correspond to one character or may correspond to multiple characters, which may be determined specifically according to actual use requirements, and the embodiment of the present invention is not limited.
Further, when each virtual object in the target virtual object corresponds to a plurality of characters, the plurality of characters may be the same kind of characters or different kinds of characters, and may be determined according to actual use requirements, which is not limited in the embodiment of the present invention.
Optionally, in this embodiment of the present invention, when the object features of the target virtual objects are the arrangement order of the target virtual objects, the number of the target virtual objects is multiple, the user may trigger the head-mounted electronic device to move each of the target virtual objects to the target area in the virtual screen, and then the head-mounted electronic device may use the arrangement order of the target virtual objects in the target area as the object features of the target virtual objects.
For example, as shown in fig. 5 (a), the first area 51 in the virtual screen 50 of the head-mounted electronic device displays 4 AR objects (i.e., N virtual objects), which are: an AR gate image, an AR circle image, an AR pentagon image, and an AR triangle image. As shown in fig. 5 (b), if the user uses the first input, the head-mounted electronic device is triggered to update and display the AR door image, the AR circular image, and the AR pentagonal image (i.e., the target virtual object) in the second area 52 (i.e., the target area) of the virtual screen 50, and the target virtual objects are arranged in the second area 52 in the following order from left to right: and the object features of the target virtual object are the AR circular image, the AR door image and the AR pentagonal image which are arranged from left to right.
Optionally, in the embodiment of the present invention, when the object feature of the target virtual object is a category of the target virtual object, the categories of the virtual objects in the target virtual object may be the same or different. For example, assuming that the target virtual object is an AR door image and an AR orange image, the target virtual object is classified into a door and an orange, i.e., the target virtual object has the object characteristics of the door and the orange.
In the embodiment of the present invention, since the object characteristic of the virtual object may be at least one of a position of the virtual object in the virtual screen, a character corresponding to the virtual object, and an arrangement order of the virtual object, that is, the password input by the user may be at least one of a position of the virtual object in the virtual screen, a character corresponding to the virtual object, an arrangement order of the virtual object, and a category of the virtual object, a probability of deciphering the password of the head-mounted electronic device may be reduced, reliability of the password of the head-mounted electronic device may be improved, and further, privacy information of an owner user may be prevented from being leaked.
Optionally, in the embodiment of the present invention, after the head-mounted electronic device determines the target virtual object, the object feature of the target virtual object may be obtained, and the object feature of the target virtual object may be used as a password input by the user. That is, the password input by the user is the same as the object characteristics of the target virtual object.
It should be noted that, in the embodiment of the present invention, when the target virtual object includes a plurality of virtual objects, the object characteristic of each of the target virtual objects may be a part of the password input by the user.
Optionally, in the embodiment of the present invention, if the target virtual object includes a virtual object selected based on T sub-inputs of the user during the process of displaying the virtual object T times, and the target virtual object includes X virtual objects, that is, in the first manner, the step 203 may be specifically implemented by the following step 203 a. If the target virtual object includes the target object selected based on the tth sub-input of the user and the target virtual object includes K virtual objects in the process of displaying the virtual object for the tth time, that is, the above-mentioned method two, the above-mentioned step 203 can be specifically implemented by the following step 203 b.
Step 203a, the head-mounted electronic device responds to the T times of sub-input of the user, and unlocks the virtual screen and displays the target information corresponding to the X unlocking objects under the condition that the object characteristics of the X virtual objects are all matched with the preset object characteristics of the X unlocking objects.
Optionally, in the embodiment of the present invention, the preset X unlocking objects may be all unlocking objects in the same unlocking item.
In the embodiment of the invention, the head-mounted electronic equipment can display the target information corresponding to the unlocking item under the condition that the object characteristics of a plurality of virtual objects selected by the input of the user for T times are respectively matched with the object characteristics of each unlocking object in the same unlocking item, so that the user can use the head-mounted electronic equipment in the use permission of the user, and the privacy information of an owner user is prevented from being leaked on the basis of ensuring that the user normally uses the head-mounted electronic equipment.
And step 203b, the head-mounted electronic device responds to the Tth sub-input of the user, and unlocks the virtual screen and displays target information corresponding to the K unlocking objects under the condition that the K virtual objects are matched with the preset object characteristics of the K unlocking objects.
Optionally, in the embodiment of the present invention, the preset K unlocking objects may be all unlocking objects in the same unlocking item.
In the embodiment of the invention, the head-mounted electronic equipment can display the target information corresponding to the unlocking item under the condition that the object characteristics of at least one virtual object selected by the Tth input of the user are matched with the object characteristics of each unlocking object in the same unlocking item, namely no matter how many virtual objects are selected by the user through triggering, the head-mounted electronic equipment can be triggered to unlock the virtual screen as long as the virtual object selected by the last input of the user is correct, so that the user can use the head-mounted electronic equipment within the use authority of the user, and the privacy information of an owner user is prevented from being leaked on the basis of ensuring the normal use of the head-mounted electronic equipment by the user.
The unlocking method provided by the embodiment of the invention is exemplarily described below with reference to fig. 6 and 7.
For example, in one possible implementation manner described above, the unlocking method according to the embodiment of the present invention may be applied to a scene in which the head-mounted electronic device displays all AR objects at a time, and unlocks the virtual screen according to the object feature of the selected AR object by each sub-input of the user.
Specifically, assume that Z is equal to 1, that is, 1 unlocking item (i.e., the first implementation manner) is preset, and the unlocking item includes four AR unlocking objects, and object features of the four AR unlocking objects are: character "1", character "9", character "0", and character "3"; if the target virtual object is matched with the unlocking item, the target virtual object corresponds to the first type of information; and when the target virtual object is not matched with the unlocking item, the target virtual object corresponds to the second type of information. Then, as shown in fig. 6 (a) and 6 (b), 10 AR key images are displayed in the virtual screen 60, and the user may sequentially perform 4 space gesture inputs (i.e., first inputs), the selected AR key images of the 4 space gesture inputs being an AR key image 61, an AR key image 62, an AR key image 63, and an AR key image 64, respectively. As shown in fig. 6 (a), if the object feature of the AR key image 61 is character "1", the object feature of the AR key image 62 is character "9", the object feature of the AR key image 63 is character "0", and the object feature of the AR key image 64 is character "3", that is, the target virtual object matches the object features of the 4 unlocking objects in the unlocking item, the head-mounted electronic device may unlock the virtual screen and display the content including the user data in the head-mounted electronic device, that is, the first type information. As shown in fig. 6 (b), if the object feature of the AR key image 61 is character "1", the object feature of the AR key image 62 is character "9", the object feature of the AR key image 63 is character "0", and the object feature of the AR key image 64 is character "5", that is, the target virtual object does not match the object feature of one of the 4 unlocking objects, the head-mounted electronic device may unlock the virtual screen and display the content of the head-mounted electronic device that does not include the user data, that is, the second type of information.
In this example, since the user can input all the passwords by sequentially selecting the 4 AR key images displayed on the virtual screen, the password can be accurately and efficiently input. Further, even if the password input by the user does not accord with the preset password, the head-mounted electronic equipment can unlock the virtual screen and display target information which does not comprise user data in the head-mounted electronic equipment, so that the privacy information of the owner user is prevented from being leaked while normal use of the head-mounted electronic equipment is ensured, and the safety of the information in the head-mounted electronic equipment can be improved.
For another example, in another possible implementation manner described above, the unlocking method provided by the embodiment of the present invention may be applied to the electronic device to display the AR object for multiple times, and unlock the scene of the virtual screen according to the object feature of the selected AR object, which is input by the user each time.
Specifically, assume that Z is 2, that is, a first unlocking item and a second unlocking item are preset; the first unlocking item comprises two AR objects, and the object characteristics of the two AR objects are respectively as follows: the character "1" and the character "g"; the second unlocking item comprises two AR objects, and the object characteristics of the two AR objects are respectively as follows: character "2" and character "d"; it is further assumed that the first unlocking item corresponds to the first type of information and the second unlocking item corresponds to the second type of information. Then, as shown in (a) of fig. 7, the virtual screen 70 of the head-mounted electronic device displays 10 AR gate images, the user pushes the AR gate image 71 open, that is, the head-mounted electronic device receives the first sub-input of the user, and then the head-mounted electronic device responds to the first sub-input, as shown in (b) of fig. 7 and (c) of fig. 7, the head-mounted electronic device may update the 10 AR gate images to 12 AR images, wherein the object feature of the AR gate image 71 is a character "1"; then, the user selects the AR dish image 72; so that the electronic device can determine the AR gate image 71 and the AR dish image 72 as the target virtual object. If the object feature of the AR dish image 72 is the character "g", that is, the object feature of the target virtual object matches all of the 2 AR objects in the first unlocking item, the head-mounted electronic device may unlock the virtual screen and display the first type of information. If the object feature of the AR door image 71 is the character "2" and the object feature of the AR dish image 72 is the character "d", that is, the object feature of the target virtual object matches with all of the 2 AR objects in the second unlocking item, the head-mounted electronic device may unlock the virtual screen and display the second type of information.
In this example, since the head-mounted electronic device can display a plurality of AR door images and a plurality of AR dish images in sequence, and can unlock the virtual screen after the user pushes an AR door image and selects an AR dish image (which may be the favorite of the user) respectively open, and display corresponding content in the head-mounted electronic device, the security of the head-mounted electronic device can be improved, the privacy information of the owner user is prevented from being leaked, and the security of information in the head-mounted electronic device can be improved.
For another example, in another possible implementation manner, the unlocking method provided by the embodiment of the present invention may be applied to the electronic device to display the AR object for multiple times, and unlock the scene of the virtual screen according to the object feature of the selected AR object input by the user in the last sub-input.
Specifically, assume that Z is 2, that is, a first unlocking item and a second unlocking item are preset, where the first unlocking item includes an AR object, and an object feature of the AR object is "apple"; the second unlocking item comprises an AR object, and the object characteristics of the AR object are watermelon respectively; it is further assumed that the first unlocking item corresponds to the first type of information and the second unlocking item corresponds to the second type of information. Then, as shown in (a) of fig. 8, the virtual screen 80 of the head-mounted electronic device displays 10 AR gate images (i.e., the above-mentioned S virtual objects), the user pushes the AR gate image 81 open, i.e., the head-mounted electronic device receives the first sub-input of the user, and then the head-mounted electronic device responds to the first sub-input, as shown in (b) of fig. 8, and the head-mounted electronic device can update the 10 AR gate images to 4 AR fruit images (i.e., the above-mentioned P virtual objects); then, as shown in fig. 8 (b), if the user selects an AR apple image, the object feature representing the target virtual object is "apple", so that the head-mounted electronic device can unlock the virtual screen and display the first type of information; if the user selects the AR watermelon image, as shown in fig. 8 (c), the object feature representing the target virtual object is "watermelon", so that the head-mounted electronic device can unlock the virtual screen and display the second type of information. Further, if the AR grape image selected by the user indicates that the object feature of the target virtual object is "grape", the head-mounted electronic device may display a prompt message "password error" to prompt the user to unlock the head-mounted electronic device without permission.
In this example, because the head-mounted electronic device can display a plurality of AR door images and a plurality of AR dish images in sequence, and can push an AR door image and select an AR dish image (can be the favorite of the user) open respectively by the user after, according to the fruit type of the AR fruit image selected by the user, unlock the virtual screen, and display corresponding information in the head-mounted electronic device, the security of the head-mounted electronic device can be improved, the privacy information of the owner user is prevented from being revealed, and the security of the information in the head-mounted electronic device can be improved.
In the unlocking method provided by the embodiment of the invention, when the head-mounted electronic device displays N virtual objects on the virtual screen in the screen locking state, the head-mounted electronic device can trigger the selected target virtual object (which is a virtual object of the N virtual objects) according to a user (which can be a user of the head-mounted electronic device or other users except the user of the head-mounted electronic device), unlock the virtual screen, and display target information corresponding to the target virtual object; namely, different target virtual objects are triggered and selected by the user, and different information is displayed by the head-mounted electronic equipment; that is, the head-mounted electronic device can display different information in the head-mounted electronic device according to different rights (determined by triggering the selected target virtual object by the user); therefore, normal use of the head-mounted electronic equipment can be guaranteed, privacy information of an owner user can be prevented from being leaked, and safety of information in the head-mounted electronic equipment can be improved.
Optionally, in the embodiment of the present invention, before the head-mounted electronic device displays the N virtual objects on the virtual screen, the user may first trigger the head-mounted electronic device to initialize the operating system of the head-mounted electronic device.
Optionally, in this embodiment of the present invention, the head-mounted electronic device may be an AR device. For example, the AR device may be an AR glasses AR helmet or the like.
Optionally, in an embodiment of the present invention, when the head-mounted electronic device is an AR glasses, at least one folding area of the AR glasses is provided with a sensor, and a sensing signal detected by the sensor may be used to trigger the AR glasses to initialize an operating system of the AR glasses. Wherein each folding area may be a temple of the AR glasses and a connection area between the temple.
Optionally, in the embodiment of the present invention, the sensor may be a pressure-sensitive sensor or a photosensitive sensor, and the like, which may be determined according to actual use requirements, and the embodiment of the present invention is not limited.
Optionally, in the embodiment of the present invention, the head-mounted electronic device may determine whether a value of the sensing signal detected by the sensor meets a target condition, and when the value of the sensing signal meets the target condition, the head-mounted electronic device may initialize an operating system of the head-mounted electronic device; when the value of the sensing signal does not satisfy the target condition, the head-mounted electronic device may not initialize an operating system of the head-mounted electronic device, for example, the head-mounted electronic device may not perform any action.
It should be noted that, in the embodiment of the present invention, the types of the sensors are different, the sensing signals may be different, and the target conditions may also be different, which may be determined according to actual use requirements, and the embodiment of the present invention is not limited.
For example, when the sensor is a photosensor, the sensing signal may be a light intensity signal, and the target condition may be that a light intensity value detected by the photosensor is less than or equal to a preset light intensity value (which may be a light intensity value detected by the photosensor when the AR glasses are in the unfolded state). When the sensor is a pressure-sensitive sensor, the sensing signal may be a pressure signal, and the target condition is that a pressure value detected by the pressure-sensitive sensor is greater than or equal to a preset pressure value (which may be a pressure value detected by the pressure-sensitive sensor when the AR glasses are in the extended state).
Optionally, in an embodiment of the present invention, the frame of the AR glasses may include a frame, two temples, and two stakes. Wherein each of the pile heads can be fixedly connected with the frame, and one of the temples and one of the pile heads can be movably connected through a connecting component, for example, the connecting component can be a hinge.
Optionally, in this embodiment of the present invention, the folding area of the AR glasses may be an area between the temple and the corresponding pile head of the temple.
For example, fig. 9 is a schematic structural diagram of the AR glasses. The sensor (not shown in fig. 9) may be provided at the junction of one temple 81 of the AR glasses 80 and the corresponding stub 82 of the temple 81.
Optionally, in the embodiment of the present invention, the sensor may be disposed at the first end of the temple of the AR glasses, or may be disposed on the stub of the AR glasses. Wherein, the first end of the mirror leg is the end contacted with the pile head corresponding to the mirror leg.
For example, fig. 10 is a schematic view illustrating a connection structure between a temple 81 of AR glasses and a post 82 corresponding to the temple 81. Wherein, as shown in fig. 10 (a), the sensor 83 may be provided at one end of the temple 81; alternatively, as shown in fig. 10 (b), the sensor 83 may be provided on the pile head 82. In this way, when the user triggers that the temple of the AR glasses changes from the folded state to the unfolded state, the head-mounted electronic device may determine that the value of the sensing signal detected by the sensor corresponds to the target value, so that the head-mounted electronic device may initialize the operating system of the AR glasses.
Illustratively, with reference to fig. 2, as shown in fig. 11, in the embodiment of the present invention, before step 201, the unlocking method provided in the embodiment of the present invention may further include step 204 and step 205 described below.
Step 204, the head-mounted electronic device receives a second input from the user to deploy a temple of the AR glasses.
In step 205, the head-mounted electronic device initializes an operating system of the head-mounted electronic device according to the sensing signal detected by the sensor in response to the second input.
In an embodiment of the present invention, the head-mounted electronic device is an AR glasses.
Optionally, in this embodiment of the present invention, the second input may be an input that the user triggers the temple of the AR glasses to change from the folded state to the unfolded state. For example, the second input may be an input in which the user's hand holds the temple of the AR glasses and moves outward (i.e., in a direction away from the lens).
Optionally, in an embodiment of the present invention, the second input may be used to trigger the head-mounted electronic device to be powered on, and initialize an operating system of the head-mounted electronic device after the head-mounted electronic device is powered on; or the operating system may be used to trigger the head-mounted electronic device to initialize the operating system of the head-mounted electronic device (for example, the operating system may initialize the head-mounted electronic device in a power-on state), which may be determined according to actual usage requirements, and the embodiment of the present invention is not limited.
Optionally, in the embodiment of the present invention, after the head-mounted electronic device initializes the operating system of the head-mounted electronic device, the head-mounted electronic device may detect whether a password is set, and if it is detected that the password is set in the head-mounted electronic device, the head-mounted electronic device may perform step 201; if the fact that the password is not set in the head-mounted electronic equipment is detected, the head-mounted electronic equipment can display prompt information to prompt a user to set the password.
In the embodiment of the invention, because the head-mounted electronic device (specifically, the AR glasses) can initialize the operating system of the AR glasses according to the input of the user before the user inputs the password, when the user selects the password input by the target virtual object, the AR glasses can unlock the AR glasses, and display information corresponding to the password input by the user (for example, display second-class information not including user data), so that the normal use of the AR glasses by the user can be ensured, and the privacy information of the owner in the AR glasses is prevented from being leaked.
Further, the AR glasses can directly initialize the operating system of the AR glasses according to the input of the user for unfolding the temple of the AR glasses, namely the input for triggering the unfolding of the AR glasses and the input for triggering the initialization of the operating system are the same input, so that the operating process of using the AR glasses can be simplified.
In the embodiment of the present invention, the unlocking method shown in each method drawing is exemplarily described with reference to one drawing in the embodiment of the present invention. In specific implementation, the unlocking method shown in each method drawing can also be implemented by combining any other drawing which can be combined and is illustrated in the above embodiments, and details are not described here.
As shown in fig. 12, an embodiment of the present invention provides a head-mounted electronic device, where the head-mounted electronic device 900 may include: a display module 901, a receiving module 902 and a processing module 903. A display module 901, configured to display N virtual objects on a virtual screen in a screen-locked state; a receiving module 902, configured to receive a first input of a user after the displaying module 901 displays the N virtual objects on the virtual screen in the lock screen state, where the first input is used to determine a target virtual object in the N virtual objects; a processing module 903, which may be configured to unlock the virtual screen in response to the first input received by the receiving module 902; the display module 901 may be further configured to display target information corresponding to the target virtual object after the processing module 903 unlocks the virtual screen; wherein N is a positive integer; the target information includes: first type information or second type information; the first type of information includes user data and the second type of information does not include user data.
In the embodiment of the invention, when the head-mounted electronic device displays N virtual objects on the virtual screen in the screen locking state, the head-mounted electronic device can trigger the selected target virtual object (which is a virtual object of the N virtual objects) according to a user (which can be a user of the head-mounted electronic device or a user other than the user of the head-mounted electronic device), unlock the virtual screen, and display target information corresponding to the target virtual object; namely, different target virtual objects are triggered and selected by the user, and different information is displayed by the head-mounted electronic equipment; that is, the head-mounted electronic device can display different information in the head-mounted electronic device according to different rights (determined by triggering the selected target virtual object by the user); therefore, normal use of the head-mounted electronic equipment can be guaranteed, and privacy information of an owner user can be prevented from being leaked.
Optionally, in the embodiment of the present invention, the head-mounted electronic device is an AR glasses, at least one folding area of the AR glasses is provided with a sensor, and each folding area is a connection area between a temple of the AR glasses and a corresponding pile head of the temple; the receiving module 902 may further be configured to receive a second input that the user opens the temple of the AR glasses before the displaying module 901 displays the N virtual objects on the virtual screen in the screen-locked state; the processing module 903 may further be configured to initialize an operating system of the head-mounted electronic device according to the sensing signal detected by the sensor in response to the second input received by the receiving module 902.
In the embodiment of the invention, because the head-mounted electronic device (specifically, the AR glasses) can initialize the operating system of the AR glasses according to the input of the user before the user inputs the password, when the user selects the password input by the target virtual object, the AR glasses can unlock the AR glasses and display information corresponding to the password input by the user (for example, display second-class information not including user data), so that the normal use of the AR glasses by the user can be ensured, the privacy information of the owner user in the AR glasses is prevented from being leaked, and the security of the information in the head-mounted electronic device can be improved.
Optionally, in this embodiment of the present invention, the first input may include T sub-inputs; the N virtual objects may be a sum of virtual objects displayed by the head-mounted electronic device T times; the display module 901 may be specifically configured to display S virtual objects on a virtual screen in a screen lock state, where the S virtual objects are virtual objects displayed at the ith time; a receiving module 902, which may be specifically configured to receive an ith sub-input of a first virtual object in the S virtual objects from a user; the ith sub-input is any one of the T sub-inputs; i is more than or equal to 1 and less than T; s is a positive integer; t is an integer greater than 1.
In the embodiment of the invention, the displayed virtual object can be input in the process of displaying the virtual object on the head-mounted electronic equipment every time by the user, so that the flexibility of operating the virtual object by the user can be improved.
Optionally, in this embodiment of the present invention, the processing module 903 may be further configured to, after the receiving module 902 receives an ith sub-input of the user to a first virtual object in the S virtual objects, respond to the ith sub-input, update the S virtual objects to P virtual objects; the P virtual objects may be virtual objects displayed on the virtual screen in the screen locking state in the process of displaying the virtual object at the (i + 1) th time; i is less than T, and P is a positive integer.
In the embodiment of the invention, the user can trigger the electronic equipment to update the virtual object displayed on the virtual screen in the screen locking state through input, so that the flexibility and the interestingness of displaying the virtual object can be improved, and the human-computer interaction performance is improved.
Optionally, in this embodiment of the present invention, the target virtual object may include X virtual objects; the X virtual objects may include a virtual object selected based on T sub-inputs of a user during display of the T virtual objects, and X may be an integer greater than or equal to T.
In the embodiment of the invention, the head-mounted electronic equipment can determine the virtual object selected based on each sub-input of the user as the object in the target virtual object, so that the head-mounted electronic equipment can determine one virtual object in the target virtual object every time, namely, the virtual object is equivalent to receive part of the password input by the user, and the password reliability of the head-mounted electronic equipment can be improved.
Optionally, in this embodiment of the present invention, the processing module 903 may be specifically configured to unlock the virtual screen when the object features of the X virtual objects are all matched with the preset object features of the X unlocking objects; the processing module 903 may be specifically configured to display target information corresponding to the X unlocking objects after the processing module 903 explains the virtual screen.
In the embodiment of the invention, the head-mounted electronic equipment can display the target information corresponding to the unlocking item under the condition that the object characteristics of a plurality of virtual objects selected by the input of the user for T times are respectively matched with the object characteristics of each unlocking object in the same unlocking item, so that the user can use the head-mounted electronic equipment in the use permission of the user, and the privacy information of an owner user is prevented from being leaked on the basis of ensuring that the user normally uses the head-mounted electronic equipment.
Optionally, in this embodiment of the present invention, the target virtual object may include K virtual objects; the K virtual objects may be virtual objects selected based on the tth sub-input of the user during the display of the tth virtual object, where K is a positive integer.
In the embodiment of the invention, the head-mounted electronic equipment can display the virtual objects for multiple times, and the target virtual object is the virtual object displayed for the last time, the selected object is input based on the last time of the user, namely no matter how many virtual objects are selected by the user, the virtual object selected for the last time by the user can trigger the head-mounted electronic equipment to unlock the virtual screen, so that the reliability of the password of the head-mounted electronic equipment can be improved, the difficulty of memorizing the password by the user can be reduced, and the man-machine interaction performance can be improved.
Optionally, in this embodiment of the present invention, the processing module 903 may be specifically configured to unlock the virtual screen when the object features of the K virtual objects are all matched with the preset object features of the K unlocking objects; the processing module 903 is specifically configured to display target information corresponding to the K unlocking objects after the processing module 903 explains the virtual screen.
In the embodiment of the invention, the head-mounted electronic equipment can display the target information corresponding to the unlocking item under the condition that the object characteristics of at least one virtual object selected by the Tth input of the user are matched with the object characteristics of each unlocking object in the same unlocking item, namely no matter how many virtual objects are selected by the user through triggering, the head-mounted electronic equipment can be triggered to unlock the virtual screen as long as the virtual object selected by the last input of the user is correct, so that the user can use the head-mounted electronic equipment within the use authority of the user, and the privacy information of an owner user is prevented from being leaked on the basis of ensuring the normal use of the head-mounted electronic equipment by the user.
Optionally, in an embodiment of the present invention, the first input may be an air gesture input; the processing module 903 may be further configured to, in response to the first input, obtain an input parameter of the first input after the display module 901 displays the N virtual objects on the virtual screen in the screen lock state, and according to the input parameter; determining a projection area of the first input on the virtual screen; and determining a virtual object located in the projection area in the virtual screen as a target virtual object.
In the embodiment of the invention, as the user can input the spaced gesture in the acquisition range (namely space) of the camera of the head-mounted electronic equipment, the head-mounted electronic equipment is triggered to input the spaced gesture into the virtual object in the projection area on the virtual screen, and the virtual object is determined as the target virtual object; namely, the user sees the virtual object through the head-mounted electronic device, namely, the head-mounted electronic device can be triggered to select the virtual object corresponding to the input through the input in the space, so that the user can see and obtain the virtual object, and the user can see and control the virtual object, thereby improving the convenience of the user operation.
The head-mounted electronic device 900 provided in the embodiment of the present invention can implement each process implemented by the head-mounted electronic device shown in the above-mentioned method embodiment, and for avoiding repetition, details are not described here again.
The embodiment of the invention provides a head-mounted electronic device, which can display N (positive integers) virtual objects on a virtual screen in a screen locking state; and receiving a first input of a user (for determining a target virtual object among the N virtual objects); and in response to the first input, unlocking the virtual screen and displaying target information corresponding to the target virtual object; the target information may include: first type information or second type information; the first type of information may include user data and the second type of information does not include user data. By the scheme, when the head-mounted electronic equipment displays N virtual objects on the virtual screen in the screen locking state, the head-mounted electronic equipment can trigger the selected target virtual object (which is a virtual object in the N virtual objects) according to a user (which can be a user of the head-mounted electronic equipment or other users except the user of the head-mounted electronic equipment), unlock the virtual screen and display target information corresponding to the target virtual object; namely, different target virtual objects are triggered and selected by the user, and different information is displayed by the head-mounted electronic equipment; that is, the head-mounted electronic device can display different information in the head-mounted electronic device according to different rights (determined by triggering the selected target virtual object by the user); therefore, normal use of the head-mounted electronic equipment can be guaranteed, privacy information of an owner user can be prevented from being leaked, and safety of information in the head-mounted electronic equipment can be improved.
Fig. 13 is a schematic hardware structure diagram of a head-mounted electronic device implementing various embodiments of the present invention. As shown in fig. 13, the head-mounted electronic device 100 includes but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, a power supply 111, and the like, and an image capturing apparatus 112. Those skilled in the art will appreciate that the configuration of the head mounted electronic device shown in fig. 13 does not constitute a limitation of the head mounted electronic device, and that the head mounted electronic device may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the head-mounted electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted head-mounted electronic device, a wearable device, a pedometer, and the like.
The display unit 106 is configured to display N virtual objects on a virtual screen in a screen-locked state; a user input unit 107 for receiving a first input of a user for determining a target virtual object among the N virtual objects after the display unit displays the N virtual objects; a processor 110 for unlocking the virtual screen in response to a first input; a display unit 106, further configured to display target information corresponding to the target virtual object after the processor 110 unlocks the virtual screen; wherein N is a positive integer; the target information includes: first type information or second type information; the first type of information includes user data and the second type of information does not include user data.
It can be understood that, in the embodiment of the present invention, the display module 901 in the structural schematic diagram of the head-mounted electronic device (for example, fig. 12) may be implemented by the display unit 106. The receiving module 902 in the structural schematic diagram of the head-mounted electronic device (for example, fig. 12) may be implemented by the user input unit 107. The processing module 903 in the structural schematic diagram of the head-mounted electronic device (for example, fig. 12) may be implemented by the processor 110.
The embodiment of the invention provides a head-mounted electronic device, which can display N (positive integers) virtual objects on a virtual screen in a screen locking state; and receiving a first input of a user (for determining a target virtual object among the N virtual objects); and in response to the first input, unlocking the virtual screen and displaying target information corresponding to the target virtual object; the target information may include: first type information or second type information; the first type of information may include user data and the second type of information does not include user data. By the scheme, when the head-mounted electronic equipment displays N virtual objects on the virtual screen in the screen locking state, the head-mounted electronic equipment can trigger the selected target virtual object (which is a virtual object in the N virtual objects) according to a user (which can be a user of the head-mounted electronic equipment or other users except the user of the head-mounted electronic equipment), unlock the virtual screen and display target information corresponding to the target virtual object; namely, different target virtual objects are triggered and selected by the user, and different information is displayed by the head-mounted electronic equipment; that is, the head-mounted electronic device can display different information in the head-mounted electronic device according to different rights (determined by triggering the selected target virtual object by the user); therefore, normal use of the head-mounted electronic equipment can be guaranteed, privacy information of an owner user can be prevented from being leaked, and safety of information in the head-mounted electronic equipment can be improved.
The head-mounted electronic device provided by the embodiment of the present invention can implement each process implemented by the head-mounted electronic device in the above method embodiments, and for avoiding repetition, details are not described here.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 101 may be used for receiving and sending signals during a message transmission or call process, and specifically, after receiving downlink data from a base station, the downlink data is processed by the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through a wireless communication system.
The head-mounted electronic device provides wireless broadband internet access to the user through the network module 102, such as assisting the user in emailing, browsing web pages, and accessing streaming media.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output as sound. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the head mounted electronic device 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.
The input unit 104 is used to receive an audio or video signal. The input unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes image data of a still picture or a video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the network module 102. The microphone 1042 may receive sound and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode.
The head-mounted electronic device 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or the backlight when the head-mounted electronic device 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the head-mounted electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer and tapping); the sensors 105 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The display unit 106 is used to display information input by a user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), or the like.
The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the head-mounted electronic device. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072. Touch panel 1071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 1071 (e.g., operations by a user on or near touch panel 1071 using a finger, stylus, or any suitable object or attachment). The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and receives and executes commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. Specifically, other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
Further, the touch panel 1071 may be overlaid on the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although in fig. 13, the touch panel 1071 and the display panel 1061 are two independent components to implement the input and output functions of the head-mounted electronic device, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the head-mounted electronic device, and is not limited herein.
The interface unit 108 is an interface for connecting an external device to the head mounted electronic apparatus 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the head mounted electronic apparatus 100 or may be used to transmit data between the head mounted electronic apparatus 100 and the external device.
The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 110 is a control center of the head-mounted electronic device, connects various parts of the whole head-mounted electronic device by using various interfaces and lines, and performs various functions of the head-mounted electronic device and processes data by running or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the head-mounted electronic device. Processor 110 may include one or more processing units; alternatively, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The head-mounted electronic device 100 may further include a power supply 111 (such as a battery) for supplying power to various components, and optionally, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.
In addition, the head-mounted electronic device 100 includes some functional modules that are not shown, and are not described in detail herein.
Optionally, an embodiment of the present invention further provides a head-mounted electronic device, including the processor 110 shown in fig. 13, the memory 109, and a computer program stored in the memory 109 and capable of running on the processor 110, where the computer program, when executed by the processor 110, implements the processes of the foregoing method embodiment, and can achieve the same technical effects, and details are not described here to avoid repetition.
Specifically, when the head-mounted electronic device (for example, the electronic device shown in fig. 13) in the above embodiment is an AR device, the AR device may include all or part of the functional modules in the head-mounted electronic device. Of course, the AR device may also include functional modules not included in the head-mounted electronic device described above.
Taking the AR device as AR glasses as an example, when the user wears the AR glasses, the scene viewed by the user is generated by processing through the AR technology, that is, the virtual scene can be displayed in the real scene in an overlapping manner through the AR technology. When the user operates the content displayed by the AR glasses, the user can see that the AR glasses peel off the real scene, so that a more real side is displayed to the user. For example, only the case of the carton can be observed when a user visually observes one carton, but the user can directly observe the internal structure of the carton through AR glasses when the user wears the AR glasses.
It is to be understood that, in the embodiment of the present invention, when the head-mounted electronic device in the above-described embodiment is an AR device, the electronic device may be an electronic device integrated with AR technology. The AR technology is a technology for realizing the combination of a real scene and a virtual scene. By adopting the AR technology, the visual function of human can be restored, so that human can experience the feeling of combining a real scene and a virtual scene through the AR technology, and further the human can experience the experience of being personally on the scene better.
The AR equipment can comprise the camera, so that the AR equipment can be combined with the virtual picture to display and interact on the basis of the picture shot by the camera. For example, in the embodiment of the present invention, the AR device may display N (positive integers) virtual objects on the virtual screen in the lock screen state; and receiving a first input of a user (for determining a target virtual object among the N virtual objects); and in response to the first input, unlocking the virtual screen and displaying target information corresponding to the target virtual object; the target information may include: first type information or second type information; the first type of information may include user data and the second type of information does not include user data. By the scheme, when the AR device displays N virtual objects on the virtual screen in the screen locking state, the AR device can trigger the selected target virtual object (which is a virtual object in the N virtual objects) according to the user (which can be the user of the AR device or other users except the user of the AR), unlock the AR device and display target information corresponding to the target virtual object; namely, the target virtual objects selected by user triggering are different, and the information displayed by the AR equipment is also different; that is, the electronic device can display different information in the head-type electronic device according to different permissions of the user (determined by triggering the selected target virtual object by the user); therefore, normal use of the AR equipment can be guaranteed, privacy information of the owner user can be prevented from being revealed, and safety of information in the AR equipment can be improved.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements the processes of the foregoing method embodiments, and can achieve the same technical effects, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may include a read-only memory (ROM), a Random Access Memory (RAM), a magnetic or optical disk, and the like.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling an electronic device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (20)

1. An unlocking method applied to a head-mounted electronic device is characterized by comprising the following steps:
displaying N virtual objects on a virtual screen in a screen locking state;
receiving a first input of a user, wherein the first input is used for determining a target virtual object in the N virtual objects, the first input comprises T sub-inputs, and the N virtual objects are displayed on a virtual screen in T times;
responding to the first input, unlocking the virtual screen, and displaying target information corresponding to the target virtual object;
wherein N is a positive integer; the target information includes: first type information or second type information; the first type of information includes user data and the second type of information does not include user data.
2. The method of claim 1, wherein the head-mounted electronic device is AR glasses;
at least one folding area of the AR glasses is provided with a sensor, and each folding area is a connection area between a temple of the AR glasses and a pile head corresponding to the temple;
before displaying the N virtual objects on the virtual screen in the lock screen state, the method further includes:
receiving a second input by a user to unfold a temple of the AR glasses;
in response to the second input, initializing an operating system of the head-mounted electronic device according to the sensing signal detected by the sensor.
3. The method according to claim 1, wherein the N virtual objects are a sum of virtual objects displayed by the head-mounted electronic device T times;
the displaying N virtual objects on the virtual screen in the screen locking state comprises:
s virtual objects are displayed on the virtual screen in a screen locking state in the process of displaying the virtual objects for the ith time;
the receiving a first input of a user comprises:
receiving the ith sub-input of a user to a first virtual object in the S virtual objects;
wherein the ith sub-input is any one of the T sub-inputs; i is more than or equal to 1 and less than or equal to T; s is a positive integer; t is an integer greater than 1.
4. The method of claim 3, wherein after receiving the i-th sub-input from the user to the first virtual object of the S virtual objects, the method further comprises:
updating the S virtual objects into P virtual objects in response to the ith sub-input;
the P virtual objects are displayed on the virtual screen in a screen locking state in the process of displaying the virtual objects for the (i + 1) th time; i is less than T; p is a positive integer.
5. The method of claim 3, wherein the target virtual object comprises X virtual objects;
and in the process of displaying the virtual objects for T times, the X virtual objects comprise the virtual objects selected based on the T times of sub-input of the user, wherein X is an integer greater than or equal to T.
6. The method of claim 5, wherein unlocking the virtual screen and displaying target information corresponding to the target virtual object comprises:
and under the condition that the object characteristics of the X virtual objects are matched with the object characteristics of the preset X unlocking objects, unlocking the virtual screen, and displaying the target information corresponding to the X unlocking objects.
7. The method of claim 3, wherein the target virtual object comprises K virtual objects;
and in the process of displaying the virtual objects for the Tth time, the K virtual objects are selected based on the Tth sub-input of the user, and K is a positive integer.
8. The method of claim 7, wherein the unlocking the virtual screen and displaying target information corresponding to the target virtual object comprises:
and under the condition that the object characteristics of the K virtual objects are matched with the object characteristics of the preset K unlocking objects, unlocking the virtual screen, and displaying target information corresponding to the K unlocking objects.
9. The method of claim 1, wherein the first input is a clear gesture input;
before the unlocking the virtual screen and displaying the target information corresponding to the target virtual object, the method further includes:
responding to the first input, and acquiring input parameters of the first input;
determining a projection area of the first input on the virtual screen according to the input parameters;
determining a virtual object in the virtual screen, which is located in the projection area, as the target virtual object.
10. A head-mounted electronic device, comprising: the device comprises a display module, a receiving module and a processing module;
the display module is used for displaying N virtual objects on a virtual screen in a screen locking state;
the receiving module is configured to receive a first input of a user after the displaying module displays the N virtual objects on the virtual screen in the screen-locked state, where the first input is used to determine a target virtual object in the N virtual objects, the first input includes T sub-inputs, and the N virtual objects are displayed on the virtual screen in T times;
the processing module is used for responding to the first input received by the receiving module and unlocking the virtual screen;
the display module is further configured to display target information corresponding to the target virtual object after the processing module unlocks the virtual screen;
wherein N is a positive integer; the target information includes: first type information or second type information; the first type of information includes user data and the second type of information does not include user data.
11. The head-mounted electronic device according to claim 10, wherein the head-mounted electronic device is AR glasses, at least one folding area of the AR glasses is provided with a sensor, and each folding area is a connection area between a temple of the AR glasses and a corresponding temple of the temple;
the receiving module is further configured to receive a second input that the user unfolds the temple of the AR glasses before the displaying module displays the N virtual objects on the virtual screen in the screen-locked state;
the processing module is further configured to initialize an operating system of the head-mounted electronic device according to the sensing signal detected by the sensor in response to the second input received by the receiving module.
12. The head-mounted electronic device of claim 10, wherein the N virtual objects are a sum of virtual objects displayed by the head-mounted electronic device T times;
the display module is specifically configured to display S virtual objects on the virtual screen in the screen lock state, where the S virtual objects are displayed for the ith time;
the receiving module is specifically configured to receive an ith sub-input of a user to a first virtual object in the S virtual objects;
wherein the ith sub-input is any one of the T sub-inputs; i is more than or equal to 1 and less than T; s is a positive integer; t is an integer greater than 1.
13. The head-mounted electronic device of claim 12,
the processing module is further configured to, after the receiving module receives an ith sub-input of a user to a first virtual object of the S virtual objects, update the S virtual objects to P virtual objects in response to the ith sub-input;
the P virtual objects are displayed on the virtual screen in a screen locking state in the process of displaying the virtual objects for the (i + 1) th time; i is less than T, and P is a positive integer.
14. The head-mounted electronic device of claim 12, wherein the target virtual object comprises X virtual objects;
and in the display process of the X virtual objects, selecting the virtual object based on the T times of sub-input of the user, wherein X is an integer greater than or equal to T.
15. The head-mounted electronic device of claim 14,
the processing module is specifically configured to unlock the virtual screen when the object features of the X virtual objects are all matched with preset object features of X unlocking objects;
the processing module is specifically configured to display the target information corresponding to the X unlocking objects after the processing module explains the virtual screen.
16. The head-mounted electronic device of claim 12, wherein the target virtual object comprises K virtual objects;
and in the display process of the K virtual objects which are the Tth virtual object, the selected virtual object is input based on the Tth sub-input of the user, and K is a positive integer.
17. The head-mounted electronic device of claim 16,
the processing module is specifically configured to unlock the virtual screen when the object features of the K virtual objects are all matched with preset object features of K unlocking objects;
the processing module is specifically configured to display the target information corresponding to the K unlocking objects after the processing module explains the virtual screen.
18. The head-mounted electronic device of claim 10, wherein the first input is a clear gesture input;
the processing module is further configured to, in response to the first input, obtain an input parameter of the first input after the display module displays the N virtual objects on the virtual screen in the screen-locked state, and according to the input parameter; determining a projection area of the first input on the virtual screen; and determining a virtual object in the virtual screen, which is located in the projection area, as the target virtual object.
19. A head-mounted electronic device comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the unlocking method according to any one of claims 1 to 9.
20. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the unlocking method according to any one of claims 1 to 9.
CN201911424860.7A 2019-12-31 2019-12-31 Unlocking method and head-mounted electronic equipment Active CN111176547B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911424860.7A CN111176547B (en) 2019-12-31 2019-12-31 Unlocking method and head-mounted electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911424860.7A CN111176547B (en) 2019-12-31 2019-12-31 Unlocking method and head-mounted electronic equipment

Publications (2)

Publication Number Publication Date
CN111176547A CN111176547A (en) 2020-05-19
CN111176547B true CN111176547B (en) 2022-02-01

Family

ID=70650822

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911424860.7A Active CN111176547B (en) 2019-12-31 2019-12-31 Unlocking method and head-mounted electronic equipment

Country Status (1)

Country Link
CN (1) CN111176547B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111143799A (en) * 2019-12-31 2020-05-12 维沃移动通信有限公司 Unlocking method and electronic equipment
CN112860078A (en) * 2021-02-19 2021-05-28 歌尔光学科技有限公司 Head-mounted display device control method, head-mounted display device, and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110231796A1 (en) * 2010-02-16 2011-09-22 Jose Manuel Vigil Methods for navigating a touch screen device in conjunction with gestures
CN105912905A (en) * 2016-04-11 2016-08-31 广东欧珀移动通信有限公司 Fingerprint unlocking method and terminal
CN106095309A (en) * 2016-06-03 2016-11-09 广东欧珀移动通信有限公司 The method of controlling operation thereof of terminal and device
CN108304073A (en) * 2018-02-11 2018-07-20 广东欧珀移动通信有限公司 Electronic device, solution lock control method and Related product

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110231796A1 (en) * 2010-02-16 2011-09-22 Jose Manuel Vigil Methods for navigating a touch screen device in conjunction with gestures
CN105912905A (en) * 2016-04-11 2016-08-31 广东欧珀移动通信有限公司 Fingerprint unlocking method and terminal
CN106095309A (en) * 2016-06-03 2016-11-09 广东欧珀移动通信有限公司 The method of controlling operation thereof of terminal and device
CN108304073A (en) * 2018-02-11 2018-07-20 广东欧珀移动通信有限公司 Electronic device, solution lock control method and Related product

Also Published As

Publication number Publication date
CN111176547A (en) 2020-05-19

Similar Documents

Publication Publication Date Title
CN111107222B (en) Interface sharing method and electronic equipment
CN109710132B (en) Operation control method and terminal
CN109542282B (en) Interface display method and terminal equipment
CN108595946B (en) Privacy protection method and terminal
CN109002340B (en) Screen locking method and electronic equipment
CN110908557B (en) Information display method and terminal equipment
CN110851031A (en) Display control method and electronic equipment
CN109190356B (en) Screen unlocking method and terminal
CN110457935B (en) Permission configuration method and terminal equipment
CN108664818B (en) Unlocking control method and device
CN111176547B (en) Unlocking method and head-mounted electronic equipment
CN108762606B (en) Screen unlocking method and terminal equipment
CN110232266B (en) Screen unlocking method and terminal equipment
CN108932092A (en) A kind of display control method and terminal device
WO2021121178A1 (en) Application startup method and electronic device
CN111159687B (en) Account information processing method, electronic equipment and server
CN109359460B (en) Face recognition method and terminal equipment
CN109343900B (en) Permission configuration method and terminal
CN111460537A (en) Method for hiding page content and electronic equipment
CN109815678B (en) Permission configuration method and mobile terminal
WO2019206224A1 (en) Screen unlocking method and mobile terminal
CN111310250A (en) Application sharing method and electronic equipment
CN107491685B (en) Face recognition method and mobile terminal
CN110032861B (en) Password setting method and terminal equipment
CN109815667B (en) Display method and terminal equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant