CN113778230A

CN113778230A - Information interaction method, device, equipment and storage medium

Info

Publication number: CN113778230A
Application number: CN202111076819.2A
Authority: CN
Inventors: 郭富祥
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2021-09-14
Filing date: 2021-09-14
Publication date: 2021-12-10

Abstract

The embodiment of the application discloses an information interaction method, an information interaction device, information interaction equipment and a storage medium, and belongs to the technical field of communication. The method comprises the following steps: responding to a trigger operation on the first head-mounted display equipment, and starting an information interaction function; detecting a sight line state between the first head-mounted display device and the second head-mounted display device through the angle measurement component; and when the sight line state is a mutual front-view state, performing information interaction with the second head-mounted display equipment, wherein the mutual front-view state refers to a state that the first head-mounted display equipment and the second head-mounted display equipment are mutually in the front-view direction of each other. According to the method, information interaction between the two head-mounted display devices can be triggered by identifying the visual scene, and the user does not need to manually operate to establish information interaction connection, so that the man-machine interaction efficiency is improved, and the interaction experience of the user adopting the head-mounted display devices is enriched.

Description

Information interaction method, device, equipment and storage medium

Technical Field

The embodiment of the application relates to the technical field of communication, in particular to an information interaction method, an information interaction device, information interaction equipment and a storage medium.

Background

The head-mounted glasses device has an independent operating system like a smart phone, and various functions can be realized by installing various types of application programs by a user. For example, the head-mounted glasses device can implement functions of map navigation, friend interaction, taking photos and videos, and making a video call with friends.

If information interaction is carried out between two head-mounted glasses devices, firstly, communication connection between the two head-mounted glasses devices needs to be established, taking Bluetooth connection as an example, on the premise that the two head-mounted glasses devices both start the Bluetooth function, the first head-mounted glasses device receives Bluetooth setting operation, displays a Bluetooth setting interface, displays a searched Bluetooth device list on the Bluetooth device interface, then receives selection operation of a second head-mounted glasses device in the Bluetooth device list, requests the second head-mounted glasses device to establish Bluetooth connection, and establishes Bluetooth connection between the first head-mounted glasses device and the second head-mounted glasses device under the condition that the request of the second head-mounted glasses device is received to confirm information, so as to realize the information interaction function supported by the head-mounted glasses devices.

The process for establishing the communication connection between the two head-wearing glasses devices is complex in steps and low in human-computer interaction efficiency.

Disclosure of Invention

The embodiment of the application provides an information interaction method, an information interaction device, information interaction equipment and a storage medium. The technical scheme is as follows:

according to an aspect of the present application, there is provided an information interaction method applied to a first head-mounted display device, on which an angle measurement component is disposed, the method including:

responding to a trigger operation on the first head-mounted display equipment, and starting an information interaction function;

detecting, by the angle measurement component, a state of a line of sight between the first head mounted display device and a second head mounted display device;

performing information interaction with the second head-mounted display equipment under the condition that the sight line states are mutually front-looking states;

the front-view state of each other refers to a state in which the first head-mounted display device and the second head-mounted display device are in the front-view direction of each other.

According to another aspect of the present application, there is provided an information interaction apparatus, on which an angle measurement component is disposed, the apparatus including:

the starting module is used for responding to triggering operation on the first head-mounted display equipment and starting an information interaction function;

the detection module is used for detecting the sight line state between the first head-mounted display equipment and the second head-mounted display equipment through the angle measurement component;

the communication module is used for performing information interaction with the second head-mounted display equipment under the condition that the sight line states are mutually front-looking states; the front-view state of each other refers to a state in which the first head-mounted display device and the second head-mounted display device are in the front-view direction of each other.

According to another aspect of the present application, there is provided a head-mounted display device comprising an goniometric component, a processor, and a memory coupled to the processor, and program instructions stored on the memory that, when executed by the processor, implement the information interaction method as provided in the various aspects of the present application.

According to another aspect of the present application, there is provided a computer-readable storage medium having stored therein program instructions, which when executed by a processor, implement the information interaction method as provided in the various aspects of the present application.

According to another aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and executes the computer instructions to cause the computer device to perform the method provided in the various alternative implementations of the information interaction method.

According to another aspect of the present application, there is provided a chip comprising programmable logic circuits and/or program instructions for implementing the information interaction method as provided in the various aspects of the present application when the chip is run.

The beneficial effects brought by the technical scheme provided by the embodiment of the application can include:

in the above information interaction method, when the head-mounted display device has started the information interaction function, the view line state between the two head-mounted display devices is detected by the angle measurement component, and after it is determined that the two head-mounted display devices are in the front view state, information interaction can be performed through the two head-mounted display devices, that is, if the two head-mounted display devices have started the information interaction function, in the scene that the two users are looking at, an information interaction channel can be quickly established between the two head-mounted display devices worn by the two users, so that the two users can perform information interaction through the two head-mounted display devices, and the head-mounted display devices can recognize the scene through the angle measurement component, i.e., information interaction between the two head-mounted display devices can be triggered, and the user does not need to manually operate to establish a communication connection between the two head-mounted display devices, the human-computer interaction efficiency is improved, and the interaction experience of the user adopting the head-mounted display equipment is enriched.

Drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments of the present application will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic view illustrating an application scenario of a head-mounted display device according to an exemplary embodiment of the present application;

FIG. 2 illustrates a schematic diagram of an information interaction system provided by an exemplary embodiment of the present application;

FIG. 3 illustrates a schematic diagram of a head mounted display device provided by an exemplary embodiment of the present application;

FIG. 4 illustrates a flow chart of an information interaction method provided by an exemplary embodiment of the present application;

FIG. 5 illustrates a flow chart of an information interaction method provided by another exemplary embodiment of the present application;

FIG. 6 illustrates a schematic view of the included directional angles provided by an exemplary embodiment of the present application;

FIG. 7 illustrates a schematic view of the included angle of direction provided by another exemplary embodiment of the present application;

FIG. 8 is a schematic view of the included angle of direction provided by another exemplary embodiment of the present application;

FIG. 9 is a block diagram illustrating an information interaction device provided by an exemplary embodiment of the present application;

FIG. 10 shows a block diagram of an information interaction device provided by another example embodiment of the present application;

fig. 11 shows a schematic structural diagram of a head-mounted display device according to an exemplary embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

In the description of the present application, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In the description of the present application, it is to be noted that, unless otherwise explicitly specified or limited, the terms "connected" and "connected" are to be interpreted broadly, e.g., as being fixed or detachable or integrally connected; can be mechanically or electrically connected; may be directly connected or indirectly connected through an intermediate. The specific meaning of the above terms in the present application can be understood in a specific case by those of ordinary skill in the art. Further, in the description of the present application, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

The head-mounted display equipment has an information interaction function; if the users use the head-mounted display devices to perform information interaction, the two head-mounted display devices need to be controlled to perform Communication connection, for example, Bluetooth (Bluetooth) connection or Near Field Communication (NFC) connection.

Taking bluetooth connection as an example, the first head-mounted display device responds to expansion operation triggered by a user and displays a bluetooth setting interface, and the bluetooth setting interface comprises a bluetooth opening control; responding to the starting operation on the Bluetooth starting control, searching Bluetooth equipment, and displaying a searched Bluetooth equipment list on a Bluetooth setting interface; in response to a selection operation on a second head mounted display device in the Bluetooth device list, sending a Bluetooth connection request to the second head mounted display device; establishing a Bluetooth connection with the second head-mounted display device in response to the received confirmation signal sent by the second head-mounted display device; the confirmation signal is a signal generated by the second head-mounted display device based on the confirmation operation after receiving the bluetooth connection request, displaying a confirmation interface according to the bluetooth connection request, and responding to the confirmation operation triggered by another user on the confirmation interface.

Obviously, the communication connection between the first head-mounted display device and the second head-mounted display device requires more steps, and the user is required to participate in multiple steps. In order to simplify the communication connection step between two head-mounted display devices, the embodiment of the application provides an information interaction method, and in the method, under the condition that the two head-mounted display devices start an information interaction function, the two head-mounted display devices automatically detect the sight line states of the two head-mounted display devices; and then, under the condition that the two are in the front-view state of each other, establishing an information interaction channel between the two, namely establishing communication connection between the two.

Illustratively, as shown in fig. 1, this is an application scenario 100 of a plurality of head mounted display devices, wherein the plurality of head mounted display devices includes a first head mounted display device 101, a second head mounted display device 102, and a third head mounted display device 103, wherein each head mounted display device broadcasts a data packet through an angle measurement component, and also listens to data packets broadcast by other head mounted display devices through the angle measurement component to determine a state of line of sight with other head mounted display devices; illustratively, the first head mounted display device 101 monitors a second data packet broadcast by the second head mounted display device 102 through the angle measurement component, and determines that the second head mounted display device 102 is located in the front-view direction of itself based on the second data packet; similarly, the second head mounted display device 102 monitors a first data packet broadcast by the first head mounted display device 101 through the angle measurement component, and determines that the first head mounted display device 101 is located in the front view direction of the second head mounted display device based on the first data packet; it may be determined that the first head mounted display apparatus 101 and the second head mounted display apparatus 102 are in a mutual front-view state, and an information interaction channel is established between the two apparatuses.

The communication connection is established without user participation, and an information interaction channel can be established between the two head-mounted display devices by automatically identifying the visual scene between the two users, so that the man-machine interaction efficiency is improved, the experience of interaction of the users by adopting the head-mounted display devices is enriched, and the scene of eye-to-eye communication between the two users in reality is simulated more truly. For details of the above information interaction method provided in the present application, please refer to the following embodiments.

Fig. 2 shows a schematic structural diagram of an information interaction system provided in an exemplary embodiment of the present application. The information interaction system includes a first head mounted display device 210 and a second head mounted display device 220.

The first head mounted display device 210 includes an goniometric component 211, a processor 212, and a memory 213. The memory 213 stores at least one instruction, which is loaded and executed by the processor 212 to control the angle measurement component 211 to determine a state of a line of sight with the second head-mounted display device 220, and perform information interaction with the second head-mounted display device 220 when it is determined that the second head-mounted display device 220 is in a front view state. Illustratively, the goniometric component 211 is equipped with communication functionality; the first head mounted display device 210 performs information interaction with the second head mounted display device 220 through the angle measurement component 211.

The second head mounted display device 220 includes an goniometric component 221, a processor 222, and a memory 223. The memory 223 stores at least one instruction, which is loaded and executed by the processor 222 to control the angle measurement component 221 to determine a state of a line of sight with the first head-mounted display device 210, and perform information interaction with the first head-mounted display device 210 when it is determined that the first head-mounted display device 210 and the angle measurement component are in a front view state. Illustratively, the goniometric component 221 is equipped with communication functionality; the second head mounted display device 220 performs information interaction with the first head mounted display device 210 through the angle measurement component 221.

Illustratively, the goniometric assembly may include at least one of: an angle measuring component adopting Ultra Wide Band (UWB) technology; an angle measurement component adopting a Wireless Fidelity (WiFi) communication technology; adopt Bluetooth Low Energy (BLE) technical angle measurement subassembly. The angle measurement assembly is arranged in the front area of the head-mounted display equipment; for example, taking the head-mounted display device as smart glasses, as shown in fig. 3, the angle measurement component 301 is disposed in a middle area 302 in front of the smart glasses. The angle measurement assembly is composed of an angle measurement antenna array, the angle measurement antenna array is used for broadcasting and receiving data packets, the angle measurement assembly further comprises a communication module, and illustratively, the UWB angle measurement antenna array on the angle measurement assembly is connected with the UWB communication module.

A processor may include one or more processing cores. The processor connects various parts throughout the head mounted display device using various interfaces and lines, performs various functions of the head mounted display device and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory, and calling data stored in the memory. Optionally, the processor may be implemented in at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor may integrate one or a combination of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU) and a modem. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the display screen; the modem is used to handle wireless communications. It is to be understood that the modem may be implemented by a single chip without being integrated into the processor.

The Memory may include a Random Access Memory (RAM) or a Read-Only Memory (ROM). Optionally, the memory includes a non-transitory computer-readable medium. The memory may be used to store an instruction, a program, code, a set of codes, or a set of instructions. The memory may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image processing function, an information interaction function, etc.), instructions for implementing various method embodiments described below, and the like; the storage data area may store data and the like referred to in the following respective method embodiments.

Fig. 4 shows a flowchart of an information interaction method provided in an exemplary embodiment of the present application. The information interaction method may be applied to the first head mounted display device shown in fig. 2. In fig. 4, the information interaction method includes:

step 410: and responding to a trigger operation on the first head-mounted display equipment, and starting an information interaction function.

Optionally, the trigger operation includes at least one of a gesture operation, a blinking operation, and a key operation.

Illustratively, a key is arranged on the first head-mounted display device, and the key is used for starting an information interaction function of the first head-mounted display device when being triggered; the first head-mounted display device receives the triggering operation on the key and starts the information interaction function. The keys include at least one of physical keys and virtual keys.

Illustratively, the first head-mounted display device is provided with a designated gesture for starting the information interaction function; the first head-mounted display device receives gesture operation of the appointed gesture and starts an information interaction function.

Illustratively, the first head mounted display device is provided with a specified number of times; the first head-mounted display device receives the specified times of continuous blinking operations and starts an information interaction function.

Step 420: the sight line state between the first head-mounted display device and the second head-mounted display device is detected through the angle measurement component.

The first head-mounted display equipment is provided with an angle measurement assembly; the first head-mounted display device monitors data packets broadcast by other head-mounted display devices through the angle measurement assembly, the azimuth angle of the other head-mounted display devices relative to the first head-mounted display device is calculated based on the data packets of the other head-mounted display devices, and the sight line direction of the first head-mounted display device where the other head-mounted display devices are located is determined through the azimuth angle.

For the first head mounted display device, the other head mounted display devices include a second head mounted display device; if the second head-mounted display device is positioned in the front-view direction of the first head-mounted display device and the first head-mounted display device receives a second confirmation signal sent by the second head-mounted display device, the first head-mounted display device determines that the first head-mounted display device and the second head-mounted display device are in a mutual front-view state; the second confirmation signal is used for indicating that the first head-mounted display device is positioned in the front-view direction of the second head-mounted display device.

For example, in this embodiment, the execution sequence between the step of the first head-mounted display device determining that the second head-mounted display device is located in the front viewing direction of the first head-mounted display device and the step of receiving the second confirmation signal sent by the second head-mounted display device is not limited.

Optionally, the goniometric assembly includes at least one of:

an angle measurement component adopting UWB technology;

an angle measuring component adopting a WiFi communication technology;

an angle measurement assembly employing BLE technology.

For example, the first head mounted display device detects the sight line state between the first head mounted display device and the second head mounted display device through UWB technology, WiFi communication technology, or BLE technology.

Step 430: and carrying out information interaction with the second head-mounted display equipment under the condition that the sight line state is the front view state of each other.

The front-view state of each other means that the first head-mounted display device and the second head-mounted display device are in the front-view direction of each other; that is, the first head mounted display device is positioned in the front view direction of the second head mounted display device, and the second head mounted display device is positioned in the front view direction of the first head mounted display device.

For example, the first head-mounted display device determines that the sight line state is a mutual front-view state, and then establishes an information interaction connection with the second head-mounted display device. Optionally, the information interaction connection may be at least one of a bluetooth connection, a WiFi connection, a mobile communication connection, and an NFC connection. For example, a first head-mounted display device performs picture transmission with a second head-mounted display device through bluetooth connection; for another example, the second head mounted display device performs voice transmission with the second head mounted display device through the NFC connection.

Optionally, the information interaction includes: at least one of encrypted conversation, encrypted information transmission and picture sharing. For example, the first head mounted display device establishes an encrypted call with the second head mounted display device. For another example, the first head-mounted display device sends the encrypted information to the second head-mounted display device, or the first head-mounted display device receives the encrypted information sent by the second head-mounted display device. For another example, the first head mounted display device shares a first picture in the line of sight with the second head mounted display device, or the first head mounted display device receives a second picture shared by the second head mounted display device, where the second picture is a picture in the line of sight of the second head mounted display device.

To sum up, in the information interaction method provided in this embodiment, when the head-mounted display device has the information interaction function turned on, the view line state between the two head-mounted display devices is detected through the angle measurement component, and after it is determined that the two head-mounted display devices are in the front view state, information interaction may be performed through the two head-mounted display devices, that is, if the information interaction function is turned on by the two head-mounted display devices, in a scene that two users are looking at, an information interaction channel may be quickly established between the two head-mounted display devices worn by the two users, so that the two users may perform information interaction through the two head-mounted display devices, and the head-mounted display device realizes recognition of the scene that the two users are looking at through the angle measurement component, that information interaction between the two head-mounted display devices may be triggered, without manual operation of the users to establish a communication connection between the two head-mounted display devices, the human-computer interaction efficiency is improved, and the interaction experience of the user adopting the head-mounted display equipment is enriched.

Fig. 5 is a flowchart illustrating an information interaction method according to an exemplary embodiment of the present application. The information interaction method can be applied to the information interaction system shown in fig. 2. In fig. 5, the information interaction method includes:

step 511: the first head-mounted display device responds to the trigger operation on the first head-mounted display device and starts the information interaction function.

The first head-mounted display equipment is provided with an angle measurement assembly; under the condition that the first head-mounted display device starts the information interaction function, the first head-mounted display device broadcasts a first data packet, and the first data packet carries a first device address of the first head-mounted display device.

Step 521: the second head-mounted display device responds to the trigger operation on the second head-mounted display device and starts the information interaction function.

Optionally, the trigger operation includes at least one of a gesture operation, a blinking operation, and a key press operation.

Illustratively, a key is arranged on the second head-mounted display device, and the key is used for starting an information interaction function of the second head-mounted display device when being triggered; and the second head-mounted display equipment receives the triggering operation on the key and starts the information interaction function. The keys include at least one of physical keys and virtual keys.

Illustratively, the second head mounted display device is provided with a designated gesture for starting the information interaction function; and the second head-mounted display equipment receives the gesture operation of the appointed gesture and starts the information interaction function.

Illustratively, the second head mounted display device is provided with a specified number of times; and the second head-mounted display equipment receives the continuous blinking operation for the specified times and starts the information interaction function. For example, the second head-mounted display device detects that the user blinks three times in succession, and starts the information interaction function.

The second head-mounted display equipment is provided with an angle measurement assembly; and under the condition that the information interaction function of the second head-mounted display equipment is started, the second head-mounted display equipment broadcasts a second data packet, and the second data packet carries a second equipment address of the second head-mounted display equipment.

Step 512: the first head-mounted display device detects that the second head-mounted display device is positioned in the first front-view direction of the first head-mounted display device through the angle measurement component.

The first head-mounted display device monitors data packets broadcast by other head-mounted display devices through the angle measurement component, monitors a second data packet broadcast by a second head-mounted display device through the angle measurement component, determines a second azimuth angle based on the second data packet, and determines that the second head-mounted display device is positioned in the first front-view direction based on the second azimuth angle. The second azimuth angle is an azimuth angle of the second head-mounted display device relative to the first head-mounted display device, that is, the second azimuth angle is an azimuth angle of the second head-mounted display device measured at a position where the first head-mounted display device is located.

Illustratively, the first head mounted display device determines the second orientation angle based on the second data packet using UWB technology, or WiFi communication technology, or BLE technology.

Illustratively, at least two positioning devices are deployed in the space, and the second data packet carries a second angular position of the second head mounted display device, where the second angular position is an angular position of the second head mounted display device in the positioning space constructed by the at least two positioning devices;

the method comprises the steps that a first head-mounted display device obtains a first angle position of the first head-mounted display device, wherein the first angle position is the angle position of the first head-mounted display device in a positioning space formed by at least two positioning devices; a second azimuth angle is determined by the first angular position, the second angular position, and the first elevation direction. The positioning space may be an indoor space. Illustratively, the first head mounted display device determines the first angular position using UWB technology, or WiFi communication technology, or BLE technology.

Illustratively, the second head mounted display device is located within a specified angular range of the first head mounted display device, i.e., is deemed to be located in the front viewing direction of the first head mounted display device. Optionally, the first head mounted display device acquires a first azimuth corresponding to the first elevation direction; determining a first direction included angle between the first front-view direction and the direction of the second head-mounted display equipment based on the first azimuth angle and the second azimuth angle; in a case where the first direction angle is less than the angle threshold, it is determined that the second head mounted display device is located in the first elevation direction.

Illustratively, the included angle threshold is 15 degrees; as shown in fig. 6, an included angle between the front-view direction of the first head-mounted display device and the direction in which the second head-mounted display device is located is 0 degree, and if it is determined that 0 degree is smaller than 15 degrees, the first head-mounted display device determines that the second head-mounted display device is located in the first front-view direction. As shown in fig. 7, an included angle B between the front view direction of the first head mounted display device and the direction in which the second head mounted display device is located is 5 degrees, and if it is determined that 5 degrees is smaller than 15 degrees, the first head mounted display device determines that the second head mounted display device is located in the front view direction of the first head mounted display device.

For example, regarding the calculation of the first direction included angle, as shown in fig. 8, if the first head-mounted display device determines that the first direction angle of the first head-mounted display device is north-west C degrees through the angle measurement component, and the first head-mounted display device determines that the second azimuth angle of the second head-mounted display device is north-west D degrees through the angle measurement component, the first direction included angle B is calculated to be (D-C) degrees. Illustratively, the angle of orientation is taken as an absolute value.

When calculating a second azimuth angle of the second head-mounted display device based on the second data packet, the signal quality of the second data packet directly affects the accuracy of the calculation; accordingly, the first head mounted display device determines a second pending azimuth based on the second data packet; acquiring a second signal quality parameter of a second data packet; calculating a second confidence of the second undetermined azimuth angle based on the second signal quality parameter; and determining the second undetermined azimuth as the second azimuth under the condition that the second confidence coefficient is greater than or equal to the confidence coefficient threshold value.

Or after the first head-mounted display device monitors the second data packet, acquiring a second signal quality parameter of the second data packet; calculating a second confidence level for the second data packet based on the second signal quality parameter; when the second confidence is greater than or equal to the confidence threshold, the second azimuth is determined based on the second data packet, so that the data packet which cannot be calculated to obtain the accurate second azimuth is excluded, the accuracy of calculation of the second azimuth is improved, and meanwhile, compared with a mode that the inaccurate second azimuth is excluded after the second azimuth is calculated, the calculation efficiency is higher.

In the case that the second confidence is less than the confidence threshold, the first head mounted display device listens again to the broadcasted second data packet to calculate the second azimuth again.

Illustratively, the second signal quality parameter may include at least one of signal received power, signal-to-noise ratio, and signal strength.

Step 513: the first head mounted display device sends a first confirmation signal to the second head mounted display device.

The first confirmation signal is used to indicate that the second head mounted display device is located in the front viewing direction of the first head mounted display device, that is, the first confirmation signal is used to notify the second head mounted display device that the first head mounted display device has confirmed that the second head mounted display device is located in the first front viewing direction.

Illustratively, the first head mounted display device sends a first acknowledgement signal to the second head mounted display device based on the second device address.

Step 522: the second head-mounted display device detects that the first head-mounted display device is positioned in the second front-view direction of the second head-mounted display device through the angle measurement component.

The second head-mounted display device monitors data packets broadcast by other head-mounted display devices through the angle measurement component, monitors the first data packet broadcast by the first head-mounted display device through the angle measurement component, determines a fourth azimuth angle based on the first data packet, and determines that the first head-mounted display device is located in a second front-view direction based on the fourth azimuth angle. The fourth azimuth angle is an azimuth angle of the first head-mounted display device relative to the second head-mounted display device, that is, the fourth azimuth angle is an azimuth angle of the first head-mounted display device measured at a position where the second head-mounted display device is located.

Illustratively, the second head mounted display device determines the fourth azimuth angle based on the first data packet using UWB technology, or WiFi communication technology, or BLE technology.

Illustratively, the first head mounted display device is located within a specified angular range of the second head mounted display device, i.e., is deemed to be located in the front viewing direction of the second head mounted display device. Optionally, the second head mounted display device acquires a third azimuth corresponding to the second front view direction; determining a second direction included angle between the second front-view direction and the direction of the first head-mounted display equipment based on the third azimuth angle and the fourth azimuth angle; and under the condition that the included angle of the second direction is smaller than the included angle threshold value, determining that the first head-mounted display equipment is positioned in the second front-view direction.

When the fourth azimuth angle of the first head-mounted display device is calculated based on the first data packet, the signal quality of the first data packet directly influences the accuracy of the calculation; accordingly, the second head mounted display device determines a fourth pending azimuth based on the first data packet; acquiring a first signal quality parameter of a first data packet; calculating a first confidence of the fourth to-be-determined azimuth angle based on the first signal quality parameter; and determining the fourth to-be-determined azimuth as a fourth azimuth in the case that the first confidence is greater than or equal to the confidence threshold.

Or after the second head-mounted display device monitors the first data packet, acquiring a first signal quality parameter of the first data packet; calculating a first confidence level for the first data packet based on the first signal quality parameter; when the first confidence is larger than or equal to the confidence threshold, the fourth azimuth is determined based on the first data packet, so that the data packet which cannot be calculated to obtain the accurate fourth azimuth is excluded, the accuracy of calculation of the fourth azimuth is improved, and meanwhile, compared with a mode that the inaccurate fourth azimuth is excluded after the fourth azimuth is calculated, the calculation efficiency is higher.

In the event that the first confidence is less than the confidence threshold, the second head mounted display device re-listens to the broadcasted first data packet to again calculate the fourth azimuth.

Illustratively, the first signal quality parameter may include at least one of signal received power, signal-to-noise ratio, and signal strength.

Optionally, the goniometric assembly includes at least one of:

an angle measurement component adopting UWB technology;

an angle measuring component adopting a WiFi communication technology;

an angle measurement assembly employing BLE technology.

Illustratively, the second head mounted display device detects the first head mounted display device in a front view direction of the second head mounted display device through UWB technology, or WiFi communication technology, or BLE technology.

Step 523: the second head mounted display device sends a second confirmation signal to the first head mounted display device.

The second confirmation signal is used to indicate that the first head mounted display device is located in the front viewing direction of the second head mounted display device, that is, the second confirmation signal is used to notify the first head mounted display device that the second head mounted display device has confirmed that the first head mounted display device is located in the second front viewing direction.

Illustratively, the second head mounted display device sends a second acknowledgement signal to the first head mounted display device based on the first device address.

Step 514: and the first head-mounted display equipment determines the sight line state as a mutual front-view state in response to a second confirmation signal sent by the second head-mounted display equipment.

And the first head-mounted display device determines that the sight line state is a mutual front-view state under the condition that the second head-mounted display device is positioned in the first front-view direction and the second confirmation signal is received.

Step 515: and the first head-mounted display equipment performs information interaction with the second head-mounted display equipment when the sight line state is the mutual front view state.

And the first head-mounted display equipment performs information interaction with the second head-mounted display equipment under the condition that the first head-mounted display equipment and the second head-mounted display equipment are determined to be in front view.

Illustratively, the first head-mounted display device establishes a bluetooth connection, or an NFC connection, or a WiFi direct connection with the second head-mounted display device to perform information interaction with the second head-mounted display device, under the condition that it is determined that the first head-mounted display device and the second head-mounted display device are in front view.

Illustratively, a first user account is logged in a system running on a first head-mounted display device; a second user account is logged in the second head-mounted display device, and the second confirmation signal carries the second user account;

the method comprises the steps that a first head-mounted display device obtains a first friend list of a first user account under the condition that the sight line state is a front view state; and carrying out information interaction with a second head-mounted display device under the condition that a second user account exists in the first friend list.

Illustratively, a first device list is stored on the first head-mounted display device, the first device list includes at least one device name, and at least one device corresponding to the at least one device name is a device trusted by the first head-mounted display device; the second confirmation signal carries a second device name of the second head-mounted display device; the method comprises the steps that a first head-mounted display device obtains a first device list under the condition that the sight line state is the front view state, and performs information interaction with a second head-mounted display device under the condition that a second device name exists in the first device list;

displaying a confirmation interface under the condition that the second equipment name does not exist in the first equipment list, wherein the confirmation interface comprises a confirmation control and a rejection control; the first head-mounted display equipment performs information interaction with the second head-mounted display equipment under the condition that the triggering operation on the confirmation control is received and a fourth confirmation signal of the second head-mounted display equipment is received, wherein the fourth confirmation signal is used for indicating that the second head-mounted display equipment determines to perform information interaction with the first head-mounted display equipment; or, when the trigger operation on the rejection control is received, the information interaction with the second head-mounted display device is abandoned. The two information interaction modes can ensure that the users who carry out information interaction know each other, and further satisfy the scene that the users want to communicate with the familiar people.

In some embodiments, if the first head-mounted display device and the second head-mounted display device have established a communication connection, the first head-mounted display device triggers a designated function with the second head-mounted display device when the line of sight state is a mutual front view state. For example, the communication connection includes at least one of a bluetooth connection, an NFC connection, and a WiFi direct connection. For example, the above-mentioned designated function includes at least one of functions of encrypting a call, transferring encrypted information, and sharing a screen. Wherein the encrypted information may include at least one of encrypted voice, encrypted image, encrypted video, encrypted message, encrypted document, and encrypted text.

It should be noted that, when the first time length between the first time and the second time is less than the time length threshold, the first head-mounted display device determines that a mutual front-view state is stored between the first head-mounted display device and the second head-mounted display device; the first time is the time when the second head-mounted display device is positioned in the first front-view direction, and the second time is the time when the second confirmation signal is received.

Step 524: the second head-mounted display device determines the sight line state as a mutual front-view state in response to the first confirmation signal sent by the first head-mounted display device.

And the second head-mounted display equipment determines that the sight line state is a mutual front-view state under the condition that the first head-mounted display equipment is positioned in the second front-view direction and the first confirmation signal is received.

Step 525: and the second head-mounted display equipment performs information interaction with the first head-mounted display equipment when the sight line state is a mutual front-view state.

And the second head-mounted display equipment performs information interaction with the first head-mounted display equipment under the condition that the second head-mounted display equipment determines that the second head-mounted display equipment and the first head-mounted display equipment are in front view.

Illustratively, the second head-mounted display device establishes a bluetooth connection, or an NFC connection, or a WiFi direct connection with the first head-mounted display device to perform information interaction with the first head-mounted display device, under the condition that it is determined that the second head-mounted display device and the first head-mounted display device are in front view.

Illustratively, the first confirmation signal carries the first user account; the second head-mounted display equipment acquires a second friend list of a second user account under the condition that the sight line state is the front sight state; and carrying out information interaction with the first head-mounted display equipment under the condition that the first user account exists in the second friend list.

Illustratively, the second head mounted display device stores a second device list, the second device list includes at least one device name, and at least one device corresponding to the at least one device name is a device trusted by the second head mounted display device; the first confirmation signal carries a first device name of the first head-mounted display device; the second head-mounted display equipment acquires a second equipment list under the condition that the sight line state is the front view state, and performs information interaction with the first head-mounted display equipment under the condition that the first equipment name exists in the second equipment list;

under the condition that the first equipment name does not exist in the second equipment list, displaying a confirmation interface, wherein the confirmation interface comprises a confirmation control and a rejection control; the second head-mounted display equipment performs information interaction with the first head-mounted display equipment under the condition that the triggering operation on the confirmation control is received and a third confirmation signal of the first head-mounted display equipment is received, wherein the third confirmation signal is used for indicating that the first head-mounted display equipment determines to perform information interaction with the second head-mounted display equipment; or, when receiving the trigger operation on the rejection control, abandoning the information interaction with the first head-mounted display device. The two information interaction modes can ensure that the users who carry out information interaction know each other, and further satisfy the scene that the users want to communicate with the familiar people.

In some embodiments, if the first head-mounted display device and the second head-mounted display device have established a communication connection, the second head-mounted display device triggers a designated function with the first head-mounted display device when the line of sight state is a mutual front view state. For example, the communication connection includes at least one of a bluetooth connection, an NFC connection, and a WiFi direct connection. For example, the above-mentioned designated function includes at least one of functions of encrypting a call, transferring encrypted information, and sharing a screen. Wherein the encrypted information may include at least one of encrypted voice, encrypted image, encrypted video, encrypted message, encrypted document, and encrypted text.

It should be noted that, when the second duration between the third time and the fourth time is less than the duration threshold, it is determined that the first head-mounted display device and the second head-mounted display device store a mutual front-view state; the third moment is the moment when the first head-mounted display device is located in the second front-view direction, and the fourth moment is the moment when the first confirmation signal is received.

In summary, according to the information interaction method provided in this embodiment, when the angle measurement component detects that the first head-mounted display device and the second head-mounted display device are in a front-view state, the user can perform information interaction through the two head-mounted display devices without performing other manual operations, so that steps of user participation are reduced, human-computer interaction efficiency is improved, and interaction experience of the user using the head-mounted display devices is enriched.

For example, the first head-mounted display device may identify at least two second head-mounted display devices at the same time, and the first direction included angle corresponding to each second head-mounted display device is smaller than the included angle threshold, that is, meets the filtering condition that the second head-mounted display device is located in the front area of the first head-mounted display device, so that one second head-mounted display device in the first front view direction is determined from the at least two second head-mounted display devices, and one of the following manners may be used:

1) the first head-mounted display equipment calculates to obtain at least two first direction included angles corresponding to at least two second head-mounted display equipment; determining a minimum first direction included angle from at least two first direction included angles; and determining that the second head-mounted display device corresponding to the minimum first direction included angle is positioned in the first front-view direction under the condition that the minimum first direction included angle is smaller than the included angle threshold value.

2) The first head-mounted display device determines at least two second head-mounted display devices, a first direction included angle corresponding to each second head-mounted display device is smaller than an included angle threshold value, and the at least two second head-mounted display devices correspond to the at least two first direction included angles; determining a minimum first direction included angle from the at least two first direction included angles; and determining that the second head-mounted display equipment corresponding to the minimum first direction included angle is positioned in the first front-view direction.

3) The method comprises the steps that under the condition that a first direction included angle corresponding to each second head-mounted display device is smaller than an included angle threshold value, the first head-mounted display device obtains signal strength of a second data packet of the second head-mounted display devices to obtain at least two second signal strengths corresponding to at least two second head-mounted display devices; it is determined that a second head mounted display device corresponding to a maximum signal strength of the at least two second signal strengths is located in the first elevation direction.

4) The first head-mounted display device determines at least two second head-mounted display devices, a first direction included angle corresponding to each second head-mounted display device is smaller than an included angle threshold value, and the at least two second head-mounted display devices correspond to the at least two first direction included angles; determining at least two minimum first direction included angles from the at least two first direction included angles; determining at least two second head-mounted display devices corresponding to the smallest first direction included angle as at least two second candidate head-mounted display devices, and obtaining signal strengths of second data packets of the at least two second candidate head-mounted display devices to obtain at least two second signal strengths; and determining a second candidate head-mounted display device corresponding to the maximum signal strength in the at least two second signal strengths to obtain a second head-mounted display device in the first front view direction.

Similarly, the second head-mounted display device may simultaneously recognize at least two first head-mounted display devices, and the second direction included angle corresponding to each first head-mounted display device is smaller than the included angle threshold, that is, meets the filtering condition that the first head-mounted display device is located in the front area of the second head-mounted display device, so that one first head-mounted display device located in the second front view direction is determined from the at least two first head-mounted display devices, and one of the following manners may be adopted:

1) the second head-mounted display equipment calculates to obtain at least two second direction included angles corresponding to the at least two first head-mounted display equipment; determining a minimum second direction included angle from at least two second direction included angles; and under the condition that the minimum second direction included angle is smaller than an included angle threshold value, determining that the first head-mounted display equipment corresponding to the minimum second direction included angle is positioned in the second front-view direction.

2) The second head-mounted display device determines at least two first head-mounted display devices, a second direction included angle corresponding to each first head-mounted display device is smaller than an included angle threshold value, and the at least two first head-mounted display devices correspond to the at least two second direction included angles; determining a minimum second direction included angle from the at least two second direction included angles; and determining that the first head-mounted display equipment corresponding to the minimum second direction included angle is positioned in the second front viewing direction.

3) The method comprises the steps that under the condition that a second direction included angle corresponding to each first head-mounted display device is smaller than an included angle threshold value, the second head-mounted display device obtains signal strength of first data packets of the first head-mounted display devices to obtain at least two first signal strengths corresponding to at least two first head-mounted display devices; and determining that the first head-mounted display equipment corresponding to the maximum signal strength in the at least two first signal strengths is positioned in the second front-view direction.

4) The second head-mounted display device determines at least two first head-mounted display devices, a second direction included angle corresponding to each first head-mounted display device is smaller than an included angle threshold value, and the at least two first head-mounted display devices correspond to the at least two second direction included angles; determining at least two minimum second direction included angles from the at least two second direction included angles; determining at least two first head-mounted display devices corresponding to the smallest second direction included angle as at least two first candidate head-mounted display devices, and obtaining signal strengths of first data packets of the at least two first candidate head-mounted display devices to obtain at least two first signal strengths; and determining a first candidate head-mounted display device corresponding to the maximum signal strength in the at least two first signal strengths to obtain a first head-mounted display device in the second front-view direction.

In summary, the method for determining the head-mounted display device in the front view direction provided in this embodiment can accurately determine whether the first head-mounted display device and the second head-mounted display device are in a mutual front view state, so as to improve the accuracy of recognizing the viewing scene.

The following are embodiments of the apparatus of the present application that may be used to perform embodiments of the method of the present application. For details which are not disclosed in the embodiments of the apparatus of the present application, reference is made to the embodiments of the method of the present application.

Fig. 9 shows a block diagram of an information interaction apparatus according to an exemplary embodiment of the present application. The device is provided with an angle measuring component. The information interaction device can be realized by software, hardware or a combination of the two to be all or part of the first head-mounted display equipment. The device includes:

a first starting module 901, configured to start an information interaction function in response to a trigger operation on a first head-mounted display device;

a first detecting module 902, configured to detect, through an angle measuring component, a sight line state between a first head-mounted display device and a second head-mounted display device;

the first communication module 903 is configured to perform information interaction with the second head-mounted display device when the gaze state is a mutual front view state; the front-view state of each other refers to a state that the first head-mounted display device and the second head-mounted display device are in the front-view direction of each other.

In some embodiments, the first detection module 902 is configured to:

detecting that the second head-mounted display device is positioned in a first front-view direction of the first head-mounted display device through the angle measurement component;

responding to a second confirmation signal sent by the second head-mounted display equipment, and determining that the sight line state is a mutual front-view state;

the second confirmation signal is used for indicating that the first head-mounted display device is positioned in the front-view direction of the second head-mounted display device.

In some embodiments, the first detection module 902 is configured to:

monitoring, by the goniometer component, a second data packet broadcast by a second head mounted display device;

determining a second orientation angle based on the second data packet, the second orientation angle being an orientation angle of the second head mounted display device relative to the first head mounted display device;

determining that the second head mounted display device is positioned in the first elevation direction based on the second azimuth angle.

In some embodiments, the first detection module 902 is configured to:

acquiring a first azimuth corresponding to the first front view direction;

determining a first direction included angle between the first front-view direction and the direction of the second head-mounted display equipment based on the first azimuth angle and the second azimuth angle;

in a case where the first direction angle is less than the angle threshold, it is determined that the second head mounted display device is located in the first elevation direction.

In some embodiments, the second head mounted display device comprises at least two; a first detecting module 902 configured to:

determining a minimum first direction included angle from at least two first direction included angles corresponding to at least two second head-mounted display devices;

and determining that the second head-mounted display device corresponding to the minimum first direction included angle is positioned in the first front-view direction under the condition that the minimum first direction included angle is smaller than the included angle threshold value.

under the condition that the included angle of the first direction corresponding to each second head-mounted display device is smaller than the included angle threshold value, acquiring the signal intensity of a second data packet of the second head-mounted display device to obtain at least two second signal intensities corresponding to at least two second head-mounted display devices;

it is determined that a second head mounted display device corresponding to a maximum signal strength of the at least two second signal strengths is located in the first elevation direction.

In some embodiments, the first detection module 902 is configured to:

determining a second pending azimuth based on the second data packet;

acquiring a second signal quality parameter of a second data packet;

calculating a second confidence of the second undetermined azimuth angle based on the second signal quality parameter;

and determining the second undetermined azimuth as the second azimuth under the condition that the second confidence coefficient is greater than the confidence coefficient threshold value.

In some embodiments, a first user account is logged into a system running on a first head mounted display device; a second user account is logged in a system running on the second head-mounted display device, and the second confirmation signal carries the second user account; a first communication module 903 configured to:

under the condition that the sight line states are mutually front-looking states, acquiring a first friend list of a first user account;

and carrying out information interaction with a second head-mounted display device under the condition that a second user account exists in the first friend list.

In some embodiments, the goniometric assembly includes at least one of:

an angle measuring component adopting an ultra-wideband technology;

an angle measuring component adopting a wireless network communication technology;

adopt angle measurement subassembly of bluetooth low energy technique.

In some embodiments, the information interaction comprises: at least one of encrypted conversation, encrypted information transmission and picture sharing.

In some embodiments, the triggering operation includes at least one of a gesture operation, a blink operation, and a key operation.

Fig. 10 shows a block diagram of an information interaction apparatus according to an exemplary embodiment of the present application. The device is provided with an angle measuring component. The information interaction device can be realized by software, hardware or a combination of the two to be all or part of the second head-mounted display equipment. The device includes:

a second starting module 1001, configured to start an information interaction function in response to a trigger operation on a second head-mounted display device;

the second detection module 1002 is configured to detect a sight line state between the first head-mounted display device and the second head-mounted display device through the angle measurement component;

the second communication module 1003 is configured to perform information interaction with the first head-mounted display device when the gaze state is a mutual front-view state; the front-view state of each other refers to a state that the first head-mounted display device and the second head-mounted display device are in the front-view direction of each other.

In some embodiments, the second detection module 1002 is configured to:

detecting that the first head-mounted display device is positioned in a second front-view direction of the second head-mounted display device through the angle measurement component;

in response to a first confirmation signal sent by the first head-mounted display device, determining that the sight line states are mutual front-view states;

the first confirmation signal is used for indicating that the second head-mounted display device is positioned in the front-view direction of the first head-mounted display device.

In some embodiments, the second detection module 1002 is configured to:

monitoring a first data packet broadcast by a first head-mounted display device through a corner measuring component;

determining a fourth azimuth angle based on the first data packet, the fourth azimuth angle being an azimuth angle of the first head mounted display device relative to the second head mounted display device;

determining that the first head mounted display device is located in the second elevation direction based on the fourth azimuth angle.

In some embodiments, the second detection module 1002 is configured to:

acquiring a third azimuth angle corresponding to the second front view direction;

determining a second direction included angle between the second front-view direction and the direction of the first head-mounted display equipment based on the third azimuth angle and the fourth azimuth angle;

and under the condition that the included angle of the second direction is smaller than the included angle threshold value, determining that the first head-mounted display equipment is positioned in the second front-view direction.

In some embodiments, the first head mounted display device includes at least two; a second detection module 1002 for:

determining a minimum second direction included angle from at least two second direction included angles corresponding to at least two first head-mounted display devices;

and under the condition that the minimum second direction included angle is smaller than an included angle threshold value, determining that the first head-mounted display equipment corresponding to the minimum second direction included angle is positioned in the second front-view direction.

under the condition that a second direction included angle corresponding to each first head-mounted display device is smaller than an included angle threshold value, acquiring the signal strength of a first data packet of the first head-mounted display device to obtain at least two first signal strengths corresponding to at least two first head-mounted display devices;

and determining that the first head-mounted display equipment corresponding to the maximum signal strength in the at least two first signal strengths is positioned in the second front-view direction.

In some embodiments, the second detection module 1002 is configured to:

determining a fourth pending azimuth based on the first data packet;

acquiring a first signal quality parameter of a first data packet;

calculating a first confidence of the fourth to-be-determined azimuth angle based on the first signal quality parameter;

and determining the fourth to-be-determined azimuth as a fourth azimuth in the case that the first confidence is greater than the confidence threshold.

In some embodiments, a first user account is logged into a system running on a first head mounted display device; a second user account is logged in a system running on the first head-mounted display device, and the first confirmation signal carries the first user account; a second communication module 1003, configured to:

under the condition that the sight line states are mutually normal sight states, a second friend list of a second user account is obtained;

and carrying out information interaction with the first head-mounted display equipment under the condition that the first user account exists in the second friend list.

In some embodiments, the goniometric assembly includes at least one of:

an angle measuring component adopting an ultra-wideband technology;

adopt angle measurement subassembly of bluetooth low energy technique.

To sum up, in the information interaction apparatus provided in this embodiment, when the head-mounted display device has the information interaction function turned on, the angle measurement component is used to detect the line-of-sight state between the two head-mounted display devices, and after it is determined that the two head-mounted display devices are in the front-view state, information interaction may be performed through the two head-mounted display devices, that is, if the two head-mounted display devices have the information interaction function turned on, in a scene that two users are looking at, an information interaction channel may be quickly established between the two head-mounted display devices worn by the two users, so that the two users may perform information interaction through the two head-mounted display devices, and the head-mounted display device realizes recognition of the scene that the two users are looking at through the angle measurement component, that information interaction between the two head-mounted display devices may be triggered, without manual operation of the users to establish a communication connection between the two head-mounted display devices, the human-computer interaction efficiency is improved, and the interaction experience of the user adopting the head-mounted display equipment is enriched.

Fig. 11 shows a schematic structural diagram of a head-mounted display device according to an exemplary embodiment of the present application. The computer device may be a device that performs the information interaction method as provided herein, and the computer device may be smart glasses. Specifically, the method comprises the following steps:

the head-mounted display device 1100 includes a Central Processing Unit (CPU) 1101, a system Memory 1104 including a Random Access Memory (RAM) 1102 and a Read Only Memory (ROM) 1103, and a system bus 1105 connecting the system Memory 1104 and the Central Processing Unit 1101. The head mounted display device 1100 also includes a basic Input/Output System (I/O) 1106, which facilitates information transfer between various devices within the computer, and a mass storage device 1107 for storing an operating System 1113, application programs 1114, and other program modules 1115.

The basic input/output system 1106 includes a display 1108 for displaying information and an input device 1109 such as a mouse, keyboard, etc. for user input of information. Wherein the display 1108 and the input device 1109 are connected to the central processing unit 1101 through an input output controller 1110 connected to the system bus 1105. The basic input/output system 1106 may also include an input/output controller 1110 for receiving and processing input from a number of other devices, such as a keyboard, mouse, or electronic stylus. Similarly, input-output controller 1110 also provides output to a display screen, a printer, or other type of output device.

The mass storage device 1107 is connected to the central processing unit 1101 through a mass storage controller (not shown) that is connected to the system bus 1105. The mass storage device 1107 and its associated computer-readable media provide non-volatile storage for the head mounted display device 1100. That is, the mass storage device 1107 may include a computer-readable medium (not shown) such as a hard disk or Compact disk Read Only Memory (CD-ROM) drive.

Computer-readable media may include computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), flash Memory or other Solid State Memory technology, CD-ROM, Digital Versatile Disks (DVD), or Solid State Drives (SSD), other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage, or other magnetic storage devices. The Random Access Memory may include a resistive Random Access Memory (ReRAM) and a Dynamic Random Access Memory (DRAM). Of course, those skilled in the art will appreciate that computer storage media is not limited to the foregoing. The system memory 1104 and mass storage device 1107 described above may be collectively referred to as memory.

According to various embodiments of the present application, the head mounted display device 1100 may also operate with a remote computer connected to a network through a network, such as the Internet. That is, the head mounted display device 1100 may connect to the network 1112 through the network interface unit 1111 that is connected to the system bus 1105, or may connect to other types of networks or remote computer systems (not shown) using the network interface unit 1111.

According to various embodiments of the present application, the head mounted display device 1100 further comprises an angle measurement component (not shown) for detecting a state of line of sight between the two head mounted display devices. This angle measuring subassembly includes: the angle measurement assembly adopts at least one of an ultra-wideband technology, a wireless network communication technology and a low-power Bluetooth technology.

The memory further includes one or more programs, and the one or more programs are stored in the memory and configured to be executed by the CPU to implement the information interaction method as described above.

The embodiment of the present application further provides a computer-readable storage medium, where at least one instruction is stored, and the at least one instruction is loaded and executed by a processor to implement the information interaction method according to the above embodiments.

Optionally, the computer-readable storage medium may include: a Read Only Memory (ROM), a Random Access Memory (RAM), a Solid State Drive (SSD), or an optical disc. The Random Access Memory may include a resistive Random Access Memory (ReRAM) and a Dynamic Random Access Memory (DRAM).

It should be noted that: in the information interaction apparatus provided in the foregoing embodiment, when the information interaction method is executed, only the division of the functional modules is illustrated, and in practical applications, the functions may be distributed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the information interaction device and the information interaction method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only exemplary of the implementation of the present application and is not intended to limit the present application, and any modifications, equivalents, improvements, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. An information interaction method is applied to a first head-mounted display device, wherein an angle measurement component is arranged on the first head-mounted display device, and the method comprises the following steps:

2. The method of claim 1, wherein the detecting, by the goniometric component, a state of line of sight between the first head mounted display device and a second head mounted display device comprises:

detecting, by the angle measurement component, that the second head mounted display device is in a first front view direction of the first head mounted display device;

determining that the sight line state is the mutual front view state in response to a second confirmation signal sent by the second head mounted display device; the second confirmation signal is used for indicating that the first head-mounted display device is positioned in the front view direction of the second head-mounted display device.

3. The method of claim 2, wherein the detecting, by the goniometric component, that the second head mounted display device is in a first elevational direction of the first head mounted display device comprises:

monitoring, by the goniometric component, a second data packet broadcast by the second head mounted display device;

determining that the second head mounted display device is located in the first elevation direction based on the second azimuth angle.

4. The method of claim 3, wherein the determining that the second head mounted display device is located in the first elevation direction based on the second azimuth angle comprises:

acquiring a first azimuth corresponding to the first front view direction;

determining a first direction included angle between the first front-view direction and the direction of the second head-mounted display device based on the first azimuth angle and the second azimuth angle;

and under the condition that the included angle of the first direction is smaller than the included angle threshold value, determining that the second head-mounted display equipment is positioned in the first front-view direction.

5. The method of claim 4, wherein the second head mounted display device comprises at least two;

determining that the second head mounted display device is located in the first front view direction under the condition that the first direction included angle is smaller than the included angle threshold value, including:

and under the condition that the minimum first direction included angle is smaller than the included angle threshold value, determining that the second head-mounted display equipment corresponding to the minimum first direction included angle is positioned in the first front viewing direction.

6. The method of claim 4, wherein the second head mounted display device comprises at least two;

under the condition that the included angle of the first direction corresponding to each second head-mounted display device is smaller than the included angle threshold value, acquiring the signal strength of a second data packet of the second head-mounted display device to obtain at least two second signal strengths corresponding to at least two second head-mounted display devices;

determining that a second head mounted display device corresponding to the largest signal strength in the at least two second signal strengths is located in the first front view direction.

7. The method of any of claims 3 to 6, wherein determining a second azimuth based on the second packet comprises:

determining a second pending azimuth based on the second data packet;

acquiring a second signal quality parameter of the second data packet;

calculating a second confidence level for the second pending azimuth based on the second signal quality parameter;

determining the second pending azimuth as the second azimuth if the second confidence is greater than a confidence threshold.

8. The method according to any one of claims 2 to 6, wherein a first user account is logged in a system running on the first head-mounted display device; a second user account is logged in a system running on the second head-mounted display device, and the second confirmation signal carries the second user account;

and under the condition that the sight line state is a mutual front-view state, performing information interaction with the second head-mounted display device, including:

under the condition that the sight line states are mutually normal sight states, acquiring a first friend list of the first user account;

and carrying out information interaction with the second head-mounted display equipment under the condition that the second user account exists in the first friend list.

9. The method of any of claims 1 to 6, wherein the goniometric assembly comprises at least one of:

an angle measuring component adopting an ultra-wideband technology;

adopt angle measurement subassembly of bluetooth low energy technique.

10. The method of any of claims 1 to 6, wherein the information interaction comprises: at least one of encrypted conversation, encrypted information transmission and picture sharing.

11. The method of any of claims 1 to 6, wherein the triggering operation comprises at least one of a gesture operation, a blinking operation, and a key press operation.

12. An information interaction device, characterized in that the device is provided with an angle measurement assembly, the device comprising:

13. A head-mounted display device comprising an goniometric component, a processor, and a memory coupled to the processor, and program instructions stored on the memory that, when executed by the processor, implement the information interaction method of any of claims 1 to 11.

14. A computer-readable storage medium in which program instructions are stored, wherein the program instructions, when executed by a processor, implement the information interaction method according to any one of claims 1 to 11.

15. A computer program product or computer program, characterized in that the computer program product or computer program comprises computer instructions, the computer instructions being stored in a computer-readable storage medium;

a processor of a computer device reads the computer instructions from the computer-readable storage medium, the processor executing the computer instructions to cause the computer device to perform the information interaction method of any one of claims 1 to 11.