CN111897411A - Interaction method and device based on atmospheric optical communication and wearable device - Google Patents

Interaction method and device based on atmospheric optical communication and wearable device Download PDF

Info

Publication number
CN111897411A
CN111897411A CN201910367135.4A CN201910367135A CN111897411A CN 111897411 A CN111897411 A CN 111897411A CN 201910367135 A CN201910367135 A CN 201910367135A CN 111897411 A CN111897411 A CN 111897411A
Authority
CN
China
Prior art keywords
optical transceiver
wearable device
interaction
signal light
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910367135.4A
Other languages
Chinese (zh)
Inventor
杨鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910367135.4A priority Critical patent/CN111897411A/en
Publication of CN111897411A publication Critical patent/CN111897411A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B10/00Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/40Transceivers

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Optical Communication System (AREA)

Abstract

The invention provides an interaction method, an interaction device and wearable equipment based on atmospheric optical communication, wherein the method comprises the following steps: the wearable device adopts the optical transceiver to send out signal light carrying the first handshake information, and adjusts the optical axis of the optical transceiver according to the detected human eye visual angle, so that the adjusted optical axis is matched with the visual angle of human eyes, and in the process of adjusting the optical axis, the optical transceiver is adopted to receive signal light emitted by external equipment, when the signal light received by the optical transceiver carries the first handshake information, the wearable device interacts with the external device through the optical transceiver, by adjusting the optical axis of the optical transceiver to match with the visual angle of human eyes and realizing optical communication based on the optical transceiver, direct information interaction and short-distance data rapid sharing among a plurality of wearing devices are realized, the interaction efficiency is high, meanwhile, the interestingness of interaction is improved, and the technical problems that in the prior art, only single information interaction between the glasses and a user can be realized by the augmented reality glasses, and the data transmission efficiency is low are solved.

Description

Interaction method and device based on atmospheric optical communication and wearable device
Technical Field
The invention relates to the technical field of augmented reality, in particular to an interaction method and device based on atmospheric optical communication and wearable equipment.
Background
With the progress of science and technology, Augmented Reality (AR) glasses realize more and more functions, and the current state of a user can be judged by tracking the eyeballs of the user, so that the corresponding function is started.
Disclosure of Invention
The present invention is directed to solving, at least to some extent, one of the technical problems in the related art.
Therefore, a first objective of the present invention is to provide an interaction method based on atmospheric optical communication, which realizes direct information interaction and short-distance data fast sharing among multiple wearable devices by adjusting an optical axis of an optical transceiver of the wearable device to match with a human eye viewing angle and realizing optical communication based on the optical transceiver, and has high interaction efficiency and improved interaction interestingness.
The second purpose of the invention is to provide an interactive device based on atmospheric optical communication.
A third object of the invention is to propose a wearable device.
A fourth object of the invention is to propose a computer-readable storage medium.
The embodiment of the first aspect of the present invention provides an interaction method based on atmospheric optical communication, where the interaction method is performed by a wearable device, the wearable device includes an optical transceiver for atmospheric optical communication, and the method includes the following steps:
the wearable device sends signal light carrying first handshake information by adopting an optical transceiver;
the wearable device adjusts the optical axis of the optical transceiver according to the detected human eye visual angle so as to enable the adjusted optical axis to be matched with the human eye visual angle;
in the process of adjusting the optical axis, the wearable device receives signal light emitted by external equipment by adopting an optical transceiver;
when the signal light received by the optical transceiver carries the first handshake information, the wearable device interacts with the external device through the optical transceiver.
The embodiment of the second aspect of the invention provides an interaction device based on atmospheric optical communication, which comprises:
the transmitting module is used for controlling the optical transceiver to transmit signal light carrying first handshake information;
the adjusting module is used for adjusting the optical axis of the optical transceiver according to the detected human eye visual angle so as to enable the adjusted optical axis to be matched with the human eye visual angle;
the receiving module is used for receiving signal light emitted by external equipment by adopting an optical transceiver in the optical axis adjusting process;
and the interaction module is used for interacting with the external equipment through the optical transceiver when the signal light received by the optical transceiver carries the first handshake information.
In a third aspect of the present invention, a wearable device is provided, which includes an optical transceiver for atmospheric optical communication, and a controller connected to the optical transceiver, where the controller includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the interaction method based on atmospheric optical communication as described in the first aspect of the present invention is implemented.
A fourth aspect of the present invention provides a computer-readable storage medium, where when executed by a processor, the program implements the method for interaction based on atmospheric optical communication as described in the first aspect.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
wearing equipment adopts the optical transceiver to send the signal light that carries first hand information, and according to the people's eye visual angle that detects, adjust the optical axis of optical transceiver, so that optical axis and people's eye visual angle after the adjustment match, and in the optical axis adjustment in-process, wearing equipment adopts the optical transceiver to receive the signal light that external equipment sent, when the signal light that optical transceiver received carries first hand information, wearing equipment passes through the optical transceiver and interacts with external equipment, the optical axis of optical transceiver through adjustment wearing equipment matches with people's eye visual angle, and realize optical communication based on the optical transceiver, direct information interaction and the data of closely sharing fast between a plurality of wearing equipment have been realized, interaction efficiency is high, interactive interest has been improved simultaneously.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic flowchart of an interaction method based on atmospheric optical communication according to an embodiment of the present invention;
fig. 2 is a schematic diagram illustrating an interaction principle of atmospheric optical communication according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of another interaction method based on atmospheric optical communication according to an embodiment of the present invention;
fig. 4 is a schematic flowchart of another interaction method based on atmospheric optical communication according to an embodiment of the present invention;
fig. 5 is a schematic flowchart of another interaction method based on atmospheric optical communication according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an interaction device based on atmospheric optical communication according to an embodiment of the present invention; and
fig. 7 is a schematic structural diagram of a wearable device provided in an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
The following describes an interaction method, an interaction device and wearable equipment based on atmospheric optical communication according to an embodiment of the invention with reference to the drawings.
Fig. 1 is a schematic flowchart of an interaction method based on atmospheric optical communication according to an embodiment of the present invention.
As shown in fig. 1, the method comprises the steps of:
step 101, the wearable device sends signal light carrying first handshake information by using an optical transceiver.
In the embodiment of the invention, the wearable device is, for example, a Virtual Reality (VR) head-mounted device, the wearable device comprises an optical transceiver for atmospheric optical communication, as a possible implementation manner, the optical transceiver comprises an infrared transmitter and an infrared receiver, and information direct interaction between the wearable devices is realized by transmitting and receiving infrared signal light.
Specifically, the wearable device sends signal light carrying first handshake information by using an optical transceiver, wherein the first handshake information includes protocol information related to information interaction established between the wearable device and the external device, so that the external device determines whether to establish information interaction with the wearable device based on the first handshake information after receiving the first handshake information sent by the wearable device.
Step 102, the wearable device adjusts an optical axis of the optical transceiver according to the detected human eye viewing angle, so that the adjusted optical axis is matched with the human eye viewing angle.
In the embodiment of the invention, the wearable device can also be provided with a human eye eyeball tracking device which is used for tracking and positioning the position of the human eye eyeball and detecting to obtain the human eye visual angle, namely the observation angle of the human eye, and the refresh rate of the wearable device for detecting the human eye visual angle is very high, for example, the wearable device can detect the human eye visual angle at the refresh rate of 120HZ, so that the accuracy and the real-time performance of the detected human eye visual angle are very high. Specifically, the human eye eyeball can reflect invisible light, so that a reflection point is formed on the eyeball, the wavelength which can be perceived by the human eye is 380 nm-780 nm, in order to not influence the normal watching of a user by using wearable equipment, an infrared light source which is low in human eye sensitivity and less in harm can be selected, as a possible implementation mode, an emission module in the human eye eyeball tracking device emits infrared rays, the infrared rays are reflected into the human eye eyeball after being reflected by the reflection module, the human eye eyeball can reflect the received infrared rays, furthermore, the imaging module collects the infrared rays reflected by the human eye eyeball, the human eye eyeball is imaged by the infrared rays, the eyeball of the user is identified from the eyeball imaging, the eyeball watching direction is detected, and the human eye viewing angle is detected. Wherein, when the human eye is focusing on attention, the angle of the visual angle of the human eye is generally a fixed angle value, for example, 20 degrees to 30 degrees.
Wherein, the optical axis of optical transceiver can be adjusted, the optical axis of optical transceiver in this embodiment is adjusted according to the people's eye visual angle that detects, that is to say, after wearing equipment detects people's eye visual angle, wearing equipment then according to the people's eye visual angle that detects, the optical axis of adjustment optical transceiver, so that the optical axis and the people's eye visual angle of optical transceiver after adjusting match, the synchronization of wearing equipment's directionality and people's eye visual angle directionality has been realized promptly, when realizing two wearing equipment visual angles and being relative, the optical transceiver that sets up on two wearing equipment can carry out the transmission of information.
As shown in fig. 2, it is shown that the optical axis of the wearable device can be adjusted to match the adjusted optical axis with the viewing angle of the human eye, for example, as shown in fig. 2, wearable device a, external devices B and C, wherein the transceiving angle corresponding to the optical axis of the optical transceiver is shown as a solid line in fig. 2, and the angle of the viewing angle of the human eye is shown as a dotted line in fig. 2.
The external devices B and C may be wearable devices.
Step 103, in the optical axis adjusting process, the wearable device receives signal light emitted by the external device by using an optical transceiver.
Specifically, in the optical axis adjustment process, the wearable device receives signal light emitted by an external device through an optical transceiver, where the external device may be another wearable device, for example, and determines whether the external device needs to interact with the wearable device according to information carried in the received signal light.
As shown in fig. 2, the optical transceiver of the wearable device a receives the signal light emitted by the external devices B and C, and in a scenario, since the angles of view of human eyes detected by the wearable device a and the external device B are matched, it is indicated that the optical axis of the optical transceiver of the wearable device a and the optical axis of the optical transceiver of the external device B are matched, that is, the signal light emitted by the wearable device a can be received by the optical transceiver of the external device B, and the information number emitted by the optical transceiver of the external device B can also be received by the wearable device a, that is, information interaction based on the optical transceivers can be implemented. In another scenario, as shown in fig. 2, optical axes of the optical transceiver of the wearable device a and the optical transceiver of the external device C are not matched, that is, signal light cannot be transmitted between the optical transceiver of the wearable device a and the optical transceiver of the external device C, and information interaction between the wearable device a and the external device C cannot be achieved.
And step 104, when the signal light received by the optical transceiver carries the first handshake information, the wearable device interacts with the external device through the optical transceiver.
Specifically, when the signal light received by the optical transceiver of the wearable device carries the first handshake information, it indicates that the external device needs to perform information interaction with the wearable device, for example, business card exchange or video synchronization or sharing is achieved through interaction. The wearable device detects the user operation behavior, if the user operation behavior belongs to the set behavior, the wearable device inquires the corresponding relation between the set behavior and the interaction information to determine target interaction information corresponding to the user operation behavior, the wearable device sends signal light carrying the target interaction information to the external device through the optical transceiver to realize direct information interaction between the wearable device and the external device, the efficiency of information interaction is improved, and interestingness is also improved.
It should be noted that, after the external device receives the signal light of the first handshake information sent by the optical transceiver of the wearable device, if the external device needs to interact with the wearable device, the external device controls the optical transceiver of the external device to send the received first handshake information, and sends a preset duration to ensure that the wearable device can receive the first handshake information, thereby implementing information interaction between the wearable device and the external device.
It should be understood that, the optical transceiver in the embodiment of the present invention implements atmospheric optical communication by sending out signal Light carrying handshake information, and compared with the atmospheric optical communication (Light Fidelity, LiFi) in the prior art, the optical transceiver in the embodiment of the present invention implements direct interaction of information by performing atmospheric optical communication through the optical transceiver, and does not need to additionally transmit through an optical device such as a bulb, which is less affected by external factors, thereby improving transmission efficiency, and meanwhile, during transmission, the optical transceiver does not need to be connected with a router, which reduces transmission cost.
In the interaction method for atmospheric optical communication in the embodiment of the invention, the wearable device sends out the signal light carrying the first handshake information by the optical transceiver, adjusts the optical axis of the optical transceiver according to the detected visual angle of human eyes, so that the adjusted optical axis is matched with the visual angle of human eyes, receives the signal light sent by the external device by the optical transceiver in the optical axis adjustment process, interacts with the external device by the wearable device through the optical transceiver when the signal light received by the optical transceiver carries the first handshake information, matches with the visual angle of human eyes by adjusting the optical axis of the optical transceiver of the wearable device, and realizes optical communication based on the optical transceiver, thereby realizing direct information interaction and short-distance data rapid sharing among a plurality of wearable devices, having high interaction efficiency, and improving the interest of interaction.
In the above embodiment, it is described that target interaction information that needs to be interacted may be determined by detecting an operation behavior of a user, and in an actual application, it may also be determined whether the wearable device needs to send signal light carrying the target interaction information to an external device through an optical transceiver by comparing the time when the operation behaviors of the wearable device and the external device are detected.
As shown in fig. 3, based on the previous embodiment, step 104 may further include the following sub-steps:
step 301, the wearable device detects a user operation behavior.
As a possible implementation manner, the change of the gaze point of the user can be determined by tracking the eyeballs of the user, the operation behavior of the user is detected according to the change of the gaze point of the user, and in a scene, if the change of the gaze point of the user from the horizontal position to the vertical position is determined by tracking the eyeballs of the user, the operation behavior of the user is determined to be nodding operation. In another scene, if the eyeball of the user is tracked to determine that the fixation point of the user disappears and then appears, the operation behavior of the user is determined to be blinking operation.
As another possible implementation manner, a gyroscope may be further disposed on the wearable device, and the user operation performed by the user, for example, a nodding operation, a shaking operation, and the like, is determined by detecting an angle change of the gyroscope.
As still another possible implementation manner, images of the user may be acquired through a camera device disposed on the wearable device, feature analysis may be performed according to the images of the user, and a user operation performed by the user, for example, a blinking operation, a head-shaking operation, or a head-shaking operation, may be determined.
Step 302, if the user operation behavior belongs to the set behavior, the wearable device queries a corresponding relationship between the set behavior and the interaction information to determine target interaction information corresponding to the user operation behavior.
Specifically, the detected user operation behavior is compared with a preset setting behavior, and if the user operation behavior belongs to the setting behavior, the wearable device further queries a corresponding relationship between the setting behavior and the interaction information, where the corresponding relationship between the setting behavior and the interaction information may be predetermined, and determines target interaction information corresponding to the user operation behavior. For example, if the operation behavior of the user is nodding operation, the corresponding target interaction information is determined to be video sharing through query.
Step 303, the wearable device receives the signal light carrying time information through the optical transceiver, where the time information is used to indicate a time when the external device detects the user operation behavior.
Specifically, the wearable device receives the portable external device through the optical transceiver
And step 304, comparing to determine that the moment when the external device detects the user operation behavior is later than the moment when the wearable device detects the user operation behavior.
Step 305, the wearable device sends signal light carrying target interaction information to the external device through the optical transceiver.
In the embodiment of the invention, after the target interaction information corresponding to the operation behavior of the user is determined, the time when the wearable device detects the operation behavior of the user and the time when the external device detects the operation behavior of the user can be further compared, and the time when the external device detects the operation behavior of the user is determined to be later than the time when the wearable device detects the operation behavior of the user, so that the wearable device sends the signal light carrying the target interaction information to the external device through the optical transceiver to realize information interaction, and meanwhile, the transmission of the interaction information through the signal light improves the efficiency of information interaction and the interest of the interaction.
For example, the operation behavior of the user is nodding operation, then confirm that the corresponding target mutual information is shared for the video through the inquiry, simultaneously, confirm that wearing equipment detects the operation that the user nods earlier than the nodding operation of the user that external equipment detected through comparing, then wearing equipment directly sends video information to external equipment through the signal light that carries video information, video information's mutual sharing has been realized, the efficiency of information interaction has been improved to the direct transmission of carrying out mutual information through signal light simultaneously, interactive interest has also been improved.
In the interaction method based on atmospheric optical communication of the embodiment of the invention, after the wearable device is determined to perform information interaction with the external device through the optical transceiver, the target information required to be interacted is further determined by detecting the operation behavior of the user, and whether the operation time of the user detected by the wearable device is earlier than the operation time of the user detected by the external device is determined by comparing, so that whether the wearable device sends the signal light carrying the target interaction information to the external device through the optical transceiver or not is determined, thereby realizing the rapid and direct interaction of the information and improving the interest of the interaction.
In the above embodiment, it is described that target interaction information that needs to be interacted may be determined by detecting an operation behavior of a user, and in an actual application, it may also be determined whether a wearable device needs to send a signal light carrying the target interaction information to an external device through an optical transceiver by comparing whether detected operation behaviors of the wearable device and the external device are the same.
As shown in fig. 4, based on the previous embodiment, step 104 may further include the following sub-steps:
step 401, the wearable device detects a user operation behavior.
Step 402, if the user operation behavior belongs to the set behavior, the wearable device queries a corresponding relationship between the set behavior and the interaction information to determine target interaction information corresponding to the user operation behavior.
Specifically, reference may be made to step 301 to step 302 in the previous embodiment, which have the same principle and are not described herein again.
Step 403, the wearable device receives the signal light carrying the operation information through the optical transceiver, where the operation information is used to instruct the external device to detect the user operation behavior.
Step 404, comparing to determine that the external device detects the same user operation behavior as the wearable device.
Step 405, the wearable device sends signal light carrying target interaction information to the external device through the optical transceiver.
In the embodiment of the invention, after the target interaction information corresponding to the operation behavior of the user is determined, whether the user operation behavior detected by the external device is the same as the user operation behavior detected by the wearable device or not can be further determined by comparing the user operation behavior detected by the wearable device with the user operation behavior detected by the external device, if so, the wearable device sends the signal light carrying the target interaction information to the external device through the optical transceiver, meanwhile, the external device can also send the signal light carrying the target interaction information to the wearable device through the optical transceiver, so that the information interaction is realized, meanwhile, the transmission of the interaction information through the signal light improves the efficiency of the information interaction, and the interestingness of the interaction is also improved.
For example, if the operation behavior of the user is blinking operation, the corresponding target interaction information is determined to be personal information through query, meanwhile, it is determined through comparison that the blinking operation of the user detected by the wearable device is the same as the blinking operation of the user detected by the external device, and then the wearable device and the external device exchange the personal information through the corresponding optical transceiver, so that interactive sharing of the personal information is realized, meanwhile, the information interaction efficiency is improved through direct transmission of the personal information through signal light, and the interaction interest is also improved.
According to the interaction method based on the atmospheric optical communication, after the fact that the wearable device needs to perform information interaction with the external device through the optical transceiver is determined, the target information needing to be interacted is further determined by detecting the operation behavior of the user, whether the user operation detected by the wearable device is the same as the user operation detected by the external device or not is determined by comparing whether the user operation detected by the wearable device and the user operation detected by the external device are the same, whether the information needs to be sent to each other or not is determined, so that the rapid and direct interaction of the interaction information is achieved, and the interestingness of the interaction is improved.
Based on the foregoing embodiments, the embodiments of the present invention further provide a possible implementation manner of an interaction method based on atmospheric optical communication, and fig. 5 is a schematic flow diagram of another interaction method based on atmospheric optical communication according to an embodiment of the present invention, as shown in fig. 5, the method includes the following steps:
step 501, the wearable device sends signal light carrying first handshake information by using an optical transceiver.
Step 502, the wearable device adjusts an optical axis of the optical transceiver according to the detected human eye viewing angle, so that the adjusted optical axis matches the human eye viewing angle.
Step 503, in the optical axis adjusting process, the wearable device receives the signal light emitted by the external device by using the optical transceiver.
Specifically, reference may be made to steps 101-103 in the above embodiments, which have the same principle and are not described herein again.
Step 504, determining whether the signal light received by the optical transceiver of the wearable device carries the first handshake information, if so, executing step 505, and if not, executing step 506.
Specifically, if the signal light received by the optical transceiver of the wearable device carries the first handshake information, step 505 is executed, otherwise, if the signal light received by the optical transceiver of the wearable device carries the second handshake information, step 506 is executed.
In step 505, the wearable device interacts with an external device through the optical transceiver.
Specifically, reference may be made to step 104 in the embodiment of fig. 1, which has the same principle and is not described herein again.
Step 506, the optical transceiver is controlled to send out the signal light carrying the second handshake information, and the optical transceiver is controlled to send out the signal light carrying the first handshake information again until the set duration is reached.
The second handshake information is sent by other external devices, and is different from the first handshake information sent by the wearable device in this embodiment.
Specifically, when the signal light received by the optical transceiver carries second handshake information, it is indicated that an external device needs to perform information interaction with the wearable device, the wearable device controls the optical transceiver to send the signal light carrying the second handshake information, and a set time is reached, the signal light carrying the second handshake information is sent for multiple times, it is ensured that the external device can receive the signal light carrying the second handshake information sent by the wearable device, and if the preset time is reached, the wearable device does not interact with the external device, for example, the wearable device does not detect user operation, or the user operation does not belong to a set behavior, the wearable device does not interact with the external device, and the optical transceiver is controlled to send the signal light carrying the first handshake information again.
In the interaction method based on the atmospheric optical communication, in the optical axis adjustment process of the optical transceiver of the wearable device, after the wearable device receives the signal light sent by the external device by the optical transceiver, if the signal light received by the optical transceiver carries second handshake information, the optical transceiver is controlled to send the signal light carrying the second handshake information, until the set time length is reached, the optical transceiver is controlled to send the signal light carrying the first handshake information again, and the accuracy of information interaction between the wearable device and the external device is improved by sending the signal light containing the handshake information for multiple times within the set time length.
In order to implement the above embodiments, the present invention further provides an interaction device based on atmospheric optical communication.
Fig. 6 is a schematic structural diagram of an interaction device based on atmospheric optical communication according to an embodiment of the present invention.
As shown in fig. 6, the apparatus includes:
and a sending module 61, configured to control the optical transceiver to send out signal light carrying the first handshake information.
And an adjusting module 62, configured to adjust an optical axis of the optical transceiver according to the detected human eye viewing angle, so that the adjusted optical axis matches the human eye viewing angle.
And a receiving module 63, configured to receive signal light emitted by an external device by using an optical transceiver in an optical axis adjustment process.
The interaction module 64 is configured to interact with an external device through the optical transceiver when the signal light received by the optical transceiver carries the first handshake information.
Further, in a possible implementation manner of the embodiment of the present invention, the apparatus further includes:
and the judging module is used for controlling the optical transceiver to send the signal light carrying the second handshake information when the signal light received by the optical transceiver carries the second handshake information, and controlling the optical transceiver to send the signal light carrying the first handshake information again until the set duration is reached.
As a possible implementation manner, the interaction module 64 includes:
and the detection unit is used for detecting the operation behavior of the user.
And the determining unit is used for inquiring the corresponding relation between the set behavior and the interactive information by the wearable device if the user operation behavior belongs to the set behavior so as to determine the target interactive information corresponding to the user operation behavior.
And the sending unit is used for sending the signal light carrying the target interaction information to the external equipment through the optical transceiver.
As a possible implementation manner, the interaction module 64 further includes:
a processing unit for receiving signal light carrying time information through the optical transceiver; the time information is used for indicating the time when the external device detects the user operation behavior, and comparing to determine that the time when the external device detects the user operation behavior is later than the time when the wearable device detects the user operation behavior.
As another possible implementation manner, the interaction module 64 includes a processing unit, which is specifically configured to receive, by the optical transceiver, signal light carrying operation information; the operation information is used for indicating the external device to detect the user operation behavior, and comparing to determine that the user operation behavior detected by the external device is the same as the user operation behavior detected by the wearable device.
It should be noted that the foregoing explanation of the embodiment of the interaction method is also applicable to the interaction apparatus of the embodiment, and the principle is the same, and is not described herein again.
In the atmosphere optical communication interaction device, the wearable device sends out the signal light carrying the first handshake information by the optical transceiver, adjusts the optical axis of the optical transceiver according to the detected visual angle of human eyes, so that the adjusted optical axis is matched with the visual angle of human eyes, receives the signal light sent by the external device by the optical transceiver in the optical axis adjustment process, interacts with the external device by the wearable device through the optical transceiver when the signal light received by the optical transceiver carries the first handshake information, matches with the visual angle of human eyes by adjusting the optical axis of the optical transceiver of the wearable device, and realizes optical communication based on the optical transceiver, thereby realizing direct information interaction and short-distance data rapid sharing among a plurality of wearable devices, having high interaction efficiency and simultaneously improving the interest of interaction.
In order to implement the above embodiment, the present invention further provides a wearable device 10, which includes an optical transceiver 120 for atmospheric optical communication, and a controller 110 connected to the optical transceiver 120, where the controller 110 includes a memory 111, a processor 112, and a computer program 113 stored in the memory and executable on the processor, and when the processor 112 executes the program 113, the interaction method based on atmospheric optical communication described in the foregoing method embodiment is implemented.
As a possible implementation, the wearable device 10 is a virtual reality VR headset, in which the optical transceiver 120 includes an infrared transmitter 122 and an infrared receiver 121.
In order to implement the above embodiments, the present invention further provides a computer-readable storage medium, which when being executed by a processor, implements the interaction method based on atmospheric optical communication according to the foregoing method embodiments.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.

Claims (14)

1. An interaction method based on atmospheric optical communication, which is executed by a wearable device including an optical transceiver for atmospheric optical communication, the method comprising the steps of:
the wearable device sends signal light carrying first handshake information by the optical transceiver;
the wearable device adjusts an optical axis of the optical transceiver according to the detected human eye visual angle, so that the adjusted optical axis is matched with the human eye visual angle;
in the process of adjusting the optical axis, the wearable device receives signal light emitted by external equipment by adopting the optical transceiver;
when the signal light received by the optical transceiver carries the first handshake information, the wearable device interacts with the external device through the optical transceiver.
2. The interaction method of claim 1, wherein the wearable device interacts with the external device through the optical transceiver, comprising:
the wearable device detects user operation behaviors;
if the user operation behavior belongs to the set behavior, the wearable device inquires the corresponding relation between the set behavior and the interaction information to determine target interaction information corresponding to the user operation behavior;
and the wearable device sends signal light carrying the target interaction information to the external device through the optical transceiver.
3. The interaction method according to claim 2, wherein before the wearable device sends the signal light carrying the target interaction information to the external device through the optical transceiver, the method further comprises:
the wearable device receives signal light carrying time information through the optical transceiver; the time information is used for indicating the time when the external equipment detects the operation behavior of the user;
and comparing to determine that the moment when the external device detects the user operation behavior is later than the moment when the wearable device detects the user operation behavior.
4. The interaction method according to claim 2, wherein before the wearable device sends the signal light carrying the target interaction information to the external device through the optical transceiver, the method further comprises:
the wearable device receives signal light carrying operation information through the optical transceiver; the operation information is used for indicating the external equipment to detect user operation behaviors;
comparing to determine that the external device detected the same user-operated behavior as the wearable device detected the same user-operated behavior.
5. The interaction method according to any one of claims 1 to 4, wherein in the optical axis adjustment process, after the wearable device receives signal light emitted by an external device with the optical transceiver, the method further includes:
and when the signal light received by the optical transceiver carries second handshake information, controlling the optical transceiver to send the signal light carrying the second handshake information, and controlling the optical transceiver to send the signal light carrying the first handshake information again until a set time length is reached.
6. An interaction device based on atmospheric optical communication, the device comprising:
the transmitting module is used for controlling the optical transceiver to transmit signal light carrying first handshake information;
an adjusting module, configured to adjust an optical axis of the optical transceiver according to the detected human eye viewing angle, so that the adjusted optical axis matches the human eye viewing angle;
the receiving module is used for receiving signal light emitted by external equipment by adopting the optical transceiver in the process of adjusting the optical axis;
and the interaction module is used for interacting with the external equipment through the optical transceiver when the signal light received by the optical transceiver carries the first handshake information.
7. The interaction device of claim 6, wherein the interaction module comprises:
the detection unit is used for detecting the operation behavior of a user;
the determining unit is used for inquiring the corresponding relation between the set behavior and the interactive information by the wearable device if the user operation behavior belongs to the set behavior so as to determine the target interactive information corresponding to the user operation behavior;
and the sending unit is used for sending the signal light carrying the target interaction information to the external equipment through the optical transceiver.
8. The interaction apparatus of claim 7, wherein the interaction module further comprises:
a processing unit for receiving signal light carrying time information through the optical transceiver; the time information is used for indicating the time when the external device detects the user operation behavior, and comparing to determine that the time when the external device detects the user operation behavior is later than the time when the wearable device detects the user operation behavior.
9. The interaction device of claim 7, wherein the processing unit is further configured to:
receiving, by the optical transceiver, signal light carrying operation information; the operation information is used for indicating the external equipment to detect user operation behaviors;
comparing to determine that the external device detected the same user-operated behavior as the wearable device detected the same user-operated behavior.
10. The interaction device according to any one of claims 6 to 9, wherein the device further comprises:
and the judging module is used for controlling the optical transceiver to send the signal light carrying the second handshake information when the signal light received by the optical transceiver carries the second handshake information, and controlling the optical transceiver to send the signal light carrying the first handshake information again until the set duration is reached.
11. A wearable device, comprising an optical transceiver for atmospheric optical communication, and a controller connected to the optical transceiver, wherein the controller comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the program, the processor implements the atmospheric optical communication-based interaction method according to any one of claims 1 to 5.
12. The wearable device of claim 11, wherein the wearable device is a Virtual Reality (VR) headset.
13. The wearable device of claim 11,
the optical transceiver includes an infrared transmitter and an infrared receiver.
14. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the atmospheric optical communication-based interaction method according to any one of claims 1 to 5.
CN201910367135.4A 2019-05-05 2019-05-05 Interaction method and device based on atmospheric optical communication and wearable device Pending CN111897411A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910367135.4A CN111897411A (en) 2019-05-05 2019-05-05 Interaction method and device based on atmospheric optical communication and wearable device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910367135.4A CN111897411A (en) 2019-05-05 2019-05-05 Interaction method and device based on atmospheric optical communication and wearable device

Publications (1)

Publication Number Publication Date
CN111897411A true CN111897411A (en) 2020-11-06

Family

ID=73169090

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910367135.4A Pending CN111897411A (en) 2019-05-05 2019-05-05 Interaction method and device based on atmospheric optical communication and wearable device

Country Status (1)

Country Link
CN (1) CN111897411A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113993224A (en) * 2021-10-25 2022-01-28 无锡小天鹅电器有限公司 Communication method of household appliance and household appliance

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102088317A (en) * 2011-01-18 2011-06-08 北京邮电大学 High speed optical transmission system and method based on TCM-64QAM code modulation
US20150181632A1 (en) * 2013-05-13 2015-06-25 Empire Technology Development Llc Line of sight initiated handshake
US20170034333A1 (en) * 2015-07-28 2017-02-02 Verizon Patent And Licensing Inc. Exchanging contact information based on identifying social interaction
CN106937531A (en) * 2014-06-14 2017-07-07 奇跃公司 Method and system for producing virtual and augmented reality
CN107087431A (en) * 2014-05-09 2017-08-22 谷歌公司 System and method for distinguishing ocular signal and continuous bio-identification

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102088317A (en) * 2011-01-18 2011-06-08 北京邮电大学 High speed optical transmission system and method based on TCM-64QAM code modulation
US20150181632A1 (en) * 2013-05-13 2015-06-25 Empire Technology Development Llc Line of sight initiated handshake
CN107087431A (en) * 2014-05-09 2017-08-22 谷歌公司 System and method for distinguishing ocular signal and continuous bio-identification
CN106937531A (en) * 2014-06-14 2017-07-07 奇跃公司 Method and system for producing virtual and augmented reality
US20170034333A1 (en) * 2015-07-28 2017-02-02 Verizon Patent And Licensing Inc. Exchanging contact information based on identifying social interaction

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113993224A (en) * 2021-10-25 2022-01-28 无锡小天鹅电器有限公司 Communication method of household appliance and household appliance

Similar Documents

Publication Publication Date Title
US9081181B2 (en) Head mounted display device and image display control method therefor
US20230314798A1 (en) Method and device for eye tracking using event camera data
US20220153412A1 (en) Control method, control system, and smart glasses for first person view unmanned aerial vehicle flight
US10948983B2 (en) System and method for utilizing gaze tracking and focal point tracking
KR102056221B1 (en) Method and apparatus For Connecting Devices Using Eye-tracking
US11221489B2 (en) Controlling light source intensities on optically trackable object
US9384737B2 (en) Method and device for adjusting sound levels of sources based on sound source priority
US9245389B2 (en) Information processing apparatus and recording medium
US10274729B2 (en) Remote control device, remote control product and remote control method
US20170295357A1 (en) Device and method for three-dimensional video communication
US10073262B2 (en) Information distribution system, head mounted display, method for controlling head mounted display, and computer program
US10867174B2 (en) System and method for tracking a focal point for a head mounted device
JP2012203128A (en) Head mounted display and method for controlling head mounted display
US10735620B2 (en) Image display system, image display method, and image display program
CN111061363A (en) Virtual reality system
CN111880640B (en) Screen control method and device, electronic equipment and storage medium
CN112887558B (en) Focus tracking method and device and electronic equipment
CN107885334B (en) Information processing method and virtual equipment
JP2023502552A (en) WEARABLE DEVICE, INTELLIGENT GUIDE METHOD AND APPARATUS, GUIDE SYSTEM, STORAGE MEDIUM
CN111897411A (en) Interaction method and device based on atmospheric optical communication and wearable device
CN113395438A (en) Image correction method and related device for eyeball tracking technology
US11714485B2 (en) Electronic device and method for providing position of user
US20220066223A1 (en) Head mounted display and control method thereof
EP3970817A1 (en) Head mounted display and control method thereof
US20230410414A1 (en) Method and system for video transformation for video see-through augmented reality

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination