CN111741511B

CN111741511B - Quick matching method and head-mounted electronic equipment

Info

Publication number: CN111741511B
Application number: CN202010482547.5A
Authority: CN
Inventors: 李晓辉
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-05-29
Filing date: 2020-05-29
Publication date: 2022-05-10
Anticipated expiration: 2040-05-29
Also published as: CN111741511A; WO2021238821A1

Abstract

The embodiment of the application provides a quick matching method and a head-mounted electronic device, wherein the method is applied to the head-mounted electronic device, the head-mounted electronic device comprises an infrared transceiver, and the method comprises the following steps: receiving user operation; responding to user operation, and sending first infrared information to target electronic equipment through an infrared transceiver; and performing Bluetooth and/or wireless fidelity Wi-Fi communication with the target electronic equipment based on the first infrared information. By adopting the embodiment of the application, the Bluetooth and/or Wi-Fi communication can be rapidly and conveniently carried out with unknown objects in a visual range, the operation is simple, and great convenience is brought to the use of users.

Description

Quick matching method and head-mounted electronic equipment

Technical Field

The present application relates to the field of communications technologies, and in particular, to a fast matching method and a head-mounted electronic device.

Background

With the development of wireless communication technology, electronic devices may communicate with other electronic devices within a visual range through bluetooth, wireless fidelity (Wi-Fi), and the like. However, at present, when two communication parties establish bluetooth and/or Wi-Fi connection and perform bluetooth and/or Wi-Fi communication, device information of a communication object, such as a bluetooth address, a Wi-Fi name, an access password and the like, is often required to be acquired in advance. And the user needs to perform complicated matching operations on the electronic device, for example, manually enter an interface for setting bluetooth in the electronic device, turn on a bluetooth switch and search peripheral electronic devices for turning on bluetooth, and manually select a target electronic device to be connected to establish communication connection, which is complicated in operation, difficult to use, and inconvenient for the user.

Disclosure of Invention

The embodiment of the application discloses a quick matching method and a head-mounted electronic device, which can quickly and conveniently carry out Bluetooth and/or Wi-Fi communication with an unknown object in a visual range, are simple to operate and greatly facilitate the use of a user.

In a first aspect, an embodiment of the present application provides a fast matching method, which is applied to a head-mounted electronic device, where the head-mounted electronic device includes an infrared transceiver, and the method includes: receiving user operation; responding to the user operation, and sending first infrared information to target electronic equipment through the infrared transceiver; and carrying out Bluetooth and/or wireless fidelity Wi-Fi communication with the target electronic equipment based on the first infrared information.

In the embodiment of the application, the head-mounted electronic equipment and the target electronic equipment carry out Bluetooth and/or Wi-Fi communication based on the first infrared information, the two communication parties do not need to acquire matching information of the other party in advance and execute complex matching operation, the head-mounted electronic equipment can be automatically matched with the target electronic equipment which is unknown in a visual range through the infrared transceiver, and Bluetooth and/or Wi-Fi communication is carried out. Moreover, the form of the head-mounted electronic equipment can ensure point-to-point communication in a complex environment, so that the privacy of the communication process is ensured.

In a possible implementation manner, the first infrared information includes connection configuration information of the head-mounted electronic device; the performing bluetooth and/or Wi-Fi communication with the target electronic device based on the first infrared information includes: receiving and verifying a Bluetooth and/or Wi-Fi connection request sent by the target electronic equipment based on the first infrared information; and when the Bluetooth and/or Wi-Fi connection request passes the verification, establishing Bluetooth and/or Wi-Fi connection with the target electronic equipment, and carrying out Bluetooth and/or Wi-Fi communication.

In the embodiment of the application, the connection configuration information that bluetooth and/or Wi-Fi are connected is established through first infrared information transmission to the head-mounted electronic equipment and target electronic equipment, the both sides of communication need not to acquire the matching information of the other side in advance and carry out loaded down with trivial details matching operation, the head-mounted electronic equipment can realize automatic matching and the high-speed joint with unknown target electronic equipment in the visual range through infrared transceiver, and the operation is simple, and is quick and convenient, and the use of the user is greatly facilitated. Moreover, the form of the head-mounted electronic equipment can ensure point-to-point communication in a complex environment, so that the privacy of the communication process is ensured.

In a possible implementation manner, the user operation is a user voice instruction, and the first infrared information is used to obtain device information of the target electronic device; before the receiving the user operation, the method further includes: establishing Bluetooth and/or Wi-Fi connection with the target electronic equipment; the performing bluetooth and/or Wi-Fi communication with the target electronic device based on the first infrared information includes: receiving the device information of the target electronic device sent by the target electronic device through the Bluetooth and/or Wi-Fi connection; and determining the target electronic equipment according to the equipment information of the target electronic equipment, and indicating the target electronic equipment to respond to the user operation through the Bluetooth and/or Wi-Fi connection.

In the embodiment of the application, the head-mounted electronic equipment acquires the equipment information of the target electronic equipment through the first infrared information, so that the target electronic equipment is determined according to the equipment information, even if the voice instruction of the user does not indicate the target electronic equipment which is remotely controlled, the automatic matching with the target electronic equipment can be realized through the infrared transceiver, the target electronic equipment is rapidly and accurately remotely controlled, the use of the user is greatly facilitated, and the user experience is improved.

In a possible implementation manner, after the sending, by the infrared transceiver, the first infrared information to the target electronic device in response to the user operation, the method further includes: receiving second infrared information sent by the target electronic equipment; the performing bluetooth and/or Wi-Fi communication with the target electronic device based on the first infrared information includes: and carrying out Bluetooth and/or Wi-Fi communication with the target electronic equipment based on the first infrared information and the second infrared information.

In the embodiment of the application, the head-mounted electronic equipment and the target electronic equipment carry out Bluetooth and/or Wi-Fi communication based on the first infrared information and the second infrared information, the two communication parties do not need to acquire matching information of the other party in advance and execute complex matching operation, the head-mounted electronic equipment can be automatically matched with the unknown target electronic equipment in a visual range through the infrared transceiver, Bluetooth and/or Wi-Fi communication is carried out, the operation is simple, the operation is fast and convenient, and great convenience is brought to the use of a user.

In a possible implementation manner, the first infrared information includes connection configuration information of the head-mounted electronic device, and/or the second infrared information includes connection configuration information of the target electronic device; the performing bluetooth and/or Wi-Fi communication with the target electronic device based on the first infrared information and the second infrared information includes: and establishing Bluetooth and/or Wi-Fi connection with the target electronic equipment based on the connection configuration information included in the first infrared information and the second infrared information, and performing Bluetooth and/or Wi-Fi communication.

In the embodiment of the application, the head-mounted electronic equipment and the target electronic equipment are connected based on the Bluetooth and/or the Wi-Fi, the two communication parties do not need to acquire matching information of the other party in advance and execute complex matching operation, the head-mounted electronic equipment can be automatically matched and quickly connected with the target electronic equipment which is unknown in a visual range through the infrared transceiver, and the head-mounted electronic equipment is simple in operation, quick and convenient and greatly facilitates use of a user. Moreover, the form of the head-mounted electronic equipment can ensure point-to-point communication in a complex environment, so that the privacy of the communication process is ensured.

In a possible implementation manner, the user operation is a user voice instruction, the first infrared information is used to obtain device information of the target electronic device, and the second infrared information includes the device information of the target electronic device; before the receiving the user operation, the method further includes: establishing Bluetooth and/or Wi-Fi connection with the target electronic equipment; the performing bluetooth and/or Wi-Fi communication with the target electronic device based on the first infrared information and the second infrared information includes: and determining the target electronic equipment according to the second infrared information, and indicating the target electronic equipment to respond to the user operation through the Bluetooth and/or Wi-Fi connection.

In the embodiment of the application, the head-mounted electronic equipment acquires the equipment information of the target electronic equipment through the first infrared information and the second infrared information, so that the target electronic equipment is determined according to the equipment information, even if the user voice instruction does not indicate the target electronic equipment which is remotely controlled, the automatic matching with the target electronic equipment can be realized through the infrared transceiver, the target electronic equipment is rapidly and accurately remotely controlled, the use of a user is greatly facilitated, and the user experience is improved.

In a second aspect, the present application provides another fast matching method, which is applied to a head-mounted electronic device, where the head-mounted electronic device includes an infrared transceiver, and the method includes: receiving user operation; responding to the user operation, and sending first infrared information to target electronic equipment through the infrared transceiver; the first infrared information is used for the first electronic equipment to carry out Bluetooth and/or Wi-Fi communication with the target electronic equipment; the first electronic device is connected to the head-mounted electronic device.

In the embodiment of the application, the first electronic device and the target electronic device carry out Bluetooth and/or Wi-Fi communication based on the first infrared information, the two communication parties do not need to acquire matching information of the other party in advance and execute complex matching operation, the first electronic device is automatically matched with the unknown target electronic device in a visual range through the infrared transceiver of the head-mounted electronic device, and Bluetooth and/or Wi-Fi communication is carried out. Moreover, the form of the head-mounted electronic equipment can ensure point-to-point communication in a complex environment, so that the privacy of the communication process is ensured.

In a possible implementation manner, the first infrared information includes connection configuration information of the first electronic device; the first infrared information is specifically used for the first electronic device to send a bluetooth and/or Wi-Fi connection request to the target electronic device, so that the first electronic device establishes a bluetooth and/or Wi-Fi connection with the target electronic device and performs bluetooth and/or Wi-Fi communication.

In the embodiment of the application, the first electronic device and the target electronic device establish connection configuration information of Bluetooth and/or Wi-Fi connection through first infrared information transmission, the two communication parties do not need to acquire matching information of the other party in advance and execute complex matching operation, the first electronic device realizes automatic matching and quick connection with the target electronic device which is unknown in a visual range through the infrared transceiver of the head-mounted electronic device, the operation is simple, the operation is quick and convenient, and great convenience is brought to the use of a user. Moreover, the form of the head-mounted electronic equipment can ensure point-to-point communication in a complex environment, so that the privacy of the communication process is ensured.

In a possible implementation manner, the user operation is a user voice instruction, the first electronic device is a device that establishes a bluetooth and/or Wi-Fi connection with the target electronic device, the first infrared information is specifically used to acquire device information of the target electronic device, the device information of the target electronic device is information that is sent to the first electronic device by the target electronic device through the bluetooth and/or Wi-Fi connection, and the device information of the target electronic device is used by the first electronic device to determine the target electronic device, and instruct the target electronic device to respond to the user operation through the bluetooth and/or Wi-Fi connection.

In the embodiment of the application, the first electronic device obtains the device information of the target electronic device through the first infrared information sent by the head-mounted electronic device, so that the target electronic device is determined according to the device information, and even if the voice command of the user does not indicate the target electronic device which is remotely controlled, automatic matching with the target electronic device can be realized, so that the target electronic device is rapidly and accurately remotely controlled, the use of the user is greatly facilitated, and the user experience is improved.

In a possible implementation manner, after the sending, by the infrared transceiver, the first infrared information to the target electronic device in response to the user operation, the method further includes: receiving second infrared information sent by the target electronic equipment; and sending the second infrared information to the first electronic equipment.

In the embodiment of the application, the first electronic device and the target electronic device carry out Bluetooth and/or Wi-Fi communication based on the first infrared information and the second infrared information, the two communication parties do not need to acquire matching information of the other party in advance and execute complex matching operation, the first electronic device realizes automatic matching with the target electronic device which is unknown in a visual range through the infrared transceiver of the head-mounted electronic device, and Bluetooth and/or Wi-Fi communication is carried out.

In a possible implementation manner, the first infrared information includes connection configuration information of the first electronic device, and/or the second infrared information includes connection configuration information of the target electronic device; the first infrared information and/or the second infrared information are specifically used for the first electronic device to establish bluetooth and/or Wi-Fi connection with the target electronic device and perform bluetooth and/or Wi-Fi communication.

In the embodiment of the application, the first electronic device and the target electronic device are connected based on the first infrared information and the second infrared information to establish Bluetooth and/or Wi-Fi, the two communication parties do not need to acquire matching information of the other party in advance and execute complex matching operation, the first electronic device is automatically matched and quickly connected with the target electronic device which is unknown in a visual range through the infrared transceiver of the head-mounted electronic device, the operation is simple, the operation is quick and convenient, and great convenience is brought to the use of a user. Moreover, the form of the head-mounted electronic equipment can ensure point-to-point communication in a complex environment, so that the privacy of the communication process is ensured.

In a possible implementation manner, the user operation is a user voice instruction, the first electronic device is a device that establishes a bluetooth and/or Wi-Fi connection with the target electronic device, the first infrared information is used to obtain device information of the target electronic device, and the second infrared information includes the device information of the target electronic device; the second infrared information is specifically used for the first electronic device to determine the target electronic device, and indicates the target electronic device to respond to the user operation through the bluetooth and/or Wi-Fi connection.

In the embodiment of the application, the first electronic device obtains the device information of the target electronic device through the first infrared information and the second infrared information, so that the target electronic device is determined according to the device information, even if the user voice instruction does not indicate the target electronic device which is remotely controlled, automatic matching with the target electronic device can be achieved, the target electronic device is rapidly and accurately remotely controlled, the use of a user is greatly facilitated, and the user experience is improved.

In a third aspect, an embodiment of the present application provides another fast matching method, which is applied to a head-mounted electronic device, where the head-mounted electronic device includes an infrared transceiver, and the method includes: receiving a user voice instruction; responding to the user voice instruction, and sending first infrared information to target electronic equipment through the infrared transceiver; the first infrared information is used for acquiring equipment information of target electronic equipment, and the head-mounted electronic equipment is connected with the target electronic equipment through a router; receiving the equipment information of the target electronic equipment sent by the target electronic equipment; and determining the target electronic equipment according to the equipment information of the target electronic equipment, and indicating the target electronic equipment to respond to the voice command through the router.

In one possible implementation manner, the device information of the target electronic device is information that is transmitted by the target electronic device to the head-mounted electronic device through infrared rays.

In a possible implementation manner, the device information of the target electronic device is information that is sent by the target electronic device to the head-mounted electronic device through the router.

In a fourth aspect, an embodiment of the present application provides another fast matching method, which is applied to a head-mounted electronic device, where the head-mounted electronic device includes an infrared transceiver, and the method includes: receiving a user voice instruction; responding to the user voice instruction, and sending first infrared information to target electronic equipment through the infrared transceiver; the first infrared information is used for acquiring device information of a target electronic device, the device information of the target electronic device is used for the first electronic device to determine the target electronic device, and the target electronic device is instructed to respond to the user voice command through a router, the first electronic device is connected with the head-mounted electronic device, and the first electronic device and the target electronic device are connected through the router.

In a possible implementation manner, after the sending, by the infrared transceiver, the first infrared information to the target electronic device in response to the user voice instruction, the method further includes: receiving device information of the target electronic device, which is transmitted by the target electronic device through infrared rays; and sending the device information of the target electronic device to the first electronic device.

In a possible implementation manner, the device information of the target electronic device is information that the target electronic device transmits to the first electronic device through the router.

In a fifth aspect, an embodiment of the present application provides another fast matching method, which is applied to a head-mounted electronic device, where the head-mounted electronic device includes an infrared transceiver, and the method includes: receiving a user voice instruction; responding to the user voice instruction, and sending first infrared information to target electronic equipment through the infrared transceiver; the first infrared information is used for indicating the target electronic device receiving the first infrared information to respond to the user voice instruction, and the target electronic device is one of at least one electronic device connected with the head-mounted electronic device through a router.

In the embodiment of the application, even if the plurality of electronic devices can receive and recognize the voice command of the user, only the target electronic device receiving the first infrared information sent by the head-mounted electronic device responds to the voice command of the user, so that the situation that the plurality of electronic devices respond to the voice command of the user can be avoided, the target electronic device can be rapidly and accurately remotely controlled, the use of the user is greatly facilitated, and the user experience is improved.

In a sixth aspect, an embodiment of the present application provides a head-mounted electronic device, including a transceiver, a processor, and a memory, where the memory is used to store a computer program, and the processor calls the computer program to perform the fast matching method provided in any one of the implementation manners of the first aspect to the fifth aspect and the first aspect to the fifth aspect of the embodiment of the present application.

In a seventh aspect, an embodiment of the present application provides a computer storage medium, where the computer storage medium stores a computer program, where the computer program includes program instructions, and when the program instructions are executed by a processor, the computer program is configured to execute the fast matching method provided in any one implementation manner of the first aspect to the fifth aspect and the first aspect to the fifth aspect of the embodiment of the present application.

In an eighth aspect, an embodiment of the present application provides a computer program product, which when run on an electronic device, causes the electronic device to execute a fast matching method provided in any one implementation manner of the first aspect to the fifth aspect and the first aspect to the fifth aspect of the present application.

It is to be understood that the head-mounted electronic device provided in the sixth aspect, the computer storage medium provided in the seventh aspect, and the computer program product provided in the eighth aspect are all configured to perform the fast matching method provided in the first to fifth aspects, and therefore, the beneficial effects achieved by the method can refer to the beneficial effects in the fast matching method provided in the first to fifth aspects, and are not described herein again.

Drawings

The drawings used in the embodiments of the present application are described below.

Fig. 1 is a schematic structural diagram of a head-mounted electronic device according to an embodiment of the present application;

FIGS. 2 a-2 d are schematic diagrams of some human-computer interactions in a call scenario provided by an embodiment of the present application;

3 a-3 e are schematic diagrams of some human-computer interactions in a remote control scenario provided by an embodiment of the application;

FIG. 4 is a schematic diagram of human-computer interaction provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of yet another human-machine interaction provided by an embodiment of the application;

fig. 6 is a schematic flowchart of a fast matching method provided in an embodiment of the present application;

fig. 7 is a schematic flowchart of another fast matching method provided in the embodiment of the present application.

Detailed Description

The embodiments of the present application will be described below with reference to the drawings. The terminology used in the description of the embodiments herein is for the purpose of describing particular embodiments herein only and is not intended to be limiting of the application.

An electronic device related to an embodiment of the present application is described. The electronic device may be a head-mounted electronic device, for example, the head-mounted electronic device may be smart glasses, Augmented Reality (AR) glasses, goggles, earphones, a microphone, and the like. The user can wear the head-mounted electronic equipment to realize the function of communicating with another user wearing the head-mounted electronic equipment, and the user can also wear the head-mounted electronic equipment to realize the function of remotely controlling the intelligent household equipment. The smart home devices may be, but are not limited to, smart speakers, smart desk lamps, air purifiers, smart lamps, smart fat scales, smart refrigerators, smart air conditioners, smart washing machines, smart water heaters, smart microwaves, smart curtains, smart fans, smart televisions, smart set-top boxes, and the like.

It can be understood that the embodiment of the present application is described by taking the electronic device as a head-mounted electronic device as an example, but the embodiment of the present application is not limited to the head-mounted electronic device, and the electronic device may also be other devices.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a head-mounted electronic device according to an embodiment of the present disclosure.

As shown in fig. 1, the head-mounted electronic device 100 may include a processor 110, a memory 120, a sensor module 130, an audio module 140, keys 150, an input/output interface 160, a communication module 170, a charging management module 190, a power management module 191, a battery 192, a display 1100, and the like. Among them, the sensor module 130 may include a sound detector 131, a touch sensor 132, a proximity light sensor 133, a distance sensor, a gyro sensor, an ambient light sensor, an acceleration sensor, a temperature sensor, and the like. The audio module 140 may include a microphone 141 and a receiver 142.

It is to be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation to the head-mounted electronic device 100. In other embodiments of the present application, the head-mounted electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.

The controller may be, among other things, a neural center and a command center of the head-mounted electronic device 100. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, a Serial Peripheral Interface (SPI) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2C interface is a bi-directional synchronous serial bus that includes a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the sound detector 131, the battery 190, the microphone 141, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the sound detector 131 through an I2C interface, so that the processor 110 and the sound detector 131 communicate through an I2C bus interface to acquire a voice signal of a user, thereby establishing/canceling a communication connection, remotely controlling smart home devices, and the like according to the voice signal. The SPI interface may be used for connection between the processor and the sensor.

The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 with the communication module 170. For example: the processor 110 communicates with a bluetooth module in the communication module 170 through a UART interface to implement a bluetooth function.

The MIPI interface may be used to connect the processor 110 with peripheral devices such as the display 1100, cameras, etc. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like. In some embodiments, the processor 110 and the camera communicate through a CSI interface to implement the capture function of the head-mounted electronic device 100. The processor 110 and the display screen 1100 communicate through the DSI interface to implement the display function of the head-mounted electronic device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the display 1100, the communication module 170, the sensor module 130, the audio module 140, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

The USB interface 180 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 180 may be used to connect a charger to charge the head-mounted electronic device 100, and may also be used to transmit data between the head-mounted electronic device 100 and a peripheral device. And the earphone can also be used for connecting an earphone and playing audio through the earphone. The interface can also be used for connecting other electronic equipment, such as mobile phones and the like. The USB interface may be USB3.0, and is configured to be compatible with Display Port (DP) signaling, and may transmit video and audio high-speed data.

It should be understood that the interface connection relationship between the modules according to the embodiment of the present invention is only illustrative, and does not form a structural limitation on the first electronic device 11. In other embodiments of the present application, the first electronic device 11 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The memory 120 may be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications of the head mounted electronic device 100 and data processing by executing instructions stored in the memory 120. The memory 120 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The data storage area may store data (such as audio data, phone book, etc.) created during use of the head-mounted electronic device 100, and the like. Further, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

The sound detector 131 may detect and process a voice signal for controlling the head-mounted electronic device 100. In some embodiments, the voice signal sent by the user 200 to control the headset electronic device 100 to establish/cancel a communication connection, remotely control a smart home device, turn on/off, and the like may be acquired by the sound detector 131.

A touch sensor 132. The touch sensor 132 may be disposed on the key 150, and the touch sensor 132 and the key 150 form a touch key. The touch sensor 132 is used to detect a touch operation applied thereto or nearby. The touch sensor 132 may communicate the detected touch operation to the application processor to determine the touch event type. In other embodiments, the touch sensor 132 may be disposed on the surface of the head-mounted electronic device 100 at a different position than the position of the key 150.

The proximity light sensor 133 may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The head-mounted electronic device 100 emits infrared light to the outside through the light emitting diode. The head-mounted electronic device 100 detects infrared reflected light from a nearby object using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the head-mounted electronic device 100. When insufficient reflected light is detected, the head-mounted electronic device 100 may determine that there is no object near the head-mounted electronic device 100. The head-mounted electronic device 100 can detect the gesture operation of a specific position of the head-mounted electronic device 100 by using the proximity light sensor 133 to achieve the purpose that the gesture operation is associated with the operation command.

A distance sensor for measuring a distance. The head mounted electronic device 100 may measure the distance by infrared or laser. In some embodiments, the head mounted electronic device 100 may utilize range sensor ranging to achieve fast focus.

The gyroscope sensors may be used to determine the motion pose of the head mounted electronic device 100. In some embodiments, the angular velocity of the head-mounted electronic device 100 about three axes (i.e., x, y, and z axes) may be determined by a gyroscope sensor. The gyroscope sensor can also be used for navigation and body feeling game scenes.

The ambient light sensor is used for sensing the ambient light brightness. The head-mounted electronic device 100 may adaptively adjust the brightness of the display 1100 based on the perceived ambient light level. The ambient light sensor can also be used to automatically adjust the white balance when taking a picture.

The acceleration sensor may detect the magnitude of acceleration of the head-mounted electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the head mounted electronic device 100 is stationary. The method can also be used for recognizing the posture of the head-mounted electronic equipment, and is applied to applications such as pedometers and the like.

The temperature sensor is used for detecting temperature. In some embodiments, the head mounted electronic device 100 implements a temperature processing strategy using the temperature detected by the temperature sensor. For example, when the temperature reported by the temperature sensor exceeds a threshold, the head-mounted electronic device 100 performs a reduction in performance of a processor located near the temperature sensor, so as to reduce power consumption and implement thermal protection. In other embodiments, the head mounted electronic device 100 heats the battery 192 when the temperature is below another threshold to avoid the low temperature causing the head mounted electronic device 100 to shut down abnormally. In other embodiments, when the temperature is below a further threshold, the head-mounted electronic device 100 performs a boost on the output voltage of the battery 192 to avoid an abnormal shutdown due to low temperature.

The headset electronic device 100 may implement audio functions via the audio module 140, the microphone 142, the receiver 142, the speaker, the headphone interface, and the application processor. Such as music playing, recording, etc.

The audio module 140 is used to convert digital audio information into analog audio signal output and also used to convert analog audio input into digital audio signal. The audio module 140 may also be used to encode and decode audio signals. In some embodiments, the audio module 140 may be disposed in the processor 110, or some functional modules of the audio module 140 may be disposed in the processor 110.

Speakers, also known as "horns," are used to convert electrical audio signals into speech signals. The head-mounted electronic device 100 can listen to music through a speaker or listen to a hands-free conversation.

The microphone 141, also called "microphone", is used to convert a voice signal into an electrical signal. When establishing a communication connection, remotely controlling the smart home device, and transmitting voice information, the user may approach the microphone 141 through the mouth to make a sound, and input a voice signal to the microphone 141. The head mounted electronic device 100 may be provided with at least one microphone 141. In other embodiments, the head-mounted electronic device 100 may be provided with two microphones 141, which may implement a noise reduction function in addition to collecting voice signals. In other embodiments, three, four or more microphones 141 may be further disposed on the head-mounted electronic device 100 to collect voice signals, reduce noise, identify sound sources, perform directional recording, and so on.

The receiver 142, also called "handset", is used to convert the audio electrical signal into a speech signal. When the head-mounted electronic device 100 receives voice information, voice can be received by placing the receiver 142 close to the ear.

In some embodiments, the sound detector 131 may include a microphone 141. The processor 110 may be configured to receive a voice signal from the microphone 141; upon receiving the voice signal, the processor 110 may operate the sound detector 131 to recognize the corresponding voice command. For example, when receiving a voice instruction to initiate a communication connection, the head-mounted electronic device 100 may turn on the infrared transceiver 1721 in the wireless communication module 172 and transmit communication request information through the infrared transceiver 1721.

The earphone interface is used for connecting a wired earphone. The headset interface may be a USB interface 180, or may be an open mobile electronic device platform (OMTP) standard interface of 3.5mm, or a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

It is understood that the positions and numbers of the microphones 141 and the receivers 142 on the head-mounted electronic device 100 shown in fig. 1 are only used for explaining the embodiments of the present application and should not be construed as limiting.

In some embodiments, the head mounted electronic device 100 may include one or more keys 150 that may control the head mounted electronic device 100 to provide the user with access to functions on the head mounted electronic device 100. For example, the user 200 may turn on a call function or a remote control function of the head-mounted electronic apparatus 100 by pressing a key. Keys 150 may be in the form of buttons, switches, dials, and touch or proximity touch sensitive devices (e.g., touch sensors). The keys 150 may be mechanical keys. Or may be touch keys.

Specifically, the keys 150 may include a power-on key, a volume key, and the like. The head mounted electronic device 100 may receive key inputs, generate key signal inputs related to user settings and function control of the head mounted electronic device 100. The keys 150 may also include indicators, which may be indicator lights, which may be used to indicate a charging status, a change in charge, or may be used to indicate a message, missed call, notification, etc.

In some embodiments, the head mounted electronic device 100 may include an input-output interface 160, and the input-output interface 160 may connect other apparatuses to the head mounted electronic device 100 through suitable components. The components may include, for example, audio/video jacks, data connectors, and the like.

In addition, the head mounted electronic device 100 may include wireless communication functionality. The communication module 170 may include a mobile communication module 171 and a wireless communication module. The wireless communication function may be realized by an antenna (not shown), a mobile communication module 171, a wireless communication module 172, a modem processor (not shown), a baseband processor (not shown), and the like.

The antenna is used for transmitting and receiving electromagnetic wave signals. Multiple antennas may be included in the head-mounted electronic device 100, each of which may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 171 may provide a solution including wireless communication of 2G/3G/4G/5G, etc. applied to the head-mounted electronic device 100. The mobile communication module 171 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 171 may receive electromagnetic waves from an antenna, filter, amplify, etc. the received electromagnetic waves, and transmit the electromagnetic waves to a modem processor for demodulation. The mobile communication module 171 can also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 171 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 171 may be disposed in the same device as at least some of the modules of the processor 110.

In some embodiments, the antenna of the head-mounted electronic device 100 is coupled with the mobile communication module 171 so that the head-mounted electronic device 100 can communicate with networks and other devices through wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), Long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a voice signal through an audio device (not limited to a speaker, etc.) or displays an image or video through the display screen 1100. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 171 or other functional modules, independent of the processor 110.

The wireless communication module 172 may provide a solution for wireless communication applied to the head-mounted electronic device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 172 may be one or more devices integrating at least one communication processing module. The wireless communication module receives electromagnetic waves via the antenna 172, performs frequency modulation and filtering on electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 172 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves via the antenna for radiation.

In some embodiments, the wireless communication module 172 may include sub-modules such as a Wi-Fi module to enable Wi-Fi wireless communication, a Bluetooth module to enable Bluetooth wireless communication, an infrared module to enable wireless communication via infrared technology, and so on. Wherein the infrared module may include at least one infrared transceiver 1721. The infrared transceiver 1721 may transmit data via infrared. Wherein, the infrared ray can be divided into near infrared ray, middle infrared ray and far infrared ray according to different wavelength ranges.

The infrared transceiver 1721 may be one or more devices that integrate at least one infrared receiver and/or infrared transmitter. The infrared transceiver 1721 may transmit infrared light or receive infrared light transmitted by another infrared transceiver or an infrared transmitter. Alternatively, the infrared transceiver 1721 may emit infrared light in a fixed direction. Optionally, the direction in which the infrared transceiver 1721 emits infrared light may also be adjusted. For example, the head-mounted electronic device 100 transmits infrared rays for acquiring device information of the intelligent table lamp to the intelligent table lamp within a visible range through the infrared transceiver 1721; in response to the infrared ray for acquiring the device information of the intelligent desk lamp, the intelligent desk lamp transmits the device information of the intelligent desk lamp to the head-mounted electronic device 100.

It is understood that the position and number of the infrared transceivers 1721 on the head-mounted electronic device 100 shown in fig. 1 are only used for explaining the embodiments of the present application and should not be construed as limiting.

The head mounted electronic device 100 implements display functions via the GPU, the display 1100, and the application processor, etc. The GPU is a microprocessor for image processing, connected to the display 1100 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 1100 is used to display images, videos, and the like. The display screen 1100 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like.

When the head-mounted electronic device is mounted on the head of a user, the user's eyes can see images presented by the display screen of the head-mounted electronic device. In the case where the display screen is transparent, the user's eyes may see the physical object through the display screen, or the user's eyes may see the image displayed by another display device through the display screen.

The number of the display screens 1100 in the head-mounted electronic device 100 may be two, respectively corresponding to two eyeballs of the user 200. The content displayed on the two display screens can be displayed independently. Different images can be displayed on the two display screens to improve the stereoscopic impression of the images. In some possible embodiments, the number of the display screens 1100 in the head-mounted electronic device 100 may also be one to correspond to two eyes of the user 200.

The head-mounted electronic device 100 may implement a shooting function through an ISP, a camera, a video codec, a GPU, a display 1100, an application processor, and the like.

The ISP is used for processing data fed back by the camera. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera.

The camera is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to be converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the head mounted electronic device 100 may include 1 or N cameras, N being a positive integer greater than 1.

For example, the camera may be mounted on the side of the head-mounted electronic device 100, and may also be mounted on the head-mounted electronic device 100 at a position between two display screens. The camera is used to capture images and video in real time within the perspective of the user 200. The head-mounted electronic device 100 generates a virtual image from the captured real-time image and video and displays the virtual image through the display screen 1100.

The processor 110 may determine a virtual image displayed on the display screen 1100 from a still image or a video image captured by the camera in combination with data (e.g., brightness, sound, etc.) acquired by the sensor module 130 to superimpose the virtual image on the real-world object.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the head-mounted electronic device 100 selects a frequency point, the digital signal processor is used for performing fourier transform or the like on the frequency point energy.

Video codecs are used to compress or decompress digital video. The head mounted electronic device 100 may support one or more video codecs. In this way, the head-mounted electronic device 100 can play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. Applications such as intelligent recognition of the head-mounted electronic device 100 can be realized by the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The charging management module 190 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 190 may receive charging input from a wired charger via the USB interface 180. In some wireless charging embodiments, the charging management module 190 may receive a wireless charging input through a wireless charging coil of the head-mounted electronic device 100. The charging management module 190 may also supply power to the head-mounted electronic device 100 through the power management module 191 while charging the battery 192.

The power management module 191 is used to connect the battery 192, the charging management module 190 and the processor 110. The power management module 191 receives input from the battery 192 and/or the charging management module 190 and provides power to the processor 110, the memory 120, the display 1100, the camera, the wireless communication module 170, and the like. The power management module 191 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In some other embodiments, the power management module 191 may also be disposed in the processor 110. In other embodiments, the power management module 191 and the charging management module 190 may be disposed in the same device.

In order to enable a user to conveniently and quickly perform bluetooth and/or Wi-Fi communication through a head-mounted electronic device, embodiments of the present application provide a fast matching method applied to the head-mounted electronic device. Examples provided by embodiments of the present application are described below.

A call scenario is introduced below: the user 200A wears the head-mounted electronic device 100A, the user 200B wears the head-mounted electronic device 100B, and the user 200B wants to perform a voice call with the user 200A within the visible range. Referring to fig. 2a and 2b, fig. 2a and 2b are schematic diagrams of some human-computer interactions in a call scenario provided by an embodiment of the present application.

As shown in fig. 2a, the user 200B can see the user 200A wearing the head-mounted electronic device 100A through the head-mounted electronic device 100B, and the user 200A can also see the user 200B wearing the head-mounted electronic device 100B through the head-mounted electronic device 100A. The data can be transmitted between the head-mounted electronic apparatus 100A and the head-mounted electronic apparatus 100B by infrared rays. The head mounted electronic device 100A may be an unknown object to the head mounted electronic device 100B, i.e., the memory of the head mounted electronic device 100B does not store the device information of the head mounted electronic device 100A; the head-mounted electronic device 100B may be an unknown object to the head-mounted electronic device 100A, that is, the memory of the head-mounted electronic device 100A does not store the device information of the head-mounted electronic device 100B.

As shown in fig. 2a, the head-mounted electronic device 100B receives a voice signal from the user 200B through the microphone, for example, the voice signal is in a language of "call request". The processor in the head-mounted electronic device 100B operates the sound detector to recognize a voice command corresponding to the voice signal, and in response to the voice command, sends a call request message using the infrared transceiver on the head-mounted electronic device 100B, where the call request message may include connection configuration information of bluetooth and/or Wi-Fi of the head-mounted electronic device 100B.

In some embodiments, the infrared transceiver of the head mounted electronic device 100B emits infrared light in a fixed direction. The user 200B may adjust the position of the head if the user 200B wants to communicate with the user 200A, for example, the user 200B shown in fig. 2a and 2B faces the user 200A, so that the head-mounted electronic device 100A can receive the call request information.

In some embodiments, the direction in which the infrared transceiver of the head mounted electronic device 100B emits infrared light may be adjusted. Alternatively, the head-mounted electronic device 100B may determine the direction of emitting the infrared rays according to a preset rule, for example, by default, the infrared rays are emitted in a straight line. Alternatively, the head-mounted electronic device 100B may also determine the direction of emitting infrared rays according to the behavior of the user, for example, detect and determine the focusing direction of the eyeball of the user 200B through a focal length detection optical sensor in the camera and the sensor module, and use the focusing direction as the direction of emitting infrared rays. The embodiment of the present application does not limit the manner of determining the direction in which the infrared ray is emitted.

As shown in fig. 2a, the head-mounted electronic device 100A receives the call request information through the infrared transceiver, and then the head-mounted electronic device 100A sends a voice prompt corresponding to the call request information to the user 200A through the receiver, or the head-mounted electronic device 100A displays a text prompt corresponding to the call request information to the user 200A. The user 200A may perform an operation on a key on the head mounted electronic device 100A to accept or reject the call request of the head mounted electronic device 100B, for example, performing a click operation on the key may indicate accepting the call request of the head mounted electronic device 100B, and performing a click operation on the key twice may indicate rejecting the call request of the head mounted electronic device 100B.

In the embodiment of the present application, only the head-mounted electronic device 100B is taken as an example of an electronic device that transmits call request information to the head-mounted electronic device 100A. However, in a specific implementation, there may be other electronic devices that transmit the call request information to the head-mounted electronic device 100A. Alternatively, the head-mounted electronic device 100A may determine the electronic device that accepts the call request according to a preset rule, for example, determine that the electronic device that first sends the call request information is the electronic device that accepts the call request. Alternatively, the head-mounted electronic device 100A may also determine the electronic device that accepts the call request according to the behavior of the user, for example, display device information of the electronic device that transmits the call request information on a display screen of the head-mounted electronic device 100A for selection by the user 200A, and determine the electronic device that accepts the call request according to a result of the selection by the user 200A. The embodiment of the present application does not limit this.

Fig. 2a illustrates an example of accepting or rejecting a call request of the head-mounted electronic device 100B by performing the above-described operation on the key of the head-mounted electronic device 100A. If the user 200A clicks a key on the head-mounted electronic device 100A twice, the head-mounted electronic device 100A detects the operation through the touch sensor and reports the operation to the processor in the head-mounted electronic device 100A, and the processor responds to the operation and sends call rejection information to the head-mounted electronic device 100B by using the infrared transceiver on the head-mounted electronic device 100A. If the user 200A clicks a key on the head-mounted electronic device 100A once, the head-mounted electronic device 100A detects the operation through the touch sensor and reports the operation to the processor in the head-mounted electronic device 100A, and the processor responds to the operation and sends the call acceptance information to the head-mounted electronic device 100B by using the infrared transceiver on the head-mounted electronic device 100A.

The example of the user 200A clicking a button on the head-mounted electronic device 100A is illustrated in fig. 2a, and the call acceptance information may include connection configuration information of bluetooth and/or Wi-Fi of the head-mounted electronic device 100A. The connection configuration information includes, but is not limited to, a bluetooth address and a pairing password, and/or a Wi-Fi name and an access password, a connection permission period, and the like.

As shown in fig. 2a, the headset electronic device 100B receives the call acceptance information through the infrared transceiver, and then based on the call request information and the connection configuration information included in the call acceptance information, the headset electronic device 100A and the headset electronic device 100B establish a bluetooth and/or Wi-Fi connection and transmit data through a bluetooth module and/or a Wi-Fi module in the wireless communication module. The Bluetooth and/or Wi-Fi communication connection and data transmission are established through the electronic equipment in the form of the head-mounted electronic equipment, so that the point-to-point communication in a complex environment can be ensured, and the privacy of the communication process is ensured. The data may be, but not limited to, voice data, text data, image data, file data, etc.; the user can view the data through a display screen or a virtual display interface of the head-mounted electronic device or an electronic device connected with the head-mounted electronic device.

In this embodiment of the application, after the head-mounted electronic device 100B receives the call acceptance information, the head-mounted electronic device 100B may actively initiate bluetooth and/or Wi-Fi connection, which may be specifically referred to as the following case one; a bluetooth and/or Wi-Fi connection may also be actively initiated by the head-mounted electronic device 100A, as described in the following case two.

The first condition is as follows: a bluetooth and/or Wi-Fi connection is initiated by the head mounted electronic device 100B to the head mounted electronic device 100A.

Specifically, the head-mounted electronic device 100B may send the bluetooth connection request and/or the Wi-Fi connection request to the head-mounted electronic device 100A through a bluetooth module and/or a Wi-Fi module in the wireless communication module according to the connection configuration information of the head-mounted electronic device 100A included in the call acceptance information. The head-mounted electronic device 100A may verify whether the connection configuration information included in the connection request is consistent with the connection configuration information of the head-mounted electronic device 100A, and if so, the verification is passed, and the connection request is accepted, so that the bluetooth and/or Wi-Fi connection is successfully established; if not, the verification is not passed, the connection request is rejected, and the Bluetooth and/or Wi-Fi connection is failed to be established. Optionally, the head-mounted electronic device 100A may further verify whether information of the electronic device that sent the connection request is consistent with information of the head-mounted electronic device 100B in the call request information, and if so, verify connection configuration information included in the connection request; if not, the verification is not passed, the connection request is rejected, and the Bluetooth and/or Wi-Fi connection is failed to be established.

For example, the call request information includes a bluetooth address of the head-mounted electronic device 100B, such as a physical address (MAC), an Internet Protocol (IP) address, and the like; the call acceptance information includes the bluetooth address of the head-mounted electronic device 100A, the pairing password, and the permitted access period. The head-mounted electronic device 100B sends a bluetooth connection request to the bluetooth address of the head-mounted electronic device 100A through the bluetooth module in the access permission period, and transmits a corresponding pairing password. In a case where it is determined that the time of receiving the connection request is within the permitted access period, and it is determined that the bluetooth address of the device that transmitted the connection request is the bluetooth address of the head-mounted electronic device 100B in the call request information, the head-mounted electronic device 100A verifies the pairing password. When the pairing password passes the verification, the head-mounted electronic device 100A receives the connection request, and the bluetooth connection is successfully established, so that the subsequent head-mounted electronic device 100A and the subsequent head-mounted electronic device 100B may transmit data through the bluetooth module. If the time of receiving the connection request is not within the allowed access period and the bluetooth address sending the bluetooth request is not the bluetooth address of the head-mounted electronic device 100B in the call request information and/or the verification pairing password is not passed, the head-mounted electronic device 100A rejects the connection request, and the bluetooth connection establishment fails.

Case two: a bluetooth and/or Wi-Fi connection is initiated by the head mounted electronic device 100A to the head mounted electronic device 100B.

The head-mounted electronic device 100A may send a bluetooth connection request and/or a Wi-Fi connection request to the head-mounted electronic device 100B through a bluetooth module and/or a Wi-Fi module in the wireless communication module according to the connection configuration information of the head-mounted electronic device 100B included in the call request information. The head-mounted electronic device 100B may verify whether the connection configuration information included in the connection request is consistent with the connection configuration information of the head-mounted electronic device 100B, and if so, the connection request is accepted after the verification is passed, so that the bluetooth and/or Wi-Fi connection is successfully established; if not, the verification is not passed, the connection request is rejected, and the Bluetooth and/or Wi-Fi connection is failed to be established.

In the embodiment of the present application, the time when the bluetooth module and/or the Wi-Fi module are turned on by the head-mounted electronic device to discover the surrounding electronic devices is not limited. Alternatively, the head-mounted electronic device 100A and the head-mounted electronic device 100B may turn on the bluetooth module and/or the Wi-Fi module to actively discover the surrounding electronic devices before the processor responds to the instruction corresponding to the voice signal sent by the user 200B. Optionally, the processor in the head-mounted electronic device 100B responds to the instruction corresponding to the voice signal sent by the user 200B, and not only sends the call request information to the head-mounted electronic device 100A by using the infrared transceiver, but also starts the bluetooth module and/or the Wi-Fi module to discover the surrounding electronic devices. In response to the user 200A clicking a key operation on the head-mounted electronic device 100A once, the processor of the head-mounted electronic device 100A not only sends call acceptance information to the head-mounted electronic device 100B using the infrared transceiver of the head-mounted electronic device 100A, but also turns on the bluetooth module and/or the Wi-Fi module to discover surrounding electronic devices; in response to the user 200A clicking twice the key operation on the head-mounted electronic device 100A, the infrared transceiver of the head-mounted electronic device 100A is only utilized to send the call rejection information to the head-mounted electronic device 100B, but the bluetooth module and/or the Wi-Fi module is not turned on.

In some embodiments, as shown in fig. 2B, the call request information may include detailed configuration information of the head-mounted electronic device 100B, such as a bluetooth address, a pairing password, and an allowed access period of the head-mounted electronic device 100B. After the headset electronic device 100A receives the call request information through the infrared transceiver, if the user 200A clicks a key on the headset electronic device 100A once, the processor of the headset electronic device 100A responds to the operation, and may send a bluetooth connection request and/or a Wi-Fi connection request to the headset electronic device 100B through the bluetooth module and/or the Wi-Fi module according to the connection configuration information in the call request information without sending call acceptance information through the infrared transceiver of the headset electronic device 100A. The head-mounted electronic device 100B verifies whether the connection configuration information included in the connection request is consistent with the connection configuration information of the head-mounted electronic device 100B, if so, the verification is passed, the connection request is accepted, the bluetooth and/or Wi-Fi connection is successfully established, and data can be transmitted based on the connection subsequently; if not, the verification is not passed, the connection request is rejected, and the Bluetooth and/or Wi-Fi connection establishment fails.

For example, the head-mounted electronic device 100A sends a bluetooth connection request to the bluetooth address of the head-mounted electronic device 100B through the bluetooth module in the access permission period, and transmits the corresponding pairing password. The head-mounted electronic device 100B receives the bluetooth connection request when determining that the time of sending the bluetooth connection request is within the allowed access period and verifying that the pairing password passes, so that the bluetooth connection is successfully established, and the subsequent head-mounted electronic device 100A and the subsequent head-mounted electronic device 100B can transmit data through the bluetooth module; and under the condition that the moment of sending the Bluetooth connection request is determined not to be in the allowed access period and/or the pairing password is verified not to pass, rejecting the Bluetooth connection request and failing to establish the Bluetooth connection.

After the head-mounted electronic device 100A receives the call request information through the infrared transceiver, if the user 200A clicks a key on the head-mounted electronic device 100A twice, the processor of the head-mounted electronic device 100A may not send any response information to the head-mounted electronic device 100B in response to the operation, and may not actively establish a bluetooth and/or Wi-Fi connection.

In some embodiments, the head-mounted electronic device may also be connected to other electronic devices, e.g., a smart watch, a smart bracelet, a smart phone, in a wired or wireless manner.

Next, another call scenario is described by taking the smart phone as the above other electronic device as an example: the user 200A wears the head-mounted electronic device 100A, and the head-mounted electronic device 100A is connected with the smartphone 300A through a bluetooth module and/or a Wi-Fi module in the wireless communication module. The user 200B wears the head-mounted electronic device 100B, and the head-mounted electronic device 100B is connected to the smartphone 300B through a bluetooth module and/or a Wi-Fi module in the wireless communication module. The user 200B wants to make a voice call with the user 200A within the visual range. Referring to fig. 2c and fig. 2d, fig. 2c and fig. 2d are schematic diagrams of other human-computer interactions in a call scenario provided by an embodiment of the present application.

As shown in fig. 2c, the user 200B can see the user 200A wearing the head-mounted electronic device 100A through the head-mounted electronic device 100B, and the user 200A can also see the user 200B wearing the head-mounted electronic device 100B through the head-mounted electronic device 100A. The information can be transmitted between the head-mounted electronic device 100A and the head-mounted electronic device 100B by infrared rays, but the head-mounted electronic device 100A may be an unknown object to the head-mounted electronic device 100B, that is, the device information of the head-mounted electronic device 100A is not stored in the memory of the head-mounted electronic device 100B; the head-mounted electronic device 100B may be an unknown object to the head-mounted electronic device 100A, that is, the memory of the head-mounted electronic device 100A does not store the device information of the head-mounted electronic device 100B.

The example in which the user 200B performs a pressing operation on a key on the head-mounted electronic apparatus 100B to initiate a communication connection will be described. The head-mounted electronic device 100B detects the pressing operation on the key through the touch sensor and reports to the processor in the head-mounted electronic device 100B, and the processor responds to the operation by sending call request information through the infrared transceiver on the head-mounted electronic device 100B, wherein the call request information may include connection configuration information of bluetooth and/or Wi-Fi of the smart phone 300B. For the description of the head-mounted electronic device 100B determining the direction in which the infrared transceiver of the head-mounted electronic device 100B emits the infrared ray, refer to the description of fig. 2a, and are not described herein again.

As shown in fig. 2c, the head-mounted electronic device 100A receives the call request information through the infrared transceiver and sends the connection configuration information therein to the smart phone 300A. Then, the head-mounted electronic device 100A sends a voice prompt corresponding to the call request information through a telephone receiver, or the head-mounted electronic device 100A displays a text prompt corresponding to the call request information to the user 200A, so that the user 200A can send a voice signal to accept or reject the call request of the head-mounted electronic device 100B; the head-mounted electronic device 100A receives the voice signal through the microphone and sends the voice signal to the smart phone 300A, and the smart phone 300A recognizes a voice instruction corresponding to the voice signal and sends the voice instruction to the head-mounted electronic device 100A. If the voice instruction is used to indicate that the call request of the head-mounted electronic device 100B is rejected, the head-mounted electronic device 100A sends call rejection information to the head-mounted electronic device 100B by using the infrared transceiver in response to the voice instruction. If the voice instruction is used to instruct to accept the call request of the head-mounted electronic device 100B, the head-mounted electronic device 100A sends call acceptance information to the head-mounted electronic device 100B by using the infrared transceiver in response to the voice instruction.

In the embodiment of the present application, only the head-mounted electronic device 100B is taken as an example of an electronic device that transmits call request information to the head-mounted electronic device 100A. However, in a specific implementation, there may be other electronic devices that send the call request information to the head-mounted electronic device 100A, and how the head-mounted electronic device 100A determines the electronic device that receives the call request information may refer to the description of fig. 2a, which is not described herein again.

Fig. 2c illustrates an example of the voice command being used to indicate that the call request of the head-mounted electronic device 100B is accepted, and the call acceptance information may include connection configuration information of bluetooth and/or Wi-Fi of the smartphone 300A. The connection configuration information of the bluetooth and/or Wi-Fi of the smart phone in the call request information and the call acceptance information may be sent to the head-mounted electronic device by the smart phone through the bluetooth and/or Wi-Fi. The connection configuration information includes, but is not limited to, a bluetooth address and pairing password, a Wi-Fi name and access password, a connection permission period, and the like.

The head-mounted electronic device 100B receives the call acceptance information through the infrared transceiver and transmits connection configuration information thereof to the smartphone 300B. Then, based on the connection configuration information included in the call request information and the call acceptance information, the smart phone 300A and the smart phone 300B establish a bluetooth and/or Wi-Fi connection and transmit data. The data may be, but not limited to, voice data, text data, image data, file data, etc.; the user can view the data through a display screen or a virtual display interface of the head-mounted electronic device or an electronic device connected with the head-mounted electronic device.

In the embodiment of the present application, the smart phone 300B may actively initiate a bluetooth and/or Wi-Fi connection to the smart phone 300A, and a specific process is similar to the case in fig. 2 a; the smart phone 300A may also actively initiate a bluetooth and/or Wi-Fi connection to the smart phone 300B, and the specific process is similar to the case two in fig. 2a, which is not described herein again. After the bluetooth and/or Wi-Fi connection between the smart phone 300A and the smart phone 300B is successfully established, the head-mounted electronic device 100A and the head-mounted electronic device 100B may be used as a receiver, a microphone and/or a display device, and the bluetooth and/or Wi-Fi connection and data transmission are established through the electronic device in the form of the head-mounted electronic device, so that the point-to-point communication in a complex environment can be ensured, and the privacy of the communication process can be ensured.

In the embodiment of the present application, the time when the smartphone turns on bluetooth and/or Wi-Fi to discover surrounding electronic devices is not limited. Alternatively, the

smart phones

300A and 300B may turn on bluetooth to actively discover surrounding electronic devices before the user 200B performs a pressing operation on a key on the head-mounted electronic device 100B. Optionally, the processor in the head-mounted electronic device 100B responds to the pressing operation of the key performed by the user 200B, and not only sends the call request information to the head-mounted electronic device 100A by using the infrared transceiver, but also informs the smart phone 300B, so that the smart phone 300B starts bluetooth to discover surrounding electronic devices. The smart phone 300A receives the voice signal and recognizes a corresponding voice instruction, and if the voice instruction is used for instructing to receive a call request of the head-mounted electronic device 100B, the smart phone 300A not only sends call receiving information to the smart phone 300B by using the infrared transceiver, but also starts bluetooth and/or Wi-Fi to discover surrounding electronic devices; if the voice command is used to indicate that the call request of the head-mounted electronic device 100B is rejected, the smart phone 300A sends call rejection information to the smart phone 300B only by using the infrared transceiver, but does not turn on bluetooth and/or Wi-Fi.

In some embodiments, as shown in fig. 2d, the call request information may include detailed configuration information of the smartphone 300B, such as a bluetooth address, a pairing password, and an allowed access period of the smartphone 300B. After the head-mounted electronic device 100A receives the call request information through the infrared transceiver, the smart phone 300A responds to a voice instruction corresponding to a voice signal sent by the user 200A, and if the voice instruction is used for indicating that a call request of the head-mounted electronic device 100B is received, the smart phone 300A may directly send a bluetooth connection request and/or a Wi-Fi connection request to the smart phone 300B according to the connection configuration information in the call request information. The smart phone 300B verifies whether the connection configuration information included in the bluetooth connection request and/or the Wi-Fi connection request is consistent with the connection configuration information of the smart phone 300B, if so, the verification is passed, the connection request is accepted, so far, the bluetooth and/or Wi-Fi connection is successfully established, and data can be transmitted based on the connection subsequently; if not, the verification is not passed, the connection request is rejected, and the Bluetooth and/or Wi-Fi connection is failed to be established.

For example, the smartphone 300A sends a bluetooth connection request to the bluetooth address of the smartphone 300B during the allowed access period, and transmits the corresponding pairing password. The smart phone 300B receives the bluetooth connection request when determining that the time of sending the bluetooth connection request is within the allowed access period and verifying that the pairing password passes, so that the bluetooth connection is successfully established, and the following smart phone 300A and smart phone 300B can transmit data through bluetooth; and under the condition that the moment of sending the Bluetooth connection request is determined not to be in the allowed access period and/or the pairing password is verified not to pass, rejecting the Bluetooth connection request and failing to establish the Bluetooth connection.

After the headset electronic device 100A receives the call request information through the infrared transceiver, the smart phone 300A responds to a voice instruction corresponding to the voice signal sent by the user 200A, and if the voice instruction is used for indicating that the call request of the headset electronic device 100B is rejected, the smart phone 300A does not actively establish a bluetooth and/or Wi-Fi connection, and the headset electronic device 100A does not send any response information to the headset electronic device 100B, and the bluetooth and/or Wi-Fi connection is failed to be established.

The user operation for triggering initiation of a communication connection and acceptance/rejection of a communication connection is not limited to the above-mentioned example, and in a specific implementation, the user operation may also be a gesture operation, a user electroencephalogram signal, or other operation, which is not limited in this embodiment of the present application.

The present invention is not limited to the above-mentioned voice prompt and text prompt, and in a specific implementation, the indication lamp may flash, illuminate or other prompts, which is not limited in the embodiment of the present application.

The connection configuration information is not limited to the connection configuration information of bluetooth and/or Wi-Fi, and in a specific implementation, the connection configuration information may further include a communication protocol standard, an allowed access period, or other information, which is not limited in this embodiment of the present application.

The electronic device for establishing the bluetooth and/or Wi-Fi connection is not limited to the above-mentioned electronic device for establishing the bluetooth and/or Wi-Fi connection, but in a specific implementation, the head-mounted electronic device 100B and the smartphone 300A may also establish the bluetooth and/or Wi-Fi connection, which is not limited in this embodiment of the present application.

A remote control scenario is introduced below: user 200 wears head-mounted electronic device 100 and user 200 wants to remotely control smart sound box 400 within a visual range. Referring to fig. 3a and 3b, fig. 3a and 3b are schematic diagrams of some human-computer interactions in a remote control scenario provided by an embodiment of the present application. The user 200 may include other smart home devices within the visual range, besides the smart sound box 400.

As shown in fig. 3a, the user 200 can see the smart sound box 400 through the head-mounted electronic device 100, and can also see other smart home devices (not shown) mentioned above. Data can be transmitted between the head-mounted electronic device 100 and the smart sound box 400 or between the other smart home devices through infrared rays.

As shown in fig. 3a, the head-mounted electronic device 100 receives a voice signal from the user 200 through a microphone, for example, the voice signal is in a language of "playing music". The processor in the head-mounted electronic device 100 operates the sound detector to recognize the voice command corresponding to the voice signal, and in response to the voice command, the head-mounted electronic device 100 sends first indication information by using the infrared transceiver, where the first indication information is used to obtain device information of the smart home device.

In some embodiments, the infrared transceiver of the head mounted electronic device 100 emits infrared light in a fixed direction. If the user 200 wants to perform bluetooth and/or Wi-Fi communication with the smart speaker 400, the user 200 may adjust the position of the head, for example, the user 200 shown in fig. 3a is directly opposite to the smart speaker 400, so that the smart speaker 400 can receive the first indication information.

In some embodiments, the direction in which the infrared transceiver of the head mounted electronic device 100 emits infrared light may be adjusted. Alternatively, the head-mounted electronic device 100 may determine the direction of emitting the infrared rays according to a preset rule, for example, a default straight line emission. Alternatively, the head-mounted electronic device 100 may also determine the direction of emitting infrared rays according to the behavior of the user, for example, detect and determine the focusing direction of the eyeball of the user 200 through a focal length detection optical sensor in the camera and the sensor module, and use the focusing direction as the direction of emitting infrared rays. The embodiment of the present application does not limit the manner of determining the direction in which the infrared ray is emitted.

As shown in fig. 3a, after receiving the first indication information through the infrared transceiver 401, the smart sound box 400 recognizes and sends device information of the smart sound box 400 to the head-mounted electronic device 100 through the infrared transceiver 401, where the device information may include identification information of the smart sound box 400, such as a MAC address, an IPv4 address, and an IPv6 address, in response to the first indication information.

The head-mounted electronic device 100 may have established bluetooth and/or Wi-Fi connections with the smart sound box 400 and other smart home devices within visual range before sending the first indication information. The head-mounted electronic device 100 receives the device information of the smart sound box 400 through the infrared transceiver, determines the smart sound box 400 to be remotely controlled according to the device information of the smart sound box 400, and sends a control instruction to the smart sound box 400 through the bluetooth and/or Wi-Fi connection, so that the smart sound box 400 plays music according to the control instruction. Therefore, the rapid identification and matching of the head-mounted electronic equipment and the remote-controlled intelligent household equipment in the visual range can be realized through the directivity of infrared rays and the control signal which does not indicate the target object to be remotely controlled, and the intelligent household equipment can be remotely controlled very conveniently. The music played by the smart sound box 400 may be locally stored in the head-mounted electronic device 100, or may be obtained by the head-mounted electronic device 100 from the internet in a wired or wireless manner.

In some embodiments, after headset electronic device 100 receives device information for smart sound box 400 via the infrared transceiver, a bluetooth and/or Wi-Fi connection may be established with smart sound box 400. For example, the device information of smart speaker 400 may include a bluetooth address and a pairing password of smart speaker 400, and head-mounted electronic device 100 may send a bluetooth connection request to smart speaker 400 according to the device information of smart speaker 400, where smart speaker 400 verifies whether the pairing password in the bluetooth connection request is correct, if the verification passes, the bluetooth connection is successfully established, and if the verification fails, the bluetooth connection is failed to be established. After the bluetooth connection or WiFi connection is established between the head-mounted electronic device 100 and the smart speaker 400, an audio file or an audio stream may be sent to the smart speaker 400, and the smart speaker 400 plays music after receiving the audio file or the audio stream.

In the embodiment of the present application, the smart home device that sends device information to the head-mounted electronic device 100 is described by taking only the smart sound box 400 as an example. However, in a specific implementation, there may be other smart home devices that send device information to the head-mounted electronic device. Optionally, the head-mounted electronic device 100 may determine, according to a preset rule, the smart home device that is remotely controlled and/or establishes the bluetooth and/or Wi-Fi connection, for example, the smart home device that replies to the device information first is the smart home device that is remotely controlled and/or establishes the bluetooth and/or Wi-Fi connection. Optionally, the head-mounted electronic device 100 may further determine, according to the behavior of the user, a smart home device that is remotely controlled and/or establishes a bluetooth and/or Wi-Fi connection, for example, obtain a brain wave signal of the user to determine the smart home device that is remotely controlled and/or establishes the bluetooth and/or Wi-Fi connection. The embodiments of the present application do not limit this.

As shown in fig. 3b, the head-mounted electronic device 100 receives a voice signal from the user 200 through the microphone, for example, the voice signal is "play music" language. The processor in the head-mounted electronic device 100 operates the sound detector to recognize a voice instruction corresponding to the voice signal, and in response to the voice instruction, the head-mounted electronic device 100 may transmit second indication information using the infrared transceiver. The second indication information is used to obtain device information of the smart home device, and the second indication information may also include device information of the head-mounted electronic device 100, for example, if the head-mounted electronic device 100 is connected to the smart speaker 400 through bluetooth, the second indication information may include a bluetooth address of the head-mounted electronic device 100.

As shown in fig. 3b, the smart speaker 400 receives the voice signal sent by the user 200 and receives the second indication information through the infrared transceiver 401. The head-mounted electronic device 100 may have established bluetooth and/or Wi-Fi connections with the smart sound box 400 and other smart home devices within visual range before sending the second indication information. When determining that the device information included in the second indication information is the device information of the head-mounted electronic device 100, the smart sound box 400 sends the device information of the smart sound box 400 to the head-mounted electronic device 100 through the bluetooth and/or Wi-Fi connection, and the head-mounted electronic device 100 determines the smart sound box 400 to be remotely controlled according to the device information of the smart sound box 400 and sends a control instruction to the smart sound box 400 through the bluetooth and/or Wi-Fi connection, so that the smart sound box 400 plays music according to the control instruction. The music played by the smart sound box 400 may be locally stored in the head-mounted electronic device 100, or may be acquired by the head-mounted electronic device 100 from the internet in a wired or wireless manner.

For example, the smart sound box 400 verifies whether the bluetooth address included in the second indication information is the bluetooth address of the head-mounted electronic device 100 connected to the smart sound box 400 via bluetooth, if yes, the smart sound box 400 sends its own device information to the head-mounted electronic device 100 via bluetooth, and the head-mounted electronic device 100 determines and remotely controls the smart sound box 400 to play music according to the device information of the smart sound box 400; otherwise, the verification fails, and the smart sound box 400 does not reply information to the head-mounted electronic device 100.

In a specific implementation, after receiving the second indication information, the smart sound box 400 may initiate a handshake process to the head-mounted electronic device 100 based on a bluetooth and/or Wi-Fi connection with the head-mounted electronic device 100, so that the head-mounted electronic device 100 determines that a target smart home device to be remotely controlled is the smart sound box 400, and remotely controls the smart sound box 400. The embodiment of the present application does not limit this.

In some embodiments, head-mounted electronic device 100 may also identify smart sound box 400 via an infrared device (e.g., an infrared transceiver) and an image capture device (e.g., a camera) to determine device information for smart sound box 400. Then, the head-mounted electronic device 100 remotely controls the smart sound box 400 corresponding to the device information through the bluetooth and/or Wi-Fi connection.

In some embodiments, the second indication information includes connection configuration information of head mounted electronic device 100, and after receiving the second indication information sent by head mounted electronic device 100 through the infrared transceiver, smart sound box 400 may establish a bluetooth and/or Wi-Fi connection with head mounted electronic device 100. For example, the second indication information includes a bluetooth address and a pairing password of the head-mounted electronic device 100, the smart speaker 400 sends a bluetooth connection request to the head-mounted electronic device 100 according to the connection configuration information of the head-mounted electronic device 100, the head-mounted electronic device 100 verifies whether the pairing password in the bluetooth connection request is correct, if the verification is passed, the bluetooth connection is successfully established, and if the verification is not passed, the bluetooth connection is failed to be established. After the bluetooth connection or WiFi connection is established between the head-mounted electronic device 100 and the smart speaker 400, an audio file or an audio stream may be sent to the smart speaker 400, and the smart speaker 400 plays music after receiving the audio file or the audio stream.

Next, another remote control scenario is described by taking the smart phone as the above other electronic device as an example: the user 200 wears the head-mounted electronic device 100, the head-mounted electronic device 100 is connected with the smart phone 300 through a bluetooth module and/or a Wi-Fi module in the wireless communication module, and the user 200 wants to remotely control the smart sound box 400 within a visual range. Referring to fig. 3c and 3d, fig. 3c and 3d are schematic diagrams of further human-machine interactions in a remote control scenario provided by an embodiment of the present application. The user 200 may include other smart home devices within the visual range, besides the smart sound box 400.

As shown in fig. 3c, the user 200 can see the smart sound box 400 through the head-mounted electronic device 100, and can also see other smart home devices (not shown) mentioned above. The smart phone 300 may be connected to the smart speaker 400 via bluetooth and/or Wi-Fi, or may be connected to other smart home devices (not shown). Data can be transmitted between the head-mounted electronic device 100 and the smart sound box 400 or between the other smart home devices through infrared rays.

As shown in fig. 3c, the head-mounted electronic device 100 receives a voice signal from the user 200 through the microphone and sends the voice signal to the smart phone 300, for example, the voice signal is in a language of "playing music". The smartphone 300 recognizes the voice command corresponding to the voice signal and sends the voice command to the head-mounted electronic device 100. In response to the voice instruction, the head-mounted electronic device 100 may transmit first indication information using the infrared transceiver, where the first indication information is used to obtain device information of the smart home device. For an explanation that the head-mounted electronic device 100 determines a direction in which the infrared transceiver of the head-mounted electronic device 100 emits infrared rays, reference may be made to the description of fig. 3a, and details are not repeated here.

As shown in fig. 3c, the smart phone 300 may have established bluetooth and/or Wi-Fi connections with the smart sound box 400 and other smart home devices within the visual range before sending the first indication information. After receiving the first indication information through the infrared transceiver 401, the smart sound box 400 recognizes and responds to the first indication information, and sends device information of the smart sound box 400 to the head-mounted electronic device 100 through the infrared transceiver 401, where the device information may include identification information of the smart sound box 400. The head-mounted electronic device 100 receives the device information of the smart sound box 400 through the infrared transceiver and sends the device information to the smart phone 300, the smart phone 300 determines the smart sound box 400 to be remotely controlled according to the device information of the smart sound box 400, and sends a control instruction to the smart sound box 400 through the bluetooth and/or Wi-Fi connection, so that the smart sound box 400 plays music according to the control instruction. Therefore, the smart phone 300 and the remote-control smart home equipment can be rapidly identified and matched in the visual range through the directivity of infrared rays and the control signal which does not indicate the target object to be remotely controlled, and the smart home equipment can be remotely controlled very conveniently. The music played by the smart sound box 400 may be locally stored in the smart phone 300, or may be acquired by the smart phone 300 from the internet in a wired or wireless manner.

In some embodiments, the head-mounted electronic device 100 receives the device information of the smart sound box 400 through the infrared transceiver and sends the device information to the smart phone 300, and the smart phone 300 may establish a bluetooth and/or Wi-Fi connection with the smart sound box 400. For example, the device information of the smart sound box 400 includes a bluetooth address and a pairing password of the smart sound box 400, the smart phone 300 sends a bluetooth connection request to the smart sound box 400 according to the device information of the smart sound box 400, the smart sound box 400 verifies whether the pairing password in the bluetooth connection request is correct, if the verification passes, the bluetooth connection is successfully established, and if the verification fails, the bluetooth connection is failed to be established. After the smart phone 300 and the smart speaker 400 establish a bluetooth connection or a WiFi connection, an audio file or an audio stream may be sent to the smart speaker 400, and the smart speaker 400 plays music after receiving the audio file or the audio stream.

In the embodiment of the present application, the smart home device that sends device information to the head-mounted electronic device 100 is described by taking only the smart sound box 400 as an example. However, in a specific implementation, there may be other smart home devices that send device information to the head-mounted electronic device 100, and how the head-mounted electronic device 100 determines the smart home device that is remotely controlled and/or establishes bluetooth and/or Wi-Fi connection may refer to the description of fig. 3a, which is not described herein again.

In some embodiments, as shown in fig. 3d, the head-mounted electronic device 100 receives a voice signal from the user 200 through a microphone and transmits the voice signal to the smartphone 300, for example, the voice signal is in a language of "playing music". The smartphone 300 recognizes the voice command corresponding to the voice signal and sends the voice command to the head-mounted electronic device 100. In response to the voice instruction, the head mounted electronic device 100 may transmit second instruction information using the infrared transceiver. The second indication information is used to obtain device information of the smart home device, and the second indication information may include the device information of the smart phone 300, for example, if the smart phone 300 is connected to the smart sound box 400 through Wi-Fi, the second indication information may include a Wi-Fi name, an IP address of the smart phone 300, and the like.

As shown in fig. 3d, smartphone 300 may have established a bluetooth and/or Wi-Fi connection with smart sound box 400 and other electronic devices within visual range before sending the second indication. The smart speaker 400 receives the voice signal from the user 200 and receives the second indication information through the infrared transceiver 401. When determining that the device information included in the second indication information is the device information of the smartphone 300, the smartphone 300 sends the device information of the smartphone 400 to the smartphone 300 through the bluetooth and/or Wi-Fi connection, and the smartphone 300 determines the remotely controlled smartphone 400 according to the device information of the smartphone 400 and sends a control instruction to the smartphone 400 through the bluetooth and/or Wi-Fi connection, so that the smartphone 400 plays music according to the control instruction.

For example, the smart sound box 400 verifies whether the IP address included in the second indication information is the IP address of the first electronic device 300 connected to the smart sound box 400 through Wi-Fi, if so, the smart sound box 400 sends its own device information to the smart phone 300 through Wi-Fi connection, and the smart phone 300 determines and remotely controls the smart sound box 400 to play music according to the device information of the smart sound box 400; otherwise, the verification fails, and the smart sound box 400 does not reply the message to the smartphone 300. The music played by the smart sound box 400 may be locally stored in the smart phone 300, or may be acquired by the smart phone 300 from the internet in a wired or wireless manner.

Not limited to the above-mentioned example, in a specific implementation, after receiving the second indication information, the smart sound box 400 may initiate a handshake process to the smart phone 300 based on the bluetooth and/or Wi-Fi connection established with the smart phone 300, so that the smart phone 300 determines that the target smart home device to be remotely controlled is the smart sound box 400, and remotely controls the smart sound box 400. The embodiment of the present application does not limit this.

In some embodiments, the second indication information includes connection configuration information of smartphone 300, and after smart sound box 400 receives the second indication information sent by headset electronic device 100 through the infrared transceiver, a bluetooth and/or Wi-Fi connection may be established with smartphone 300 through a bluetooth module and/or a Wi-Fi module in the wireless communication module. For example, the second indication information includes a bluetooth address and a pairing password of the smartphone 300, the smart speaker 400 sends a bluetooth connection request to the smartphone 300 according to the second indication information, the smartphone 300 verifies whether the pairing password in the bluetooth connection request is correct, if the verification passes, the bluetooth connection is successfully established, and if the verification fails, the bluetooth connection is failed to be established. After the smart phone 300 and the smart speaker 400 establish a bluetooth connection or a WiFi connection, an audio file or an audio stream may be sent to the smart speaker 400, and the smart speaker 400 plays music after receiving the audio file or the audio stream.

In some embodiments, the head-mounted electronic device 100 may also identify the smart sound box 400 through an infrared device (e.g., an infrared transceiver) and an image capture device (e.g., a camera), so as to determine device information of the smart sound box 400 and send the device information to the smartphone 300. Then, the smart phone 300 remotely controls the smart sound box 400 corresponding to the device information through bluetooth and/or Wi-Fi connection.

It can be understood that the smart home device responds to the control signal when receiving both the information sent by the head-mounted electronic device through infrared rays and the control signal (such as a voice signal) sent by the user. For example, a child who does not wear a head-mounted electronic device cannot remotely control smart home devices only through control signals. Therefore, the remote control authority of the intelligent household equipment is set, and the intelligent household equipment is convenient for a user to use.

In some embodiments, for some remote control processes without multiple interactions, the head-mounted electronic device 100 may also directly control smart home devices within a visual range via infrared rays. For example, taking the example of turning on the light of the remote-control intelligent desk lamp as an example, the head-mounted electronic device 100 sends the first indication information to the intelligent desk lamp through the infrared transceiver in response to the voice instruction corresponding to the voice signal of the user 200, so as to obtain the device information of the intelligent desk lamp. The head-mounted electronic device 100 determines the infrared ray for turning on the remote control intelligent desk lamp according to the device information. Then, the head-mounted electronic device 100 transmits the infrared ray for turning on the intelligent desk lamp by remote control to the intelligent desk lamp through the infrared transceiver, and the intelligent desk lamp is turned on in response to the infrared ray.

The identification information of any two pieces of intelligent home equipment in the at least two pieces of intelligent home equipment is different, and the intelligent home equipment corresponding to the identification information can be uniquely determined according to any one piece of identification information.

It is to be understood that the positions and numbers of the infrared transceivers 401 on the smart sound box 400 shown in fig. 3 a-3 d are only used for explaining the embodiments of the present application and should not be construed as limiting.

It can be understood that when the processing capability of the head-mounted electronic device is sufficient, the background processing work can be completed by the head-mounted electronic device. When the processing capability of the head-mounted electronic device is insufficient, background processing work in the above-mentioned call scenario, remote control scenario, or other scenarios may be completed through other electronic devices connected to the head-mounted electronic device or an additional integrated processing unit, for example, in fig. 2b, the smart phone 300A assists in recognizing the voice signal of the user to obtain a corresponding voice instruction, and returns the corresponding voice instruction to the head-mounted electronic device 100A, and the head-mounted electronic device 100A performs a corresponding operation according to the voice instruction.

In a specific implementation, the smart home device may be remotely controlled and/or the bluetooth and/or Wi-Fi connection may be established with the smart home device through a user operation, a gesture operation, a user brain wave signal, or other operations acting on a key on the head-mounted electronic device 100, which is not limited in this embodiment of the present application.

In a specific implementation, the smart home device and the head-mounted electronic device 100 or the smart phone 300 may be indirectly connected through a router, a gateway, or other devices, instead of being directly connected through bluetooth and/or Wi-Fi. Specific examples can be seen in fig. 3e, and the network architecture shown in fig. 3e may include a head-mounted electronic device 100, a smart phone 300, a smart sound box 400, a smart television 500, a smart lamp 600, and other smart home devices, and a router 700. These smart home devices are connected to a Wi-Fi network provided by router 700. After receiving the first indication information or the second indication information, the smart sound box 400 may send the device information of the smart sound box 400 to the head-mounted electronic device 100 or the smartphone 300 through the router 700. The head-mounted electronic device 100 or the smartphone 300 may also be connected to a Wi-Fi network provided by the router 700, and send a control instruction to the smart sound box 400 through the router 700, so as to remotely control the smart sound box 400. In some embodiments, after receiving the first indication information or the second indication information, the smart sound box 400 may send device information of the smart sound box 400 to the head-mounted electronic device 100 or the smartphone 300 through the infrared transceiver 401. Head-mounted electronic device 100 or smartphone 300 may send a control instruction to smart sound box 400 via router 700 according to the device information of smart sound box 400, so as to remotely control smart sound box 400. For example, the head-mounted electronic device 100 sends a control instruction to the router 700, where the control instruction carries the device information of the smart sound box 400, and the router 700 sends the control instruction to the smart sound box 400 according to the device information of the smart sound box 400 after receiving the control instruction. It is understood that the head mounted electronic device 100 may send an audio file or audio stream to the smart sound box 400, or may send the audio file or audio stream via the router 700.

In some embodiments, the head-mounted electronic device 100 receives a voice signal from the user 200 through a microphone, for example, the voice signal is "play music". The processor in the head-mounted electronic device 100 operates the sound detector to recognize the voice command corresponding to the voice signal, and in response to the voice command, the head-mounted electronic device 100 uses the infrared transceiver to transmit third indication information, where the third indication information is used to indicate the device receiving the third indication information to respond to the voice command. It can be understood that the smart home devices can collect the voice signal of the user. For example, when the user 200 wears the head-mounted electronic device 100, the user speaks the voice signal to the smart sound box 400, at this time, the third indication information sent by the head-mounted electronic device 100 through the infrared transceiver is received by the smart sound box 400, and the other smart home devices do not receive the third indication information, in response to the third indication information, the smart sound box 400 recognizes a voice instruction corresponding to the voice signal, and plays music in response to the voice instruction. It is understood that smart sound box 400 may recognize the corresponding voice command upon receiving the voice signal, and execute the voice command upon receiving the third indication message. The music played in the smart sound box 400 may be stored locally or may be obtained from the network through the router. Similarly, when a plurality of intelligent electric lamps are in the home network, when the user sends a voice signal of 'on lamp', the intelligent electric lamp receiving the third indication information turns on the electric lamp, and other intelligent electric lamps not receiving the third indication information do not turn on the electric lamp.

In the home network, only the intelligent home devices receiving the infrared information respond to the voice command, so that the situation that a plurality of intelligent home devices respond to the voice command of the user can be avoided.

In some embodiments, as shown in fig. 3e, the router 700 may also be connected to the server 800, and the head-mounted electronic device 100, the smart phone 300, and the smart home device may be connected to the server 800 through the router 700, and communicate with other devices connected to the server 800 through the server 800. After receiving the first indication information or the second indication information, the smart sound box 400 may send the device information of the smart sound box 400 to the head-mounted electronic device 100 or the smartphone 300 through the server 800. Head-mounted electronic device 100 or smartphone 300 may send a control instruction to smart sound box 400 through server 800, so as to remotely control smart sound box 400. The server 800 may be a server corresponding to an application program installed in the head-mounted electronic device 100 or the smart phone 300 and used for controlling the smart home device, for example, an application server of smart home. In some embodiments, after receiving the first indication information or the second indication information, the smart sound box 400 may send device information of the smart sound box 400 to the head-mounted electronic device 100 or the smartphone 300 through the infrared transceiver 401. Head-mounted electronic device 100 or smartphone 300 may send a control instruction to smart sound box 400 via server 800 according to the device information of smart sound box 400, so as to remotely control smart sound box 400. The server 800 may be a server corresponding to an application program installed in the head-mounted electronic device 100 or the smart phone 300 and used for controlling the smart home device, for example, an application server of smart home. The detailed process of the head-mounted electronic device 100 or the smart phone 300 remotely controlling the smart sound box 400 through the router 700 or the server 800 is similar to the process described in fig. 3a to 3d, and is not described herein again.

In the embodiment of the present application, the mapping relationship between the user operation and the instruction may be stored in the head-mounted electronic device 100. The instructions may include: initiating a communication connection (e.g., a call connection); accept or reject a communication request (e.g., a call request); and remotely controlling the intelligent household equipment. The mapping relationship may be preset by the system, or may be set in a user-defined manner in response to a user operation. An example of user-defined setting of the mapping relationship between the user operation and the instruction is given below.

Referring to fig. 4, fig. 4 is a schematic diagram of human-computer interaction. As shown in fig. 4, the user 200 may open an option of "first key associated with the call function" on the setting interface of the display screen 110 of the head-mounted electronic device 100, and the head-mounted electronic device 100 may establish a mapping relationship between the first key press and the call function in response to the operation. After opening the option of "first key associated with a call function", the head mounted electronic device 100 may initiate a call connection, accept or reject a call request in response to the operation of the first key, as in the examples of fig. 2 a-2 d above.

Similarly, as shown in fig. 4, the user 200 may open an option of "voice signal associated with call function" on the setting interface of the display screen 110 of the head-mounted electronic device 100, and the head-mounted electronic device 100 may establish a mapping relationship between the voice signal and the call function in response to the operation. After the option of "voice signal associated with call function" is turned on, the head-mounted electronic device 100 may detect the voice signal of the user 200 through the microphone, recognize a voice instruction corresponding to the voice signal through the sound detector, and initiate a call connection, accept or reject the call request in response to the voice instruction, as in the examples of fig. 2a to 2d above.

Similarly, as shown in fig. 4, the user 200 may open an option of "OK gesture associated with the call function" on the setting interface of the display screen 110 of the head-mounted electronic device 100, and the head-mounted electronic device 100 may establish a mapping relationship between the OK gesture and the call function in response to the operation. After opening the option of "OK gesture associated with call function", the head mounted electronic device 100 may initiate a call connection, accept or reject the call request in response to the OK gesture detected by the camera.

The option for the electronic device to detect that the user turns on the "first key associated call function" may be an on switch for the processor of the head mounted electronic device 100 to detect that a finger is placed at the option of the "first key associated call function" by using a camera.

It can be understood that the manner of setting the mapping relationship between the user operation and the instruction of the remote control smart home device by the user through customization may be consistent with fig. 4 described above.

It is to be understood that the example of the mapping relationship between the user operation and the instruction in the customized setting shown in fig. 4 is only used to explain the embodiment of the present application, and should not be construed as a limitation. The setting interface may further include other options for customizing the corresponding relationship between the user operation and the instruction, which is not limited in the embodiment of the present application.

In some embodiments, the head-mounted electronic device may establish a connection with other electronic devices (e.g., a smartphone, a smartwatch, a smartband, etc.). The connection may be a bluetooth connection, a Wi-Fi connection, or other wireless communication connection, or may be a wired connection, which is not limited in this embodiment of the present application.

Referring to fig. 5, fig. 5 is a schematic diagram of another human-computer interaction provided in the embodiments of the present application. The head-mounted electronic device 100 may interact with the smartphone 300 through the established connection. The smartphone 300 may also receive a user operation, such as a touch operation, and generate a setting instruction to send to the head-mounted electronic device 100. Specifically, as shown in fig. 5, after the head-mounted electronic device 100 establishes a connection with the smartphone 300, the smartphone 300 may receive a touch operation of the user, and will be used to open a function: the speech signal controls the call function to be transmitted to the head-mounted electronic device 100. The head mounted electronic device 100 performs the function of turning on: and initiating a call connection through a voice signal, and receiving or rejecting a call request.

It is understood that the interaction between the head-mounted electronic device 100 and the electronic device shown in fig. 5 is only for explaining the embodiments of the present application, and should not be construed as limiting. The head mounted electronic device 100 may also utilize the electronic device to set other parameters or to interact with other data, such as the settings interface of FIG. 4.

Based on some embodiments shown in fig. 1, fig. 2a to fig. 2d, fig. 3a to fig. 3e, and fig. 4 to fig. 5, the fast matching method provided by the present application is described below.

Referring to fig. 6, fig. 6 is a diagram illustrating a fast matching method according to an embodiment of the present application, where the fast matching method is applied to a head-mounted electronic device, and the head-mounted electronic device includes an infrared transceiver. The head mounted electronic device may be the head mounted electronic device shown in fig. 1. The method includes, but is not limited to, the steps of:

s601: the head-mounted electronic device receives a user operation.

Specifically, the user operation may be, but is not limited to, a voice instruction of the user, an operation of a key acting on the head-mounted electronic device, a gesture operation, a user brain wave signal, or the like. In the remote control scenario, the user operation is generally a voice instruction of the user, which can be specifically referred to the above examples of fig. 3a to 3 d. In the call scenario, an example of the user operation may refer to the user operation shown in fig. 2 a-2 d. The operation of the key acting on the head-mounted electronic device can be, but is not limited to, clicking, pressing, sliding and the like; the gesture operation may be, but is not limited to, a scissor hand, a fist, a ringing finger, a bitok, and the like.

S602: in response to a user operation, the head-mounted electronic device transmits first infrared information to the target electronic device through the infrared transceiver.

Specifically, the target electronic device is an electronic device capable of transmitting data by infrared rays, and the target electronic device may include an infrared transceiver that transmits and receives infrared rays. The target electronic device may be another head mounted electronic device structurally consistent with the head mounted electronic device described above, such as the head mounted electronic device 100A described above in fig. 2 a-2 b. The target electronic device may also be an electronic device such as a smart watch, a smart phone, etc. capable of transmitting data via infrared rays, such as the smart phone 300A in fig. 2 c-2 d described above. In a remote control scenario, the target electronic device may also be a smart home device capable of transmitting data via infrared rays, such as the smart sound box 400 in fig. 3a to 3 e. The target electronic device is an electronic device within a visual range of a user wearing the head-mounted electronic device, and the user wearing the head-mounted electronic device can see the target electronic device through the head-mounted electronic device.

Specifically, the instruction for the user to operate and transmit the first infrared information may be preset by the system, or may be set in response to the operation of the user. Referring specifically to the description of fig. 4, the setting interface shown in fig. 4 may also be displayed on a first electronic device (e.g., a smartphone) to which the head-mounted electronic device is connected.

Specifically, the first infrared information may be used to trigger a wireless communication process between the head-mounted electronic device and the target electronic device, including but not limited to the following two scenarios:

scene one: and (5) calling scenes.

Illustratively, the first infrared information is used for the headset electronic device to establish a bluetooth and/or Wi-Fi connection with the target electronic device, for example, the first infrared information is call request information, and the first infrared information may include connection configuration information of the headset electronic device, which may be specifically described in the above description of the call request information in fig. 2a and fig. 2 b.

Scene two: and (5) remotely controlling the scene.

Illustratively, the first infrared information may be used for the headset electronic device to establish a bluetooth and/or Wi-Fi connection with the target electronic device, e.g., the first infrared information may include connection configuration information of the headset electronic device. The first infrared information may also be used for the head-mounted electronic device to determine and remotely control the target electronic device, for example, the first infrared information is first indication information or second indication information, and is used to obtain device information of the target electronic device, which may be specifically referred to in the description of the first indication information in fig. 3a and the second indication information in fig. 3 b. The first infrared information is third indication information for indicating the target electronic device to respond to the user operation, which may be specifically referred to in the description of the third indication information in fig. 3 e.

S603: based on the first infrared information, the head-mounted electronic device communicates with the target electronic device via Bluetooth and/or Wi-Fi.

In some embodiments, based on the first infrared information, the head-mounted electronic device may establish a bluetooth and/or Wi-Fi connection with the target electronic device to thereby communicate bluetooth and/or Wi-Fi with the target electronic device. In the scenario one, the first infrared information may include connection configuration information of the head-mounted electronic device, the target electronic device may initiate a connection request of bluetooth and/or Wi-Fi to the head-mounted electronic device according to the connection configuration information, the head-mounted electronic device verifies the connection request, and accepts the connection request if the verification is passed, and establishes bluetooth and/or Wi-Fi connection successfully, otherwise rejects the connection request, and fails to establish bluetooth and/or Wi-Fi connection. See, in particular, the description above of fig. 2B for the headset electronic device 100A and the headset electronic device 100B establishing a bluetooth and/or Wi-Fi connection. In the second scenario, a process of establishing the bluetooth and/or Wi-Fi connection between the head-mounted electronic device and the target electronic device is similar to the first scenario, and specific reference may be made to the description of establishing the bluetooth and/or Wi-Fi connection between the head-mounted electronic device 100 and the smart speaker 400 in fig. 3 b.

In some embodiments, the headset electronic device and the target electronic device may also establish a bluetooth and/or Wi-Fi connection prior to S601. In the second scenario, the first infrared information is used to obtain device information of the target electronic device. The target electronic device receives and responds to the first infrared information, and sends device information of the target electronic device to the head-mounted electronic device through the Bluetooth and/or Wi-Fi connection. The head-mounted electronic device determines the target electronic device according to the device information of the target electronic device, and instructs the target electronic device to respond to the voice command of the user through the bluetooth connection and/or the Wi-Fi connection, which may be specifically described in the above description of fig. 3b that the head-mounted electronic device 100 remotely controls the smart sound box 400.

In some embodiments, the head mounted electronic device and the target electronic device may also be connected through a router before S601. In the second scenario, the first infrared information is used to obtain device information of the target electronic device. The target electronic device receives and responds to the first infrared information, and device information of the target electronic device is sent to the head-mounted electronic device through the router. The head-mounted electronic device determines the target electronic device according to the device information of the target electronic device, and instructs the target electronic device to respond to the voice instruction of the user through the router, which may be specifically described in the above description of fig. 3e that the head-mounted electronic device 100 remotely controls the smart sound box 400.

In some embodiments, the head mounted electronic device and the target electronic device may also be connected through a router before S601. In the second scenario, the first infrared information is used to instruct the target electronic device to respond to the voice command of the user, the target electronic device that receives the first infrared information responds to the voice command of the user, and other electronic devices connected to the head-mounted electronic device through the router only receive the voice command of the user and do not receive the first infrared information, so that the other electronic devices do not respond to the voice command of the user. That is to say, only the smart home devices receiving the infrared information respond to the voice command in the home network, so that the situation that a plurality of smart home devices all respond to the voice command of the user does not occur. In particular, refer to the above description of fig. 3e that the head-mounted electronic device 100 remotely controls the smart sound box 400 through the third indication information.

In a possible implementation manner, after S602 and before S603, the method further includes:

the target electronic equipment sends second infrared information to the head-mounted electronic equipment;

and the head-mounted electronic equipment receives second infrared information sent by the target electronic equipment.

Then S603 specifically is: based on the first infrared information and the second infrared information, the head-mounted electronic device performs Bluetooth and/or Wi-Fi communication with the target electronic device.

In some embodiments, based on the first infrared information and the second infrared information, the head-mounted electronic device may establish a bluetooth and/or Wi-Fi connection with the target electronic device to thereby communicate bluetooth and/or Wi-Fi with the target electronic device. In scenario one described above, the first infrared information may include connection configuration information of the head-mounted electronic device, and/or the second infrared information may include connection configuration information of the target electronic device. The second infrared information may be call acceptance information or call rejection information, and when the second infrared information is call acceptance information, the second infrared information may include connection configuration information of the target electronic device, which may be specifically described in the description of the call acceptance information in fig. 2 a.

For example, the second infrared information includes connection configuration information of the target electronic device, the head-mounted electronic device may initiate a bluetooth and/or Wi-Fi connection request to the target electronic device according to the connection configuration information, the target electronic device verifies the connection request, if the verification is passed, the connection request is accepted, the head-mounted electronic device establishes a bluetooth and/or Wi-Fi connection with the target electronic device successfully, and then data may be transmitted based on the connection; and if the verification is not passed, rejecting the connection request and failing to establish the Bluetooth and/or Wi-Fi connection. The process of the headset electronic device establishing a bluetooth and/or Wi-Fi connection with the target electronic device can be seen in the process of the headset electronic device 100B establishing a bluetooth and/or Wi-Fi connection with the headset electronic device 100A in fig. 2 a. The data may be, but not limited to, voice data, text data, image data, file data, and the like. The user can view the data through a display screen or a virtual display interface of the head-mounted electronic device or an electronic device connected with the head-mounted electronic device.

In the second scenario, a process of establishing the bluetooth and/or Wi-Fi connection between the head-mounted electronic device and the target electronic device is similar to the first scenario, and specific reference may be made to the description of establishing the bluetooth and/or Wi-Fi connection between the head-mounted electronic device 100 and the smart speaker 400 in fig. 3 a.

In some embodiments, the headset electronic device and the target electronic device may also establish a bluetooth and/or Wi-Fi connection prior to S601. In the second scenario, the first infrared information is used to obtain device information of the target electronic device, and the second infrared information may include the device information of the target electronic device. The head-mounted electronic equipment determines target electronic equipment according to the equipment information, and instructs the target electronic equipment to respond to the voice instruction of the user through the Bluetooth and/or Wi-Fi connection. See, in particular, the above description of fig. 3a for the head mounted electronic device 100 to remotely control the smart sound box 400.

In some embodiments, the head mounted electronic device and the target electronic device may also be connected through a router before S601. In the second scenario, the first infrared information is used to obtain device information of the target electronic device, and the second infrared information may include the device information of the target electronic device. The head-mounted electronic device determines the target electronic device according to the device information, and instructs the target electronic device to respond to the voice instruction of the user through the router, which is specifically described in the above description of fig. 3e that the head-mounted electronic device 100 remotely controls the smart sound box 400.

It can be understood that, regarding a specific implementation manner of each step of the method described in fig. 6, reference may be made to the foregoing embodiments in fig. 1, fig. 2a to fig. 2b, fig. 3a to fig. 3b, fig. 3e, fig. 4, and fig. 5, which are not described herein again.

In the method described in fig. 6, the head-mounted electronic device and the target electronic device establish device matching information for bluetooth and/or Wi-Fi connection through infrared transmission, and the user can realize automatic matching and fast connection between both communication parties in the visible range through the directivity of infrared without acquiring device information of a communication object in advance and performing cumbersome matching operation. The head-mounted electronic equipment can also determine the target electronic equipment through infrared rays, and even if the target electronic equipment which is remotely controlled is not specified by user operation, the automatic matching with the target electronic equipment can be realized through the directivity of the infrared rays, so that the target electronic equipment is rapidly and accurately remotely controlled, the use of a user is greatly facilitated, and the user experience is improved.

Referring to fig. 7, fig. 7 is a schematic diagram illustrating another fast matching method according to an embodiment of the present application, where the method is applied to a head-mounted electronic device, and the head-mounted electronic device includes an infrared transceiver. The head mounted electronic device may be the head mounted electronic device shown in fig. 1. The method includes, but is not limited to, the steps of:

s701: the head-mounted electronic device establishes a connection with the first electronic device.

In particular, the connection may be a wired connection, for example, through a USB data line, or a wireless communication connection, for example, a bluetooth connection or a Wi-Fi connection. The head-mounted electronic device may interact with the first electronic device based on the established connection. The first electronic device may also receive a user operation and generate a related instruction to send to the head-mounted electronic device, which may be referred to in the above example of fig. 5.

The first electronic device may also be configured to assist the head-mounted electronic device to perform background processing, for example, if the head-mounted electronic device does not have a call function, the call function may be implemented by the first electronic device, and at this time, the head-mounted electronic device may be used as an earphone, a microphone, a display device, and the like. If the processing power of the head-mounted electronic device is insufficient, the first electronic device may assist in identifying and processing data, etc. The first electronic device may be an electronic device such as a smart phone, a smart watch, a smart bracelet, or a processing unit additionally integrated on the head-mounted electronic device.

S702: the head-mounted electronic device receives a user operation.

Specifically, S702 is identical to S601, and is not described herein again.

S703: in response to a user operation, the head-mounted electronic device transmits first infrared information to the target electronic device through the infrared transceiver.

Specifically, the description of the target electronic device may refer to the description of S602, which is not described herein again.

Specifically, the instruction for the user to operate and transmit the first infrared information may be preset by the system, or may be set in response to the operation of the user. Referring specifically to the description of fig. 4, the setup interface shown in fig. 4 may also be displayed on a first electronic device (e.g., a smartphone) to which the head-mounted electronic device is connected.

Specifically, the first infrared information may be used to trigger a wireless communication process between the first electronic device and the target electronic device, including but not limited to the following two scenarios:

scene one: and (5) calling scenes.

Illustratively, the first infrared information is used for the first electronic device to establish a bluetooth and/or Wi-Fi connection with the target electronic device, for example, the first infrared information may be call request information, and the first infrared information may include connection configuration information of the first electronic device, which may be specifically described in the call request information in fig. 2c and fig. 2d above.

Scene two: and (5) remotely controlling the scene.

Illustratively, the first infrared information may be used for the first electronic device to establish a bluetooth and/or Wi-Fi connection with the target electronic device, e.g., the first infrared information may include connection configuration information of the first electronic device. The first infrared information may also be used for the first electronic device to determine and remotely control the target electronic device, for example, the first infrared information is first indication information or second indication information, and is used to acquire device information of the target electronic device, which may specifically refer to the description of the first indication information in fig. 3c and the second indication information in fig. 3 d. The first infrared information is third indication information for indicating the target electronic device to respond to the user operation, which may be specifically referred to in the description of the third indication information in fig. 3 e.

S704: based on the first infrared information, the first electronic device performs Bluetooth and/or Wi-Fi communication with the target electronic device.

In some embodiments, based on the first infrared information and the second infrared information, the first electronic device may establish a bluetooth and/or Wi-Fi connection with the target electronic device to thereby communicate bluetooth and/or Wi-Fi with the target electronic device. In the first scenario, the first infrared information may include connection configuration information of the first electronic device, the target electronic device may initiate a bluetooth and/or Wi-Fi connection request to the first electronic device according to the connection configuration information, the first electronic device verifies the connection request, and accepts the connection request if the verification is passed, otherwise, the connection request is rejected. See in particular the above description of fig. 2d in which smartphone 300A and smartphone 300B establish a bluetooth and/or Wi-Fi connection. In the second scenario, the process of establishing the bluetooth and/or Wi-Fi connection between the first electronic device and the target electronic device is similar to the scenario, and specific reference may be made to the description of establishing the bluetooth and/or Wi-Fi connection between the smart phone 300 and the smart speaker 400 in fig. 3 d.

In some embodiments, the first electronic device and the target electronic device may also establish a bluetooth and/or Wi-Fi connection prior to S702. In the second scenario, the first infrared information is used to obtain device information of the target electronic device. And the target electronic equipment receives and responds to the first infrared information, and sends the equipment information of the target electronic equipment to the first electronic equipment through the Bluetooth and/or Wi-Fi connection between the first electronic equipment and the target electronic equipment. The first electronic device determines a target electronic device according to the device information of the target electronic device, and instructs the target electronic device to respond to the voice command of the user through Bluetooth and/or Wi-Fi connection between the first electronic device and the target electronic device. See in particular the above description of smart phone 300 remotely controlling smart sound box 400 in fig. 3 d.

In some embodiments, the first electronic device and the target electronic device may also be connected through a router before S702. In the second scenario, the first infrared information is used to obtain device information of the target electronic device. The target electronic device receives and responds to the first infrared information, and sends device information of the target electronic device to the first electronic device through the router. The first electronic device determines the target electronic device according to the device information of the target electronic device, and instructs the target electronic device to respond to the voice command of the user through the router, which is specifically described above with reference to the description of fig. 3e in which the smart phone 300 remotely controls the smart sound box 400.

In a possible implementation manner, after S703 and before S704, the method further includes:

the head-mounted electronic device sends the second infrared information to the first electronic device.

Then S704 specifically is: based on the first infrared information and the second infrared information, the first electronic device performs Bluetooth and/or Wi-Fi communication with the target electronic device.

In some embodiments, based on the first infrared information and the second infrared information, the first electronic device may establish a bluetooth and/or Wi-Fi connection with the target electronic device to thereby communicate bluetooth and/or Wi-Fi with the target electronic device. In scenario one, the first infrared information may include connection configuration information of the first electronic device, and/or the second infrared information may include connection configuration information of the target electronic device. The second infrared information may be call acceptance information or call rejection information, and when the second infrared information is call acceptance information, the second infrared information may include connection configuration information of the target electronic device, which may be specifically described in the above description of the call acceptance information in fig. 2 c.

For example, the second infrared information includes connection configuration information of the target electronic device, the first electronic device may initiate a bluetooth and/or Wi-Fi connection request to the target electronic device according to the connection configuration information, the target electronic device verifies the connection request, if the verification is passed, the connection request is accepted, the first electronic device establishes a bluetooth and/or Wi-Fi connection with the target electronic device successfully, and then data may be transmitted based on the bluetooth and/or Wi-Fi connection; and if the verification is not passed, rejecting the connection request and failing to establish the Bluetooth and/or Wi-Fi connection. The process of the first electronic device establishing a bluetooth and/or Wi-Fi connection with the target electronic device can be seen from the above description of the smart phone 300A and the smart phone 300B establishing a bluetooth and/or Wi-Fi connection in fig. 2 c. The data may be, but not limited to, voice data, text data, image data, file data, and the like. The user can view the data through a display screen or a virtual display interface of the head-mounted electronic device or an electronic device connected with the head-mounted electronic device.

In the second scenario, the process of establishing the bluetooth and/or Wi-Fi connection between the first electronic device and the target electronic device is similar to the scenario, and specific reference may be made to the description of establishing the bluetooth and/or Wi-Fi connection between the smart phone 300 and the smart speaker 400 in fig. 3 c.

In some embodiments, the first electronic device and the target electronic device may also establish a bluetooth and/or Wi-Fi connection prior to S702. In the second scenario, the first infrared information is used to obtain device information of the target electronic device, and the second infrared information may include the device information of the target electronic device. The first electronic equipment determines target electronic equipment according to the equipment information, and instructs the target electronic equipment to respond to the voice command of the user through Bluetooth and/or Wi-Fi connection between the first electronic equipment and the target electronic equipment. See in particular the above description of fig. 3c in which smartphone 300 remotely controls smart speaker 400.

In some embodiments, the first electronic device and the target electronic device may also be connected through a router before S702. In the second scenario, the first infrared information is used to obtain device information of the target electronic device, and the second infrared information may include the device information of the target electronic device. The first electronic device determines the target electronic device according to the device information, and instructs the target electronic device to respond to the voice command of the user through the router, which is specifically described in the above description of fig. 3e in which the smart phone 300 remotely controls the smart sound box 400.

It can be understood that, for specific implementation of each step of the method described in fig. 7, reference may be made to the embodiments in fig. 1, fig. 2c to fig. 2d, fig. 3c to fig. 3d, fig. 3e, fig. 4, and fig. 5, which are not described herein again.

In the method described in fig. 7, the first electronic device establishes a bluetooth and/or Wi-Fi connection with the target electronic device through the head-mounted electronic device, and the head-mounted electronic device and the target electronic device transmit the device matching information for establishing the bluetooth and/or Wi-Fi connection through infrared rays. The user does not need to acquire the equipment information of the communication object in advance and execute complicated matching operation, and the automatic matching and the quick connection of the two communication parties in the visible range can be realized through the directivity of infrared rays. First electronic equipment also can confirm target electronic equipment through wearing electronic equipment, even user operation does not indicate the target electronic equipment that needs the remote control, also can realize the automatic matching with target electronic equipment through directive property of infrared ray to this target electronic equipment is controlled in remote fast and accurately, thereby made things convenient for user's use greatly, promoted user experience and felt.

The embodiments of the present application can be combined arbitrarily to achieve different technical effects.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions described in accordance with the present application are generated, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a Digital Versatile Disk (DVD)), or a semiconductor medium (e.g., a Solid State Disk (SSD)), among others.

In short, the above description is only an example of the technical solution of the present invention, and is not intended to limit the scope of the present invention. Any modifications, equivalents, improvements and the like made in accordance with the disclosure of the present invention are intended to be included within the scope of the present invention.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. A fast matching method applied to a head-mounted electronic device, the head-mounted electronic device comprising an infrared transceiver, the method comprising:

receiving user operation;

responding to the user operation, sending first infrared information to target electronic equipment through the infrared transceiver, wherein the directivity of the first infrared information is used for realizing automatic matching of two communication parties in a visual range, and the first infrared information comprises connection configuration information of the head-mounted electronic equipment, or the first infrared information is used for acquiring equipment information of the target electronic equipment, or the first infrared information is used for acquiring connection configuration information of the target electronic equipment;

and carrying out Bluetooth and/or wireless fidelity Wi-Fi communication with the target electronic equipment based on the first infrared information.

2. The method of claim 1, wherein the first infrared information includes connection configuration information of the head-mounted electronic device; the performing bluetooth and/or wireless fidelity Wi-Fi communication with the target electronic device based on the first infrared information includes:

receiving and verifying a Bluetooth and/or Wi-Fi connection request sent by the target electronic equipment based on the first infrared information;

and when the Bluetooth and/or Wi-Fi connection request passes the verification, establishing Bluetooth and/or Wi-Fi connection with the target electronic equipment, and carrying out Bluetooth and/or Wi-Fi communication.

3. The method of claim 1, wherein the user operation is a user voice instruction, and the first infrared information is used to obtain device information of the target electronic device;

before the receiving the user operation, the method further comprises: establishing a Bluetooth and/or Wi-Fi connection with the target electronic device;

the performing bluetooth and/or wireless fidelity Wi-Fi communication with the target electronic device based on the first infrared information includes:

receiving the device information of the target electronic device sent by the target electronic device through the Bluetooth and/or Wi-Fi connection;

and determining the target electronic equipment according to the equipment information of the target electronic equipment, and indicating the target electronic equipment to respond to the user operation through the Bluetooth and/or Wi-Fi connection.

4. The method of claim 1, wherein after transmitting the first infrared information to the target electronic device via the infrared transceiver in response to the user operation, the method further comprises: receiving second infrared information sent by the target electronic equipment;

and performing Bluetooth and/or Wi-Fi communication with the target electronic equipment based on the first infrared information and the second infrared information.

5. The method of claim 4, wherein the first infrared information comprises connection configuration information of the head-mounted electronic device, and/or wherein the second infrared information comprises connection configuration information of the target electronic device;

the performing bluetooth and/or Wi-Fi communication with the target electronic device based on the first infrared information and the second infrared information includes:

and establishing Bluetooth and/or Wi-Fi connection with the target electronic equipment based on the connection configuration information included in the first infrared information and the second infrared information, and carrying out Bluetooth and/or Wi-Fi communication.

6. The method of claim 4, wherein the user operation is a user voice instruction, the first infrared information is used for acquiring device information of the target electronic device, and the second infrared information comprises the device information of the target electronic device;

and determining the target electronic equipment according to the second infrared information, and indicating the target electronic equipment to respond to the user operation through the Bluetooth and/or Wi-Fi connection.

7. A fast matching method applied to a head-mounted electronic device, the head-mounted electronic device comprising an infrared transceiver, the method comprising:

receiving user operation;

responding to the user operation, sending first infrared information to target electronic equipment through the infrared transceiver, wherein the directivity of the first infrared information is used for realizing automatic matching of two communication parties in a visual range, and the first infrared information comprises connection configuration information of the head-mounted electronic equipment, or the first infrared information is used for acquiring equipment information of the target electronic equipment, or the first infrared information is used for acquiring connection configuration information of the target electronic equipment; the first infrared information is used for the first electronic equipment to perform Bluetooth and/or Wi-Fi communication with the target electronic equipment; the first electronic device is connected with the head-mounted electronic device.

8. The method of claim 7, wherein the first infrared information includes connection configuration information of the first electronic device; the first infrared information is specifically used for the first electronic device to send a Bluetooth and/or Wi-Fi connection request to the target electronic device, so that the first electronic device establishes Bluetooth and/or Wi-Fi connection with the target electronic device and performs Bluetooth and/or Wi-Fi communication.

9. The method of claim 7, wherein the user operation is a user voice instruction, the first electronic device is a device that establishes a bluetooth and/or Wi-Fi connection with the target electronic device, the first infrared information is specifically used to obtain device information of the target electronic device, the device information of the target electronic device is information that the target electronic device sends to the first electronic device through the bluetooth and/or Wi-Fi connection, and the device information of the target electronic device is used by the first electronic device to determine the target electronic device and instruct the target electronic device to respond to the user operation through the bluetooth and/or Wi-Fi connection.

10. The method of claim 7, wherein after transmitting the first infrared information to the target electronic device via the infrared transceiver in response to the user operation, the method further comprises:

receiving second infrared information sent by the target electronic equipment;

and sending the second infrared information to the first electronic equipment.

11. The method of claim 10, wherein the first infrared information comprises connection configuration information of the first electronic device, and/or wherein the second infrared information comprises connection configuration information of the target electronic device; the first infrared information and/or the second infrared information are specifically used for the first electronic device to establish Bluetooth and/or Wi-Fi connection with the target electronic device and perform Bluetooth and/or Wi-Fi communication.

12. The method of claim 10, wherein the user action is a user voice instruction, the first electronic device is a device that establishes a bluetooth and/or Wi-Fi connection with the target electronic device, the first infrared information is used to obtain device information of the target electronic device, and the second infrared information includes device information of the target electronic device; the second infrared information is specifically used for the first electronic device to determine the target electronic device, and indicates the target electronic device to respond to the user operation through the bluetooth and/or Wi-Fi connection.

13. A head-mounted electronic device, characterized in that the head-mounted electronic device comprises a transceiver, a processor and a memory for storing a computer program, the processor invoking the computer program for performing the method of any of claims 1-12.

14. A computer storage medium, characterized in that it stores a computer program which, when executed by a processor, implements the method of any one of claims 1-12.