CN114679761A

CN114679761A - UWB-based equipment interaction method, device and equipment

Info

Publication number: CN114679761A
Application number: CN202210238362.9A
Authority: CN
Inventors: 韩喆
Original assignee: Alipay Hangzhou Information Technology Co Ltd
Current assignee: Alipay Hangzhou Information Technology Co Ltd
Priority date: 2020-04-14
Filing date: 2020-04-14
Publication date: 2022-06-28
Also published as: CN111542128A; CN111542128B

Abstract

A UWB-based device interaction method, apparatus and device are disclosed. When a plurality of local devices need to interact, based on the operation of a user, the instruction direction can be directly determined, and then the propagation matching of the UWB signals is carried out in the instruction direction, so that the target device in the same direction is determined, the UWB signal connection is established with the target, and the data transmission among the plurality of local devices is realized.

Description

UWB-based equipment interaction method, device and equipment

Technical Field

The embodiment of the specification relates to the technical field of information, in particular to a UWB-based equipment interaction method, device and equipment.

Background

With the development of technologies, the interaction between screens is more and more required, such as a voting function of a teleconference, or data transfer and display to another screen through a cloud server, and the like, which are generally performed in a remote scene and depend on a network. However, when multiple devices are in one scene, a scheme for performing mutual interaction among multiple local devices is still lacking.

Based on this, the embodiments of the present specification provide a more convenient UWB-based device interaction method.

Disclosure of Invention

The embodiment of the application aims to provide a scheme which can realize equipment interaction more conveniently when a plurality of local equipment exist.

In order to solve the above technical problem, the embodiments of the present application are implemented as follows:

a UWB-based device interaction method, comprising:

receiving an operation instruction of a user, and determining the instruction direction of user equipment according to the operation instruction; the instruction direction is used for determining the direction of the target device;

receiving ultra-wideband UWB signals sent by each peripheral device, and respectively determining the propagation direction of each UWB signal;

determining the similarity degree between the instruction direction of the user equipment and the propagation direction of each UWB signal, and determining the peripheral equipment with the similarity degree meeting the preset conditions as target equipment;

and establishing a communication connection with the target device through the UWB signals, and transmitting data.

Correspondingly, the embodiment of the present specification further provides a UWB-based device interaction apparatus, including:

the receiving module is used for receiving an operation instruction of a user and determining the instruction direction of the user equipment according to the operation instruction; the command direction is used for determining the direction of a target peripheral device;

the first determining module is used for receiving UWB signals sent by each peripheral device and respectively determining the propagation direction of each UWB signal;

The second determining module is used for determining the similarity between the instruction direction of the user equipment and the propagation direction of each UWB signal and determining the peripheral equipment with the similarity meeting the preset conditions as target equipment;

and the connecting module establishes communication connection with the target equipment through a UWB signal and transmits data.

According to the scheme provided by the embodiment of the specification, when a plurality of devices are in local and need to interact, the instruction direction can be directly determined based on the operation of a user, further UWB signal propagation matching is carried out in the instruction direction, so that the target devices in the same direction are determined, UWB signal connection is established with the target, and data transmission among the plurality of devices in the local is realized.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of embodiments of the invention.

In addition, any one of the embodiments in the present specification does not necessarily achieve all the effects described above.

Drawings

In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the embodiments of the present specification, and other drawings can be obtained by those skilled in the art according to the drawings.

FIG. 1 is a schematic diagram of a scenario addressed by an embodiment of the present disclosure;

FIG. 2 is a flowchart illustrating a UWB based device interaction method according to an embodiment of the present disclosure;

fig. 3 is a schematic diagram illustrating an orientation of a user equipment provided in an embodiment of the present specification;

FIG. 4 is a schematic diagram of similarity identification provided in an embodiment of the present disclosure;

FIG. 5 is a schematic structural diagram of an interaction apparatus of a UWB-based device according to an embodiment of the present specification;

fig. 6 is a schematic structural diagram of an apparatus for configuring a method according to an embodiment of the present disclosure.

Detailed Description

In order to make those skilled in the art better understand the technical solutions in the embodiments of the present specification, the technical solutions in the embodiments of the present specification will be described in detail below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only a part of the embodiments of the present specification, and not all the embodiments. All other embodiments that can be derived by one of ordinary skill in the art from the embodiments given herein are intended to be within the scope of protection.

In conventional local device interaction, if there are multiple devices within an environment, one of them needs to be designated for communication. For example, each machine is given a number, and the corresponding device is connected by manually entering the specific number (the connection can be scanned by wifi, bluetooth BLE, etc. protocols). The process often needs manual number input and is tedious to operate.

As shown in fig. 1, fig. 1 is a schematic view of a scenario according to an embodiment of the present disclosure. In the scenario shown in fig. 1, there are 3 other peripheral devices around, and both the user device and the other peripheral devices may be devices such as a mobile phone, a tablet computer, a smart band, etc. which can receive UWB. If in a conventional manner, the user is required to enter the corresponding peripheral device number to make the connection. Based on this, the embodiment of the present specification provides a more convenient local device interaction method.

As shown in fig. 2, fig. 2 is a flowchart of a UWB-based device interaction method provided in an embodiment of the present disclosure, and is applied to a scenario where multiple devices are all present in a same location (e.g., a same office, a conference room, a bedroom, a living room, and the like), where a size of a range of the same location may be defined based on an effective range of a UWB signal, and the method specifically includes the following steps:

S201, receiving an operation instruction of a user, and determining an instruction direction of user equipment according to the operation instruction.

As mentioned above, the user device may be a smart device such as a mobile phone, a tablet computer, and the like, and the acceptable operation instructions include: clicking (including single or double clicking), sliding, long pressing, and the like. Click and slide are taken as examples in this specification:

and if the user gives a click operation, determining the direction of the user equipment as the instruction direction. The direction of the user equipment can be obtained by jointly calculating an acceleration sensor and a geomagnetic sensor carried in the equipment, which is a mature algorithm at present and is not described herein again. Alternatively, the orientation of the user equipment may also specify a direction by default, for example, the directions pointed by the two long sides of the mobile phone. As shown in fig. 3, fig. 3 is a schematic diagram of an orientation of a user equipment provided in an embodiment of the present specification. The Y-axis direction in fig. 3 is the direction pointed by the two long sides, i.e. the default direction.

In practical applications, the direction obtained by the calculation may be the same as the direction pointed by the two long sides of the mobile phone, or may have a certain included angle. As shown in fig. 3, the calculated X-axis may be taken as a command direction.

And if the user gives the sliding operation, determining the direction pointed by the sliding operation of the user as the instruction direction. The direction in which the sliding operation of the user is directed is the direction in which a ray composed of a start point and an end point when the user performs the sliding operation is directed. For example, the direction of the screen surface of the mobile phone is calculated first, then the relative direction of the sliding operation on the mobile phone is calculated, and the final direction is obtained by superposition.

Further, when a sliding operation given by a user is received, the direction offset of the sliding operation may be combined to perform superposition according to the direction of the user equipment, so as to obtain an instruction direction of the user equipment.

S203, receiving the ultra-wideband UWB signals sent by other peripheral equipment in the environment, and respectively determining the propagation direction of each UWB signal.

Other peripheral equipment can broadcast Ultra Wide Band (UWB) signals to the surroundings all the time through UWB chips carried by the peripheral equipment, where UWB is a wireless carrier communication technology and transmits data by nanosecond-level non-sine wave narrow pulses. The other peripheral devices broadcast to the outside can be one or a plurality of.

The user device may receive UWB signals broadcast by each of the other peripheral devices by scanning the direction and distance of each signal source (i.e., each of the other peripheral devices) simultaneously.

For example, for the direction of the signal source, the arrival angle (i.e., the arrival direction) of each received UWB signal may be identified by an antenna array carried in the UWB chip, and the arrival direction is determined as the propagation direction of the UWB signal.

For the distance of the signal source, three-point ranging can be performed by measuring the time taken to reach different signal receiving devices by a positioning method (time of arrival) based on the arrival time, for example, to obtain the distance between the transmitting point and the receiving point. Or the signal sources are specifically position-detected based on a Time Difference of arrival (TDOA) positioning method TDOA, so as to accurately obtain the positions or coordinates of the signal sources and calculate the distances between the signal sources and the ue.

And S205, judging the similarity between the instruction direction of the user equipment and the propagation direction of each UWB signal, and determining other peripheral equipment with the similarity meeting preset conditions as target equipment.

After the instruction direction and the propagation direction of each signal source are obtained, the similarity degree between the instruction direction and the propagation direction of each signal source can be directly compared. For example, an included angle between the instruction direction of the user equipment and the propagation direction of each UWB signal is determined, and the degree of similarity is determined according to the size of the included angle, where the smaller the included angle is, the greater the degree of similarity is.

In an embodiment, the similarity between the angle of arrival of the signal of each signal source and the angle of the device itself may be compared to determine whether there is any peripheral device in the direction instructed by the user equipment. As shown in fig. 4, fig. 4 is a schematic diagram of similarity identification provided in an embodiment of the present disclosure. In the schematic diagram, α _ u, β _ u, μ _ u respectively represent the arrival angles of the signal sources in the ground coordinate system,

then the user equipment itself is characterizedAnd dis1, dis2, and dis3 in the figures represent the distance of each other peripheral device from the user device, respectively.

In this way, the similarity can be measured directly by applying the difference or ratio of the angle of arrival to the angle of the user equipment itself, and the smaller the difference, or the closer the ratio is to 1, the greater the similarity.

After the similarity degree of the propagation direction of each other peripheral device and the user equipment is determined, corresponding screening can be performed.

For example, other peripheral devices having a degree of similarity not lower than a preset similarity threshold (the similarity threshold may be determined based on practical experience) are determined as the target devices. In this way of filtering, it is possible to filter out multiple target devices, e.g. multiple user devices in the same direction.

Based on this, further screening may be performed according to details of each of the other peripheral devices, for example, determining the other peripheral devices having the similarity degree not lower than the preset similarity threshold, and calculating the distance between the other peripheral devices not lower than the preset similarity threshold and the user equipment according to the received UWB signal; and determining the peripheral device closest to the other peripheral devices with the similarity degree not lower than the preset similarity threshold as the target device.

And S207, establishing communication connection with the target equipment through a UWB signal, and transmitting data.

After the target device is selected, a communication connection may be established with the target device using a preset UWB protocol, so as to transfer the model, data, resource transfer, and the like between the user device and the target device.

Such mutual transfer may be performed from the target device to the user device, or may be performed from the user device to the target device.

In a specific implementation manner, cross-screen interaction between a target device and a user device can be achieved through communication connection, that is, content currently displayed in the target device is transferred to the user device, and a corresponding application is called, synchronous display, high precision of UWB and judgment of a three-dimensional angle are performed in the user device, so that a plurality of peripheral devices in the same scene can be distinguished, the peripheral device to which a user operation is directed is found, and the problem of large data transfer amount in local cross-device interaction can be solved by using UWB.

Further, in an embodiment, if there are multiple determined target devices, during the cross-screen interaction, the user equipment may also establish UWB signal connections with multiple devices at the same time, and simultaneously receive contents currently presented by multiple target devices, deliver the contents to the user equipment, and present the contents in the user equipment in a split-screen manner. The split-screen display is to divide a screen in the user equipment into a plurality of areas, and simultaneously display the contents displayed in the plurality of target equipment in the plurality of areas in the screen.

In an embodiment, after the user equipment has established a connection with the target equipment, another operation instruction of the user may be further received, and the equipment to be connected is determined from the other equipment according to the similarity between the direction of the another instruction and the propagation direction of the received UWB signal in the manner described above; and establishing UWB signal connection with the equipment to be connected and transmitting the data in the target equipment to the equipment to be connected. By the method, when other peripheral equipment is fixed equipment of which the direction is not easy to adjust, the user equipment is used as a transfer station, and data communication is realized on each piece of fixed equipment, for example, cross-screen interaction among a plurality of fixed desktop computers is realized through a mobile phone of a user, and the like.

Correspondingly, an embodiment of the present specification further provides a UWB-based device interaction apparatus, as shown in fig. 5, fig. 5 is a schematic structural diagram of the UWB-based device interaction apparatus provided in the embodiment of the present specification, and includes:

the receiving module 501 receives an operation instruction of a user, and determines an instruction direction of user equipment according to the operation instruction;

a determining module 503, configured to receive UWB signals sent by other peripheral devices in an environment, and determine propagation directions of the UWB signals respectively;

The determining module 505 is configured to determine a similarity between the instruction direction of the user equipment and the propagation direction of each UWB signal, and determine other peripheral devices with the similarity meeting a preset condition as target devices;

the connection module 507 establishes a communication connection with the target device through a UWB signal, and transfers data.

Further, the receiving module 501 receives a click operation of a user, and determines a direction of a user device as an instruction direction; or receiving a sliding operation of a user, and determining a direction pointed by the sliding operation of the user as an instruction direction; or receiving the sliding operation of the user, and determining the instruction direction of the user equipment according to the direction offset of the direction superposition sliding operation of the user equipment.

Further, the determining module 505 determines an arrival direction when each UWB signal is received, and determines the arrival direction as a propagation direction of the UWB signal; and determining an included angle between the instruction direction of the user equipment and the propagation direction of each UWB signal, and determining the similarity according to the size of the included angle, wherein the smaller the included angle is, the larger the similarity is.

Further, the determining module 505 determines other peripheral devices with similarity degrees not lower than a preset similarity threshold as target devices; or determining other peripheral equipment with the included angle not exceeding the preset angle as target equipment according to the corresponding relation between the included angle and the similarity degree.

Further, the determining module 505 determines other peripheral devices with a similarity degree not lower than a preset similarity threshold, and calculates a distance between the other peripheral devices with the similarity degree not lower than the preset similarity threshold and the user equipment according to the received UWB signal; and determining the peripheral device closest to the other peripheral devices with the similarity degree not lower than the preset similarity threshold as the target device.

Further, the connection module 507 transfers the content currently displayed in the target device to the user device, and displays the content in the user device.

Furthermore, the connection module 507 receives the content currently displayed by the multiple target devices at the same time, transfers the content to the user device, and displays the content in the user device in a split screen manner.

Further, after establishing a communication connection with the target device through a UWB signal and transmitting data, the receiving module 501 is further configured to receive another operation instruction of the user, and determine another instruction direction of the user according to the another operation instruction; the determining module 505 is further configured to determine a device to be connected from the other devices according to a similarity between the another instruction direction and a propagation direction of the received UWB signal; the connection module 507 is further configured to establish a UWB signal connection with the device to be connected, and transmit data in the target device to the device to be connected.

Embodiments of the present specification further provide a computer device, which at least includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the device interaction method shown in fig. 2 when executing the program.

Fig. 6 is a schematic diagram illustrating a more specific hardware structure of a computing device according to an embodiment of the present disclosure, where the computing device may include: a processor 1010, a memory 1020, an input/output interface 1030, a communication interface 1040, and a bus 1050. Wherein the processor 1010, memory 1020, input/output interface 1030, and communication interface 1040 are communicatively coupled to each other within the device via bus 1050.

The processor 1010 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits, and is configured to execute related programs to implement the technical solutions provided in the embodiments of the present disclosure.

The Memory 1020 may be implemented in the form of a ROM (Read Only Memory), a RAM (Random Access Memory), a static storage device, a dynamic storage device, or the like. The memory 1020 may store an operating system and other application programs, and when the technical solution provided by the embodiments of the present specification is implemented by software or firmware, the relevant program codes are stored in the memory 1020 and called to be executed by the processor 1010.

The input/output interface 1030 is used for connecting an input/output module to input and output information. The i/o module may be configured as a component in a device (not shown) or may be external to the device to provide a corresponding function. The input devices may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output devices may include a display, a speaker, a vibrator, an indicator light, etc.

The communication interface 1040 is used for connecting a communication module (not shown in the drawings) to implement communication interaction between the present apparatus and other apparatuses. The communication module can realize communication in a wired mode (such as USB, network cable and the like) and also can realize communication in a wireless mode (such as mobile network, WIFI, Bluetooth and the like).

Bus 1050 includes a path that transfers information between various components of the device, such as processor 1010, memory 1020, input/output interface 1030, and communication interface 1040.

It should be noted that although the above-mentioned device only shows the processor 1010, the memory 1020, the input/output interface 1030, the communication interface 1040 and the bus 1050, in a specific implementation, the device may also include other components necessary for normal operation. In addition, those skilled in the art will appreciate that the above-described apparatus may also include only those components necessary to implement the embodiments of the present description, and not necessarily all of the components shown in the figures.

Embodiments of the present specification also provide a computer-readable storage medium on which a computer program is stored, where the computer program is executed by a processor to implement the device interaction method shown in fig. 2.

Computer-readable media, including both permanent and non-permanent, removable and non-removable media, may implement the information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

From the above description of the embodiments, it is clear to those skilled in the art that the embodiments of the present disclosure can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the embodiments of the present specification or portions thereof contributing to the prior art may be embodied in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, or the like, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods described in the embodiments or some portions of the embodiments of the present specification.

The systems, methods, modules or units described in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. A typical implementation device is a computer, which may be in the form of a personal computer, laptop, cellular telephone, camera phone, smart phone, personal digital assistant, media player, navigation device, email messaging device, game console, tablet computer, wearable device, or a combination of any of these devices.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the method embodiment, since it is substantially similar to the method embodiment, it is relatively simple to describe, and reference may be made to the partial description of the method embodiment for relevant points. The above-described method embodiments are merely illustrative, wherein the modules described as separate components may or may not be physically separate, and the functions of the modules may be implemented in one or more software and/or hardware when implementing the embodiments of the present specification. And part or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the embodiment. One of ordinary skill in the art can understand and implement without inventive effort.

The foregoing is merely a detailed description of the embodiments of the present disclosure, and it should be noted that modifications and embellishments could be made by those skilled in the art without departing from the principle of the embodiments of the present disclosure, and should be considered as the scope of the embodiments of the present disclosure.

Claims

1. A UWB-based device interaction method, comprising:

receiving an operation instruction of a user, and determining an instruction direction of user equipment according to the operation instruction; the instruction direction is used for determining the direction of the target device;

2. The method of claim 1, wherein the receiving an operation instruction of a user and determining an instruction direction of a user device according to the operation instruction comprise:

receiving click operation of a user, and determining the direction of user equipment as an instruction direction; alternatively, the first and second electrodes may be,

receiving sliding operation of a user, and determining a direction pointed by the sliding operation of the user as an instruction direction; alternatively, the first and second electrodes may be,

and receiving the sliding operation of the user, and determining the instruction direction of the user equipment according to the direction offset of the direction superposition sliding operation of the user equipment.

3. The method of claim 1, said determining how similar a commanded direction of said user device is to a direction of propagation of said respective UWB signal, comprising:

Determining the arrival direction when each UWB signal is received, and determining the arrival direction as the propagation direction of the UWB signal;

and determining an included angle between the instruction direction of the user equipment and the propagation direction of each UWB signal, and determining the similarity degree according to the size of the included angle, wherein the smaller the included angle is, the larger the similarity degree is.

4. The method of claim 1, said determining how similar the commanded direction of said user equipment is to the direction of propagation of said respective UWB signal, comprising:

determining the similarity of the angle between the instruction direction of the user equipment and the propagation direction of each UWB signal, and taking the similarity of the angle as the similarity degree; alternatively, the first and second electrodes may be,

and determining the ratio of the instruction direction of the user equipment to the propagation direction of each UWB signal, and determining the similarity according to the size of the ratio, wherein the closer the included angle is to 1, the greater the similarity is.

5. The method of claim 1, wherein the determining the peripheral device with the similarity degree meeting the preset condition as the target device comprises:

determining the peripheral equipment with the similarity degree not lower than a preset similarity threshold as target equipment; alternatively, the first and second electrodes may be,

and determining an included angle between the instruction direction of the user equipment and the propagation direction of each UWB signal, and determining the peripheral equipment of which the included angle does not exceed a preset angle as target equipment according to the corresponding relation between the included angle and the similarity degree.

6. The method of claim 1, wherein the determining the peripheral device with the similarity degree meeting the preset condition as the target device comprises:

determining peripheral equipment with the similarity degree not lower than a preset similarity threshold, and calculating the distance between the peripheral equipment with the similarity degree not lower than the preset similarity threshold and the user equipment according to the received UWB signals;

and determining the peripheral equipment which is closest to the peripheral equipment with the similarity degree not lower than a preset similarity threshold value as the target equipment.

7. The method of claim 1, said establishing a communication connection with said target device via UWB signals and communicating data, comprising:

and transmitting the content currently displayed in the target equipment to the user equipment, and displaying the content in the user equipment.

8. The method according to claim 7, wherein if there are a plurality of target devices, said transferring the content currently displayed in the target device to the user device and displaying the content in the user device comprises:

and simultaneously receiving the currently displayed contents of a plurality of target devices, transmitting the currently displayed contents to the user equipment, and displaying the currently displayed contents in the user equipment in a split screen mode.

9. The method of claim 1, after said establishing a communication connection with said target device via UWB signals and communicating data, said method further comprising:

Receiving another operation instruction of the user, and determining another instruction direction of the user according to the another operation instruction;

determining equipment to be connected from the peripheral equipment according to the similarity degree of the other instruction direction and the propagation direction of the received UWB signals;

and establishing UWB signal connection with the equipment to be connected, and transmitting data in the target equipment to the equipment to be connected.

10. An apparatus for UWB-based device interaction, comprising:

the receiving module is used for receiving an operation instruction of a user and determining the instruction direction of user equipment according to the operation instruction; the command direction is used for determining the direction of a target peripheral device;

the second determining module is used for determining the similarity degree between the instruction direction of the user equipment and the propagation direction of each UWB signal, and determining the peripheral equipment of which the similarity degree meets the preset condition as target equipment;

11. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any one of claims 1 to 9 when executing the program.