CN113453146B - Equipment interaction control method, equipment interaction control device and storage medium - Google Patents

Equipment interaction control method, equipment interaction control device and storage medium Download PDF

Info

Publication number
CN113453146B
CN113453146B CN202110571256.8A CN202110571256A CN113453146B CN 113453146 B CN113453146 B CN 113453146B CN 202110571256 A CN202110571256 A CN 202110571256A CN 113453146 B CN113453146 B CN 113453146B
Authority
CN
China
Prior art keywords
uwb
terminal
space
devices
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110571256.8A
Other languages
Chinese (zh)
Other versions
CN113453146A (en
Inventor
蔡亮
彭聪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN202110571256.8A priority Critical patent/CN113453146B/en
Publication of CN113453146A publication Critical patent/CN113453146A/en
Application granted granted Critical
Publication of CN113453146B publication Critical patent/CN113453146B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/025—Services making use of location information using location based information parameters
    • H04W4/026—Services making use of location information using location based information parameters using orientation information, e.g. compass
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/023—Services making use of location information using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30—Services specially adapted for particular environments, situations or purposes
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Automation & Control Theory (AREA)
  • Telephone Function (AREA)

Abstract

The disclosure relates to a device interaction control method, a device interaction control apparatus and a storage medium. The equipment interaction control method is applied to a terminal, and an ultra wideband communication UWB chip is installed in the terminal, and comprises the following steps: a first spatial location of the terminal in a space including a plurality of UWB devices is determined. And determining the current position of the terminal in space as a second space position, and determining the relative position between the second space position and the first space position. Based on the relative position and the first azimuth mapping relationship, it is determined that the terminal has a second azimuth mapping relationship with each of the plurality of UWB devices at a second spatial position. And determining UWB equipment in the current direction of the terminal based on the current direction of the terminal and the second azimuth mapping relation, and performing interactive control on the UWB equipment in the current direction. Based on the azimuth mapping relation between the terminal and each UWB, the situation that a plurality of UWB devices are overlapped in space and cannot be identified can be effectively avoided.

Description

Equipment interaction control method, equipment interaction control device and storage medium
Technical Field
The disclosure relates to the technical field of terminal control, and in particular relates to a device interaction control method, a device interaction control device and a storage medium.
Background
The Ultra Wide Band (UWB) technology is a wireless carrier communication technology, and has the advantages of insensitivity to channel fading, low power spectrum density of a transmitting signal, low interception rate, low system complexity, capability of providing positioning accuracy of a plurality of centimeters and the like.
Along with continuous intellectualization of the equipment, accurate space positioning is performed on the terminal based on the ultra-wideband communication UWB chip and the array antenna. Based on the orientation of the terminal, the terminal can establish connection with a plurality of other UWB devices with ultra-wideband communication UWB chips, further the UWB device to be controlled is determined according to the orientation of the terminal, a control window of the UWB device to be controlled is popped up, and a user further controls the UWB device to be controlled through the control window.
In the prior art, the UWB device to be controlled is determined according to the orientation of the terminal, and the UWB device to be controlled is a UWB device directly opposite to the terminal in the orientation. The terminal cannot determine if there are other optional UWB devices to be controlled in this orientation.
Disclosure of Invention
In order to overcome the problems in the related art, the present disclosure provides an apparatus interaction control method, an apparatus interaction control device, and a storage medium.
According to a first aspect of an embodiment of the present disclosure, there is provided an apparatus interaction control method applied to a terminal, in which an ultra wideband communication UWB chip is installed, the apparatus interaction control method including: a first spatial location of the terminal in a space including a plurality of UWB devices is determined, the terminal having a first azimuthal mapping relationship with each of the plurality of UWB devices at the first spatial location. And determining the current position of the terminal in the space as a second space position, and determining the relative position between the second space position and the first space position. And determining that the terminal has a second azimuth mapping relation with each UWB device in the plurality of UWB devices at the second spatial position based on the relative position and the first azimuth mapping relation. And determining UWB equipment in the current direction of the terminal based on the current direction of the terminal and the second azimuth mapping relation, and performing interactive control on the UWB equipment in the current direction.
In one embodiment, the first direction mapping relationship is determined as follows: and controlling the terminal to point to each UWB device in the plurality of UWB devices respectively, and determining a directional extension line between the terminal and each UWB device in the plurality of UWB devices respectively. And directing the terminal to an intersection point of directional extension lines of all the plurality of UWB devices as the first space position. And respectively determining the azimuth mapping relation between the first space position and each UWB device in the plurality of UWB devices to obtain the first azimuth mapping relation.
In another embodiment, the determining the relative position between the second spatial position and the first spatial position includes: and determining a deflection direction of the terminal in the space and a travel distance relative to the first space position in real time based on an acceleration gyro sensor installed in the terminal, and determining a relative position between the second space position and the first space position based on the deflection direction and the travel distance.
In yet another embodiment, the performing interactive control on the UWB device currently pointing upwards includes: in response to including a UWB device in the current direction of the terminal, the UWB device is interactively controlled as the UWB device to be controlled.
In yet another embodiment, the performing interactive control on the UWB device currently pointing upwards includes: and responding to the current direction of the terminal to comprise a plurality of UWB devices, and displaying prompt information by using a popup window, wherein the prompt information is used for prompting the existence of the plurality of UWB devices. And under the condition that a selection instruction of the UWB equipment to be controlled is selected from the plurality of UWB equipment based on the prompt information by a user, the selected UWB equipment is used as the UWB equipment to be controlled to carry out interactive control.
According to a second aspect of the embodiments of the present disclosure, there is provided an apparatus interaction control device applied to a terminal in which an ultra wideband communication UWB chip is installed, the apparatus interaction control method including: a determining unit, configured to determine a first spatial position of the terminal in a space including a plurality of UWB devices, determine a current position of the terminal in the space as a second spatial position, determine a relative position between the second spatial position and the first spatial position, and determine that the terminal has a second azimuth mapping relationship with each of the plurality of UWB devices at the second spatial position based on the relative position and the first azimuth mapping relationship, where the terminal has the first azimuth mapping relationship with each of the plurality of UWB devices at the first spatial position. And the control unit is used for determining UWB equipment in the current direction of the terminal based on the current direction of the terminal and the second azimuth mapping relation, and performing interactive control on the UWB equipment in the current direction.
In one embodiment, the first direction mapping relationship is determined as follows: and controlling the terminal to point to each UWB device in the plurality of UWB devices respectively, and determining a directional extension line between the terminal and each UWB device in the plurality of UWB devices respectively. And directing the terminal to an intersection point of directional extension lines of all the plurality of UWB devices as the first space position. And respectively determining the azimuth mapping relation between the first space position and each UWB device in the plurality of UWB devices to obtain the first azimuth mapping relation.
In another embodiment, the determination unit determines the relative position between the second spatial position and the first spatial position by: and determining a deflection direction of the terminal in the space and a travel distance relative to the first space position in real time based on an acceleration gyro sensor installed in the terminal, and determining a relative position between the second space position and the first space position based on the deflection direction and the travel distance.
In yet another embodiment, the control unit performs interactive control on the UWB device currently pointed up in the following manner: in response to including a UWB device in the current direction of the terminal, the UWB device is interactively controlled as the UWB device to be controlled.
In yet another embodiment, the control unit performs interactive control on the UWB device currently pointed up in the following manner: and responding to the current direction of the terminal to comprise a plurality of UWB devices, and displaying prompt information by using a popup window, wherein the prompt information is used for prompting the existence of the plurality of UWB devices. And under the condition that a selection instruction of the UWB equipment to be controlled is selected from the plurality of UWB equipment based on the prompt information by a user, the selected UWB equipment is used as the UWB equipment to be controlled to carry out interactive control.
According to a third aspect of the embodiments of the present disclosure, there is provided an apparatus interaction control device, including: a memory for storing instructions; a processor; the instructions for invoking the memory store perform any of the device interaction control methods described above.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, perform any one of the above-described device interaction control methods.
The technical scheme provided by the embodiment of the disclosure can comprise the following beneficial effects: according to the equipment interaction control method provided by the disclosure, according to the first space position of the terminal in the space, the first direction mapping relation between the terminal and the plurality of UWB equipment in the space is respectively determined so as to determine the direction relation of the plurality of UWB equipment relative to the first space position of the terminal. According to the relative position between the second spatial position and the first spatial position of the current position of the terminal, the second azimuth mapping relation between the terminal and a plurality of UWB devices in the space can be redetermined, and then one or a plurality of UWB devices existing in the direction can be determined and controlled according to the current direction of the terminal, so that the situation that the plurality of UWB devices are overlapped in space and cannot be identified is effectively avoided.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flow chart illustrating a device interaction control method according to an exemplary embodiment.
FIG. 2 is a flowchart illustrating a method of determining a mapping relationship, according to an example embodiment.
Fig. 3 is a schematic diagram illustrating a spatial location according to an exemplary embodiment.
Fig. 4 is another schematic diagram of a spatial location shown according to an exemplary embodiment.
Fig. 5 is a flow chart illustrating another device interaction control method according to an example embodiment.
Fig. 6 is a block diagram illustrating a device interaction control apparatus according to an example embodiment.
Fig. 7 is a block diagram of an electronic device, according to an example embodiment.
Fig. 8 is a block diagram illustrating a device interaction control apparatus according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.
In the prior art, when a terminal performs interactive control with other UWB equipment in the same space through an ultra-wideband communication chip in the terminal, the UWB equipment which is directly opposite to the terminal face to face in the direction is determined to be the UWB equipment to be controlled by the terminal according to the direction of the terminal, and then the UWB equipment is used for controlling a display window of the UWB equipment through a popup window to prompt a terminal user to control the UWB equipment.
In the process of controlling the UWB device by the terminal, if the spatial position of the terminal changes, and a plurality of UWB devices appear in the direction of the terminal, the method can only determine that the UWB device which is directly opposite to the terminal in the direction is the UWB device to be controlled by the terminal, and can not determine whether other UWB devices which can be controlled exist in the direction. If the user wants to control other UWB devices in the direction through the terminal, the position needs to be moved again until the terminal can directly face to face with the other UWB devices in the new space position and the new direction of the terminal, and the purpose of controlling the other UWB devices is achieved.
In view of this, the present disclosure provides an apparatus interaction control method applied to a terminal mounted with an ultra wideband communication UWB chip. By utilizing the characteristic of accurate positioning of the UWB technology, the first direction mapping relation between the terminal and a plurality of UWB devices in the space can be predetermined according to the first space position of the terminal in the space. And re-determining a second azimuth mapping relation between the terminal and each UWB device according to the relative position between the current second spatial position and the first spatial position of the terminal in space, further determining all UWB devices included in the current direction of the terminal at the second spatial position, and controlling each UWB device in the current direction, so that the situation that a plurality of UWB devices are overlapped in space and cannot be identified is effectively avoided.
In the present disclosure, the terminal is a terminal that is mounted with an ultra wideband communication UWB chip and is capable of transmitting a control instruction. In one example, the types of terminals may include mobile terminals, such as: cell phones, tablets, notebooks, etc. In another example, the structure of the terminal may include: a two-sided screen terminal, a folded screen terminal, a full screen terminal, etc. In yet another example, the UWB device may include: intelligent household appliances such as air conditioner, television, sound box, etc.
Fig. 1 is a flow chart illustrating a device interaction control method according to an exemplary embodiment. As shown in fig. 1, the device interaction control method includes the following steps S11 to S14.
In step S11, a first spatial position of the terminal in a space including a plurality of UWB devices is determined.
In the embodiment of the disclosure, the terminal can sense UWB devices directly opposite to the terminal in each direction and the distance between each UWB device and the terminal in the same space based on the ultra-wideband communication UWB chip and the array antenna which are installed in the terminal.
In order to facilitate the terminal to be able to clearly determine a plurality of UWB devices included in the space, a first spatial position of the terminal having a first orientation mapping relationship with each of the plurality of UWB devices in the space is determined first, so that the terminal can establish an orientation mapping relationship with each of the plurality of UWB devices in each orientation in the space by rotating different orientations at the first spatial position, thereby achieving the purpose of controlling the UWB devices in each orientation in the plurality of UWB devices without moving the position.
In an example, if the locations of the plurality of UWB devices in the space are not changed, the first spatial location may be historical data stored in the terminal in advance, and then when the terminal enters the space, the historical data is called to obtain the first spatial location.
In another example, if the locations of the plurality of UWB devices within the space change, or the terminal enters the space for the first time, the first spatial location may be determined based on the control terminal pointing to each of the plurality of UWB devices, respectively.
In step S12, the current position of the terminal in space is determined as a second spatial position, and the relative position between the second spatial position and the first spatial position is determined.
In the embodiment of the present disclosure, the current location may be any location of the terminal in space. To determine the change in position of the terminal, the current position of the terminal in space is determined as a second spatial position.
The current position corresponding to the second spatial position may be that the in-space position corresponding to the first spatial position belongs to the same position. It is understood that the terminal is always located at the first spatial position, and no position change occurs, so that the current position corresponding to the second spatial position belongs to the same position as the position in the space corresponding to the first spatial position. Or when the terminal appears in the space again, the current position just belongs to the same position in the space corresponding to the first space position, and therefore, the second space position is the same as the first space position.
The current position corresponding to the second spatial position may also be that the in-space position corresponding to the first spatial position belongs to a different position. It can be understood that the terminal changes its position based on the position in space corresponding to the first spatial position, and further obtains the second spatial position according to the current position in space. Or when the terminal appears in the space again, the current position of the terminal in the space and the position in the space corresponding to the first space position do not belong to the same position.
Therefore, in order to determine the positional relationship between the second spatial position and the first spatial position, the relative position between the second spatial position and the first spatial position is determined based on the first spatial position, so that it can be clarified whether the current position of the terminal in space belongs to the same position as the position in space corresponding to the first spatial position through the relative position, and further, whether the control and controlled relationship can be established between the terminal and each of a plurality of UWB devices in each direction in space by rotating different directions when the terminal is in the second spatial position.
In step S13, it is determined that the terminal has a second azimuth mapping relationship with each of the plurality of UWB devices at the second spatial position based on the relative position and the first azimuth mapping relationship.
In an embodiment of the present disclosure, at the second spatial position, an azimuth mapping relationship between the terminal and each of the plurality of UWB devices is determined by rotating the orientation of the terminal, respectively. Because the current position corresponding to the second spatial position may belong to different positions with respect to the spatial position corresponding to the first spatial position, the situation that part of UWB devices overlap in a certain direction of the second spatial position occurs, that is, the situation that part of UWB devices are on an extension line of the same direction occurs, so that the terminal can only establish an azimuth mapping relationship with UWB devices directly opposite to the terminal in the direction. That is, when the terminal establishes an azimuth mapping relationship with each of the plurality of UWB devices in the space at the second spatial location, it may result in that the terminal cannot establish an azimuth mapping relationship with a part of the UWB devices.
In order to avoid the situation, based on the determined relative position and the first azimuth mapping relation, whether the UWB devices with overlapped directions and the corresponding UWB devices exist in each pointing direction or not can be determined in the process that the terminal is located at the second spatial position and each UWB device in the plurality of UWB devices is established, so that the terminal can establish the azimuth mapping relation with each UWB device in the plurality of UWB devices at the second spatial position, the missing phenomenon is avoided, and the second azimuth mapping relation between the terminal and each UWB device in the plurality of UWB devices at the second spatial position is determined.
In step S14, the UWB device in the current orientation of the terminal is determined based on the current orientation of the terminal and the second azimuth mapping relationship, and interactive control is performed on the UWB device in the current orientation.
In the embodiment of the disclosure, based on the current direction of the terminal and the second azimuth mapping relationship, it can be determined whether a plurality of UWB devices with overlapping directions are included in the current direction. And the terminal performs interactive control on the UWB device in the current direction according to the UWB device determined in the current direction. In one example, if a plurality of overlapped UWB devices are not included in the current direction, only one UWB device is determined to be a UWB device that performs interactive control with the terminal, and further performs interactive control with the UWB device. If the current direction comprises a plurality of UWB devices with overlapped directions, determining the plurality of UWB devices with overlapped directions as the UWB device with the current direction of the terminal, and further performing interactive control with the plurality of UWB devices with overlapped directions. In another example, if a plurality of UWB devices including overlapping directions in the current direction of the terminal, one of the UWB devices may be optionally controlled according to the requirement when performing the interactive control, which is not limited in the present disclosure.
Through the embodiment, based on the first space position of the terminal in the space, whether a plurality of UWB devices with overlapped directions appear in the current direction of the terminal at the second space position can be determined, and when the relationship between control and controlled is established between the current direction UWB device and the UWB device, the phenomenon of missing UWB devices can be avoided, so that the current direction UWB device can be interactively controlled by the terminal, and further the use experience of a user can be improved.
The following embodiment will specifically explain a determination process of the first azimuth mapping relationship.
FIG. 2 is a flowchart illustrating a method of determining a mapping relationship, according to an example embodiment. As shown in fig. 2, the method of determining the mapping relationship includes the following steps.
In step S21, the control terminal points to each of the plurality of UWB devices, respectively, and determines directional extension lines between the terminals points to each of the plurality of UWB devices, respectively.
In the embodiment of the disclosure, the control terminal points to each UWB device in the plurality of UWB devices respectively, and then establishes UWB communication connection with each UWB device in the space. In the process of controlling the terminal to point to each UWB device, the direction extension lines of the terminal to each UWB device in the plurality of UWB devices are respectively determined, so that the position of the terminal in the space can be determined according to the intersection point of the direction extension lines, and the position of the terminal does not need to be moved, so that the azimuth mapping relation can be established between the rotational direction and all the UWB devices in the space.
In step S22, an intersection of directional extension lines of the terminals directed to each of the plurality of UWB devices is set as a first spatial position.
In step S23, the azimuth mapping relationship between the first spatial position and each of the plurality of UWB devices is determined, and a first azimuth mapping relationship is obtained.
In an implementation scenario, as shown in fig. 3, point a is the first spatial position of the terminal 1. Fig. 3 is a schematic diagram illustrating a spatial location according to an exemplary embodiment. At point a, the terminal 1 can establish an azimuth mapping relationship with each UWB device 2 in space by rotating the direction, determine the relative direction of each UWB device 2 with respect to the terminal 1, and further obtain a first azimuth mapping relationship.
In an embodiment, if UWB devices are newly added in space, the above manner is adopted to redetermine the new first spatial location, so as to avoid missing the newly added UWB devices when confirming the second azimuth mapping relationship.
In another embodiment, the relative position between the second spatial position and the first spatial position may be determined based on an accelerometer-gyro sensor installed in the terminal. In one example, the accelerometer-gyro sensor may be one integrated component, may be two separate components in the same circuit, and is not limited in this disclosure. When the motion state of the terminal changes, the position and the direction of the terminal can be changed, and then the deflection direction of the terminal in space and the travelling distance relative to the first space position can be determined in real time through the acceleration gyroscope sensor, so that the first space position is taken as a reference, and the relative position between the second space position and the first space position can be determined according to the determined deflection direction and travelling distance.
In an implementation scenario, the process of determining the relative position between the second spatial position and the first spatial position may be as shown in fig. 4. Fig. 4 is another schematic diagram of a spatial location shown according to an exemplary embodiment. The point a is the first spatial position of the terminal 1, and when the motion state of the terminal 1 changes, the position and the direction of the terminal 1 change. Based on the acceleration gyro sensor installed in the terminal, the deflection direction of the terminal in space and the travel distance of the current position B of the terminal 1 relative to the first space position a can be determined in real time in the process of moving the terminal 1, so that the relative position between the second space position and the first space position is determined. After determining the relative position between the second spatial position and the first spatial position, it may be determined whether or not a UWB device overlapping in direction appears in the current direction of the terminal 1 based on the terminal having the first direction mapping relationship with each of the plurality of UWB devices. If the UWB devices with overlapping directions appear, the UWB device a and the UWB device b with overlapping directions may be determined as UWB devices to be interactively controlled with the terminal.
In an embodiment, when it is determined that the current direction of the terminal at the second spatial position includes one UWB device based on the relative position and the first direction mapping relationship, the UWB device is used as the UWB device to be controlled to be interactively controlled by the terminal in response to the terminal including one UWB device in the current direction. In one example, a control window for controlling the UWB device to be controlled may be displayed in the terminal through a popup window, so that a user may control the UWB device to be controlled according to the control window.
In another embodiment, when it is determined that the current orientation of the terminal at the second spatial location includes a plurality of UWB devices based on the relative location and the first orientation mapping, then characterizing that the current orientation includes UWB devices overlapping in multiple directions. In order to facilitate prompting a user to display prompt information through a popup window when a plurality of UWB devices exist in the current direction, prompting that a plurality of UWB devices capable of being interactively controlled exist in the current direction, so that the user can select and determine the UWB devices required to be interactively controlled. After the user selects according to the received prompt information, a selection instruction for selecting the UWB equipment to be controlled from a plurality of UWB equipment is triggered. And the terminal performs interactive control on the selected UWB equipment serving as the UWB equipment to be controlled according to the received selection instruction.
In an implementation scenario, taking a terminal as a mobile phone and a UWB device as an intelligent device as an example, a process of controlling multiple UWB devices in the same space by using the mobile phone may be as shown in fig. 5. Fig. 5 is a flow chart illustrating another device interaction control method according to an example embodiment.
In the same space, opening UWB chips in the mobile phone and UWB chips of all UWB devices in the space to ensure that the mobile phone can establish UWB communication connection with all UWB devices in the space, so as to determine the UWB devices to be controlled according to the pointing direction of the mobile phone.
The method comprises the steps of controlling a mobile phone to point to each UWB device in a plurality of UWB devices in a space respectively, and determining a direction extension line when the mobile phone points to each UWB device respectively. And pointing the mobile phone to the intersection point of the directional extension lines of the UWB devices, and determining the first space position of the mobile phone in the space. And determining the azimuth mapping relation between the mobile phone and each UWB device according to the determined first space position to obtain a first azimuth mapping relation.
And determining the travelling track of the mobile phone in the space in real time through an acceleration gyroscope sensor arranged in the mobile phone, namely determining the deflection direction of the mobile phone in the space and the travelling distance relative to the first space position, and determining the current position as a second space position.
And determining the relative position between the second spatial position and the first spatial position according to the first spatial position, and further determining a second azimuth mapping relation between the current second spatial position and each UWB device based on the relative position and the first azimuth mapping relation.
Based on the current direction of the mobile phone and the second direction mapping relation, determining whether UWB devices with overlapped directions exist in the current direction, namely whether a plurality of UWB devices are included in the current direction. If the UWB device comprises a plurality of UWB devices, prompt information is displayed through a popup window to prompt a user that the plurality of UWB devices exist in the current direction, so that the user can select the UWB device to be controlled which needs to be interactively controlled. If only one UWB device exists, the UWB device is used as the UWB device to be controlled, and the UWB device to be controlled is displayed through the popup window.
Based on the same conception, the embodiment of the disclosure also provides a device interaction control device applied to the terminal. Wherein, the ultra wideband communication UWB chip is installed in the terminal.
It can be understood that, in order to implement the above-mentioned functions, the device interaction control apparatus provided in the embodiments of the present disclosure includes corresponding hardware structures and/or software modules that perform each function. The disclosed embodiments may be implemented in hardware or a combination of hardware and computer software, in combination with the various example elements and algorithm steps disclosed in the embodiments of the disclosure. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Those skilled in the art may implement the described functionality using different approaches for each particular application, but such implementation is not to be considered as beyond the scope of the embodiments of the present disclosure.
Fig. 6 is a block diagram illustrating a device interaction control apparatus according to an example embodiment. Referring to fig. 6, the device interaction control apparatus 100 includes a determination unit 101 and a control unit 102.
A determining unit 101, configured to determine a first spatial position of the terminal in a space including a plurality of UWB devices, determine a current position of the terminal in the space as a second spatial position, determine a relative position between the second spatial position and the first spatial position, and determine that the terminal has a second azimuth mapping relationship with each of the plurality of UWB devices at the second spatial position based on the relative position and the first azimuth mapping relationship, wherein the terminal has a first azimuth mapping relationship with each of the plurality of UWB devices at the first spatial position.
And the control unit 102 is used for determining the UWB device in the current direction of the terminal based on the current direction of the terminal and the second direction mapping relation and performing interactive control on the UWB device in the current direction.
In one embodiment, the first direction mapping is determined as follows: the control terminal points to each UWB device in the plurality of UWB devices respectively, and determines the directional extension line between the terminal points to each UWB device in the plurality of UWB devices respectively. And pointing the terminal to an intersection point of directional extension lines of each of the plurality of UWB devices as a first spatial position. And respectively determining the azimuth mapping relation between the first space position and each UWB device in the plurality of UWB devices to obtain a first azimuth mapping relation.
In another embodiment, the determination unit 101 determines the relative position between the second spatial position and the first spatial position in the following manner: the yaw direction of the terminal in space and the travel distance relative to the first spatial position are determined in real time based on the accelerometer gyro sensor mounted in the terminal, and the relative position between the second spatial position and the first spatial position is determined based on the yaw direction and the travel distance.
In yet another embodiment, the control unit 102 interactively controls the UWB device currently pointing upwards in the following manner: in response to including a UWB device in the current direction of the terminal, the UWB device is interactively controlled as the UWB device to be controlled.
In yet another embodiment, the control unit 102 interactively controls the UWB device currently pointing upwards in the following manner: in response to the plurality of UWB devices being included in the current orientation of the terminal, the popup displays a hint message for hinting that the plurality of UWB devices are present. And under the condition that a selection instruction of the UWB equipment to be controlled is selected from the plurality of UWB equipment based on the prompt information by the user, the selected UWB equipment is used as the UWB equipment to be controlled to carry out interactive control.
The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.
Fig. 7 is a block diagram of an electronic device for performing a device interaction control method, according to an example embodiment. For example, the electronic device 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 7, the electronic device 200 may include one or more of the following components: a processing component 202, a memory 204, a power component 206, a multimedia component 208, an audio component 210, an input/output (I/O) interface 212, a sensor component 214, and a communication component 216.
The processing component 202 generally controls overall operation of the electronic device 200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 202 can include one or more modules that facilitate interactions between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.
The memory 204 is configured to store various types of data to support operations at the electronic device 200. Examples of such data include instructions for any application or method operating on the electronic device 200, contact data, phonebook data, messages, pictures, videos, and the like. The memory 204 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power component 206 provides power to the various components of the electronic device 200. The power components 206 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 200.
The multimedia component 208 includes a screen between the electronic device 200 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front-facing camera and/or a rear-facing camera. When the electronic device 200 is in an operational mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 210 is configured to output and/or input audio signals. For example, the audio component 210 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 200 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 204 or transmitted via the communication component 216. In some embodiments, audio component 210 further includes a speaker for outputting audio signals.
The I/O interface 212 provides an interface between the processing assembly 202 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 214 includes one or more sensors for providing status assessment of various aspects of the electronic device 200. For example, the sensor assembly 214 may detect an on/off state of the electronic device 200, a relative positioning of the components, such as a display and keypad of the electronic device 200, a change in position of the electronic device 200 or a component of the electronic device 200, the presence or absence of a user's contact with the electronic device 200, an orientation or acceleration/deceleration of the electronic device 200, and a change in temperature of the electronic device 200. The sensor assembly 214 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 216 is configured to facilitate communication between the electronic device 200 and other devices, either wired or wireless. The electronic device 200 may access a wireless network based on a communication standard, such as WiFi,2G, or 3G, or a combination thereof. In one exemplary embodiment, the communication component 216 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the electronic device 200 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for performing any of the device interaction control methods described above.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 204, including instructions executable by processor 220 of electronic device 200 to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
Fig. 8 is a block diagram illustrating a device interaction control apparatus according to an exemplary embodiment. For example, the device interaction control apparatus 300 may be provided as a server. Referring to fig. 8, device interaction control apparatus 300 includes a processing component 322 that further includes one or more processors and memory resources represented by memory 332 for storing instructions, such as application programs, executable by processing component 322. The application program stored in memory 332 may include one or more modules each corresponding to a set of instructions. Further, the processing component 322 is configured to execute instructions to perform any of the device interaction control methods described above.
The device interaction control apparatus 300 may further include a power component 326 configured to perform power management of the device interaction control apparatus 300, a wired or wireless network interface 350 configured to connect the device interaction control apparatus 300 to a network, and an input output (I/O) interface 358. The device interaction control apparatus 300 may operate based on an operating system stored in the memory 332, such as Windows server (tm), mac OS XTM, unixTM, linuxTM, freeBSDTM, or the like.
It is further understood that the term "plurality" in this disclosure means two or more, and other adjectives are similar thereto. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship. The singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It is further understood that the terms "first," "second," and the like are used to describe various information, but such information should not be limited to these terms. These terms are only used to distinguish one type of information from another and do not denote a particular order or importance. Indeed, the expressions "first", "second", etc. may be used entirely interchangeably. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure.
It will be further understood that "connected" includes both direct connection where no other member is present and indirect connection where other element is present, unless specifically stated otherwise.
It will be further understood that although operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (10)

1. The device interaction control method is characterized by being applied to a terminal, wherein an ultra wideband communication UWB chip is installed in the terminal, and the device interaction control method comprises the following steps:
determining a first spatial position of the terminal in a space comprising a plurality of UWB devices, wherein the terminal has a first orientation mapping relation with each UWB device in the plurality of UWB devices at the first spatial position;
determining the current position of the terminal in the space as a second space position, and determining the relative position between the second space position and the first space position, wherein the current position corresponding to the second space position and the position in the space corresponding to the first space position belong to different positions;
determining a second azimuth mapping relationship between the terminal and each UWB device in the plurality of UWB devices at the second spatial position based on the relative position and the first azimuth mapping relationship;
determining whether a plurality of UWB devices with overlapped directions are included in the current direction of the terminal or not based on the current direction of the terminal and the second azimuth mapping relation;
if the current direction comprises a plurality of UWB devices with overlapped directions, determining the plurality of UWB devices with overlapped directions as UWB devices with the current direction of the terminal, and performing interactive control with the plurality of UWB devices with overlapped directions; or if the current direction comprises a plurality of UWB devices with overlapped directions, displaying prompt information by a popup window, and under the condition that a user selects a selection instruction of the UWB device to be controlled from the plurality of UWB devices with overlapped directions based on the prompt information, performing interactive control by using the selected UWB device as the UWB device to be controlled, wherein the prompt information is used for prompting that the plurality of UWB devices exist in the current direction;
Wherein the first spatial position satisfies: the terminal can establish an azimuth mapping relation with each UWB device in the space through rotating the direction without moving the terminal position at the first space position, and when the terminal rotates at the first space position, no UWB device with overlapped directions exists in each direction.
2. The device interaction control method according to claim 1, wherein the first direction mapping relationship is determined in the following manner:
controlling the terminal to point to each UWB device in the plurality of UWB devices respectively, and determining a direction extension line of the terminal pointing to each UWB device in the plurality of UWB devices respectively;
directing the terminal to an intersection point of directional extension lines of all the plurality of UWB devices as the first space position;
and respectively determining the azimuth mapping relation between the first space position and each UWB device in the plurality of UWB devices to obtain the first azimuth mapping relation.
3. The device interaction control method according to claim 1 or 2, characterized in that the determining the relative position between the second spatial position and the first spatial position comprises:
and determining a deflection direction of the terminal in the space and a travel distance relative to the first space position in real time based on an acceleration gyro sensor installed in the terminal, and determining a relative position between the second space position and the first space position based on the deflection direction and the travel distance.
4. The device interaction control method of claim 1, further comprising:
and if the current direction of the terminal comprises a UWB device, the UWB device is used as the UWB device to be controlled to carry out interactive control.
5. An apparatus interaction control device, which is applied to a terminal, in which an ultra wideband communication UWB chip is installed, the apparatus interaction control device comprising:
a determining unit, configured to determine a first spatial position of the terminal in a space including a plurality of UWB devices, determine a current position of the terminal in the space as a second spatial position, and determine a relative position between the second spatial position and the first spatial position, where the current position corresponding to the second spatial position and an intra-spatial position corresponding to the first spatial position belong to different positions, and determine a second azimuth mapping relationship between the terminal at the second spatial position and each of the plurality of UWB devices based on the relative position and the first azimuth mapping relationship, where the terminal has the first azimuth mapping relationship between the terminal at the first spatial position and each of the plurality of UWB devices;
A control unit configured to determine whether a plurality of UWB devices with overlapping directions are included in the current direction of the terminal based on the current direction of the terminal and the second azimuth mapping relationship;
the control unit is further configured to: if the current direction comprises a plurality of UWB devices with overlapped directions, determining the plurality of UWB devices with overlapped directions as UWB devices with the current direction of the terminal, and performing interactive control with the plurality of UWB devices with overlapped directions; or, the control unit is further configured to: if the current direction comprises a plurality of UWB devices with overlapped directions, displaying prompt information by a popup window, and under the condition that a user selects a selection instruction of the UWB device to be controlled from the plurality of UWB devices with overlapped directions based on the prompt information, performing interactive control on the selected UWB device as the UWB device to be controlled, wherein the prompt information is used for prompting that the plurality of UWB devices exist in the current direction;
wherein the first spatial position satisfies: the terminal can establish an azimuth mapping relation with each UWB device in the space through rotating the direction without moving the terminal position at the first space position, and when the terminal rotates at the first space position, no UWB device with overlapped directions exists in each direction.
6. The device interaction control apparatus of claim 5 wherein the first orientation mapping is determined by:
controlling the terminal to point to each UWB device in the plurality of UWB devices respectively, and determining a direction extension line of the terminal pointing to each UWB device in the plurality of UWB devices respectively;
directing the terminal to an intersection point of directional extension lines of all the plurality of UWB devices as the first space position;
and respectively determining the azimuth mapping relation between the first space position and each UWB device in the plurality of UWB devices to obtain the first azimuth mapping relation.
7. The device interaction control apparatus according to claim 5 or 6, wherein the determination unit determines the relative position between the second spatial position and the first spatial position by:
and determining a deflection direction of the terminal in the space and a travel distance relative to the first space position in real time based on an acceleration gyro sensor installed in the terminal, and determining a relative position between the second space position and the first space position based on the deflection direction and the travel distance.
8. The device interaction control apparatus of claim 5, wherein the control unit is further configured to:
and if the current direction of the terminal comprises a UWB device, the UWB device is used as the UWB device to be controlled to carry out interactive control.
9. An electronic device, the electronic device comprising:
a memory for storing instructions; and
a processor for invoking said instructions stored in memory to perform a device interaction control method as recited in any of claims 1-4.
10. A computer readable storage medium storing instructions which, when executed by a processor, perform the device interaction control method of any of claims 1-4.
CN202110571256.8A 2021-05-25 2021-05-25 Equipment interaction control method, equipment interaction control device and storage medium Active CN113453146B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110571256.8A CN113453146B (en) 2021-05-25 2021-05-25 Equipment interaction control method, equipment interaction control device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110571256.8A CN113453146B (en) 2021-05-25 2021-05-25 Equipment interaction control method, equipment interaction control device and storage medium

Publications (2)

Publication Number Publication Date
CN113453146A CN113453146A (en) 2021-09-28
CN113453146B true CN113453146B (en) 2024-01-09

Family

ID=77810207

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110571256.8A Active CN113453146B (en) 2021-05-25 2021-05-25 Equipment interaction control method, equipment interaction control device and storage medium

Country Status (1)

Country Link
CN (1) CN113453146B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004320209A (en) * 2003-04-14 2004-11-11 Sony Corp Communication device, its display method, computer program, and communication method
JP2010238096A (en) * 2009-03-31 2010-10-21 Ntt Docomo Inc Terminal device, augmented reality system and terminal screen display method
CN105424032A (en) * 2015-12-08 2016-03-23 小米科技有限责任公司 Terminal indoor positioning method and device
CN106789461A (en) * 2016-12-12 2017-05-31 北京小米移动软件有限公司 The method and device of intelligent home device connection
CN112327653A (en) * 2020-11-13 2021-02-05 北京小米移动软件有限公司 Device control method, device control apparatus, and storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9462108B2 (en) * 2014-05-12 2016-10-04 Lg Electronics Inc. Mobile terminal and method for controlling the mobile terminal
GB2542631B (en) * 2015-09-28 2017-09-13 tado GmbH Method and system for controlling a home appliance depending on a user position

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004320209A (en) * 2003-04-14 2004-11-11 Sony Corp Communication device, its display method, computer program, and communication method
JP2010238096A (en) * 2009-03-31 2010-10-21 Ntt Docomo Inc Terminal device, augmented reality system and terminal screen display method
CN105424032A (en) * 2015-12-08 2016-03-23 小米科技有限责任公司 Terminal indoor positioning method and device
CN106789461A (en) * 2016-12-12 2017-05-31 北京小米移动软件有限公司 The method and device of intelligent home device connection
CN112327653A (en) * 2020-11-13 2021-02-05 北京小米移动软件有限公司 Device control method, device control apparatus, and storage medium

Also Published As

Publication number Publication date
CN113453146A (en) 2021-09-28

Similar Documents

Publication Publication Date Title
CN107908351B (en) Application interface display method and device and storage medium
KR101949737B1 (en) Mobile terminal and controlling method therof, and recording medium thereof
EP3933565A1 (en) Screen projection method, screen projection device, and storage medium
KR101701834B1 (en) Mobile terminal and Control Methods for transmitting communication data and displaying communication list thereof
KR101919796B1 (en) Mobile terminal and method for controlling the same
KR20140141967A (en) Mobile terminal and method for controlling the same
JP7250872B2 (en) Device control method, device control device and storage medium
CN106485660B (en) Electronic map zooming method and device
US20180138933A1 (en) Method and device for adjusting frequencies of intercom apparatuses
CN112019895B (en) Function operation control method, function operation control device, and storage medium
KR20130000532A (en) Mobile terminal and method for controlling the same
CN116954540A (en) Application program display method and device and terminal
CN112073800B (en) Device function calling method, device function calling device and storage medium
CN113453146B (en) Equipment interaction control method, equipment interaction control device and storage medium
EP4134793A1 (en) Method and apparatus for controlling input function, and storage medium
CN112040059B (en) Application control method, application control device and storage medium
KR101706941B1 (en) Mobile terminal and quick access operation control method thereof
CN111246012B (en) Application interface display method and device and storage medium
CN112860827B (en) Inter-device interaction control method, inter-device interaction control device and storage medium
KR101645491B1 (en) Mobile terminal and communication control method thererof
US11064307B2 (en) Electronic device and method of outputting audio
CN113220203B (en) Activity entry display method, device, terminal and storage medium
CN110647281B (en) False touch prevention method and device and storage medium
CN117692994A (en) Terminal equipment control method, device, equipment, storage medium and chip
CN115714857A (en) Event reminding method and device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant