WO2023202141A1

WO2023202141A1 - Display method, control device and computer storage medium

Info

Publication number: WO2023202141A1
Application number: PCT/CN2022/142423
Authority: WO
Inventors: 陈虎
Original assignee: Oppo广东移动通信有限公司
Priority date: 2022-04-20
Filing date: 2022-12-27
Publication date: 2023-10-26
Also published as: CN114756152A

Abstract

Disclosed in the embodiments of the present application is a display method. The method is applied to a control device, which is connected to at least one controlled device, and the control device and the controlled device both have a UWB function. The method comprises: sending a UWB signal to a controlled device, so as to determine relative position information of a control device and the controlled device; determining, on an interface of the control device, position coordinates of an identifier of the control device and a display area containing the identifier of the control device; according to the relative position information of the control device and the controlled device, determining, in the display area, position coordinates of a control application icon of the controlled device; and according to the position coordinates of the identifier of the control device and the position coordinates of the control application icon of the controlled device, displaying the identifier of the control device and the control application icon of the controlled device in the display area. Also provided in the embodiments of the present application are a control device and a computer storage medium.

Description

A display method, control device and computer storage medium

Cross-references to related applications

This application is filed based on a Chinese patent application with application number 202210418289.3 and a filing date of April 20, 2022, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated by reference into this application in full. .

Technical field

The present application relates to the layout technology of control software, and in particular, to a display method, a control device and a computer storage medium.

Background technique

Currently, in the design of multi-device control interaction and connection, on the control device (such as a mobile phone), the control applications corresponding to the discovered devices around will be displayed in real time through the control software. By selecting or dragging the control of one of the devices Application to realize interaction and control with it. However, the user interface (UI) layout of general control software does not have a fixed pattern, and the basic layout method is relatively random.

Because in the UI layout of the control software on the control device, the control applications that display surrounding devices are arranged in a random manner, which is not conducive to the control of the device, resulting in low efficiency of control of the device; it can be seen from this that the existing control The equipment has a technical problem of inefficient control of the controlled equipment.

Contents of the invention

The technical solution of this application is implemented as follows:

Embodiments of the present application provide a display method. The method is applied to a control device. The control device is connected to at least one controlled device. Both the control device and the controlled device have UWB functions, including:

Send a UWB signal to the controlled device to determine the relative position information of the control device and the controlled device;

Determine the position coordinates of the logo of the control device on the interface of the control device and the display area containing the logo of the control device;

Determine the position coordinates of the control application icon of the controlled device on the display area according to the relative position information of the control device and the controlled device;

According to the position coordinates of the identification of the control device and the position coordinates of the control application icon of the controlled device, the identification of the control device and the control application icon of the controlled device are displayed on the display area.

An embodiment of the present application provides a control device connected to at least one controlled device, and both the control device and the controlled device have UWB functions, including:

A first determination module, configured to send a UWB signal to the controlled device to determine the relative position information of the control device and the controlled device;

a second determination module, configured to determine the position coordinates of the logo of the control device on the interface of the control device and the display area containing the logo of the control device;

A third determination module configured to determine the position coordinates of the control application icon of the controlled device on the display area based on the relative position information between the control device and the controlled device;

A display module configured to display the identity of the control device and the control of the controlled device on the display area according to the position coordinates of the identity of the control device and the position coordinates of the control application icon of the controlled device. Application icon.

The embodiment of the present application provides a control device, including:

A processor and a storage medium storing instructions executable by the processor. The storage medium relies on the processor to perform operations through a communication bus. When the instructions are executed by the processor, one or more of the above implementations are performed. The display method described in the example.

Embodiments of the present application provide a computer storage medium that stores executable instructions. When the executable instructions are executed by one or more processors, the processor performs the display as described in one or more embodiments. method.

Description of the drawings

Figure 1 is a schematic flowchart of an optional display method provided by an embodiment of the present application;

Figure 2 is a schematic diagram of the arrangement of control application icons of the controlled device on the interface of the control device in the related art;

Figure 3a is the first diagram of UWB ranging principle in related technology;

Figure 3b shows the second principle diagram of UWB ranging in related technologies;

Figure 4 is a schematic diagram of optional relative position information with a controlled device provided by an embodiment of the present application;

Figure 5 is a schematic coordinate diagram of an optional display area provided by an embodiment of the present application;

Figure 6a is a schematic diagram of optional scenario one provided by the embodiment of the present application;

Figure 6b is a schematic interface diagram of a control device corresponding to an optional scenario provided by the embodiment of the present application;

Figure 7a is a schematic diagram of optional scenario two provided by the embodiment of the present application;

Figure 7b is a schematic interface diagram of a control device corresponding to optional scenario two provided by the embodiment of the present application;

Figure 8 is a schematic structural diagram of an optional control device provided by an embodiment of the present application;

Figure 9 is a schematic structural diagram of another optional control device provided by an embodiment of the present application.

Detailed ways

In a first aspect, embodiments of the present application provide a display method. The method is applied to a control device. The control device is connected to at least one controlled device. Both the control device and the controlled device have UWB functions. ,include:

In an optional embodiment, determining the position coordinates of the identification of the control device on the interface of the control device and the display area containing the identification of the control device include:

Determine the position coordinates of the identification of the control device within a preset distance from the center position on the interface of the control device;

An area on the interface of the control device centered on the position coordinates of the identification of the control device is determined as the display area.

In an optional embodiment, determining the position coordinates of the control application icon of the controlled device on the display area based on the relative position information of the control device and the controlled device includes:

Determine the distance between the control application icon of the controlled device and the identification of the control device according to the distance in the relative position information of the control device and the controlled device;

According to the relative angle in the relative position information of the control device and the controlled device and the distance between the control application icon of the controlled device and the identification of the control device, the The location coordinates of the control application icon of the controlled device.

In an optional embodiment, the distance between the control application icon of the controlled device and the identity of the control device is determined based on the distance in the relative position information of the control device and the controlled device. distance, including:

Select the maximum value of the distance from the distances in the relative position information between the control device and the controlled device;

Determine the scaling factor of the distance based on the maximum value of the distance and the minimum value of the distance from the center of the display area to the boundary;

According to the scaling coefficient of the distance, the distance in the relative position information of the control device and the controlled device is scaled to obtain the distance between the control application icon of the controlled device and the identification of the control device. .

In an optional embodiment, the method further includes:

When the relative position information of the control device and the first controlled device among the controlled devices changes, the display is determined based on the changed relative position information of the control device and the first controlled device. The position coordinates of the control application icon of the first controlled device in the area;

According to the position coordinates of the control application icon of the first controlled device, the control application icon of the first controlled device is updated and displayed on the display area.

In an optional embodiment, the method further includes:

When a new second controlled device is added to the controlled device, send a UWB signal to the second controlled device to determine the relative position information of the control device and the second controlled device;

Determine the position coordinates of the control application icon of the second controlled device on the display area according to the relative position information between the control device and the second controlled device;

The control application icon of the second controlled device is displayed on the display area according to the position coordinates of the control application icon of the second controlled device.

In an optional embodiment, the method further includes:

When the connection between a third controlled device among the controlled devices and the control device is disconnected, the control application icon of the third controlled device is de-displayed on the display area.

In an optional embodiment, after displaying the identification of the control device and the control application icon of the controlled device on the interface of the control device, the method further includes:

In response to the opening operation of the control application of the fourth controlled device among the controlled devices, display the control interface of the control application of the fourth controlled device on the interface of the control device;

In response to a touch operation on a control interface of a control application of the fourth controlled device, the fourth controlled device is controlled to perform a control function corresponding to the touch operation.

In an optional embodiment, the connection method between the control device and the controlled device includes at least one of the following:

BT connection, ZigBee connection, Wi-Fi connection, UWB connection.

In a second aspect, embodiments of the present application further provide a control device connected to at least one controlled device, and both the control device and the controlled device have UWB functions, including:

A first determination module configured to send a UWB signal to the controlled device to determine the relative position information of the control device and the controlled device;

a second determination module configured to determine the position coordinates of the identification of the control device on the interface of the control device and the display area containing the identification of the control device;

A third determination module configured to determine the position coordinates of the control application icon of the controlled device on the display area based on the relative position information of the control device and the controlled device;

A display module configured to display the identification of the control device and the control of the controlled device on the display area according to the position coordinates of the identification of the control device and the position coordinates of the control application icon of the controlled device. Application icon.

In an optional embodiment, the second determination module is specifically configured to:

In an optional embodiment, the third determination module is specifically configured to:

In an optional embodiment, the third determination module determines the distance between the control application icon of the controlled device and the control device based on the distance in the relative position information of the control device and the controlled device. The distance between the identifiers includes:

In an optional embodiment, the control device is further configured to:

After the identification of the control device and the control application icon of the controlled device are displayed on the interface of the control device, in response to the opening operation of the control application of the fourth controlled device among the controlled devices, on the The control interface of the control application of the fourth controlled device is displayed on the interface of the control device;

BT connection, ZigBee connection, Wi-Fi connection, UWB connection.

In a third aspect, embodiments of the present application also provide a control device, including:

A processor and a storage medium storing instructions executable by the processor. The storage medium relies on the processor to perform operations through a communication bus. When the instructions are executed by the processor, one or more of the above implementations are performed. display method as described in the example.

In a fourth aspect, embodiments of the present application further provide a computer storage medium that stores executable instructions. When the executable instructions are executed by one or more processors, the processor executes one or more of the above steps. The display method described in the embodiment.

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application.

The embodiment of the present application provides a display method. The method is applied to a control device. The control device is connected to at least one controlled device. Both the control device and the controlled device have UWB functions. Figure 1 is provided for the embodiment of the present application. A schematic flow chart of an optional display method is shown in Figure 1. The display method may include:

S101: Send a UWB signal to the controlled device to determine the relative position information of the control device and the controlled device;

Figure 2 is a schematic diagram of the arrangement of control application icons of the controlled device on the interface of the control device in the related art. As shown in Figure 2, it is the interface of the control device. The main display page of the control software of the control device is displayed on the interface. The logo 21 of the control device is displayed in the center of the page, and the control application icons (icon 22, icon 23 and icon 24) of the controlled device are also displayed in other locations on the page. Among them, the control application icon of the controlled device Randomly displayed on this page, causing technical problems with inefficiency in the control equipment's response to control instructions.

In order to improve the control efficiency of the control device, embodiments of the present application provide a control method, and the control device is connected to at least one controlled device, wherein the connection method between the control device and the controlled device can be a Bluetooth (BT) connection. , Zifeng protocol (ZigBee) connection, wireless fidelity (Wireless Fidelity, Wi-Fi) connection, ultra-wideband (Ultra Wide Band, UWB) connection, here, the embodiment of the present application does not specifically limit this.

Since both the control device and the controlled device have UWB functions, here, UWB positioning technology can be used to obtain the relative position information of the control device and the controlled device. In UWB positioning technology, the control device sends a UWB signal to each controlled device. , using the UWB ranging principle, that is, Time Of Flight (ToF) to measure distance.

Figure 3a is the first principle diagram of UWB ranging in related technologies. As shown in Figure 3a, it mainly uses the signal flight time between two asynchronous receivers and transmitters (Transceiver) to measure the distance between nodes. Among them, initiator A is set in the control In the equipment, transponder B is set in the controlled equipment.

Single Sided-Two-Way Ranging (SS-TWR) Each module will generate an independent timestamp from the start. UWB module A in starter A transmits at the Ta1 moment on its timestamp. UWB signal of request nature, UWB module B in responder B receives the UWB signal at time Tb1 on its timestamp, and then after applying certain processing methods to the UWB signal, UWB module B transmits a response nature at time Tb2 The signal is received by UWB module A at its own timestamp Ta2. From this, the flight time ToF _{A_B} of the pulse signal between the two UWB modules can be calculated, and then multiplied by the speed of light c, the distance between the two modules can be determined.

Among them, the calculation formula of the flight time ToF _{A_B} is as follows:

δ _reply =Tb2-Tb1 (2)

δ _loop =Ta2-Ta1 (3)

It should be noted that the SS-TWR algorithm has a relatively strict constraint. The sending device and the receiving device must have clock synchronization. If the accuracy requirements are not very high and a shorter ranging time is required, it can be used.

In order to reduce the impact of clock offset, DS-TWR and reverse measurement compensation are often used in UWB ranging. Figure 3b shows the second principle diagram of UWB ranging in related technologies. As shown in Figure 3b, UWB module A on its timestamp Ta1 moment transmits a pulse signal of request nature. UWB module B receives the signal at Tb1 moment on its timestamp. Then after applying certain processing methods to the UWB signal, UWB module B simultaneously transmits response nature and request nature at Tb2 moment. The signal is received by UWB module A at its own timestamp Ta2. After processing for a period of time, the response signal is received at Ta3 and module B receives it at Tb3 of its timestamp. From this, the flight time ToF _{A_B} of the pulse signal between the two UWB modules can be calculated, and then multiplied by the speed of light c, the distance between the two modules can be determined.

δ _loopA =Ta2-Ta1 (5)

δ _loopB =Tb3-Tb2 (6)

δ _replyA =Ta3-Ta2 (7)

δ _replyB =Tb2-Tb1 (8)

It should be noted that UWB angle information: The UWB signal contains angle information and can be obtained directly.

The above relative position information may include distance and relative angle, both of which can be obtained through the UWB ranging principle.

In this way, the relative position information between the control device and the controlled device can be obtained through UWB ranging. Here, the relative position information between the control device and the controlled device can be used to know the positional relationship between the control device and the controlled device. Below, use Figure 4 to explain the relative positional relationship between the control equipment and the controlled equipment.

Figure 4 is a schematic diagram of optional relative position information with a controlled device provided by the embodiment of the present application. As shown in Figure 4, the master device 41 and two slave devices (including the slave device 42 and the slave device 43) have Connection relationship, where the master device 41 can include a mobile phone or a personal computer (PC), etc., and the slave devices 42 and 43 can include a television (Television, TV), PC, smart speakers, etc., as marked in Figure 4 The angle and distance (1) of the slave device 42 relative to the master device 41 and the angle and distance (2) of the slave device 43 relative to the master device 41 are shown.

It should be noted that the master device provided in the embodiment of the present application is equivalent to the above-mentioned control device, and the slave device is equivalent to the above-mentioned controlled device.

S102: Determine the position coordinates of the logo of the control device on the interface of the control device and the display area containing the logo of the control device;

In addition, when the control device is connected to at least one controlled device, in order to display the connection relationship between each controlled device and the control device, it is necessary to determine the position coordinates of the identification of the control device on the interface of the control device. After determining the identification of the control device After obtaining the position coordinates, a part of the area can be drawn from the interface of the control device as a display area, where the display area contains the identification of the control device. In this way, the position coordinates of the identification of the control device and the control application icon of the control device are determined. display area.

In order to better present the positional relationship between the control device and the controlled device, in an optional embodiment, S102 may include:

Determine the position coordinates of the logo of the control device within a preset distance from the center position on the interface of the control device;

The area on the interface of the control device centered on the position coordinates of the logo of the control device is determined as the display area.

Understandably, a position coordinate can be randomly selected on the interface of the control device within a circular area with the central position as the center and a preset distance as the radius, as the position coordinate of the logo of the control device, and then in the circular area with the logo of the control device. The area with the position coordinate as the center is determined as the display area. It should be noted that the shape of the above-mentioned display area can be an irregular shape or a regular shape, such as a square or a circle. Here, the embodiment of the present application does not specify this. limited.

In this way, the position coordinates of the identification of the control device and the display area of the control application icon of the controlled device are determined.

S103: Determine the position coordinates of the control application icon of the controlled device on the display area based on the relative position information between the control device and the controlled device;

Through S101, the relative position information of the control device and the controlled device is determined, and the position coordinates of the control application icon of the controlled device on the display area can be determined. Here, based on the mapping relationship between the relative position information and the display area, according to the control The relative position information between the device and the controlled device is calculated to obtain the position coordinates of the control application icon of the controlled device; the relative position information between the control device and the controlled device can also be used, for example, according to the relative position information between the control device and the controlled device. The distance and relative angle are scaled to obtain the position coordinates of the control application icon of the controlled device on the display area.

In order to better present the relative positional relationship between the control device and the controlled device on the display area, in an optional embodiment, S103 may include:

Determine the distance between the control application icon of the controlled device and the identification of the control device based on the distance in the relative position information between the control device and the controlled device;

According to the relative angle in the relative position information of the control device and the controlled device and the distance between the control application icon of the controlled device and the identification of the control device, the position coordinates of the control application icon of the controlled device on the display area are calculated.

It can be understood that the relative position information between the control device and the controlled device includes the distance between the control device and the control device and the relative angle between the control device and the control device. According to the distance in the relative position information between the control device and the controlled device, , determine the distance between the control application icon of the controlled device and the logo of the control device. Here, the preset scaling factor can be used to calculate the distance between the control application icon of the controlled device and the logo of the control device. You can also The distance between the control application icon of the controlled device and the identification of the control device is determined in other ways, which is not specifically limited in this embodiment of the present application.

After determining the distance between the control application icon of the controlled device and the identification of the control device, the distance between the control application icon of the controlled device and the control device can also be determined based on the relative angle in the relative position information of the control device and the controlled device and the distance between the control application icon of the controlled device and the control device. The distance between the logos can be used to calculate the position coordinates of the control application icon of the controlled device on the display area. For example, when the position coordinates of the logo of the control device are used as the center of the circle, trigonometric functions can be used to calculate the control position of the controlled device on the display area. The location coordinates of the application icon.

Further, in order to determine the distance between the control application icon of the controlled device and the identification of the controlled device, in an optional embodiment, the controlled device is determined based on the distance in the relative position information of the controlled device and the controlled device. The distance between the control application icon of the control device and the logo of the control device, including:

Select the maximum value of the distance from the distances in the relative position information of the control device and the controlled device;

According to the scaling coefficient of the distance, the distance in the relative position information of the control device and the controlled device is scaled to obtain the distance between the control application icon of the controlled device and the identification of the control device.

Understandably, the maximum value of the distance is first selected from the distance in the relative position information of the control device and the controlled device, and then the scaling factor of the distance is determined based on the maximum value of the distance and the minimum value of the center distance boundary of the display area, For example, the ratio between the minimum value of the distance boundary from the center of the display area and the maximum value of the distance is determined as the scaling factor. After the scaling factor is determined, the distance in the relative position information of the control device and the controlled device can be calculated. Zoom to get the distance between the control application icon of the controlled device and the identification of the control device.

S104: Display the identity of the control device and the control application icon of the controlled device on the display area according to the position coordinates of the identity of the control device and the position coordinates of the control application icon of the controlled device.

After calculating the position coordinates of the identification of the control device and the position coordinates of the control application icon of the controlled device, the control can be displayed on the display area based on the position coordinates of the identification of the control device and the position coordinates of the control application icon of the controlled device. The identification of the device and the control application icon for the controlled device.

In this way, the positional relationship between the control device and the controlled device can be displayed on the interface of the control device, which is conducive to receiving reliable control instructions and improving the control efficiency of the controlled device.

After the identification of the control device and the control application icon of the controlled device are displayed in the display area, when there is a controlled device whose relative position information changes with the control device, in an optional embodiment, the above Methods can also include:

When the relative position information of the control device and the first controlled device among the controlled devices changes, the control application of the first controlled device on the display area is determined based on the changed relative position information of the control device and the first controlled device. The location coordinates of the icon;

Here, when the relative position information of the control device and the first controlled device among the controlled devices changes, that is to say, the control device performs real-time monitoring of the relative position information of the control device and the controlled device. Through real-time monitoring, it is found that When the relative position information of the control device and the first controlled device changes, the position of the control application icon of the first controlled device on the display area can be re-determined based on the changed relative position information of the control device and the first controlled device. Coordinates, this determination method is consistent with the above-mentioned method of determining the position coordinates of the control application icon of the controlled device on the display area, and will not be described again here.

After determining the position coordinates of the control application icon of the first controlled device, update and display the control application icon of the first controlled device on the display area, so that the control device and the controlled device are presented in a timely manner on the interface of the control device the real relative positional relationship between them.

When a new controlled device is connected to the control device, in an optional embodiment, the above method may also include:

Determine the position coordinates of the control application icon of the second controlled device on the display area based on the relative position information between the control device and the second controlled device;

Display the control application icon of the second controlled device on the display area according to the position coordinates of the control application icon of the second controlled device.

That is to say, when the second controlled device is connected to the control device, which is equivalent to when the second controlled device is added to the controlled device, the control device sends a UWB signal to the second controlled device to determine whether the control device is connected to the second controlled device. The relative position information of the controlled device can be determined in the above-mentioned manner of determining the relative position information of the control device and the controlled device, which will not be described again here.

After the relative position information of the control device and the second controlled device is determined, the position coordinates of the control application icon of the second controlled device on the display area can be determined based on the relative position information of the control device and the second controlled device. The determination method is consistent with the above-mentioned method of determining the position coordinates of the control application icon of the controlled device on the display area, and will not be described again here.

Finally, after knowing the position coordinates of the control application icon of the second controlled device, the control application icon of the second controlled device is displayed on the display area.

In this way, the positional relationship between the newly added controlled device and the control device is presented in a timely manner, so that the user can promptly learn the positional relationship between the newly added controlled device and the control device.

In order to update the display area in time, in an optional embodiment, the above method may also include:

When the connection between the third controlled device among the controlled devices and the control device is disconnected, the control application icon of the third controlled device is de-displayed on the display area.

When there is a disconnected controlled device among the controlled devices, that is, the third controlled device, since there is no connection relationship between the controlled device and the control device, the display of the third controlled device on the display area is cancelled. The control application icon enables the control application icon on the display area to truly reflect the positional relationship between the controlled device and the control device.

In addition, in order to improve the control efficiency of the controlled equipment, in an optional embodiment, after S104, the above method may also include:

In response to the opening operation of the control application of the fourth controlled device in the controlled device, display the control interface of the control application of the fourth controlled device on the interface of the control device;

In response to a touch operation on the control interface of the control application of the fourth controlled device, the fourth controlled device is controlled to perform a control function corresponding to the touch operation.

For the control application icon of the fourth controlled device among the controlled devices, receiving a click operation from the user causes the control device to receive an opening operation for the control application of the fourth controlled device, and in response to the opening operation, The control interface of the control application of the fourth controlled device is displayed on the interface of the control device. The user sends a touch operation to the control interface of the control application of the fourth controlled device on the control interface. In response to the touch operation, the fourth controlled device is controlled. The control device performs the control function corresponding to the touch operation.

For example, after the user learns the positional relationship between each controlled device and the control device through the interface of the control device, the user wants to turn on the speakers. At this time, the user can know the approximate position of each speaker from the interface of the control device, so as to adjust the location according to the user's needs. position to select which position to control the speaker.

In this way, the interface based on the control device can improve the control efficiency of the controlled device.

The following is an example to describe the control method in one or more of the above embodiments.

Figure 5 is a schematic coordinate diagram of an optional display area provided by an embodiment of the present application. As shown in Figure 5, after obtaining the distance and angle data of the slave device relative to the master device, the slave device displays the data to the software based on the obtained data. in the UI interface. The specific methods are as follows:

First, in the software UI layout, construct the XY two-dimensional plane coordinate axis on the interface of the main device, and display the logo of the main device at the origin of the two-dimensional plane coordinates.

Then, use the identity of the main device as the center point of the entire UI, determine the radius R according to the actual size of the interface of the control device, and then use this to determine the circular display area range of the entire UI layout, divide R equally into words N, etc. according to the actual situation Then draw a circular display area in the circular display area with the center point as the center and R/N, 2*R/N,..., R as the radius.

Finally, after determining the UI layout structure, the actual distances between all detected slave devices and the master device are recorded as d1, d2,..., dn, and the relative angles are recorded as θ1, θ2,..., θn. The maximum value of the distance is recorded as D; the coordinates of the m-th device in the UI are calculated as follows:

Rm＝R/D*dm (9)

Xm＝Rm*cosθm (10)

Ym＝Rm*sinθm (11)

Among them, (Xm, Ym) represents the position coordinates of the slave device.

In this way, the calculated position coordinates of the control application icon of each slave device are displayed on the corresponding position coordinates.

Figure 6a is a schematic diagram of optional scenario one provided by the embodiment of the present application. The user uses a mobile phone (main device) at the desk in the study room. The layout of other devices in the room is as shown in Figure 6a. Figure 6b is an embodiment of the present application. An optional scene-corresponding control device interface diagram is provided. By calculating the distance and angle between the master device and each slave device, the UI layout of the master device control software is dynamically updated, as shown in Figure 6b. Each device is in The displayed position in the software UI is consistent with the actual position.

Figure 7a is a schematic diagram of optional scenario two provided by the embodiment of the present application. The user is on the sofa in the living room, using a mobile phone (main device). The layout of other devices in the room is as shown in Figure 7a. Figure 7b is an implementation of the present application. The example provides a schematic diagram of the interface of the control device corresponding to optional scenario 2. By calculating the distance and angle between the master device and each slave device, the UI layout of the master device control software is dynamically updated, as shown in Figure 7b. Each device The displayed position in the software UI is consistent with the actual position.

In this example, a multi-device interactive UI design method is more intelligent, novel, and in line with people's natural senses. It makes the software UI no longer rigid and unchanging, making the UI smarter and more understanding of users, giving users a more natural experience.

In this way, a method is provided to dynamically update the UI interactive interface layout based on the actual relative positions and distances between devices; the software interface can update the UI layout in real time according to changes in device positions; this method is used when the central device is used to connect or control other surrounding devices. , the layout of the UI interface is consistent with the user's natural vision and senses.

Embodiments of the present application provide a display method. The method is applied to a control device. The control device is connected to at least one controlled device. Both the control device and the controlled device have UWB functions, including: sending a UWB signal to the controlled device. To determine the relative position information of the control device and the controlled device, determine the position coordinates of the control device's logo on the interface of the control device and the display area containing the control device's logo, based on the relative position information of the control device and the controlled device , determine the position coordinates of the control application icon of the controlled device on the display area, and display the identification of the control device and the control application icon of the controlled device on the display area according to the position coordinates of the control device identification and the position coordinates of the control application icon of the controlled device. Control the application icon; that is to say, in the embodiment of the present application, after the relative position information of the control device and the controlled device is determined through the UWB signal, and the position coordinates and display area of the control device's logo are determined, according to the control device and the The relative position information of the controlled device can determine the position coordinates of the control application icon of the controlled device on the display area, and then the identification of the control device and the control application icon of the controlled device can be displayed in the display area. Due to the above-mentioned The position coordinates of the control application icon are determined based on the relative position information of the control device and the controlled device, so that the layout on the display area can reflect the relative position relationship between the control device and the controlled device, that is, the display area of the control device can show Based on the positional relationship between the control device and the controlled device, the control device can receive a reliable and accurate control operation in response to the control operation, thereby improving the control efficiency of the controlled device.

Based on the same inventive concept of the previous embodiments, embodiments of the present application provide a control device. The control device is connected to at least one controlled device. Both the control device and the controlled device have UWB functions. Figure 8 is a control device provided by the embodiment of the present application. A schematic structural diagram of an optional control device is shown in Figure 8. The electronic device includes:

The first determination module 81 is configured to send a UWB signal to the controlled device to determine the relative position information of the control device and the controlled device;

The second determination module 82 is configured to determine the position coordinates of the identification of the control device on the interface of the control device and the display area containing the identification of the control device;

The third determination module 83 is configured to determine the position coordinates of the control application icon of the controlled device on the display area based on the relative position information of the control device and the controlled device;

The display module 84 is configured to display the identity of the control device and the control application icon of the controlled device on the display area according to the position coordinates of the identity of the control device and the position coordinates of the control application icon of the controlled device.

In an optional embodiment, the second determination module 82 is specifically configured to:

In an optional embodiment, the third determination module 83 is specifically configured to:

In an optional embodiment, the third determination module 83 determines the distance between the control application icon of the controlled device and the identity of the control device according to the distance in the relative position information of the control device and the controlled device, including :

In an optional embodiment, the control device is further configured to:

When the relative position information of the control device and the first controlled device among the controlled devices changes, the position of the control application icon of the first controlled device on the display area is determined based on the relative position information of the control device and the first controlled device. Position coordinates;

In an optional embodiment, the control device is also configured to:

After the identification of the control device and the control application icon of the controlled device are displayed on the interface of the control device, in response to the opening operation of the control application of the fourth controlled device in the controlled device, the fourth controlled device is displayed on the interface of the control device. The control interface of the control application of the control device;

In practical applications, the above-mentioned first determination module 81, second determination module 82, third determination module 83 and control module 84 can be implemented by a processor located on the control device, specifically a central processing unit (CPU, Central Processing Unit), Implementation of microprocessor (MPU, Microprocessor Unit), digital signal processor (DSP, Digital Signal Processing) or field programmable gate array (FPGA, Field Programmable Gate Array).

Figure 9 is a schematic structural diagram of another optional control device provided by an embodiment of the present application. As shown in Figure 9, an embodiment of the present application provides a control device 900, which includes:

The processor 91 and the storage medium 92 that stores instructions executable by the processor 91. The storage medium 92 relies on the processor 91 to perform operations through the communication bus 93. When the instructions are executed by the processor 91, The display method performed in one or more of the above embodiments is executed.

It should be noted that in actual application, various components in the terminal are coupled together through the communication bus 93 . It can be understood that the communication bus 93 is used to implement connection communication between these components. In addition to the data bus, the communication bus 93 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the various buses are labeled as communication bus 93 in FIG. 9 .

Embodiments of the present application provide a computer storage medium that stores executable instructions. When the executable instructions are executed by one or more processors, the processor executes the control as in one or more of the above embodiments. The device executes the display method.

Among them, the computer-readable storage medium can be magnetic random access memory (ferromagnetic random access memory, FRAM), read-only memory (Read Only Memory, ROM), programmable read-only memory (Programmable Read-Only Memory, PROM), programmable read-only memory (PROM), Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash Memory, Magnetic Surface Memory , optical disk, or Compact Disc Read-Only Memory (CD-ROM) and other memories.

Those skilled in the art will understand that embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, magnetic disk storage and optical storage, etc.) embodying computer-usable program code therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine, such that the instructions executed by the processor of the computer or other programmable data processing device produce a use A device for realizing the functions specified in one process or multiple processes of the flowchart and/or one block or multiple blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory that causes a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction means, the instructions The device implements the functions specified in a process or processes of the flowchart and/or a block or blocks of the block diagram.

These computer program instructions may also be loaded onto a computer or other programmable data processing device, causing a series of operating steps to be performed on the computer or other programmable device to produce computer-implemented processing, thereby executing on the computer or other programmable device. Instructions provide steps for implementing the functions specified in a process or processes of a flowchart diagram and/or a block or blocks of a block diagram.

The above descriptions are only preferred embodiments of the present application and are not intended to limit the protection scope of the present application.

Industrial applicability

The display method, control device and computer storage medium provided in the embodiments of this application are applied to the control device. The control device is connected to at least one controlled device. Both the control device and the controlled device have UWB functions, including: The control device sends UWB signals to determine the relative position information of the control device and the controlled device, determine the position coordinates of the control device's logo on the interface of the control device, and the display area containing the control device's logo. According to the control device and the controlled device The relative position information of the device determines the position coordinates of the control application icon of the controlled device on the display area, and displays the identification of the control device on the display area based on the position coordinates of the control device's logo and the position coordinates of the control application icon of the controlled device. and control application icons of the controlled equipment; enabling the control equipment to receive reliable and accurate control operations in response to the control operations, thereby improving control efficiency of the controlled equipment.

Claims

A display method, the method is applied to a control device, the control device is connected to at least one controlled device, and both the control device and the controlled device have UWB functions, including:

Send a UWB signal to the controlled device to determine the relative position information of the control device and the controlled device;

Determine the position coordinates of the logo of the control device on the interface of the control device and the display area containing the logo of the control device;

Determine the position coordinates of the control application icon of the controlled device on the display area according to the relative position information of the control device and the controlled device;

According to the position coordinates of the identification of the control device and the position coordinates of the control application icon of the controlled device, the identification of the control device and the control application icon of the controlled device are displayed on the display area.
The method according to claim 1, wherein the determining the position coordinates of the identification of the control device on the interface of the control device and the display area containing the identification of the control device includes:

Determine the position coordinates of the identification of the control device within a preset distance from the center position on the interface of the control device;

An area on the interface of the control device centered on the position coordinates of the identification of the control device is determined as the display area.
The method according to claim 1 or 2, wherein the position coordinates of the control application icon of the controlled device on the display area are determined based on the relative position information of the control device and the controlled device, include:

Determine the distance between the control application icon of the controlled device and the identification of the control device according to the distance in the relative position information of the control device and the controlled device;

According to the relative angle in the relative position information of the control device and the controlled device and the distance between the control application icon of the controlled device and the identification of the control device, the The location coordinates of the control application icon of the controlled device.
The method according to claim 3, wherein the distance between the control application icon of the controlled device and the identification of the control device is determined based on the distance in the relative position information of the control device and the controlled device. distance, including:

Select the maximum value of the distance from the distances in the relative position information between the control device and the controlled device;

Determine the scaling factor of the distance based on the maximum value of the distance and the minimum value of the distance from the center of the display area to the boundary;

According to the scaling coefficient of the distance, the distance in the relative position information of the control device and the controlled device is scaled to obtain the distance between the control application icon of the controlled device and the identification of the control device. .
The method of claim 1, further comprising:

When the relative position information of the control device and the first controlled device among the controlled devices changes, the display is determined based on the changed relative position information of the control device and the first controlled device. The position coordinates of the control application icon of the first controlled device in the area;

According to the position coordinates of the control application icon of the first controlled device, the control application icon of the first controlled device is updated and displayed on the display area.
The method of claim 1, further comprising:

When a new second controlled device is added to the controlled device, send a UWB signal to the second controlled device to determine the relative position information of the control device and the second controlled device;

Determine the position coordinates of the control application icon of the second controlled device on the display area according to the relative position information between the control device and the second controlled device;

The control application icon of the second controlled device is displayed on the display area according to the position coordinates of the control application icon of the second controlled device.
The method of claim 1, further comprising:

When the connection between a third controlled device among the controlled devices and the control device is disconnected, the control application icon of the third controlled device is de-displayed on the display area.
The method according to claim 1, wherein after displaying the identification of the control device and the control application icon of the controlled device on the interface of the control device, the method further includes:

In response to the opening operation of the control application of the fourth controlled device among the controlled devices, display the control interface of the control application of the fourth controlled device on the interface of the control device;

In response to a touch operation on a control interface of a control application of the fourth controlled device, the fourth controlled device is controlled to perform a control function corresponding to the touch operation.
The method according to claim 1, wherein the connection method between the control device and the controlled device includes at least one of the following:

BT connection, ZigBee connection, Wi-Fi connection, UWB connection.
A control device, the control device is connected to at least one controlled device, both the control device and the controlled device have UWB functions, including:

A first determination module configured to send a UWB signal to the controlled device to determine the relative position information of the control device and the controlled device;

a second determination module configured to determine the position coordinates of the identification of the control device on the interface of the control device and the display area containing the identification of the control device;

A third determination module configured to determine the position coordinates of the control application icon of the controlled device on the display area based on the relative position information of the control device and the controlled device;

A display module configured to display the identification of the control device and the control of the controlled device on the display area according to the position coordinates of the identification of the control device and the position coordinates of the control application icon of the controlled device. Application icon.
The control device according to claim 10, wherein the second determination module is specifically configured to:

Determine the position coordinates of the identification of the control device within a preset distance from the center position on the interface of the control device;

An area on the interface of the control device centered on the position coordinates of the identification of the control device is determined as the display area.
The control device according to claim 10 or 11, wherein the third determination module is specifically configured to:

Determine the distance between the control application icon of the controlled device and the identification of the control device according to the distance in the relative position information of the control device and the controlled device;

According to the relative angle in the relative position information of the control device and the controlled device and the distance between the control application icon of the controlled device and the identification of the control device, the The location coordinates of the control application icon of the controlled device.
The control device according to claim 12, wherein the third determination module determines the control application icon of the controlled device and the controlled device according to the distance in the relative position information of the control device and the controlled device. The distance between the markings of the control equipment includes:

Select the maximum value of the distance from the distances in the relative position information between the control device and the controlled device;

Determine the scaling factor of the distance based on the maximum value of the distance and the minimum value of the distance from the center of the display area to the boundary;

According to the scaling coefficient of the distance, the distance in the relative position information of the control device and the controlled device is scaled to obtain the distance between the control application icon of the controlled device and the identification of the control device. .
The control device according to claim 10, wherein the control device is further configured to:

When the relative position information of the control device and the first controlled device among the controlled devices changes, the display is determined based on the changed relative position information of the control device and the first controlled device. The position coordinates of the control application icon of the first controlled device in the area;

According to the position coordinates of the control application icon of the first controlled device, the control application icon of the first controlled device is updated and displayed on the display area.
The control device according to claim 10, wherein the control device is further configured to:

When a new second controlled device is added to the controlled device, send a UWB signal to the second controlled device to determine the relative position information of the control device and the second controlled device;

Determine the position coordinates of the control application icon of the second controlled device on the display area according to the relative position information between the control device and the second controlled device;

The control application icon of the second controlled device is displayed on the display area according to the position coordinates of the control application icon of the second controlled device.
The control device according to claim 10, wherein the control device is further configured to:

When the connection between a third controlled device among the controlled devices and the control device is disconnected, the control application icon of the third controlled device is de-displayed on the display area.
The control device according to claim 10, wherein the control device is further configured to:

After the identification of the control device and the control application icon of the controlled device are displayed on the interface of the control device, in response to the opening operation of the control application of the fourth controlled device among the controlled devices, on the The control interface of the control application of the fourth controlled device is displayed on the interface of the control device;

In response to a touch operation on a control interface of a control application of the fourth controlled device, the fourth controlled device is controlled to perform a control function corresponding to the touch operation.
The control device according to claim 10, wherein the connection method between the control device and the controlled device includes at least one of the following:

BT connection, ZigBee connection, Wi-Fi connection, UWB connection.
A control device including:

A processor and a storage medium storing instructions executable by the processor. The storage medium relies on the processor to perform operations through a communication bus. When the instructions are executed by the processor, the above-mentioned claims 1 to 1 are executed. The display method described in any one of 9.
A computer storage medium stores executable instructions. When the executable instructions are executed by one or more processors, the processor executes the display method according to any one of claims 1 to 9.