WO2022032673A1

WO2022032673A1 - Device control method and apparatus, and storage medium

Info

Publication number: WO2022032673A1
Application number: PCT/CN2020/109331
Authority: WO
Inventors: 沈剑锋; 闫雅婷; 汪智勇; 郑佩; 李晨雄; 张李平; 王�华
Original assignee: 上海传英信息技术有限公司
Priority date: 2020-08-14
Filing date: 2020-08-14
Publication date: 2022-02-17
Also published as: CN116249960A

Abstract

Embodiments of the present application provide a device control method and apparatus, and a storage medium, which are applied to an electronic device. The method comprises: determining an element to be added and a user interface, the element to be added being a combination element, and the user interface being an interface on which the element to be added is to be placed; if free spaces in the user interface are insufficient to place the element to be added, splitting the combination element into at least two elements, such that the at least two elements can be respectively placed into the free spaces in the user interface. The space utilization rate is improved.

Description

Device control method, device and storage medium

technical field

The embodiments of the present application relate to the field of terminals, and in particular, to a device control method, apparatus, and storage medium.

Background technique

At present, different elements (such as application icons, tool widgets, etc.) can be placed on the user interface of electronic devices (such as mobile phones, tablet computers, etc.) New elements, or moving existing elements of the user interface.

In some implementations, when adding interface elements, the area to be added is calculated and compared with the area of the remaining space in the interface where the element to be added is placed, so that the element to be added is placed in the remaining space of the interface. However, in some cases, although there is remaining space in the interface, the system will still prompt the user that there is not enough space to place the element to be added. For example, the remaining space of the interface is discontinuous and the remaining space is not enough to place the element to be added, which reduces the space utilization.

The preceding statements are intended to provide general background information and may not constitute prior art.

SUMMARY OF THE INVENTION

To solve the above problems, embodiments of the present application provide a device control method, device, and storage medium, so as to improve space utilization.

In a first aspect, an embodiment of the present application provides a device control method, the method comprising:

Determine the element to be added and the user interface; the element to be added is a combined element; the user interface is an interface for placing the element to be added;

If the free space in the user interface is not enough to place the element to be added, split the combined element into at least two elements, so that the at least two elements can be placed in the free space of the user interface respectively .

In a possible implementation manner, the free space in the user interface is insufficient to place the element to be added, including at least one of the following:

The position distribution between the cells occupied by the element to be added is different from the position distribution between the idle cells in the user interface;

The shape of the element to be added is different from the shape of the free space in the user interface;

The area occupied by the element to be added is larger than the area of the free space in the user interface;

The number of cells occupied by the element to be added is greater than the number of free cells in the user interface.

In a possible implementation manner, after splitting the combined element into at least two elements, the method further includes:

The at least two elements are sequentially placed in the free space of the user interface according to the priority information of the split elements.

In a possible implementation manner, the priority information of the split elements includes at least one of the following:

the sequence of splitting the combined elements;

Or the order of user frequency from low to high, or from high to low.

In a possible implementation manner, before splitting the combined element into at least two elements, it further includes at least one of the following:

The attribute information of the element to be added and/or the layout information of the element in the user interface is adjusted.

In a possible implementation manner, after the combination element is split into at least two elements, at least one of the following is further included:

The attribute information of the element and/or the layout information of the element in the user interface are adjusted.

In a possible implementation manner, the attribute information includes at least one of the following information: the area occupied by the element to be added, the number of cells occupied by the element to be added, the occupied area of the element to be added The location distribution between cells, the shape of the element to be added, the combination of the element to be added, the priority information of the element to be added; and/or,

The layout information includes at least one of the following information: the area of free space in the user interface, the number of free cells in the user interface, the location distribution between free cells in the user interface, the user interface The shape of the free space in the interface, the spacing between the existing elements in the user interface, and the priority information of the existing elements in the user interface.

In a possible implementation manner, the adjustment method of the attribute information includes at least one of the following: reducing or cropping the occupied area, reducing the number of occupied cells, adjusting the position distribution between the occupied cells, or the The shape of the element to be added, the combination method or priority information of adjusting the element to be added; and/or,

The adjustment method of the layout information includes at least one of the following: enlarging or expanding the area of the free space, increasing the number of free cells, adjusting the position distribution between the free cells or the shape of the free space, adjusting the spacing between existing elements or priority information.

In a possible implementation manner, the manner of splitting the combined element into at least two elements includes at least one of the following:

Split according to the preset splitting method of combined elements;

Splitting is performed according to the attribute information and/or the layout information.

In a second aspect, an embodiment of the present application provides a device control method, the method comprising:

Determine the element to be added and a user interface; the user interface is an interface for placing the element to be added;

If the free space in the user interface is not enough to place the element to be added, move at least one existing element of the user interface to another user interface, and move the element to be added according to the priority information of the element to be added. add elements to be placed in the space of the user interface;

Moving at least one existing element of the user interface to another user interface includes at least one of the following:

moving at least one existing element of the user interface to other user interfaces in a first order; the first order is from back to front, or from front to back;

Or move at least one existing element of the user interface to other user interfaces in a second order; the second order is the order of the frequency of user usage from low to high;

Or move at least one existing element of the user interface to another user interface, so as to obtain N free cell spaces in the user interface; the N is the number of cells occupied by the element to be added; wherein N is a positive integer.

In a possible implementation manner, placing the element to be added in the space of the user interface includes:

determining the state of a cell of the user interface;

The element to be added is placed in the space of the user interface according to the state of the cell, wherein the state of the cell includes an idle state or an occupied state; the idle state is the state of the element to be placed; the The occupied state is the placed element state.

In a possible implementation manner, placing the element to be added into the space of the user interface according to the state of the cell includes:

If the state of the cell is an idle state, placing the element to be added into a cell in the idle state of the user interface;

determining the element to be moved in the user interface;

The attribute information of the element to be moved and/or the layout information of the element in the user interface is adjusted, and the element to be moved is moved to the free space of the user interface.

The number of cells occupied by the element to be added is greater than the number of free cells in the user interface;

The shape of the element to be added is different from the shape of the free space in the user interface.

In a possible implementation manner, before the moving at least one existing element of the user interface to another user interface, the method further includes at least one of the following:

In a possible implementation manner, after the moving at least one existing element of the user interface to another user interface, the method further includes at least one of the following:

The attribute information of the existing element and/or the layout information of the element in the user interface are adjusted.

In a possible implementation manner, the method for moving at least one existing element of the user interface to another user interface includes at least one of the following:

Move according to the preset movement mode;

The movement is performed according to the attribute information and/or the layout information.

In a third aspect, an embodiment of the present application provides a device control device, the device includes: a determining module and a splitting module, wherein,

The determining module is used to determine an element to be added and a user interface; the element to be added is a combined element; the user interface is an interface for placing the element to be added;

The splitting module is configured to split the combined element into at least two elements if the free space in the user interface is not enough to place the element to be added, so that the at least two elements can be placed on the in the free space of the user interface.

In a possible implementation, the device further includes a placement module, wherein,

The placing module is configured to, after the splitting module splits the combined element into at least two elements, place the at least two elements in sequence on the said at least two elements according to the priority information of the split elements. in the free space of the user interface.

the sequence of splitting the combined elements;

Or the order of user frequency from low to high, or from high to low.

In a possible implementation, the device further includes an adjustment module, wherein,

The adjusting module is configured to, before the splitting module splits the combined element into at least two elements, adjust the attribute information of the element to be added and/or the layout information of the element in the user interface.

In a possible implementation manner, the adjustment module is further configured to, after the splitting module splits the combined element into at least two elements, adjust the attribute information of the element and/or the user Layout information for elements in the interface.

Split according to the preset splitting method of combined elements;

In a fourth aspect, the embodiments of the present application provide a device control method, including a determination module, a movement module, and a placement module, wherein,

The determining module is used for determining an element to be added and a user interface; the user interface is an interface for placing the element to be added;

The moving module is configured to, if the free space in the user interface is not enough to place the element to be added, move at least one existing element of the user interface to another user interface;

The placing module is configured to, according to the priority information of the element to be added, place the element to be added in the space of the user interface;

Or move at least one existing element of the user interface to other user interfaces in a second order; the second order is the order of user frequency from low to high;

In a possible implementation manner, the placement module is specifically used for:

determining the state of a cell of the user interface;

determining the element to be moved in the user interface;

The adjustment module is configured to, before the moving module moves at least one existing element of the user interface to another user interface, adjust the attribute information of the element to be added and/or the layout of the elements in the user interface information.

In a possible implementation manner, the adjustment module is further configured to, after the moving module moves at least one existing element of the user interface to another user interface, adjust the attribute information and the attribute information of the existing element. /or layout information of elements in the user interface.

In a possible implementation manner, the moving module is specifically used for:

Move according to a preset movement pattern; or,

In a fifth aspect, an embodiment of the present application provides a device control apparatus, including: at least one processor and a memory;

the memory is used to store computer-executable instructions;

The at least one processor is configured to execute computer-executable instructions stored in the memory, so that the at least one processor executes the device control method according to any one of the first aspects above.

In a sixth aspect, an embodiment of the present application provides a device control apparatus, including: at least one processor and a memory;

the memory is used to store computer-executable instructions;

The at least one processor is configured to execute computer-executable instructions stored in the memory, so that the at least one processor executes the device control method according to any one of the second aspect above.

In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, where computer-executable instructions are stored in the computer-readable storage medium, and when a processor executes the computer-executable instructions, any one of the above-mentioned first aspects is implemented. The device control method described in item.

In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium, where computer-executable instructions are stored in the computer-readable storage medium, and when a processor executes the computer-executable instructions, any one of the above-mentioned second aspects is implemented. The device control method described in item.

In the device control method, device, and storage medium provided by the embodiments of the present application, the elements to be added are split into at least two elements, and the split elements are respectively placed on the user interface, thereby avoiding the distribution of free space in the user interface due to the Or the shape is different from the position distribution or shape of the element to be added, so that the element to be added cannot be placed in the user interface, and the space of the user interface is wasted, thus improving the space utilization rate of the user interface.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

1 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present application;

FIG. 2 is an architecture diagram of a communication network system provided by an embodiment of the present application;

3 is a schematic diagram of an application scenario provided by an embodiment of the present application;

FIG. 4 is a schematic flowchart of a device control method provided by an embodiment of the present application;

5 is a schematic diagram of a combination element provided by an embodiment of the present application;

6A is a schematic diagram of a user interface provided by an embodiment of the present application;

6B is a schematic diagram of another user interface provided by an embodiment of the present application;

FIG. 7 provides another device control method according to an embodiment of the present application;

FIG. 8 is a schematic diagram of adding interface elements provided by an embodiment of the present application;

FIG. 9 is a schematic flowchart of another device control method provided by an embodiment of the present application;

10 is a schematic flowchart of another device control method provided by an embodiment of the present application;

11 is a schematic diagram of adding interface elements in another device control method provided by an embodiment of the present application;

12 is a schematic flowchart of another device control method provided by an embodiment of the present application;

13 is a schematic diagram of adding interface elements in yet another device control method provided by an embodiment of the present application;

14 is a schematic flowchart of a fifth device control method provided by an embodiment of the present application;

15 is a schematic diagram of adding interface elements in yet another device control method provided by an embodiment of the present application;

16 is a schematic flowchart of another device control method provided by an embodiment of the present application;

17 is a schematic diagram of adding interface elements in another device control method provided by an embodiment of the present application;

FIG. 18 is a schematic diagram of a reduced existing element of a user interface provided by an embodiment of the present application;

19 is a schematic flowchart of another device control method provided by an embodiment of the present application;

20 is a schematic diagram of adding interface elements in another device control method provided by an embodiment of the present application;

FIG. 21 is a schematic structural diagram of a device control apparatus provided by an embodiment of the application;

FIG. 22 is a schematic structural diagram of another device control apparatus provided by an embodiment of the present application;

23 is a schematic structural diagram of another device control apparatus provided by an embodiment of the application;

FIG. 24 is a schematic structural diagram of still another device control apparatus provided by an embodiment of the present application;

FIG. 25 is a schematic diagram of a hardware structure of a device control apparatus provided by an embodiment of the present application.

detailed description

In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

In the following description, suffixes such as 'module', 'component' or 'unit' used to represent elements are used only to facilitate the description of the present application, and have no specific meaning per se. Thus, "module", "component" or "unit" may be used interchangeably.

The apparatus may be implemented in various forms. For example, the devices described in this application may include devices such as cell phones, tablet computers, notebook computers, PDAs, Personal Digital Assistants (PDAs), Portable Media Players (PMPs), navigation devices, Mobile terminals such as wearable devices, smart bracelets, and pedometers, as well as stationary terminals such as digital TVs and desktop computers.

In the following description, a mobile terminal will be used as an example, and those skilled in the art will understand that, in addition to elements specially used for mobile purposes, the configurations according to the embodiments of the present application can also be applied to stationary type terminals.

Please refer to FIG. 1 , which is a schematic diagram of the hardware structure of a mobile terminal implementing various embodiments of the present application. The mobile terminal 100 may include: an RF (Radio Frequency, radio frequency) unit 101, a WiFi module 102, an audio output unit 103, a /V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that the structure of the mobile terminal shown in FIG. 1 does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or less components than the one shown, or combine some components, or different components layout.

Below in conjunction with Fig. 1, each component of the mobile terminal is introduced in detail:

The radio frequency unit 101 can be used for receiving and sending signals during transmission and reception of information or during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 110; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, Global System for Mobile Communication), GPRS (General Packet Radio Service, General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000 , Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, Time Division Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency division duplexing long term evolution) and TDD-LTE (Time Division Duplexing-Long Term Evolution, time division duplexing long term evolution) and so on.

WiFi is a short-distance wireless transmission technology, and the mobile terminal can help users to send and receive emails, browse web pages, access streaming media, etc. through the WiFi module 102, which provides users with wireless broadband Internet access. Although FIG. 1 shows the WiFi module 102, it can be understood that it is not a necessary component of the mobile terminal, and can be completely omitted as required within the scope of not changing the essence of the invention.

When the mobile terminal 100 is in a call signal receiving mode, a talking mode, a recording mode, a voice recognition mode, a broadcast receiving mode, etc., the audio output unit 103 can store the data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109. The audio data is converted into audio signal and output as sound. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the mobile terminal 100 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The A/V input unit 104 is used to receive audio or video signals. The A/V input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 responds to still pictures or images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The image data of the video is processed. The processed image frames may be displayed on the display unit 106 . The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102 . The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, etc. operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 101 for output in the case of a telephone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to remove (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.

The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can close the display panel 1061 and the display panel 1061 when the mobile terminal 100 is moved to the ear. / or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes), and can detect the magnitude and direction of gravity when it is stationary. games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, etc. Other sensors such as thermometers, infrared sensors, etc. will not be repeated here.

The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numerical or character information, and generate key signal input related to user settings and function control of the mobile terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072 . The touch panel 1071, also referred to as a touch screen, can collect the user's touch operations on or near it (such as the user's finger, stylus, etc., any suitable object or attachment on or near the touch panel 1071). operation), and drive the corresponding connection device according to the preset program. The touch panel 1071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 110, and can receive the command sent by the processor 110 and execute it. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1071 , the user input unit 107 may also include other input devices 1072 . Specifically, other input devices 1072 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, operation sticks, etc., which are not specifically limited here. .

Further, the touch panel 1071 can cover the display panel 1061, and when the touch panel 1071 detects a touch operation on or near it, it transmits it to the processor 110 to determine the type of the touch event, and then the processor 110 determines the type of the touch event according to the touch event. Type provides corresponding visual output on display panel 1061 . Although in FIG. 1 , the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the mobile terminal, but in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated The input and output functions of the mobile terminal are implemented, which is not specifically limited here.

The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100 . For example, external devices may include wired or wireless headset ports, external power (or battery charger) ports, wired or wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 108 may be used to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used between the mobile terminal 100 and the external Transfer data between devices.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required for at least one function, and the like; Data created by the use of the mobile phone (such as audio data, phone book, etc.), etc. Additionally, memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is the control center of the mobile terminal, uses various interfaces and lines to connect various parts of the entire mobile terminal, runs or executes the software programs and/or modules stored in the memory 109, and calls the data stored in the memory 109. , perform various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem The processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 110 .

The mobile terminal 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption management through the power management system and other functions.

Although not shown in FIG. 1 , the mobile terminal 100 may also include a Bluetooth module, etc., which will not be described herein again.

To facilitate understanding of the embodiments of the present application, a communication network system on which the mobile terminal of the present application is based is described below.

Please refer to FIG. 2. FIG. 2 is an architecture diagram of a communication network system provided by an embodiment of the application. The communication network system is an LTE system of universal mobile communication technology. ) 201, E-UTRAN (Evolved UMTS Terrestrial Radio Access Network, Evolved UMTS Terrestrial Radio Access Network) 202, EPC (Evolved Packet Core, Evolved Packet Core) 203 and the operator's IP service 204.

Specifically, the UE 201 may be the above-mentioned terminal 100, which will not be repeated here.

E-UTRAN 202 includes eNodeB 2021 and other eNodeB 2022 and the like. The eNodeB 2021 can be connected to other eNodeBs 2022 through a backhaul (eg X2 interface), the eNodeB 2021 is connected to the EPC 203 , and the eNodeB 2021 can provide access from the UE 201 to the EPC 203 .

EPC 203 may include MME (Mobility Management Entity, Mobility Management Entity) 2031, HSS (Home Subscriber Server, Home Subscriber Server) 2032, other MME 2033, SGW (Serving Gate Way, Serving Gateway) 2034, PGW (PDN Gate Way, packet data network gateway) 2035 and PCRF (Policy and Charging Rules Function, policy and charging functional entity) 2036 and so on. Among them, MME2031 is a control node that processes signaling between UE201 and EPC203, and provides bearer and connection management. The HSS2032 is used to provide some registers to manage functions such as the home location register (not shown in the figure), and to store some user-specific information about service characteristics, data rates, etc. All user data can be sent through SGW2034, PGW2035 can provide IP address allocation and other functions of UE 201, PCRF2036 is the policy and charging control policy decision point of service data flow and IP bearer resources, it is the policy and charging execution function A unit (not shown) selects and provides available policy and charging control decisions.

The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem, IP Multimedia Subsystem) or other IP services.

Although the above takes the LTE system as an example, those skilled in the art should know that this application is not only applicable to the LTE system, but also applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new The network system, etc., is not limited here.

Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

FIG. 3 is a schematic diagram of an application scenario provided by an embodiment of the present application. Referring to FIG. 3 , it includes an electronic device 100 , a user interface 101 , an element to be added 102 and an existing element 103 .

The electronic device 100 may be a mobile phone, a tablet computer, etc., and the system of the electronic device may be an Android system. The user interface 101 may be the main desktop interface of the electronic device or the auxiliary desktop interface, and the interface may be divided into a plurality of cells, and these cells are used to place various elements (such as the element to be added 102, the existing element 103). ). The element to be added 102 may be an element in the user interface that has not yet been placed. It is indicated by a dashed line in FIG. 3 . Existing elements 103 may be elements that have already been placed in the user interface. It is represented by a solid line rounded box in Figure 3. The element to be added 102 and the existing element 103 may include an application icon, a shortcut icon or a widget (widget) icon of a function in the application, and the like.

In some cases, the user needs to add the element 102 to be added to the user interface 101 of the electronic device 100 for convenience, such as adding a time and weather combination element to the main desktop interface of the mobile phone to facilitate the user to check the time and weather. Alternatively, the user needs to add the element 102 to be added to the user interface 101 of the electronic device 100 and then move it in the user interface 101, so that the elements can be arranged according to the user's wishes, for example, according to the user's frequency of use, move the element with higher frequency of use to the same user interface of the electronic device.

In this application, by determining the element to be added and the user interface, obtaining the attribute information of the element to be added and the layout information of the element in the user interface, and adjusting the attribute information of the element to be added and/or the layout information of the element in the user interface, the Elements are placed into the space of the user interface, enabling the addition of elements. In this way, combined with the attribute information of the element to be added and/or the layout information of the element in the user interface, the space in the user interface can be fully utilized, and the space utilization rate can be improved.

Hereinafter, the technical solutions shown in the present application will be described in detail through specific embodiments. It should be noted that the following specific embodiments may be combined with each other, and the same or similar content will not be repeated in different embodiments.

FIG. 4 is a schematic flowchart of a device control method provided by an embodiment of the present application. Referring to FIG. 4, the method may include:

S201: Determine the element to be added and the user interface, the element to be added is a combined element, and the user interface is an interface where the element to be added is placed.

The execution body of the embodiment of the present application may be an electronic device, or may be a device control device provided in the electronic device. Optionally, the device control device can be implemented by software, or can be implemented by a combination of software and hardware.

A combined element includes at least two elements, that is, a combined element is a combination of at least two elements. For example, a time element and a weather element may be included in the combined element, or the combined element may include a pattern element and a text element.

Next, the combined elements will be described with reference to FIG. 5 .

FIG. 5 is a schematic diagram of a combination element provided by an embodiment of the present application. Referring to FIG. 5 , the user interface includes a combination element M, and the combination element M includes an element M1 and an element M2.

The user interface may be an interface where elements to be added are placed. The user interface can be divided into a plurality of cells, and the state of the cells can be idle or occupied. When the state of the cell is in the idle state, the element to be added can be placed in the cell, and when the state of the cell is in the occupied state, the element to be added cannot be placed in the cell. For example, you can use true to indicate that the cell state is occupied, and false to indicate that the cell state is idle.

S202: If the free space in the user interface is not enough to place the element to be added, split the combined element into at least two elements.

Optionally, the free space in the user interface is not enough to place the element to be added, which may include at least one of the following situations:

Case 1. The position distribution between the cells occupied by the element to be added is different from the position distribution between the idle cells in the user interface.

In this case, the number of free cells in the user interface may be greater than or equal to the number of cells occupied by the elements to be added. However, because the location distribution between the cells occupied by the elements to be added is different from that of the free cells in the user interface The location distribution between the grids results in insufficient free space in the user interface to place the elements to be added.

For example, the location distribution of the cells occupied by the element to be added is 2*3, and the location distribution of the free cells in the user interface is 3*2, then the location distribution of the cells occupied by the element to be added is the same as that of the free cells in the user interface. The distribution of positions between cells is different.

This situation will be described below with reference to FIG. 6A .

FIG. 6A is a schematic diagram of a user interface provided by an embodiment of the present application. Referring to FIG. 6A , the user interface includes a plurality of cells, wherein the state of the cell shown by the solid line is the occupied state, and the state of the cell shown by the dotted line is the idle state. The user interface also includes an element M to be added, the element M to be added is a combined element, and the position distribution between the cells occupied by the element M to be added is 1*4 (that is, one row and four columns); free cells in the user interface The position distribution between is 2*2 (ie, two rows and two columns). Therefore, the position distribution among the cells occupied by the element to be added is different from the position distribution among the idle cells in the user interface.

Of course, in this case, the position distribution between the cells occupied by the element to be added and the position distribution between the idle cells in the user interface may also be other, which is not specifically limited in this embodiment of the present application.

Case 2. The shape of the element to be added is different from the shape of the free space in the user interface.

In this case, the number of free cells in the user interface may be greater than or equal to the number of cells occupied by the elements to be added. However, since the shape of the elements to be added is different from the shape of the free space in the user interface, the idle space in the user interface is caused. There is not enough space to place the element to be added.

For example, if the shape of the element to be added is a rectangle of 1*3, and the shape of the free space in the user interface is a square of 2*2, the shape of the element to be added is different from the shape of the free space in the user interface.

This situation will be described below with reference to FIG. 6B .

FIG. 6B is a schematic diagram of another user interface provided by an embodiment of the present application. Please refer to FIG. 6B . Referring to FIG. 6B , the user interface includes a plurality of cells, wherein the state of the cell shown by the solid line is the occupied state, and the state of the cell shown by the dotted line is the idle state. The user interface also includes an element M to be added, the element M to be added is a combined element, and the position distribution between the cells occupied by the element M to be added is 1*2 (that is, one row and two columns); free cells in the user interface The position distribution between is 2*1 (ie, two rows and one column). Therefore, the shape of the element to be added is different from the shape of the free space in the user interface.

Of course, in this case, the shape of the element to be added and the shape of the free space in the user interface may also be other, which are not specifically limited in this embodiment of the present application.

Case 3: The area occupied by the element to be added is larger than the area of the free space in the user interface.

Case 4: The number of cells occupied by elements to be added is greater than the number of free cells in the user interface.

After the combined element is split, at least two elements can be obtained, and the obtained element after splitting can be a single element or a sub-combination element, and the sub-combination element includes at least two elements (or a single element).

For example, assuming that the combined element includes 3 single elements, denoted as single element 1, single element 2 and single element 3, the combined element can be split into two elements, denoted as element 1 and element 2, respectively, where , element 1 can be a single element 1, and element 2 can include a single element 2 and a single element 3.

S203: Place at least two elements in the free space of the user interface respectively.

Optionally, the split elements can also be placed in the free space of the user interface in the following manner: split the combined element into at least two elements; according to the priority information of the split elements, split the at least two elements. In turn, they are placed in the free space of the user interface.

For example, if the element to be added is a combination element of time and weather, the combination element can be divided into a time element and a weather element, and the time element in the combination can also be divided into a year, month, day, and hour, minute, and second elements. By dividing a combined element with a large number of cells into a plurality of elements with a small number of cells, the free space of the user interface can be reasonably utilized to improve the space utilization of the user interface.

Optionally, the priority information of the split elements may include at least one of the following: the order of splitting and combining elements; or the order of user usage frequency from low to high, or from high to low.

The combined element may be split into at least two elements in at least one of the following manners: splitting according to a preset splitting manner of the combined element; or splitting according to attribute information and/or layout information. For example, the preset splitting method of combined elements includes: if the combined element includes N elements, splitting the combined elements into N elements; or using the same attribute element as one element and different attribute elements as the second element, such as In Fig. 6B, the year, month, day, and hour, minute, and second elements in the element M to be added belong to the time element, so they are not split as a sub-combination element, and the weather element is different from the time element, and is split into two elements; or the element to be added There are different layout partitions between the included elements. If each element has its own edge, it will be split according to the edge of the element; if there is a partition line between each element, it will be split according to the partition line between elements; or other user-defined split methods, this There are no restrictions.

Before splitting the combined element into at least two elements, the attribute information of the element to be added and/or the layout information of the element in the user interface may also be adjusted.

After the combined element is split into at least two elements, the attribute information of the element to be added and/or the layout information of the element in the user interface can also be adjusted.

Optionally, the attribute information can be adjusted in the following possible implementation manners:

Method 1. Reduce or crop the area occupied by the element to be added.

Optionally, the elements to be added may be reduced to reduce the area occupied by the elements to be added. Alternatively, the element to be added can be clipped to reduce the area occupied by the element to be added. For example, the less important content of the element to be added can be trimmed, or the content of the element to be added or the content other than the edge can be trimmed.

Method 2: Reduce the number of cells occupied by elements to be added.

Optionally, the element to be added may be reduced or trimmed to reduce the number of cells occupied by the element to be added.

Mode 3: Adjust the position distribution among the cells occupied by the elements to be added.

For example, assuming that the position distribution between the cells occupied by the elements to be added is 1*4 (one row and four columns), the position distribution between the cells occupied by the elements to be added can be adjusted to 2*2 (two rows and two columns) .

Method 4: Adjust the shape of the element to be added.

The shape of the element to be added can be circle, square, rectangle, trapezoid, etc.

Mode 5: Adjust the combination mode or priority information of the elements to be added.

Optionally, the layout information includes at least one of the following information: the area of free space in the user interface, the number of free cells in the user interface, the location distribution between the free cells in the user interface, the shape of the free space in the user interface, The spacing between existing elements in the user interface, the priority information of the existing elements in the user interface.

The layout information can be adjusted in at least one of the following ways:

Method 1. Enlarge or expand the free space area.

The free space area may refer to a continuous free space area.

For example, the position of at least one existing element in the user interface may be moved to increase the area of contiguous free space in the user interface.

For example, some existing elements in the user interface may be deleted, or some existing elements in the user interface may be merged for processing.

Method 2. Increase the number of free cells.

Method 3: Adjust the position distribution or the shape of the free space between the free cells.

Mode 4: Adjust the spacing or priority information between existing elements.

In this embodiment, by splitting the element to be added into at least two elements, and placing the split elements on the user interface respectively, it is avoided that the position distribution or shape of the free space in the user interface is different from the position distribution or shape of the element to be added. The shape of the element to be added cannot be placed on the user interface, and the space of the user interface is wasted. Therefore, the space utilization rate of the user interface is improved.

FIG. 7 is another device control method provided by an embodiment of the present application. Referring to FIG. 7, the method may include:

S501: Determine the element to be added and the user interface.

The element to be added can be an element, multiple elements, or a combination of elements. Can be elements of the same type or elements of different types. The user interface may be the current interface where the element to be added is placed. The free space for this UI is not contiguous. For details, please refer to S201.

S502: If the free space in the user interface is not enough to place the element to be added, move at least one existing element of the user interface to another user interface.

Optionally, the other user interface may be a desktop interface of the electronic device other than the current interface where the element to be added is placed.

Case 1. The area occupied by the element to be added is larger than the area of the free space in the user interface.

Case 2: The number of cells occupied by the element to be added is greater than the number of free cells in the user interface.

Case 3: The position distribution between the cells occupied by the element to be added is different from the position distribution between the idle cells in the user interface.

Case 4. The shape of the element to be added is different from the shape of the free space in the user interface.

It should be noted that, for the above four situations, reference may be made to the description in S202, which will not be repeated here.

Optionally, at least one existing element of the user interface can be moved to another user interface in at least one of the following ways:

Mode 1: Move at least one existing element of the user interface to other user interfaces in a first order; the first order is from back to front, or from front to back.

Manner 2: Move at least one existing element of the user interface to other user interfaces in a second order; the second order is an order in which the user's usage frequency is from low to high.

Mode 3: Move at least one existing element of the user interface to another user interface, so as to obtain N free cell spaces in the user interface; N is the number of cells occupied by the element to be added; wherein N can be 1, 2, 3 ....etc. positive integers.

Mode 4: Move according to a preset movement mode.

For example, the preset moving manner may be moving elements in preset cells in the user interface to other user interfaces, or the preset moving manner may be moving elements of a preset type in the user interface to other user interfaces. For example, the preset types may include weather types, text types, and the like.

Manner 5: Move according to attribute information and/or layout information.

Certainly, at least one existing element of the user interface may also be moved to another user interface in other manners, which is not specifically limited in this embodiment of the present application.

S503: Place the element to be added in the space of the user interface according to the priority information of the element to be added.

Specifically, the elements to be added can be placed in the space of the user interface according to the order of the frequency of using the elements to be added by the user, the type of the elements to be added, or the order of obtaining the elements to be added. The specific placement method is not limited here.

Optionally, the space for placing the user interface of the element to be added may be a free space or a space occupied by an existing element. If the space for placing the element to be added is free space, you can directly place the element to be added in the free space; if the space for placing the element to be added is the space occupied by an existing element, you can place the element to be added at the same time. Move the existing element to another space in the user interface, or move the existing element to another user interface.

The element to be added can be placed in the space of the user interface in the following way: determine the state of the cell of the user interface, and place the element to be added in the space of the user interface according to the state of the cell, wherein the state of the cell includes The idle state or the occupied state; the idle state is the state of the element to be placed; the occupied state is the state of the placed element. If the state of the cell is in the idle state, the element to be added is placed in the cell in the idle state of the user interface; if the state of the cell is in the occupied state, the element to be moved in the user interface is determined; the attribute information of the element to be moved is adjusted. and/or the layout information of elements in the user interface, to move the element to be moved into the free space of the user interface.

Before moving at least one existing element of the user interface to another user interface, the attribute information of the element to be added and/or the layout information of the element in the user interface may also be adjusted.

After moving at least one existing element of the user interface to another user interface, the attribute information of the existing element and/or the layout information of the element in the user interface may also be adjusted.

Optionally, the attribute information includes at least one of the following information: the area occupied by the element to be added, the number of cells occupied by the element to be added, the position distribution between the cells occupied by the element to be added, the shape of the element to be added, The combination method of the elements to be added, and the priority information of the elements to be added.

The attribute information can be adjusted in several possible implementations as follows:

Method 1. Reduce or crop the area occupied by the element to be added.

Optionally, the elements to be added may be reduced to reduce the area occupied by the elements to be added. Alternatively, the element to be added can be clipped to reduce the area occupied by the element to be added. For example, the less important content of the element to be added may be trimmed, or the content of the element to be added or the content other than the edge may be trimmed.

Method 2: Reduce the number of cells occupied by elements to be added.

Method 4: Adjust the shape of the element to be added.

The layout information can be adjusted in at least one of the following ways:

Method 1. Enlarge or expand the free space area.

Method 2. Increase the number of free cells.

Mode 4: Adjust the spacing or priority information between existing elements.

In this embodiment, by moving the existing elements with low priority in the current user interface to other interfaces, the free space of the current user interface is increased, which is enough to place the elements to be added, and it is avoided that due to insufficient free space of the user interface, the Some space of the user interface caused by placing the elements to be added is vacant, thus improving the space utilization of the user interface.

Next, with reference to FIG. 8 , the method shown in the embodiment of FIG. 7 will be described.

FIG. 8 is a schematic diagram of adding interface elements according to an embodiment of the present application. Referring to Figure 8, the solid line rounded box is the existing element of the user interface. The free space in the user interface in the left picture is 2*2, and the black filled rounded box is the existing element with the lowest priority. The right picture The time widget in and the three dotted rounded squares are the elements to be added. If you want to place the element to be added in the user interface shown on the left, it cannot be placed. Then, move the existing element with the lowest priority in the left image to other user interfaces, and then the element to be added can be placed in the user interface. interface space. The user interface where the elements to be added are placed is shown on the right side of Figure 8.

FIG. 9 is a schematic flowchart of another device control method provided by an embodiment of the present application. Referring to FIG. 9, the method is applied to an electronic device and may include:

S701: Determine the element to be added and the user interface.

Optionally, the execution body of the embodiment of the present application may be an electronic device, or may be a device control apparatus provided in the electronic device. Optionally, the device control apparatus may be implemented by software, or may be implemented by a combination of software and hardware.

Preferably, the user interface may be an interface where elements to be added are placed. The user interface can be divided into a plurality of cells, and the state of the cells can be idle or occupied. For example, you can use true to indicate that the cell state is occupied, and false to indicate that the cell state is idle. If the state of a cell of the user interface is false, the element to be added can be placed in the cell.

Optionally, the element may include at least one of the following: an application icon, a widget icon, a function icon, at least two application icons, patterns and text information, and the like. Wherein, the application icon may be an icon of an application (such as a chat application, a shopping application, etc.); the widget icon may be an icon of a widget (such as a clock weather widget, a music widget, etc.); the function icon may be "settings" Or the icons of functions such as "one-key lock screen"; the at least two application icons may be icons formed by combining the icons of at least two application programs. The element to be added may be any one or more of the above-mentioned elements.

S702: Acquire information on the area occupied by the element to be added or the number of cells occupied by the element, and the information on the area of free space or the number of free cells in the user interface.

Optionally, the area occupied by the element to be added may be the product of the number of user interface cells the element to be added needs to occupy in the horizontal direction and the number of user interface cells in the vertical direction if the element to be added is placed on the user interface. For example, the element to be added is a combined element of time and weather, and the area occupied by the combined element may be 1*4 or 2*2.

Optionally, the number of cells occupied by the element to be added may be the number of cells occupied in the user interface if the element to be added is placed in the user interface. Assuming that the element to be added is a combination of 1*4 or 2*2 of time and weather, and the combined element is placed in the user interface, the number of cells in the user interface that needs to be occupied is 4, that is, the element to be added occupies 4 The number of cells is 4.

Optionally, the free space area in the user interface may be the space area of the unplaced element in the user interface, or may be the sum of the areas of the cells in the idle state in the user interface. The number of idle cells information may include the number of cells in an idle state in the user interface, or the sum of the numbers of cells in an idle state.

S703: Adjust the attribute information of the element to be added and/or the layout information of the element in the user interface, and place the element to be added in the space of the user interface.

Optionally, the attribute information may include at least one of the following information: the area occupied by the element to be added, the location distribution between the cells occupied by the element to be added, the shape of the element to be added, the combination method of the element to be added, the element to be added Element's priority information.

Wherein, the position distribution between the cells occupied by the element to be added may be continuous or discontinuous. The shape of the element to be added may include a rectangle, a square, and the like. The combination of elements to be added may include horizontal combination and vertical combination. The priority information of the element to be added may include priority information according to the frequency of use by the user, priority information according to the placement position of the element to be added, priority information according to the type of the element to be added, and the like.

Optionally, the layout information may include at least one of the following information: the area of free space in the user interface, the location distribution between free cells in the user interface, the shape of the free space in the user interface, and the space between existing elements in the user interface. spacing, priority information for elements already in the user interface.

The free cell may be a cell in a false state, and the free space area in the user interface may be the product of the number of horizontal free cells and the number of vertical free cells in the user interface. The distribution of positions between idle cells in the user interface can be continuous or discontinuous. The shape of the free space in the user interface can be a rectangle or a square, etc. The spacing between existing elements in the user interface may be horizontal spacing and/or vertical spacing between existing elements. The priority information of the existing elements in the user interface may include the priority information according to the frequency of use by the user, the priority information according to the placement position of the existing elements, the priority information according to the type of the existing elements, and the like.

Optionally, it is possible to first judge whether the element to be added and the element in the user interface meet the preset conditions; if the preset conditions are met, then adjust the attribute information of the element to be added and/or the layout information of the element in the user interface, and then adjust the attribute information of the element to be added and/or the layout information of the element in the user interface. The step of placing the element into the space of the user interface; if the preset conditions are not met, the step of placing the element to be added into the space of the user interface is directly executed.

Optionally, the preset conditions may include at least one of the following: the number of cells occupied by the elements to be added is greater than the number of free cells in the user interface; the area occupied by the elements to be added is greater than the area of free space in the user interface; the elements to be added The position distribution between the occupied cells is different from the position distribution between the free cells in the user interface; the shape of the element to be added is different from the shape of the free space in the user interface.

Optionally, the space of the user interface may be an idle space in the user interface, or may be a cell in an idle state in the user interface.

Optionally, the attribute information of the element to be added or the layout information of the element in the user interface can be adjusted separately, or the attribute information of the element to be added and the layout information of the element in the user interface can be combined to adjust both at the same time, so that the user can The space of the interface can be used more rationally.

Optionally, before adjusting the attribute information of the element to be added and/or the layout information of the element in the user interface and placing the element to be added in the space of the user interface, the state of the cell of the user interface can be determined first, and the state can be is idle or occupied. In this way, the attribute information of elements to be added and/or the layout information of elements in the user interface can be adjusted according to the position distribution of the cells in the idle state of the user interface, and the elements to be added can be placed in the cells of the idle state of the user interface. By determining the state of the cells of the user interface, the elements to be added can be placed in the space of the user interface quickly and conveniently, which improves the efficiency of adding interface elements.

Optionally, after placing the element to be added in the space of the user interface, the element to be moved in the user interface can also be determined; the attribute information of the element to be moved and the layout information of the element in the user interface are obtained; Attribute information and/or layout information of elements in the user interface, placing the element to be moved into a free cell of the user interface.

The attribute information of the element to be moved may include at least one of the following information: the number of cells occupied by the element to be moved, the area occupied by the element to be moved, the position distribution between the cells occupied by the element to be moved, the The shape of the element, the combination of the elements to be moved, and the priority information of the elements to be moved. The user interface can be the same user interface or different user interfaces.

In this way, by adjusting the attribute information of the element and/or the layout information of the element in the user interface, the intelligent movement of the element is realized, the mechanical movement of the element is avoided, and the user experience is improved.

In the device control method provided by this implementation, by determining the element to be added and the user interface, the information on the area occupied by the element to be added or the number of cells occupied and the information on the area of free space or the number of free cells in the user interface are obtained, and the information on the area of the free space or the number of free cells in the user interface is adjusted. The attribute information of the element and/or the layout information of the element in the user interface, the element to be added is placed in the space of the user interface, thereby realizing the addition of the element in the user interface. In this way, combined with the attribute information of the element to be added and/or the layout information of the element in the user interface, the space in the user interface can be fully utilized, and the space utilization rate is improved.

An embodiment of the present application further provides a device control method, please refer to FIG. 10 , and FIG. 10 is a schematic flowchart of another device control method provided by an embodiment of the present application. In this method, if the free space in the user interface is not enough to place the element to be added, the element to be added is reduced. The method can include:

S801: Determine the element to be added and the user interface.

The element to be added may be an element or a combined element. The user interface may be an interface where elements to be added are placed. For details, please refer to S201.

S802: If the free space in the user interface is not enough to place the element to be added, reduce the element to be added.

Optionally, the free space in the user interface is not enough to place the element to be added, which may include at least one of the following: the number of cells occupied by the element to be added is greater than the number of free cells in the user interface; or the area occupied by the element to be added is greater than The area of free space in the user interface.

Optionally, the elements to be added can be reduced proportionally.

Optionally, the element to be added is proportionally reduced to a preset size to obtain the reduced element to be added, and the preset size is the size of the free space that can be placed in the user interface;

Alternatively, the element to be added is proportionally reduced to a preset size, so that the element to be added can be placed in the free space of the user interface, and the reduced element to be added is obtained.

S803: Place the reduced element to be added in the free space of the user interface.

For example, FIG. 11 is a schematic diagram of adding interface elements in another device control method provided by an embodiment of the present application. Suppose the element to be added is a time widget, see Figure 11, the dotted line element in the left figure is the time widget to be added, the number of cells occupied by the time widget is 2*3, and the number of free cells in the user interface is The number is 1*2, and the solid line time widget in the figure on the right is the reduced time widget to be added. By reducing the dotted line element on the left to the free space that can be placed in the user interface, the solid line in the figure on the right is obtained. Time widget. The number of cells occupied by the solid-line time widget is 1*2, which is the same as the number of free cells in the user interface. In this way, the reduced time widget can be placed in the free space of the user interface. middle.

Optionally, if there is more free space in the user interface, the element to be added can be enlarged and reduced. Optionally, the reduced element to be added may be enlarged to the original ratio of the element to be added.

In this embodiment, by reducing the size of the element to be added and placing it on the user interface, it is avoided that the element to be added cannot be placed on the user interface because the free space in the user interface is not enough to place the element to be added, and the space of the user interface is wasted, Therefore, the space utilization of the user interface is improved.

An embodiment of the present application further provides a device control method. Please refer to FIG. 12 , which is a schematic flowchart of another device control method provided by an embodiment of the present application. In this method, the element to be added is a combination element, and if the free space in the user interface is not enough to place the element to be added, the combination method of the combination element is adjusted. The method can include:

S1001: Determine the element to be added and the user interface.

The element to be added may be a combination element, such as a time and weather combination element, a pattern and text information combination element, and the like. The user interface is an interface where elements to be added are placed. For details, please refer to S201.

S1002: If the free space in the user interface is not enough to place the element to be added, adjust the combination method of the combined element.

Optionally, the free space in the user interface is not enough to place the element to be added, which may include at least one of the following: the position distribution between the cells occupied by the element to be added is different from the position distribution between the idle cells in the user interface; or The shape of the element to be added is different from the shape of the free space in the user interface.

For example, the location distribution of the cells occupied by the elements to be added is 2*3, and the location distribution of the free cells in the user interface is 3*2, then the location distribution of the cells occupied by the elements to be added is the same as that of the free cells in the user interface. The distribution of locations is different. For another example, if the shape of the element to be added is a rectangle of 1*3, and the shape of the free space in the user interface is a square of 2*2, the shape of the element to be added is different from the shape of the free space in the user interface.

Optionally, the combination mode may be a combination mode in a combination mode set preset in the electronic device, and the combination mode set includes a variety of different combination modes of elements.

S1003: Place the adjusted composition element in the free space of the user interface.

Optionally, the combination mode of the combined elements can be adjusted in at least one of the following ways, and the adjusted combined elements can be placed in the free space of the user interface:

From the preset combination mode set, select a combination mode that matches the position distribution of the free cells in the user interface or the shape of the free space, and place the selected combined elements in the free space of the user interface.

Or, adjust the combination mode of the combined elements to a combination mode that matches the position distribution between the free cells in the user interface or the shape of the free space, and place the adjusted combined element in the free space of the user interface.

If there is more free space in the user interface, the adjusted combination mode of the combined elements is adjusted to the best combination mode.

For example, FIG. 13 is a schematic diagram of adding interface elements in yet another device control method provided by an embodiment of the present application. Please refer to Figure 13. The time and weather combination widget in the left figure is the element to be added. The shape of the combination widget is a 1*4 rectangle, while the free space in the user interface is shaped as a 2*2 square. Set the combination of time and weather widgets to be centralized, select a combination of 2*2 with the same shape as the free space in the user interface, or adjust the combination of time and weather widgets from 1*4 to 2*2, get In the figure on the right, the shape is a 2*2 square combination widget, so that the shape of the combination widget is the same as the shape of the free space in the user interface. In this way, the adjusted combination widget can be placed in the free space of the user interface.

Optionally, if there are more free cells in the user interface, the combination mode of the adjusted combination elements can be adjusted to the best combination mode. The optimal combination mode may be a combination mode in a set of preset combination modes. Adjusting the combination of the combined elements to the best combination can improve the user's visual effect on the elements, thereby improving the user experience.

In this embodiment, by adjusting the combination of the elements to be added, the adjusted elements to be added are placed on the user interface, so as to avoid that the position distribution or shape of the free space in the user interface is different from the position distribution or shape of the elements to be added. The added elements cannot be placed on the user interface, which wastes the space of the user interface, and thus improves the space utilization of the user interface.

An embodiment of the present application further provides a device control method, please refer to FIG. 14 , and FIG. 14 is a schematic flowchart of a fifth device control method provided by an embodiment of the present application. In this method, the elements to be added are at least two elements, and if the free space in the user interface is not enough to place the elements to be added, some elements of the elements to be added are placed. The method can include:

S1201: Determine the element to be added and the user interface.

The elements to be added can be at least two elements of the same type or different types, such as at least two shopping-type application icons, or more than one shopping-type application icon and more than one chat-type application, or more than one application icon and more than one widget icon, etc. The user interface may be an interface where elements to be added are placed. For details, please refer to S201.

S1202: If the free space in the user interface is not enough to place the elements to be added, place some of the at least two elements to be added in the free space of the user interface according to the position distribution between the free cells in the user interface, and place The remaining unplaced elements remain in the original UI.

Optionally, the free space in the user interface is not enough to place the element to be added, which may include at least one of the following: the number of cells occupied by the element to be added is greater than the number of free cells in the user interface; or the area occupied by the element to be added is greater than Free space in the user interface.

Optionally, some of the at least two elements to be added may be determined in at least one of the following ways: according to the frequency of the user using the element from high to low; or according to the type of the element; or according to the user's preference; There is no specific limitation.

Optionally, the remaining unplaced elements may be elements to be added except the elements placed in the free space of the user interface. The original user interface may be the user interface where the element to be added is located when the element to be added is not added.

For example, FIG. 15 is a schematic diagram of adding interface elements in yet another device control method provided by an embodiment of the present application. Referring to Figure 15, the five dashed rounded squares on the left are the elements to be added. To place the five elements to be added in the free space of the user interface, at least 1*5 or 2*3 cells are required, and the user The free space in the interface is 2*2, then according to the position distribution of the free cells in the user interface, four of the five elements to be added are placed in the free space of the user interface according to the position distribution of 2*2, as shown in the figure As shown in the figure on the right in 15, at the same time restore the remaining one element back to its original position and do not add it for the time being.

In this embodiment, by placing some elements of the elements to be added on the user interface, it is avoided that the elements to be added are caused by the number or area of cells occupied by the elements to be added being larger than the number or free area of free cells in the user interface. It cannot be placed in the user interface, and the space of the user interface is wasted. Therefore, the space utilization rate of the user interface is improved.

An embodiment of the present application further provides a device control method. Please refer to FIG. 16 , which is a schematic flowchart of another device control method provided by an embodiment of the present application. In this method, if the free space in the user interface is not enough to place the element to be added, the spacing between the existing elements in the user interface is adjusted, so that the element to be added is placed in the adjusted user interface. The method can include:

S1401: Determine the element to be added and the user interface.

The element to be added may be an element or multiple elements or a combination of elements. The user interface may be an interface where elements to be added are placed. For details, please refer to S201.

S1402: If the free space in the user interface is not enough to place the element to be added, adjust the spacing between the existing elements in the user interface.

Optionally, the free space in the user interface is not enough to place the element to be added, which may include at least one of the following: the number of cells occupied by the element to be added is greater than the number of free cells in the user interface; or the area occupied by the element to be added is greater than The area of free space in the user interface; or the position distribution between the cells occupied by the elements to be added is different from the position distribution between the free cells in the user interface; or the shape of the element to be added is different from the shape of the free space in the user interface.

Optionally, the horizontal spacing and/or vertical spacing between existing elements in the user interface can be adjusted so that the horizontal and/or vertical spacing between existing elements becomes smaller, thereby obtaining more free space for placing the to-be-added elements. element.

S1403: Place the element to be added in the space of the adjusted user interface.

For example, FIG. 17 is a schematic diagram of adding interface elements in another device control method provided by an embodiment of the present application. Referring to Figure 17, the solid line rounded box is an existing element, the overall layout of the user interface in the left figure is 4*5, and the free cell is 2*2, that is, four elements to be added can be placed. If you want to add six elements to be added to the user interface in the figure on the left, the current free space in the user interface is not enough. By adjusting the vertical spacing between the existing elements in the user interface, the adjusted user interface is obtained as shown in Figure 17. As shown in the side view, the vertical spacing between the existing elements becomes smaller, so that the overall layout of the user interface becomes 4*6. In this way, the user interface has eight free cells, which are enough to place the six elements to be added in the adjustment. After the user interface in the free space.

Optionally, before adjusting the spacing between existing elements in the user interface, the existing elements in the user interface may be reduced first. As shown in FIG. 18 , FIG. 18 is a schematic diagram showing a reduced scale of existing elements of a user interface provided by an embodiment of the present application. Referring to Figure 18, the solid line rounded box in the left figure is the existing element of the original size, and its size can be 144*144 pixels, and the solid line rounded box in the right figure is the reduced existing element, and its size is 144*144 pixels. The size can be 122*122 pixels. By reducing the existing elements in the user interface, the horizontal and vertical spacing between the existing elements becomes larger, and then the horizontal and/or vertical spacing between the existing elements can be reduced, so that the number of user interface can be increased. In the free space, more elements to be added are placed on the user interface, thereby improving the space utilization of the user interface.

In this embodiment, by adjusting the spacing between existing elements of the user interface, the free space of the user interface is increased, so that more elements to be added are placed, thus improving the space utilization rate of the user interface.

An embodiment of the present application further provides a device control method. Please refer to FIG. 19 , which is a schematic flowchart of another device control method provided by an embodiment of the present application. In this method, the free space of the user interface is discontinuous. If the free space in the user interface is not enough to place the element to be added, the position of the existing element in the user interface is moved to obtain the free space of the continuous position, and the element to be added is placed. The method can include:

S1701: Determine the element to be added and the user interface.

The user interface may be an interface for placing elements to be added, and the positions of the free spaces of the user interface are discontinuous. For details, please refer to S201.

S1702: If the free space in the user interface is not enough to place the element to be added, move the position of at least one existing element in the user interface to obtain free space in consecutive positions.

Optionally, the free space of the continuous location can be obtained in at least one of the following ways:

Move the position of at least one existing element of the user interface in a first order to obtain free space in consecutive positions; the first order can be from back to front, or from front to back;

Or, move the position of at least one existing element of the user interface in sequence in a second order to obtain free space in consecutive positions; the second order is the order of user frequency from low to high;

Or, move at least one existing element of the user interface by at least one cell to obtain N free cell spaces in consecutive positions; N is the number of cells occupied by the element to be added; where N can be 1, 2, 3.. .. etc. positive integers.

S1703: Place the element to be added into the free space of the continuous position of the user interface.

For example, FIG. 20 is a schematic diagram of adding interface elements in another device control method provided by an embodiment of the present application. Referring to Figure 20, the solid line rounded box is the existing elements of the user interface. The existing elements of the user interface in the left picture are scattered, and the three free cells are not continuous, and only three 1*1 waiting cells can be placed. Add elements, if you want to place 1*3 elements to be added, you cannot place them. By moving the position of the existing elements in the user interface, the user interface in the figure on the right is obtained. The existing elements of the user interface are arranged in a concentrated manner, and the three free cells are continuous. Not only can three 1*1 elements to be added be placed, You can also place a 1*3 element to be added.

In this embodiment, by moving the positions of the existing elements in the user interface, the discontinuous free space of the user interface becomes a continuous free space. In this way, all the free spaces in the user interface are concentrated, and different types and sizes can be placed. The element to be added improves the space utilization of the user interface.

In addition, it should be noted that the above methods for elements to be added in the embodiments of FIGS. 4-20 are also applicable to elements to be moved, that is, the method for moving user interface elements and the method for adding interface elements in the above-mentioned embodiments of FIGS. 4-20 are the same, and will not be repeated here.

Based on the above method embodiments, the present application further provides a device control apparatus, which will be described in detail below.

FIG. 21 is a schematic structural diagram of a device control apparatus provided by an embodiment of the present application. Referring to FIG. 21 , the device control apparatus 190 may include: a determining module 1901 and a splitting module 1902, wherein:

The determining module 1901 is used to determine an element to be added and a user interface; the element to be added is a combined element; the user interface is an interface for placing the element to be added;

The splitting module 1902 is configured to, if the free space in the user interface is not enough to place the element to be added, split the combined element into at least two elements, so that the at least two elements can be placed separately in the free space of the user interface.

The device control apparatus shown in the embodiments of the present application can implement the technical solutions shown in the foregoing method embodiments, and the implementation principles and beneficial effects thereof are similar, which will not be repeated here.

FIG. 22 is a schematic structural diagram of another device control apparatus provided by an embodiment of the present application. On the basis of the embodiment shown in FIG. 21, please refer to FIG. 22, the device control apparatus 190 further includes a placement module 1903, wherein:

The placing module 1903 is configured to, after the splitting module 1902 splits the combined element into at least two elements, place the at least two elements in sequence according to the priority information of the split elements. in the free space of the user interface.

the sequence of splitting the combined elements;

Or the order of user frequency from low to high, or from high to low.

In a possible implementation manner, the apparatus further includes an adjustment module 1904, wherein:

The adjustment module 1904 is configured to, before the splitting module 1902 splits the combined element into at least two elements, adjust the attribute information of the element to be added and/or the layout information of the element in the user interface .

In a possible implementation manner, the adjustment module 1904 is further configured to, after the splitting module 1902 splits the combined element into at least two elements, adjust the attribute information and/or all the elements of the element. Describes the layout information of elements in the user interface.

In a possible implementation manner, the attribute information includes at least one of the following information: the area occupied by the element to be added, the number of cells occupied by the element to be added, the area occupied by the element to be added The location distribution between cells, the shape of the element to be added, the combination of the element to be added, the priority information of the element to be added; and/or,

Split according to the preset splitting method of combined elements;

The device control apparatus shown in the embodiments of the present application can implement the technical solutions shown in the foregoing method embodiments, and the implementation principles and beneficial effects thereof are similar, and will not be repeated here.

FIG. 23 is a schematic structural diagram of another device control apparatus provided by an embodiment of the present application. Referring to FIG. 23, the device control apparatus 210 may include: a determining module 2101, a moving module 2102 and a placing module 2103, wherein,

The determining module 2101 is used to determine an element to be added and a user interface; the user interface is an interface for placing the element to be added;

The moving module 2102 is configured to, if the free space in the user interface is not enough to place the element to be added, move at least one existing element of the user interface to another user interface;

The placing module 2103 is configured to, according to the priority information of the element to be added, place the element to be added in the space of the user interface;

In a possible implementation manner, the placing module 2103 is specifically used for:

determining the state of a cell of the user interface;

determining the element to be moved in the user interface;

FIG. 24 is a schematic structural diagram of still another device control apparatus provided by an embodiment of the present application. On the basis of the embodiment shown in FIG. 23, please refer to FIG. 24, the device control apparatus 210 further includes an adjustment module 2104, wherein:

The adjustment module 2104 is configured to, before the moving module 2102 moves at least one existing element of the user interface to another user interface, adjust the attribute information of the element to be added and/or the element in the user interface layout information.

In a possible implementation manner, the adjusting module 2104 is further configured to, after the moving module 2102 moves at least one existing element of the user interface to another user interface, adjust the attribute of the existing element Information and/or layout information for elements in the user interface.

In a possible implementation manner, the moving module 2102 is specifically used for:

Move according to a preset movement pattern; or,

FIG. 25 is a schematic diagram of a hardware structure of a device control apparatus provided by an embodiment of the present application. Please refer to FIG. 25 . The device control apparatus 230 includes: at least one processor 2301 and a memory 2302 . The processor 2301 and the memory 2302 are connected through a bus 2303 .

In a specific implementation process, the at least one processor 2301 executes the computer-executed instructions stored in the memory 2302, so that the at least one processor 2301 executes the above device control method.

For the specific implementation process of the processor 2301, reference may be made to the foregoing method embodiments, and the implementation principles and technical effects thereof are similar, and details are not described herein again in this embodiment.

The device control apparatus shown in FIG. 25 is only an example, and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

The present application also provides a device, the device comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program being executed by the processor to achieve the above the steps of the method.

Embodiments of the present application further provide a computer-readable storage medium, where computer-executable instructions are stored in the computer-readable storage medium, and when a processor executes the computer-executable instructions, the method described in any of the foregoing method embodiments is implemented. Device control method.

The embodiments of the present application also provide a computer program product, the computer program product includes computer program code, when the computer program code is run on a computer, the computer is made to execute the method described in the various possible implementation manners above.

An embodiment of the present application further provides a chip, including a memory and a processor, where the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a chip installed with the chip is The apparatus performs the method as described in the various possible embodiments above.

It should be noted that, in this article, step codes such as S201 and S202 are used, the purpose of which is to express the corresponding content more clearly and briefly, and does not constitute a substantial restriction on the sequence. Those skilled in the art may S202 will be executed first and then S201, etc., but these should all fall within the protection scope of this application.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element defined by the phrase "comprises a..." does not preclude the presence of additional identical elements in the process, method, article, or device that includes the element, and further, different implementations of the present application Components, features and elements with the same names in the examples may have the same meaning or may have different meanings, and their specific meanings need to be determined by their explanations in this specific embodiment or further combined with the context in this specific embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited by these terms. These terms are only used to distinguish the same type of information from each other. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of this document. The word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determining", depending on the context. Also, as used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context dictates otherwise. It should be further understood that the terms "comprising", "comprising" indicate the presence of stated features, steps, operations, elements, components, items, kinds, and/or groups, but do not exclude one or more other features, steps, operations, The existence, appearance or addition of elements, assemblies, items, categories, and/or groups. The terms "or" and "and/or" as used herein are to be construed to be inclusive or to mean any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: A; B; C; A and B; A and C; B and C; A, B and C" . Exceptions to this definition arise only when combinations of elements, functions, steps, or operations are inherently mutually exclusive in some way.

It should be understood that, although the steps in the flowcharts in the embodiments of the present application are displayed in sequence according to the arrows, these steps are not necessarily executed in the sequence indicated by the arrows. Unless explicitly stated herein, the execution of these steps is not strictly limited to the order and may be performed in other orders. Moreover, at least a part of the steps in the figure may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution order is not necessarily sequential. Instead, it may be performed in turn or alternately with other steps or at least a portion of sub-steps or stages of other steps.

Those of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by program instructions related to hardware. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps including the above method embodiments are executed; and the foregoing storage medium includes: ROM, RAM, magnetic disk or optical disk and other media that can store program codes.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present application, but not to limit them; It should be understood that: it is still possible to modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements to some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the embodiments of the present application scope of the programme.

Claims

A device control method, characterized in that the method comprises:

Determine the element to be added and the user interface; the element to be added is a combined element; the user interface is an interface for placing the element to be added;

If the free space in the user interface is not enough to place the element to be added, split the combined element into at least two elements, so that the at least two elements can be placed in the free space of the user interface respectively .
The method according to claim 1, wherein the free space in the user interface is insufficient to place the element to be added, comprising at least one of the following:

The position distribution between the cells occupied by the element to be added is different from the position distribution between the idle cells in the user interface;

The shape of the element to be added is different from the shape of the free space in the user interface;

The area occupied by the element to be added is larger than the area of the free space in the user interface;

The number of cells occupied by the element to be added is greater than the number of free cells in the user interface.
The method according to claim 1, wherein after splitting the combined element into at least two elements, the method further comprises:

The at least two elements are sequentially placed in the free space of the user interface according to the priority information of the split elements.
The method according to claim 3, wherein the priority information of the split elements includes at least one of the following:

the sequence of splitting the combined elements;

Or the order of user frequency from low to high, or from high to low.
The method according to claim 1, wherein before the splitting the combined element into at least two elements, the method further comprises at least one of the following:

The attribute information of the element to be added and/or the layout information of the element in the user interface is adjusted.
The method according to claim 1, wherein after the splitting the combined element into at least two elements, the method further comprises at least one of the following:

The attribute information of the element and/or the layout information of the element in the user interface are adjusted.
The method according to claim 5 or 6, characterized in that,

The attribute information includes at least one of the following information: the area occupied by the element to be added, the number of cells occupied by the element to be added, the position distribution among the cells occupied by the element to be added, and the number of cells occupied by the element to be added. the shape of the element to be added, the combination of the element to be added, and the priority information of the element to be added; and/or,

The layout information includes at least one of the following information: the area of free space in the user interface, the number of free cells in the user interface, the location distribution between free cells in the user interface, the user interface The shape of the free space in the interface, the spacing between the existing elements in the user interface, and the priority information of the existing elements in the user interface.
The method of claim 7, wherein:

The adjustment method of the attribute information includes at least one of the following: reducing or cropping the occupied area, reducing the number of occupied cells, adjusting the position distribution between the occupied cells or the shape of the element to be added, adjusting the The combination or priority information of adding elements; and/or,

The adjustment method of the layout information includes at least one of the following: enlarging or expanding the area of the free space, increasing the number of free cells, adjusting the position distribution between the free cells or the shape of the free space, adjusting the spacing between existing elements or priority information.
The method according to claim 7, wherein the manner of splitting the combined element into at least two elements comprises at least one of the following:

Split according to the preset splitting method of combined elements;

Splitting is performed according to the attribute information and/or the layout information.
A device control method, characterized in that the method comprises:

Determine the element to be added and a user interface; the user interface is an interface for placing the element to be added;

If the free space in the user interface is not enough to place the element to be added, move at least one existing element of the user interface to another user interface, and move the element to be added according to the priority information of the element to be added. add elements to be placed in the space of the user interface;

Moving at least one existing element of the user interface to another user interface includes at least one of the following:

moving at least one existing element of the user interface to other user interfaces in a first order; the first order is from back to front, or from front to back;

Or move at least one existing element of the user interface to other user interfaces in a second order; the second order is an order in which the user's frequency of use is from low to high;

Or move at least one existing element of the user interface to another user interface, so as to obtain N free cell spaces in the user interface; the N is the number of cells occupied by the element to be added; wherein N is a positive integer.
The method according to claim 10, wherein placing the element to be added into the space of the user interface comprises:

determining the state of a cell of the user interface;

The element to be added is placed in the space of the user interface according to the state of the cell, wherein the state of the cell includes an idle state or an occupied state; the idle state is the state of the element to be placed; the The occupied state is the placed element state.
The method according to claim 11, wherein the placing the element to be added in the space of the user interface according to the state of the cell comprises:

If the state of the cell is an idle state, placing the element to be added into a cell in the idle state of the user interface;

determining the element to be moved in the user interface;

The attribute information of the element to be moved and/or the layout information of the element in the user interface is adjusted, and the element to be moved is moved to the free space of the user interface.
The method according to any one of claims 10 to 12, wherein the free space in the user interface is insufficient to place the element to be added, comprising at least one of the following:

The area occupied by the element to be added is larger than the area of the free space in the user interface;

The number of cells occupied by the element to be added is greater than the number of free cells in the user interface;

The position distribution between the cells occupied by the element to be added is different from the position distribution between the idle cells in the user interface;

The shape of the element to be added is different from the shape of the free space in the user interface.
The method according to claim 10, wherein before the moving at least one existing element of the user interface to another user interface, the method further comprises at least one of the following:

The attribute information of the element to be added and/or the layout information of the element in the user interface is adjusted.
The method according to claim 10, wherein after the moving at least one existing element of the user interface to another user interface, the method further comprises at least one of the following:

The attribute information of the existing element and/or the layout information of the element in the user interface are adjusted.
The method according to claim 14 or 15, wherein,

The attribute information includes at least one of the following information: the area occupied by the element to be added, the number of cells occupied by the element to be added, the location distribution among the cells occupied by the element to be added, and the number of cells occupied by the element to be added. the shape of the element to be added, the combination of the element to be added, and the priority information of the element to be added; and/or,

The layout information includes at least one of the following information: the area of free space in the user interface, the number of free cells in the user interface, the location distribution between free cells in the user interface, the user interface The shape of the free space in the interface, the spacing between the existing elements in the user interface, and the priority information of the existing elements in the user interface.
The method of claim 16, wherein:

The adjustment method of the attribute information includes at least one of the following: reducing or cropping the occupied area, reducing the number of occupied cells, adjusting the position distribution between the occupied cells or the shape of the element to be added, adjusting the The combination or priority information of adding elements; and/or,

The adjustment method of the layout information includes at least one of the following: enlarging or expanding the area of the free space, increasing the number of free cells, adjusting the position distribution between the free cells or the shape of the free space, adjusting the spacing between existing elements or priority information.
The method according to claim 16, wherein the manner of moving at least one existing element of the user interface to another user interface comprises at least one of the following:

Move according to the preset movement mode;

The movement is performed according to the attribute information and/or the layout information.
A device control device, characterized in that it includes: at least one processor and a memory;

the memory is used to store computer-executable instructions;

The at least one processor is configured to execute computer-executable instructions stored in the memory, so that the at least one processor executes the device control method of any one of claims 1 to 18.
A computer-readable storage medium, wherein computer-executable instructions are stored in the computer-readable storage medium, and when a processor executes the computer-executable instructions, any one of claims 1 to 18 is implemented. device control method.