CN116540908A

CN116540908A - Application layout control method and related device

Info

Publication number: CN116540908A
Application number: CN202211466580.4A
Authority: CN
Inventors: 朱登奎; 施元昌; 袁修明
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-09-11
Filing date: 2020-09-11
Publication date: 2023-08-04
Also published as: CN114173005A; CN114173005B; CN115857852A

Abstract

The application aims to provide an application layout control method and a related device, and the width value of a screen of terminal equipment is sent to an application under the condition that an application interface of the application is required to be displayed; receiving an application interface returned by the application, wherein the width value of the application interface is equal to the width value of the screen; and reducing the width value of the application interface to the width value of the actual window. The application interface can be displayed completely and without interception when the application is displayed on terminal equipment with different screens and different window sizes, and the user experience is improved.

Description

Application layout control method and related device

Technical Field

The present disclosure relates to the field of terminal technologies, and in particular, to an application layout control method and a related device.

Background

An application (App) is an application program, and mainly refers to an application program installed on a terminal device, so that the terminal device can perfect the function of the terminal device, and richer use experience is provided for a user. With the rapid development of the information age, the number of applications has been shown to increase in a burst, and more applications have been launched into the market, accompanied by a number of problems with the display of applications on terminals. For example, when an application is displayed on a terminal device, problems such as picture cutting and font cutting occur, the interface layout of the application is not compatible with the terminal device, and the user experience is poor.

Therefore, how to adapt the layout of the application to the terminal devices with different screens and different window sizes becomes an important research topic in the technical field.

Disclosure of Invention

The application aims to provide an application layout control method, an application layout control device and application layout control equipment, wherein a width value of a screen of terminal equipment is sent to an application under the condition that an application interface of the application is required to be displayed; receiving an application interface returned by the application, wherein the width value of the application interface is equal to the width value of the screen; and reducing the width value of the application interface to the width value of the actual window. The application interface can be displayed completely and without interception when the application is displayed on terminal equipment with different screens and different window sizes.

In a first aspect, the present application provides a method for controlling an application layout, where the method is used in a terminal device, where the terminal device provides an application layout control processing function for an application, where the application includes a system application provided by a first manufacturer and a third party application provided by a non-first manufacturer, and the first manufacturer is a manufacturer of the terminal device, and the method includes: under the condition that an application interface of an application needs to be displayed, sending the screen width value of the terminal equipment to the application; receiving an application interface returned by the application, wherein the width value of the application interface is equal to the width value of the screen; and reducing the width value of the application interface to an actual window width value.

When the method provided in the first aspect is implemented, the terminal device invokes the application layout control function when the application needs to display the application interface of the application, so that the width value of the application interface after application layout control processing is equal to the width value of the screen, and then the width value of the application interface is reduced to the width value of the actual window, and the resource information of the application interface can be displayed to the actual window completely and without interception.

The application layout control function refers to a function which is independently developed by a manufacturer of the terminal device and is not possessed by terminal devices produced by other manufacturers. That is, the layout adaptation function is a point of distinction between terminal devices produced by different manufacturers. The layout control function may be developed by the manufacturer based on hardware and/or software unique to the terminal device.

With reference to the first aspect, in some embodiments, in a case where an application interface of an application needs to be displayed, a screen width value of the terminal device is sent to the application. The display request operation of the application interface of the application comprises the following steps: the application is started and triggered, and the switching display among a plurality of user interfaces contained in the application is triggered. Exemplary, clicking on the system interface and the application shortcut icon of the multitasking bar starts the starting triggering operation of the application; alternatively, the switching display between the user interfaces A, B, C provided by the application triggers the operation.

With reference to the first aspect, in some embodiments, in a case where an application interface of an application needs to be displayed, sending, to the application, a width value of a screen of the terminal device includes: and sending interface resource configuration information to the application, wherein the interface resource configuration information comprises the width value of the screen of the terminal equipment.

With reference to the first aspect, in some embodiments, in a case where an application interface of an application needs to be displayed, sending a width value of a screen of a terminal device to the application, where the screen of the terminal device is a folding screen; the folding screen comprises a front display area and a back display area; under the condition that the folding screen is in a folding state, the width value of the screen is the width value of the screen corresponding to the application interface; the width value of the screen is the width value of the screen unfolded by the folding screen when the folding screen is in an unfolded state.

With reference to the first aspect, in some embodiments, before receiving the application interface returned by the application, the method further includes: and sending length information to the application, wherein the length information contains a length value which is the length value of the screen.

In combination with the first aspect, in some embodiments, before narrowing the width value of the application interface to the width value of the actual window, the method further includes:

And under the condition that the ratio of the width value to the length value of the actual window is larger than the ratio of the width value to the length value of the screen, intercepting the application interface to obtain a target application interface, wherein the length value of the target application interface is the quotient of the product of the length value of the actual window and the width value of the screen and the width value of the actual window.

The length value of the actual window is set as L _{Real world} The width of the actual window is W _{Real world} The width value of the screen is W _{Screen panel} The length value of the target application interface is L _x The length value L of the target application interface _x The solution formula of (2) is:

with reference to the first aspect, in some embodiments, after receiving the application interface returned by the application, the method further includes:

reducing the length value of the application interface to be the quotient of the product of the length value of the screen and the width value of the actual window and the width value of the screen;

and under the condition that the length value of the application interface is larger than the length value of the actual window, intercepting the application interface to obtain a target application interface, wherein the length value of the target application interface is equal to the length value of the actual window.

Here, the length value of the application interface is reduced to L _x The width value of the screen is W _{Screen panel} The length value of the screen is L _{Screen panel} The width of the actual window is W _{Real world} The L is _x The solution formula of (2) is:

with reference to the first aspect, in some embodiments, before displaying the application interface to the screen of the terminal device, the method further includes:

and under the condition that the ratio of the width value to the length value of the actual window is larger than the ratio of the width value to the length value of the screen, the length value of the application interface is smaller than the length value of the actual window, and the actual window is set to be transparent. The transparency coefficient of the actual window is set to be 0, the transparency coefficient range is 0-1.0,0 is completely transparent, and 1 is completely opaque.

In combination with the first aspect, in some embodiments, before receiving the application interface returned by the application, the terminal device currently displays and runs at least one application, and the actual window width value is smaller than the screen width value. The application currently displayed and operated by the terminal device includes QQ, payment treasures, and the like, and the terminal device receives a display request operation of an application interface of WeChat, and after the layout control processing, the WeChat is displayed to an actual window in a state of a floating window, where a width value of the actual window is smaller than that of the screen.

With reference to the first aspect, in some embodiments, in a case where an application interface of an application needs to be displayed, a screen width value of the terminal device is sent to the application. The display request operation of the application interface of the application comprises the following steps:

1. and responding to an operation instruction of clicking a desktop application shortcut icon of the terminal equipment by a user, and initiating an application interface display request instruction of the application.

2. And responding to an operation instruction of clicking the shortcut icon of the multi-taskbar application by a user, and initiating an application interface display request instruction of the application.

3. And responding to triggering operation among a plurality of user interfaces provided by the user switching application, and initiating an application interface display request instruction of the application.

Additionally, in some embodiments, the multitasking bar may be hidden according to user needs. Specifically, in response to a gesture on the multi-taskbar, the terminal device displays interactive factors for hiding the multi-taskbar control in a display area thereof; the gesture includes a long press gesture, a swipe gesture, a double tap gesture, or a heavy press gesture.

With reference to the first aspect, in some embodiments, the application comprises a system application or a third party application. The system application is an application provided by a first manufacturer, and the third party application is an application provided by a non-first manufacturer. The first manufacturer is a manufacturer of the terminal device.

With reference to the first aspect, in some embodiments, an application process of the application includes resource configuration information of at least one application interface.

With reference to the first aspect, in some embodiments, before displaying the application interface to the terminal screen, the method further includes: animation scaling, layer scaling, position adjustment, including scaling and/or panning of display size, position.

With reference to the first aspect, in some embodiments, when the application interface is displayed on the terminal screen, the method further includes: and switching the focus, wherein the focus is switched to switch the application focus from the non-target application to the application.

In a second aspect, the present application provides an apparatus comprising:

a transmitting unit, configured to transmit a width value of a screen of the terminal device to an application in a case where an application interface of the application needs to be displayed;

the receiving unit is used for receiving the application interface returned by the application;

and the control unit is used for reducing the width value of the application interface to the width value of the actual window.

The apparatus provided in the second aspect, the sending unit is configured to send, to an application, a screen width value of the terminal device in a case where an application interface of the application needs to be displayed; the display triggering operation of the application interface of the application to be displayed comprises the following steps: the application is started and triggered, and the switching display among a plurality of user interfaces contained in the application is triggered.

With reference to the second aspect, in some embodiments, sending the width value of the screen of the terminal device to the application includes:

and sending interface resource configuration information to the application, wherein the interface resource configuration information comprises the width value of the screen.

With reference to the second aspect, in some embodiments, the screen of the terminal device is a folding screen;

under the condition that the folding screen is in a folding state, the width value of the screen is the width value of the screen corresponding to the application interface;

the width value of the screen is the width value of the screen unfolded by the folding screen when the folding screen is in an unfolded state.

With reference to the second aspect, in some embodiments, before receiving the application interface returned by the application, the sending unit is further configured to:

and sending length information to the application, wherein the length information contains a length value which is the length value of the screen.

With reference to the second aspect, in some embodiments, before narrowing the width value of the application interface to the width value of the actual window, the apparatus further includes:

and the intercepting unit is used for intercepting the application interface to obtain a target application interface under the condition that the ratio of the width value to the length value of the actual window is larger than the ratio of the width value to the length value of the screen, and the length value of the target application interface is the quotient of the product of the length value of the actual window and the width value of the screen and the width value of the actual window.

Here, let the length value of the actual window be L _{Real world} The width of the actual window is W _{Real world} The width value of the screen is W _{Screen panel} The length value of the target application interface is L _x The length value L of the target application interface _x The solution formula of (2) is:

with reference to the second aspect, in some embodiments, after receiving the application interface returned by the application,

the control unit is further used for:

the apparatus further comprises:

the intercepting unit is used for intercepting the application interface to obtain a target application interface under the condition that the length value of the application interface is larger than that of the actual window, and the length value of the target application interface is equal to that of the actual window.

with reference to the second aspect, in some embodiments, before displaying the application interface to the screen of the terminal device, the apparatus further includes:

And the setting unit is used for setting the actual window to be transparent under the condition that the length value of the application interface is smaller than the length value of the actual window.

In a third aspect, the present application provides a terminal device, including: a memory, a processor, wherein the memory stores program instructions; the program instructions, when executed by the processor, cause the processor to perform the method as described in the first aspect and any possible implementation of the first aspect.

In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored therein; the computer program, when run on one or more processors, causes the terminal device to perform the method as described in the first aspect and any possible implementation of the first aspect.

In a fifth aspect, the present application provides a computer program product comprising instructions which, when run on a terminal device, cause the terminal device to perform a method as described in the first aspect and any possible implementation of the first aspect.

By implementing the technical scheme provided by the application, the terminal equipment returns to the application interface after the layout control processing when the application is required to be displayed, and the resource information of the application interface can be displayed on the screen of the terminal equipment completely and without interception.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings that are required to be used in the embodiments will be briefly described below.

Fig. 1 is a schematic structural diagram of a terminal device provided in an embodiment of the present application;

fig. 2A is a schematic diagram of a main interface of a terminal device according to an embodiment of the present application;

FIG. 2B is a flow diagram of a method for applying layout control as disclosed in an embodiment of the present application;

3A-3B are interface diagrams of embodiments of the present application in a scenario in which a system interface launches an application;

FIGS. 4A-4B are diagrams illustrating an application interface in a bottom multi-tasking navigation bar launch application scenario in accordance with embodiments of the present application;

FIGS. 5A-5C are diagrams illustrating an application interface in a multi-taskbar launch application scenario according to embodiments of the present application;

FIGS. 6A-6B are application interface diagrams illustrating the launching of an application scenario in a message notification bar according to embodiments of the present application;

fig. 7A-7B are application interface diagrams of a scenario of a switching display operation between multiple application interfaces provided by an application according to an embodiment of the present application;

FIG. 8 is a schematic diagram of the system architecture diagram of an embodiment of the present application, showing the connections between the layers;

FIG. 9 is a schematic diagram of a layout control device disclosed in an embodiment of the present application;

FIG. 10 is a further flow diagram of a method for applying layout control as disclosed in an embodiment of the present application;

FIG. 11 is yet another flow diagram of a method for applying layout control disclosed in an embodiment of the present application;

FIG. 12 is yet another flow diagram of a method for applying layout control disclosed in an embodiment of the present application;

13A-13E are schematic diagrams of formula calculations in accordance with embodiments of the present application;

fig. 14 is a flow chart of display request processing of an application disclosed in an embodiment of the present application.

Detailed Description

The invention is described in further detail below with reference to the accompanying drawings.

The terminology used in the following embodiments of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include the plural forms as well, unless the context clearly indicates to the contrary. It should also be understood that the term "and/or" as used in this application refers to and encompasses any or all possible combinations of one or more of the listed items.

The following embodiments of the present invention provide a method and related apparatus for controlling an application layout, where when an application is started, a terminal system invokes a function of controlling an application layout, so that an interface width after application layout adaptation is the same as a display window width, and application interface resource information can be completely displayed on an actual display window, so as to optimize layout compatibility of the application under the condition of different window sizes.

The scheme of the invention is realized by the mobile terminal, and more particularly, the scheme can be realized by a specific device arranged in the mobile terminal. The specific device may be a function module of a stand-alone application or other applications, installed and run in the mobile terminal or an operating system of the mobile terminal, or the specific device may be a hardware circuit, installed in the mobile terminal. The specific device is used for performing application layout control processing when the application needs to display an application interface, and is referred to herein as application layout control processing device for convenience of description. However, those skilled in the art will appreciate that the device name is merely for convenience of description and should not be construed as limiting the invention in any way.

Herein, the mobile terminal includes, but is not limited to, any portable terminal product capable of interacting with a user, such as a single-sided screen phone, a double-sided folding screen phone, a tablet computer, etc.

The scheme of the present invention is applicable to the case of displaying windows of one or more applications on the current screen of the mobile terminal, and is not limited to the general case, and is exemplified herein by displaying windows of 1, 2 or 3 applications in the screen display area of the mobile terminal, however, it should be understood by those skilled in the art that the case of displaying the number of application windows is merely an example and should not be construed as any limitation of the present invention, and the present invention is equally applicable to the case of displaying more than 3 application windows in the screen display area of the mobile terminal.

The invention has no special requirement on the processing capability of the mobile terminal, for example, the invention can be applied to the mobile terminal with a single-core or multi-core processor and also can be applied to the mobile terminal with single threads or multiple threads. When the mobile terminal does not have the capability of running a plurality of applications at the same time, the invention can simultaneously present windows of the plurality of applications to a user, but only one of the applications is run; when the mobile terminal has the capability of running a plurality of applications simultaneously, the invention can simultaneously present windows of the plurality of applications to a user and simultaneously run corresponding applications in each window.

In the following embodiments of the present application, the application layout control function refers to a function that a manufacturer of a terminal device independently develops and is not possessed by terminal devices produced by other manufacturers. That is, the application layout control function is a point of distinction between terminal devices produced by different manufacturers. The application layout control function is developed by the manufacturer based on the unique hardware and/or software of the terminal device.

It is to be understood that "application layout control" is just one word used in the present embodiment, and the meaning of the representation thereof has been described in the present embodiment, and the name thereof is not to be construed as limiting the present embodiment. In other embodiments of the present application, "application layout control" may also be referred to as other terms such as "application interface adaptation," "application display control," and the like.

In the embodiment of the application, an application interface of an application needs to be displayed, where the application includes a system application and a third party application, and the third party application refers to an application program provided or developed by a manufacturer of a non-terminal device. The manufacturer of the terminal device may include the manufacturer, supplier, provider or operator of the terminal device, etc. The manufacturer may refer to a manufacturer who processes and manufactures the terminal devices from homemade or purchased parts and raw materials. The provider may refer to a manufacturer that provides the complete machine, raw materials or parts of the terminal device. The operator may refer to a vendor responsible for the distribution of the terminal device. In the embodiment of the present application, the manufacturer of the terminal device may also be referred to as a first manufacturer. In some embodiments, a third party application may also refer to an application that is not preloaded on the terminal device. For example, for Hua mobile phones, weChat, facebook, skype, messenger, whatsApp, etc. apps belong to third party applications, while those that are developed autonomously, such as Hua wearable, hua mall, hua mobile services, etc., belong to system applications.

In the embodiment of the present application, as shown in fig. 14, the application is started for the first time, and the flow of the display processing of the application includes: calculating the window size, applying layout processing, adding window animation, and window display processing, wherein the window animation is an animation effect when the application pops up. As shown in fig. 12, the overall application flow includes: the method comprises the steps of starting an application for the first time, switching an application focus from a background to a foreground, changing application resource configuration information, acquiring application global resource configuration information, and updating the application global resource configuration information under the condition that the resource configuration information of a window is identical to the application global resource configuration information.

In the embodiment of the present application, in the case that an application interface of an application needs to be displayed, the application layout control processing function is invoked, and as shown in fig. 8, the main core flow of the method includes: an application layer, a system service layer, a display management layer, the application layer comprising one or more application programs; the system service layer comprises an application management service and a window management service, wherein the application management service comprises functions of starting an application, displaying the application and the like, and the window management service comprises functions of animation scaling, layer scaling, input position adjustment and the like; the display management service includes a display scaling function. There is data interaction between the application management service and the application layer, the application management service and the window management service, the system service and the display management service. The application management service sends a starting application request message to the window management service, the window management service returns window information to the application management service, the application management service sends the window information to an application layer, the application layer returns the interface resource layout information to the application management service after finishing interface layout, the application management service sends information of an application interface to the window management service, and the window management service sends interface information subjected to animation scaling, layer scaling and input position adjustment to the display management service for display scaling processing.

In the following embodiments of the present application, the terminal device has a function of application layout control processing, and when an application needs to display an application interface, the terminal device system will perform layout control adjustment on the application, regardless of whether the "adaptation system scaling" function of the application is on or not on. In case of application discomfort or adaptation, there are two implementations of application layout control:

1. as shown in fig. 10, when an application needs to display an application interface, interface resource configuration information is sent to the application, the interface resource configuration information includes a width value of a screen of the terminal device, length information is sent to the application, the length value included in the length information is the length value of the screen, and the application can receive the width value and the length value of the screen under the condition that the application is adapted or not adapted; the application generates an application interface that is laid out based on the width and length values of the screen.

As shown in fig. 13A, in the case that the ratio of the width value to the length value of the actual window is greater than the ratio of the width value to the length value of the screen, the application interface is intercepted to obtain a target application interface, where the length value of the target application interface is the quotient of the product of the length value of the actual window and the width value of the screen and the width value of the actual window. And receiving a target application interface returned by the application, and reducing the target application interface to an actual window size.

and under the condition that the ratio of the width value to the length value of the actual window is not larger than the ratio of the width value to the length value of the screen, after receiving the application interface returned by the application, reducing the width value of the application interface to the width value of the actual window, and simultaneously reducing the length value of the application interface in equal proportion. Before displaying the application interface to the screen of the terminal device, the method further comprises:

and setting the actual window to be transparent under the condition that the length value of the application interface is smaller than the length value of the actual window. Specifically, the transparency coefficient of the actual window is set to 0, the transparency coefficient takes a value range of 0-1.0,0 is completely transparent, and 1.0 is completely opaque.

2. As shown in fig. 11, when an application needs to display an application interface, interface resource configuration information is sent to the application, the interface resource configuration information includes a width value of a screen of the terminal device, length information is sent to the application, the length value included in the length information is the length value of the screen, and the application can receive the width value and the length value of the screen under the condition that the application is adapted or not adapted; the application generates an application interface that is laid out based on the width and length values of the screen.

After receiving the application interface returned by the application, reducing the length value of the application interface to be the quotient of the product of the length value of the screen and the width value of the actual window and the width value of the screen;

As shown in fig. 13B, the length value of the application interface is reduced to L _x The width value of the screen is W _{Screen panel} The length value of the screen is L _{Screen panel} The width of the actual window is W _{Real world} The L is _x The solution formula of (2) is:

and setting the actual window to be transparent under the condition that the length value of the application interface is smaller than the length value of the actual window. Specifically, the transparency coefficient of the actual window is set to 0, the transparency coefficient takes a value range of 0-1.0, the actual window is completely transparent when the transparency coefficient is 0, and the actual window is completely opaque when the transparency coefficient is 1.0.

The embodiment of the application may divide the functional units of the electronic device according to the above method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated in one processing unit. The integrated units may be implemented in hardware or in software functional units. It should be noted that, in the embodiment of the present application, the division of the units is schematic, which is merely a logic function division, and other division manners may be implemented in actual practice.

Referring to fig. 9, fig. 9 is a schematic structural diagram of an application layout control device disclosed in an embodiment of the present application, and as shown in fig. 9, the application layout control device 900 includes a sending unit 901, a receiving unit 902, a control unit 903, an intercepting unit 904, and a setting unit 905, where:

the sending unit 901 is configured to send, to an application, a width value of a screen of the terminal device in a case where an application interface of the application needs to be displayed.

The receiving unit 902 is configured to receive the application interface returned by the application, where a width value of the application interface is equal to a width value of the screen.

The control unit 903 is configured to reduce the width value of the application interface to the width value of the actual window.

The intercepting unit 904 is configured to intercept the application interface to obtain a target application interface when a ratio of the width value to the length value of the actual window is greater than a ratio of the width value to the length value of the screen before the width value of the application interface is reduced to the width value of the actual window, where the length value of the target application interface is a quotient of a product of the length value of the actual window and the width value of the screen and the width value of the actual window.

Or, the control unit 903 is further configured to reduce, after receiving the application interface returned by the application, a length value of the application interface to a quotient of a product of the length value of the screen and the width value of the actual window and the width value of the screen; the intercepting unit 904 is configured to intercept the application interface to obtain a target application interface when the length value of the application interface is greater than the length value of the actual window, where the length value of the target application interface is equal to the length value of the actual window.

The setting unit 905 is configured to set the real window to be transparent in a case where a length value of the application interface is smaller than a length value of the real window before the application interface is displayed on the screen of the terminal device.

It is to be understood that "application layout control" is just one word used in the present embodiment, and the meaning of the representation thereof has been described in the present embodiment, and the name thereof is not to be construed as limiting the present embodiment.

An exemplary terminal device 100 provided in the following embodiments of the present application is first described below.

Fig. 1 shows a schematic structure of a terminal device 100.

The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (un iversa l ser ia l bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (subscr iber ident ificat ion modu le, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, terminal device 100 may include more or less components than illustrated, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (app l icat ion processor, AP), a modem processor, a graphics processor (graph ics process ing un it, GPU), an image signal processor (image s igna l processor, ISP), a controller, a video codec, a digital signal processor (d igita l s igna l processor, DSP), a baseband processor, and/or a neural network processor (neuro l-network process ing un it, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated ci rcu it, I2C) interface, an integrated circuit built-in audio (inter-integrated ci rcu it sound, I2S) interface, a pulse code modulation (pu l se code modu l at ion, PCM) interface, a universal asynchronous receiver transmitter (un iversa l asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobi le industry processor interface, MI PI), a general purpose input/output (GPIO) interface, a subscriber identity module (subscr iber ident ity modu le, SIM) interface, and/or a universal serial bus (un iversa l ser ia l bus, USB) interface, among others.

The I2C interface is a bi-directional synchronous serial bus comprising a serial data line (ser ia l data l ine, SDA) and a serial clock line (derai l C lock l ine, SCL). In some embodiments, the processor 110 may contain multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc., respectively, through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through an I2C bus interface to implement a touch function of the terminal device 100.

The I2S interface may be used for audio communication. In some embodiments, the processor 110 may contain multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 via an I2S bus to enable communication between the processor 110 and the audio module 170. The audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface, so as to implement a function of answering a call through the bluetooth headset.

PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface to implement a function of answering a call through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through a UART interface, to implement a function of playing music through a bluetooth headset.

The MI PI interface may be used to connect the processor 110 with peripheral devices such as a display 194, a camera 193, and the like. The MI PI interface includes camera serial interface (camera ser ia l interface, CSI), display screen serial interface (d i sp l ay ser ia linterface, DSI), etc. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the photographing function of terminal device 100. The processor 110 and the display 194 communicate via a DSI interface to implement the display function of the terminal device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, an MI PI interface, etc.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the terminal device 100, or may be used to transfer data between the terminal device 100 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other terminal devices, such as AR devices, etc.

It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only illustrative, and does not constitute a structural limitation of the terminal device 100. In other embodiments of the present application, the terminal device 100 may also use different interfacing manners, or a combination of multiple interfacing manners in the foregoing embodiments.

The charge management module 140 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charge management module 140 may receive a charging input of a wired charger through the USB interface 130. In some wireless charging embodiments, the charge management module 140 may receive wireless charging input through a wireless charging coil of the terminal device 100. The charging management module 140 may also supply power to the terminal device through the power management module 141 while charging the battery 142.

The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 to power the processor 110, the internal memory 121, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance) and other parameters. In other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charge management module 140 may be disposed in the same device.

The wireless communication function of the terminal device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the terminal device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied to the terminal device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noi se amp l ifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional module, independent of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (Wi re less loca larea networks, WLAN) (e.g., wireless fidelity (Wi re less fide l ity, wi-Fi) network), bluetooth (BT), global navigation satellite system (globa l navigat ion sate l l ite system, GNSS), frequency modulation (frequency modu l at ion, FM), near field wireless communication technology (near fie ld commun icat ion, NFC), infrared technology (I R), etc. applied to the terminal device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 150 of terminal device 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that terminal device 100 may communicate with a network and other devices via wireless communication techniques. The wireless communication techniques may include global system for mobile communications (globa l system for mobi le communicat ions, GSM), general packet radio service (genera l packet rad io service, GPRS), code division multiple access (code d ivi s ion mu lt ip le access, CDMA), wideband code division multiple access (wideband code d ivi s ion mu lt ip le access, WCDMA), time division code division multiple access (t ime-d ivi s ion code d ivi s ion mu lt ip le access, TD-SCDMA), long term evolution (long term evo l ut ion, LTE), BT, GNSS, WLAN, NFC, FM, and/or I R techniques, among others. The GNSS may include a global satellite positioning system (globa l pos it ion ing system, GPS), a global navigation satellite system (globa l navigat ion sate l l ite system, GLONASS), a beidou satellite navigation system (beidou navigat ion sate l l ite system, BDS), a quasi zenith satellite system (quas i-zen ith sate l l ite system, QZSS) and/or a satellite based augmentation system (sate l l ite based augmentat ion systems, SBAS).

The terminal device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (l iqu id crysta l d i sp l ay, LCD), an Organic Light Emitting Diode (OLED), an active-matrix organic light emitting diode (AMOLED) or an active-matrix organic light emitting diode (matr ix organ ic l ight emitt ing d iode), a Flexible Light Emitting Diode (FLED), a mini led, a Micro-OLED, a quantum dot light emitting diode (quantum dot l ight emitt ing d iodes, QLED), or the like. In some embodiments, the terminal device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

In the embodiment of the application, the display screen 194 may be used to display a user interface, and various controls in the user interface may be used to monitor the touch operations of the user at different sources of the terminal device and different locations of the terminal device. In response to this operation, the display screen 194 may also be used to display the result of the response of the terminal device to the touch operation.

The terminal device 100 may implement a photographing function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coup led device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the terminal device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the terminal device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The terminal device 100 may support one or more video codecs. In this way, the terminal device 100 can play or record video in various encoding formats, for example: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a Neural Network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the terminal device 100 may be implemented by the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to realize expansion of the memory capability of the terminal device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The internal memory 121 may be used to store computer executable program code including instructions. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data (such as audio data, phonebook, etc.) created during use of the terminal device 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (un iversa l f l ash storage, UFS), and the like. The processor 110 performs various functional applications of the terminal device 100 and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The terminal device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The terminal device 100 can listen to music or to handsfree talk through the speaker 170A.

A receiver 170B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When the terminal device 100 receives a call or voice message, it is possible to receive voice by approaching the receiver 170B to the human ear.

Microphone 170C, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 170C through the mouth, inputting a sound signal to the microphone 170C. The terminal device 100 may be provided with at least one microphone 170C. In other embodiments, the terminal device 100 may be provided with two microphones 170C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the terminal device 100 may be further provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, implement directional recording functions, etc.

The earphone interface 170D is used to connect a wired earphone. The earphone interface 170D may be a USB interface 130 or a 3.5mm open mobile terminal platform (open mobi le termina l p l atform, OMTP) standard interface, a american cellular telecommunications industry association (ce l l u l ar te lecommun icat ions industry associat ion of the USA, CTIA) standard interface.

The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. The capacitance between the electrodes changes when a force is applied to the pressure sensor 180A. The terminal device 100 determines the intensity of the pressure according to the change of the capacitance. When a touch operation is applied to the display 194, the terminal device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The terminal device 100 may also calculate the position of the touch from the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example: and executing an instruction for checking the short message when the touch operation with the touch operation intensity smaller than the first pressure threshold acts on the short message application icon. And executing an instruction for newly creating the short message when the touch operation with the touch operation intensity being greater than or equal to the first pressure threshold acts on the short message application icon.

The gyro sensor 180B may be used to determine a motion gesture of the terminal device 100. In some embodiments, the angular velocity of the terminal device 100 about three axes (i.e., x, y, and z axes) may be determined by the gyro sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. Illustratively, when the shutter is pressed, the gyro sensor 180B detects the angle of the shake of the terminal device 100, calculates the distance to be compensated by the lens module according to the angle, and allows the lens to counteract the shake of the terminal device 100 by the reverse motion, thereby realizing anti-shake. The gyro sensor 180B may also be used for navigating, somatosensory game scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the terminal device 100 calculates altitude from barometric pressure values measured by the barometric pressure sensor 180C, aiding in positioning and navigation.

The magnetic sensor 180D includes a hall sensor. The terminal device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. In some embodiments, when the terminal device 100 is a folder, the terminal device 100 may detect opening and closing of the folder according to the magnetic sensor 180D. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.

The acceleration sensor 180E can detect the magnitude of acceleration of the terminal device 100 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the terminal device 100 is stationary. The method can also be used for identifying the gesture of the terminal equipment, and is applied to the applications such as horizontal and vertical screen switching, pedometers and the like.

A distance sensor 180F for measuring a distance. The terminal device 100 may measure the distance by infrared or laser. In some embodiments, the terminal device 100 may range using the distance sensor 180F to achieve fast focusing.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The terminal device 100 emits infrared light outward through the light emitting diode. The terminal device 100 detects infrared reflected light from a nearby object using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object in the vicinity of the terminal device 100. When insufficient reflected light is detected, the terminal device 100 may determine that there is no object in the vicinity of the terminal device 100. The terminal device 100 can detect that the user holds the terminal device 100 close to the ear to talk by using the proximity light sensor 180G, so as to automatically extinguish the screen for the purpose of saving power. The proximity light sensor 180G may also be used in holster mode, pocket mode to automatically unlock and lock the screen.

The ambient light sensor 180L is used to sense ambient light level. The terminal device 100 may adaptively adjust the brightness of the display 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust white balance when taking a photograph. The ambient light sensor 180L may also cooperate with the proximity light sensor 180G to detect whether the terminal device 100 is in a pocket to prevent false touches.

The fingerprint sensor 180H is used to collect a fingerprint. The terminal device 100 can utilize the collected fingerprint characteristics to realize fingerprint unlocking, access an application lock, fingerprint photographing, fingerprint incoming call answering and the like.

The temperature sensor 180J is for detecting temperature. In some embodiments, the terminal device 100 performs a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the terminal device 100 performs a reduction in the performance of a processor located near the temperature sensor 180J in order to reduce power consumption to implement thermal protection. In other embodiments, when the temperature is below another threshold, the terminal device 100 heats the battery 142 to avoid the low temperature causing the terminal device 100 to shut down abnormally. In other embodiments, when the temperature is below a further threshold, the terminal device 100 performs boosting of the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperatures.

The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the terminal device 100 at a different location than the display 194.

The bone conduction sensor 180M may acquire a vibration signal. In some embodiments, bone conduction sensor 180M may acquire a vibration signal of a human vocal tract vibrating bone pieces. The bone conduction sensor 180M may also contact the pulse of the human body to receive the blood pressure pulsation signal. In some embodiments, bone conduction sensor 180M may also be provided in a headset, in combination with an osteoinductive headset. The audio module 170 may analyze the voice signal based on the vibration signal of the sound portion vibration bone block obtained by the bone conduction sensor 180M, so as to implement a voice function. The application processor may analyze the heart rate information based on the blood pressure beat signal acquired by the bone conduction sensor 180M, so as to implement a heart rate detection function.

The keys 190 include a power-on key, a volume key, etc. The keys 190 may be mechanical keys. Or may be a touch key. The terminal device 100 may receive key inputs, generating key signal inputs related to user settings and function controls of the terminal device 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration alerting as well as for touch vibration feedback. For example, touch operations acting on different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also correspond to different vibration feedback effects by touching different areas of the display screen 194. Different application scenarios (such as time reminding, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card may be inserted into the SIM card interface 195 or withdrawn from the SIM card interface 195 to achieve contact and separation with the terminal apparatus 100. The terminal device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support Nano SIM cards, micro SIM cards, and the like. The same SIM card interface 195 may be used to insert multiple cards simultaneously. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The terminal device 100 interacts with the network through the SIM card to realize functions such as call and data communication. In some embodiments, the terminal device 100 employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the terminal device 100 and cannot be separated from the terminal device 100.

Some exemplary User Interfaces (UIs) provided by the terminal device 100 are described below. The term "user interface" in the present specification and claims and in the drawings is a media interface for interaction and exchange of information between an application program or operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (graph ic user interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, window, control, etc. displayed in the display of the maximum device, where the control may include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, etc.

Fig. 2A illustrates an exemplary user interface 21 on the terminal device 100 for exposing applications installed by the terminal device 100.

The user interface 21 may include: status bar 201, calendar indicator 202, weather indicator 203, tray 204 with commonly used application icons, multitasking bar 205, and other application icons.

Status bar 201 may include: one or more signal strength indicators 201A of a mobile communication signal (also may be referred to as a cellular signal), one or more signal strength indicators 201C of an operator name (e.g., "chinese mobile") 201B, a wireless high-fidelity (Wi re less fide l ity, wi-Fi) signal, a battery status indicator 201D, a time indicator 201E.

Calendar indicator 202 may be used to indicate a current time, such as a date, day of the week, time-of-day information, etc.

Weather indicator 203 may be used to indicate weather type, such as cloudy, rainy, etc., and may also be used to indicate information such as air temperature.

Multitasking bar 204, when detecting that the user clicks on multitasking bar 204, terminal device 100 may present a shortcut to the application that the user has recently opened. The naming of the taskbar may also be other and is not limited in this application. Not limited to virtual keys, the multitasking bar 204 may also be implemented as physical keys.

Tray 205 with common application icons may show: phone icon 205A, text message icon 205B, browser icon 205C, album icon 205D, camera icon 205E.

Other application icons may be, for example: wechat (Wechat) icon 206, QQ icon 207, set icon 208, payment device icon 209, application 1 icon 210. The user interface 21 may also include a page indicator 211. Other application icons may be distributed across multiple pages and page indicator 211 may be used to indicate which page the user is currently browsing for applications in. The user may slide the area of the other application icons left and right to view the application icons in the other pages.

In some embodiments, the user interface 201 exemplarily shown in fig. 2A may be a Home screen.

In other embodiments, the terminal device 100 may also include an entity's home screen key or swipe gesture. The home screen key or the sliding gesture can be used for receiving a command of a user and returning the currently displayed UI to the home interface, so that the user can conveniently view the home screen at any time. The instruction may specifically be an operation instruction of a user pressing the home screen key once, or an operation instruction of a user pressing the home screen key twice in a short time, or an operation instruction of a user pressing the home screen key for a long time in a predetermined time; the sliding gesture can be a sliding gesture of a user from the bottom of the display area of the mobile phone upwards at any angle. In other embodiments of the present application, the home screen key may also incorporate a fingerprint identifier for subsequent fingerprinting and identification when the home screen key is pressed.

It will be appreciated that fig. 2A illustrates only a user interface on the terminal device 100 by way of example and should not be construed as limiting the embodiments of the present application.

Fig. 2B is a method flowchart 22 of an embodiment of the present invention, showing a workflow of a terminal device application display adaptation device.

Fig. 3A and 3B schematically illustrate interface diagrams 31 and 32 in the scenario where the system interface starts the application according to the embodiment of the present application, and the icon of the user interface 31 is consistent with the icon of the user interface 21, which is not described herein.

Fig. 4A and 4B illustrate interface diagrams 41 and 42 of the embodiment of the present application in a scenario where the bottom multitasking navigation bar starts an application, as shown in the user interface 41 of fig. 4A, which includes a bottom multitasking navigation bar 401 that shows an application currently running in the background.

5A, 5B, and 5C illustrate interface diagrams 51, 52, 53 of embodiments of the present application in a context of a multi-taskbar launching application, as illustrated in FIG. 5A user interface 51 that includes a multi-taskbar 501 that is deployed to view shortcuts to applications that have been recently historically opened by a user.

Fig. 6A and 6B schematically illustrate interface diagrams 61 and 62 in a scenario where the application is started in the message notification bar according to the embodiment of the present application.

Fig. 7A and 7B schematically illustrate interface diagrams 71 and 72 in a scenario where the application is started in the message notification bar according to the embodiment of the present application.

In the following, some embodiments of displaying a complete application interface without truncation after layout control processing when an application needs to be displayed are described in conjunction with five different usage scenarios.

Use scenario one: system interface launch application

3A-3B are shown in an exemplary embodiment, the screen of the terminal device is a folding screen, the folding screen includes a front display area and a back display area, and when the folding screen is in a folded state, the width value of the screen is the width value of the screen corresponding to the application interface; the width value of the screen is the width value of the screen unfolded by the folding screen when the folding screen is in an unfolded state. In this embodiment the folded handset is in an unfolded state. This embodiment is an exemplary presentation of the method described in claims 1-4.

In the following exemplary embodiments shown in fig. 3A to 3B, the user interface 31 indicates whether the terminal device currently displays an interface or is a system interface, that is, a main interface, and the terminal device detects a start trigger operation of the application 1 as shown in fig. 3A, and sends interface resource configuration information to the application 1 in response to the start trigger operation of the application 1, where the interface resource configuration information includes a width value of a screen in an expanded state of the terminal device as shown in a flowchart 22 in fig. 2B; transmitting length information to the application 1, wherein the length information contains a length value which is the length value of the screen; the application 1 lays out an application interface of the application in a configuration window with the width value and the length value equal to the screen; as shown in fig. 13D, the ratio of the width value to the length value of the actual window of this embodiment is equal to the ratio of the width value to the length value of the screen, that is: And receiving the application interface returned by the application, and reducing the application interface in an equal proportion so that the width value of the application interface is equal to the width value of the actual window, and simultaneously reducing the length value of the application interface in an equal proportion.

And displaying the application interface shown in fig. 3B through the layer display process. Whether the application is adaptive or not, the complete application interface without truncation after the application interface is subjected to layout control processing can be displayed.

Before displaying the application interface, the method further comprises application focus switching, and the application focus is switched from other applications to the application 1.

The window interface is that the user interface is displayed in a window form, and action buttons such as maximization, closing, zooming and the like are arranged in the window interface, so that the window can be simply operated. The triggering operation of the window maximizing or zooming function includes, but is not limited to, any triggering function applicable to the invention, wherein a user can trigger the function through a function button, and can also be some default triggering operation preset or a designated operation in a designated area, such as gesture sliding from the lower left corner to the upper right corner. It will be appreciated by those skilled in the art that the above-described window scaling trigger operation and initiation operation for initiating detection of the window scaling trigger operation are merely examples, and should not be construed as limiting the invention in any way, and that other existing or future window scaling trigger operations and initiation operations for detecting the window scaling trigger operation may also be adapted to the present invention.

(II) use scenario two: bottom multitasking navigation bar launch application

In the following embodiments shown in fig. 4A to fig. 4B, the screen of the terminal device is a folding screen, where the folding screen includes a front display area and a back display area, and in the case where the folding screen is in a folded state, the width value of the screen is the width value of the screen corresponding to the application interface; the width value of the screen is the width value of the screen unfolded by the folding screen when the folding screen is in an unfolded state. In this embodiment the folded handset is in an unfolded state. This embodiment is an exemplary presentation of the method described in claim 5.

4A-4B, the user interface 41 represents that the terminal device displays and runs at least one application in full screen, the application can be a system application or a third party application, as shown in the user interface 41 in FIG. 4A, the user interface further comprises a bottom multitasking navigation bar 401, the bottom multitasking navigation bar displays an application running in the background at present, the position of the taskbar can be at the side of the screen or at the bottom of the screen, the default state can be unfolded or hidden, and the position of the bottom multitasking navigation bar and whether the default state of the taskbar is unfolded or hidden should not form a limitation on the embodiment of the present application.

The terminal device detects a start trigger operation of application 1 on the bottom multitasking navigation bar 401 as shown in the user interface 41 of fig. 4A. As shown in the flowchart 22 in fig. 2B, in response to a start trigger operation of the application 1, interface resource configuration information is sent to the application 1, where the interface resource configuration information includes a width value of a screen in an expanded state of the terminal device; transmitting length information to the application 1, wherein the length information contains a length value which is the length value of the screen; the application 1 lays out the application interface of the application in a configuration window equal to the width value and the length value of the screen.

Receiving an application interface returned by the application, as shown in fig. 13A, in the case that the ratio of the width value to the length value of the actual window is greater than the ratio of the width value to the length value of the screen, namely: at the position ofIn the case of (2), as shown in the flowchart of fig. 10, the application interface is intercepted to obtain a target application interface, where the length value of the target application interface is the quotient of the product of the length value of the actual window and the width value of the screen and the width value of the actual window. And receiving the target application interface returned by the application 1, and reducing the width value of the target application interface to the actual window width value.

As shown in FIG. 13A, the length value of the actual window is here set to L _{Real world} The width of the actual window is W _{Real world} The width value of the screen is W _{Screen panel} The length value of the target application interface is L _x The length value L of the target application interface _x The solution formula of (2) is:

or,

after receiving the application interface returned by the application, as shown in fig. 11, reducing the width value of the application interface to the width value of the actual window, as shown in fig. 13B, and reducing the length value of the application interface to the quotient of the product of the length value of the screen and the width value of the actual window and the width value of the screen; and under the condition that the length value of the application interface is larger than the length value of the actual window, intercepting the application interface to obtain a target application interface, wherein the width value and the length value of the target application interface are equal to those of the actual window.

and displaying the application interface shown in fig. 4B through the layer display process. Whether the application is adaptive or not, the complete application interface without truncation after the application interface is subjected to layout control processing can be displayed.

The window interface is that a user interface is displayed in a window form, and action buttons such as a maximization control, a closing control, or zooming are arranged in the window interface, so that the window can be simply operated, and detailed description of specific implementation modes is omitted in other embodiments.

(III) use scenario III: multi-taskbar launch application

In the following embodiments shown in fig. 5A to fig. 5C, the screen of the terminal device is a folding screen, where the folding screen includes a front display area and a rear display area, and in the case where the folding screen is in a folded state, the width value of the screen is the width value of the screen corresponding to the application interface; the width value of the screen is the width value of the screen unfolded by the folding screen when the folding screen is in an unfolded state. In this embodiment the folded handset is in an unfolded state. This embodiment is an exemplary presentation of the method described in claim 6.

5A-5C, the user interface 51 indicates that the terminal device is currently displaying and running at least two applications, which may be system applications or third party applications, and the terminal device detects a triggering operation of the multitasking bar 501 as shown in the user interface 51 of FIG. 5A, and in response to the triggering operation, the terminal system displays the multitasking bar 501 as shown in the user interface 52 of FIG. 5B, where the multitasking bar displays a shortcut of an application that has been recently opened by a user, and the application that has been opened by a history may be an application that has been closed, or an application that has not been closed and is still running in the background, and an application icon that has not been closed and has been closed and is the latest in the application that has been closed is preferentially displayed; if the multitasking bar is not wanted to be displayed, the corresponding gesture is slid and retracted.

The terminal device detects a start trigger operation of application 1 on the multitasking bar 501 as shown in the user interface 52 of fig. 5B. As shown in the flowchart 22 in fig. 2B, in response to a start trigger operation of the application 1, interface resource configuration information is sent to the application 1, where the interface resource configuration information includes a width value of a screen in an expanded state of the terminal device; transmitting length information to the application 1, wherein the length information contains a length value which is the length value of the screen; the application 1 lays out the application interface of the application in a configuration window equal to the width value and the length value of the screen.

Receiving an application interface returned by the application, as shown in fig. 13C, the ratio of the width value to the length value of the actual window in this embodiment is smaller than the ratio of the width value to the length value of the screen, that is:a kind of electronic device. The width value of the application interface is reduced to an actual window width value, and the length value of the application interface is reduced to a quotient of the product of the length value of the screen and the width value of the actual window and the width value of the screen, and the formula is described in other embodiments and is not repeated herein.

As shown in fig. 10 or fig. 11, before displaying the application interface to the screen of the terminal device, the method further includes: the length value of the application interface is smaller than that of the actual window, and the actual window is set to be transparent. Specifically, the transparency coefficient of the actual window is set to 0, the transparency coefficient takes a value range of 0-1.0,0 is completely transparent, and 1.0 is completely opaque.

And displaying the application interface as shown in fig. 5C through the layer display process. Whether the application is adaptive or not, the complete application interface without truncation after the application interface is subjected to layout control processing can be displayed.

(IV) use scenario four: message notification bar launch application

In the following embodiments shown in fig. 6A to 6B, the screen of the terminal device is a folding screen, where the folding screen includes a front display area and a back display area, and in the case that the folding screen is in a folded state, the width value of the screen is the width value of the screen corresponding to the application interface; the width value of the screen is the width value of the screen unfolded by the folding screen when the folding screen is in an unfolded state. In this embodiment, the folding cellular phone is in a folded state. This embodiment is an exemplary presentation of the method described in claim 7.

6A-6B, the user interface 61 indicates that the terminal device displays and runs the current application, the application may be a system application or a third party application, as shown in the user interface 61 in FIG. 6A, an application 1 notification message box 601 appears at the top, the application 1 includes a system application or a third party application, the content of the notification message includes message pushing or other, the user clicks a message notification bar, and can directly enter a message detail interface of the application, read or process the message notification, the user can choose to ignore the message notification, and two processing modes of ignoring the notification can exist, one is that the device detects that the user does not perform any triggering operation for a certain time, and a message notification bar instruction is stored by default; another method of ignoring messages is for the device to receive an operation instruction from a user to slide the notification bar to the left or right, and responsive to the instruction, to stow the message notification bar, and a series of responsive operations of the message notification bar should not constitute limitations on embodiments of the present application.

The terminal equipment detects that a user clicks a message notification bar, receives a starting triggering operation of the application 1, namely an application interface is required to be displayed, and responds to the starting triggering operation of the application 1 to send interface resource configuration information to the application 1, wherein the interface resource configuration information comprises a width value of a screen corresponding to a current interface in a folding state of the terminal equipment, and the flow chart 22 is shown in fig. 2B; transmitting length information to the application 1, wherein the length information contains a length value which is the length value of the screen; the application 1 lays out an application interface of the application in a configuration window with the width value and the length value equal to the screen; as shown in fig. 13E, the ratio of the width value to the length value of the actual window of this embodiment is equal to the ratio of the width value to the length value of the screen, that is:the ratio of the width value to the length value of the actual window is not equal to the ratio of the width value to the length value of the screen, and in other embodiments, details are described herein, which will not be repeated. And receiving the application interface returned by the application, and reducing the application interface in an equal proportion so that the width value of the application interface is equal to the width value of the actual window.

And displaying the application interface as shown in fig. 6B through the layer display process. Whether the application is adaptive or not, the complete application interface without truncation after the application interface is subjected to layout control processing can be displayed.

(fifth) use scenario five: switching display operation among multiple application interfaces provided by application

7A-7B are shown in an exemplary embodiment, the screen of the terminal device is a folding screen, the folding screen includes a front display area and a back display area, and when the folding screen is in a folded state, the width value of the screen is the width value of the screen corresponding to the application interface; the width value of the screen is the width value of the screen unfolded by the folding screen when the folding screen is in an unfolded state. In this embodiment, the folding cellular phone is in a folded state. In this embodiment, the description describes an exemplary description that an application interface display triggering operation of an application includes a switching display operation between a plurality of application interfaces provided by the application.

As shown in fig. 7A, in response to a switching display operation between a plurality of application interfaces provided by the application, interface resource configuration information is sent to the application 1, where the interface resource configuration information includes a width value of a screen corresponding to a current interface in a folded state of the terminal device; transmitting length information to the application 1, wherein the length information contains a length value which is the length value of the screen; the application 1 lays out an application interface of the application in a configuration window with the width value and the length value equal to the screen; as shown in fig. 13E, the ratio of the width value to the length value of the actual window of this embodiment is equal to the ratio of the width value to the length value of the screen, that is: The ratio of the width value to the length value of the actual window is not equal to the ratio of the width value to the length value of the screen, and in other embodiments, details are described herein, which will not be repeated. And receiving the application interface returned by the application, and reducing the application interface in an equal proportion so that the width value of the application interface is equal to the width value of the actual window. And displaying the application interface shown in fig. 7B through the layer display process. The application interface is a complete non-truncated application interface after layout control processing.

As used in the above embodiments, the term "when …" may be interpreted to mean "if …" or "after …" or "in response to determination …" or "in response to detection …" depending on the context. Similarly, the phrase "at the time of determination …" or "if detected (a stated condition or event)" may be interpreted to mean "if determined …" or "in response to determination …" or "at the time of detection (a stated condition or event)" or "in response to detection (a stated condition or event)" depending on the context.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces, in whole or in part, a flow or function consistent with embodiments of the present application. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), etc.

Those of ordinary skill in the art will appreciate that implementing all or part of the above-described method embodiments may be accomplished by a computer program to instruct related hardware, the program may be stored in a computer readable storage medium, and the program may include the above-described method embodiments when executed. And the aforementioned storage medium includes: ROM or random access memory RAM, magnetic or optical disk, etc.

Claims

1. An application layout control method, applied to a terminal device, the method comprising:

sending a width value of a screen of a terminal device to an application under the condition that an application interface of the application needs to be displayed;

receiving the application interface returned by the application, wherein the width value of the application interface is equal to the width value of the screen;

and reducing the width value of the application interface to the width value of the actual window.

2. The method of claim 1, wherein the transmitting the width value of the screen of the terminal device to the application comprises:

3. A method according to claim 1 or 2, wherein the screen of the terminal device is a folding screen;

when the folding screen is in a folding state, the width value of the screen is the width value of the screen corresponding to the application interface;

and when the folding screen is in an unfolding state, the width value of the screen is the width value of the unfolded screen of the folding screen.

4. A method according to any of claims 1-3, wherein prior to said receiving said application interface returned by said application, said method further comprises:

and sending length information to the application, wherein the length value contained in the length information is the length value of the screen.

5. The method of claim 4, wherein prior to said narrowing the width value of the application interface to the width value of the actual window, the method further comprises:

6. The method of claim 4, wherein after receiving the application interface returned by the application, the method further comprises:

and under the condition that the length value of the application interface is larger than that of the actual window, intercepting the application interface to obtain a target application interface, wherein the length value of the target application interface is equal to that of the actual window.

7. The method of claim 4, wherein prior to displaying the application interface to the screen of the terminal device, the method further comprises:

and setting the actual window to be transparent under the condition that the length value of the application interface is smaller than the length value of the actual window.

8. An application layout control device, characterized by comprising:

a sending unit, configured to send a width value of a screen of a terminal device to an application in a case where an application interface of the application needs to be displayed;

the receiving unit is used for receiving the application interface returned by the application, and the width value of the application interface is equal to the width value of the screen;

9. The apparatus of claim 8, wherein the transmitting unit for transmitting the width value of the screen of the terminal device to the application comprises:

10. The apparatus according to claim 8 or 9, wherein the screen of the terminal device is a folding screen;

11. The apparatus according to any one of claims 8-10, wherein the sending unit is further configured to send, to the application, length information before the receiving the application interface returned by the application, where the length information includes a length value that is a length value of the screen.

12. The apparatus of claim 11, wherein the apparatus further comprises:

The intercepting unit is used for intercepting the application interface to obtain a target application interface under the condition that the ratio of the width value to the length value of the actual window is larger than the ratio of the width value to the length value of the screen before the width value of the application interface is reduced to the width value of the actual window, and the length value of the target application interface is the quotient of the product of the length value of the actual window and the width value of the screen and the width value of the actual window.

13. The apparatus of claim 11, wherein the apparatus further comprises:

the control unit is further configured to reduce, after receiving the application interface returned by the application, a length value of the application interface to a quotient of a product of a length value of the screen and a width value of the actual window and the width value of the screen;

14. The apparatus of claim 11, wherein the apparatus further comprises:

A setting unit, configured to set the actual window to be transparent in a case where a length value of the application interface is smaller than a length value of the actual window before the application interface is displayed on a screen of the terminal device.

15. A terminal device, comprising: a memory, a processor, wherein the memory stores program instructions; the program instructions, when executed by the processor, cause the processor to perform the method of any of claims 1 to 7.