CN115562535B

CN115562535B - Application control method and electronic equipment

Info

Publication number: CN115562535B
Application number: CN202210043198.6A
Authority: CN
Inventors: 刘诗聪; 姚远
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-01-14
Filing date: 2022-01-14
Publication date: 2024-05-17
Anticipated expiration: 2042-01-14
Also published as: CN115562535A

Abstract

An application control method and an electronic device. By implementing the technical scheme provided by the application, the third party application can be free from development or only needs a small amount of development, when one display area of the electronic equipment displays one functional page, the remote controller template interface corresponding to the functional page is automatically displayed in the other display area, and the operability of the electronic equipment is greatly improved.

Description

Application control method and electronic equipment

Technical Field

The present application relates to the field of terminals and communications technologies, and in particular, to an application control method and an electronic device.

Background

With the development of mobile devices, foldable mobile terminals are becoming a popular choice in order to meet the requirements of both large screens and portability.

When the foldable mobile terminal is in an unfolded state, the foldable mobile terminal can meet the requirement that a user uses the large-screen mobile device to watch more contents. When the foldable mobile terminal is in a folded state, the portable mobile terminal can meet the requirement of a user on portability of the mobile terminal.

How to further improve the convenience of using the foldable mobile terminal by using the stand state of the foldable mobile terminal between the unfolded state and the folded state is a problem to be solved.

Disclosure of Invention

The application provides an application control method and electronic equipment, which are used for improving operability of the electronic equipment.

In a first aspect, the present application provides an application control method, including: the method comprises the steps that the electronic equipment displays a first functional page of a first application program in a first display area, wherein the first display area is one display area in a plurality of display areas of the electronic equipment, and the first application program is a third party application installed in the electronic equipment by a user; the electronic equipment determines a first remote controller template corresponding to the first functional page, and the corresponding relation among the first application program, the first functional page and the first remote controller template is recorded in a page remote controller template file preset in the electronic equipment; the electronic equipment displays the first remote controller template in a second display area according to the configuration information of the first remote controller template recorded in the preset template configuration file, wherein the second display area is a display area which is different from the first display area in the electronic equipment.

In the above embodiment, when the first function page of the first application program is displayed in the first display area in the electronic device, the electronic device may determine, according to the page remote controller template file preset in the system, a first remote controller template corresponding to the first function page. And displaying the first remote controller template in a second display area according to the configuration information of the first remote controller template recorded in the template configuration file preset in the system. Because the page remote controller template file and the template configuration file are preset in the system, even if the developer of the first application program does not develop the first remote controller template for controlling the first functional page, the electronic equipment can automatically display the first remote controller template in a second display area in a matching way, so that the operability of the electronic equipment is greatly improved, and the development workload of a third party application developer is reduced.

With reference to some embodiments of the first aspect, in some embodiments, the method further includes: and responding to the operation of the user on the first control on the first remote controller template, and executing the operation corresponding to the first control on the first functional page in the first display area by the electronic equipment.

In the above embodiment, the user may respond to the operation of the first control on the first remote controller template displayed in the second display area by the electronic device, and execute the operation corresponding to the first control on the first function page, so as to further improve operability of the electronic device.

In combination with some embodiments of the first aspect, in some embodiments, the first control belongs to one of a control that directly controls a desktop, a control that directly injects a keymouse event, a control that directly controls hardware, a control that performs touch mapping conversion, and a control that reserves custom buttons for third party applications.

In the above embodiment, although the first remote controller template is displayed according to the page remote controller template file and the template configuration file preset by the system, the controls in the first remote controller template may not only have controls for directly controlling the desktop, controls for directly injecting the mouse event, controls for directly controlling the hardware, controls for performing touch mapping conversion, and the like, which do not need to be participated in processing by the developer of the third party application, but also may perform a small amount of development to reserve a control for customizing keys for the third party application to set the specific function of the third party application if the developer of the third party application needs. The development workload of the third party application is reduced, the flexibility of the functional design of the first remote controller template is guaranteed, and the usability of the first remote controller template is improved.

In combination with some embodiments of the first aspect, in some embodiments, the first control belongs to a control for reserving a custom button for a third party application, and the first application program includes a system support state software development kit.

In the above embodiment, a developer of the third party application may customize the function of the control of the customized key for the third party application in the first remote controller template by integrating the system support state software development kit in the third party application, thereby reducing the development workload of the third party application, guaranteeing the flexibility of the function design of the first remote controller template, and improving the usability of the first remote controller template.

With reference to some embodiments of the first aspect, in some embodiments, the method further includes: in the case that the electronic device displays the first remote controller template in the second display area for the first time, the electronic device displays a modification prompt window, wherein the modification prompt window is used for prompting a user to select whether to modify the first remote controller template; when the operation of confirming to modify the first remote controller template is received, the electronic equipment changes the first remote controller template displayed in the second display area into an editable state; and under the condition that the operation of confirming not to modify the first remote controller template is received, the electronic equipment displays a template modification control in the first remote controller template, wherein the template modification control is used for enabling the first remote controller template to be changed into an editable state after being triggered.

In the above embodiment, the user may modify the first remote controller template displayed in the second display area, so as to meet the own use requirement and improve the use, thereby improving the man-machine interaction performance of the electronic device.

With reference to some embodiments of the first aspect, in some embodiments, the method further includes: after the first remote control template is modified, the electronic device updates the content modified to the first remote control template into the preset template configuration file.

In the above embodiment, after the first remote controller template is modified, the modified content may be updated to the preset template configuration file, so that when the user opens the first functional page for the second time and displays the first remote controller template in the second display area, the remote controller template conforming to the use habit of the user, which is modified last time, is directly displayed, and the man-machine interaction performance of the electronic device is improved.

With reference to some embodiments of the first aspect, in some embodiments, the method further includes: responding to display switching operation of a user, and displaying a second functional page of the first application program on the first display area by the electronic equipment, wherein the second functional page is different from the first functional page; the electronic equipment determines a second remote controller template corresponding to the second functional page, and the corresponding relation among the first application program, the second functional page and the second remote controller template is recorded in the preset page remote controller template file; and the electronic equipment displays the second remote controller template in the second display area according to the configuration information of the second remote controller template recorded in the preset template configuration file, wherein the second remote controller template is different from the first remote controller template.

In the above embodiment, the remote controller template corresponds not only to the application program but also to the function page in the application program. Even the same application program, when the second display area is switched to another different functional page (for example, a second functional page), the second remote controller template corresponding to the second functional page can be determined and displayed by searching the preset page remote controller template file and the template configuration file, so that the operability of the electronic equipment on each functional page is greatly improved.

With reference to some embodiments of the first aspect, in some embodiments, the electronic device is a folding screen electronic device; the electronic device further includes, prior to the step of displaying the first function page of the first application in the first display area: the electronic equipment displays the first functional page in a full-screen display area in an unfolded state; in response to a user's operation to fold the electronic device into a stand-still state, the electronic device divides the full-screen display area into the first display area and the second display area.

In the above embodiment, the electronic device with a folding screen may be switched between the unfolded state and the stand state, and when the electronic device is switched to the stand state, the electronic device may display the first function page displayed in the unfolded state in the first display area and display the corresponding first function page in the second display area. Thus, the special state of the folding screen electronic device can be utilized to improve the operation performance of the folding screen electronic device.

With reference to some embodiments of the first aspect, in some embodiments, the electronic device is a multi-screen electronic device, the first display area is one display screen in the electronic device, and the second display area is another display screen in the electronic device.

In the above embodiment, the multi-screen electronic device may display the remote controller template on another display screen other than one display application program, so that the functional pages of the displayed application program may be controlled more flexibly.

In a second aspect, an embodiment of the present application provides an electronic device, including: one or more processors and memory; the memory is coupled to the one or more processors, the memory for storing computer program code, the computer program code comprising computer instructions that the one or more processors call to cause the electronic device to perform: displaying a first function page of a first application program in a first display area, wherein the first display area is one display area in a plurality of display areas of the electronic equipment, and the first application program is a third party application installed in the electronic equipment by a user; determining a first remote controller template corresponding to the first functional page, wherein the corresponding relation among the first application program, the first functional page and the first remote controller template is recorded in a page remote controller template file preset in the electronic equipment; and displaying the first remote controller template in a second display area according to the configuration information of the first remote controller template recorded in the preset template configuration file, wherein the second display area is a display area which is different from the first display area in the electronic equipment.

With reference to some embodiments of the second aspect, in some embodiments, the one or more processors are further configured to invoke the computer instructions to cause the electronic device to perform: and responding to the operation of the user on the first control on the first remote controller template, and executing the operation corresponding to the first control on the first functional page in the first display area.

With reference to some embodiments of the second aspect, in some embodiments, the first control belongs to one of a control that directly controls a desktop, a control that directly injects a keymouse event, a control that directly controls hardware, a control that performs touch mapping conversion, and a control that reserves custom buttons for third party applications.

With reference to some embodiments of the second aspect, in some embodiments, the first control belongs to a control for reserving a custom button for a third party application, and the first application program includes a system-in-rack software development kit.

With reference to some embodiments of the second aspect, in some embodiments, the one or more processors are further configured to invoke the computer instructions to cause the electronic device to perform: displaying a modification prompt window under the condition that the electronic equipment displays the first remote controller template in the second display area for the first time, wherein the modification prompt window is used for prompting a user to select whether to modify the first remote controller template; changing the first remote controller template displayed in the second display area to an editable state upon receiving an operation confirming modification of the first remote controller template; and displaying a template modification control in the first remote controller template under the condition that the operation of confirming not to modify the first remote controller template is received, wherein the template modification control is used for enabling the first remote controller template to be changed into an editable state after being triggered.

With reference to some embodiments of the second aspect, in some embodiments, the one or more processors are further configured to invoke the computer instructions to cause the electronic device to perform: after the first remote control template is modified, updating the content modified by the first remote control template into the preset template configuration file.

With reference to some embodiments of the second aspect, in some embodiments, the one or more processors are further configured to invoke the computer instructions to cause the electronic device to perform: responding to display switching operation of a user, and displaying a second functional page of the first application program on the first display area by the electronic equipment, wherein the second functional page is different from the first functional page; the electronic equipment determines a second remote controller template corresponding to the second functional page, and the corresponding relation among the first application program, the second functional page and the second remote controller template is recorded in the preset page remote controller template file; and the electronic equipment displays the second remote controller template in the second display area according to the configuration information of the second remote controller template recorded in the preset template configuration file, wherein the second remote controller template is different from the first remote controller template.

With reference to some embodiments of the second aspect, in some embodiments, the electronic device is a folding screen electronic device; the one or more processors are also configured to invoke the computer instructions to cause the electronic device to perform: displaying the first functional page in a full-screen display area in an unfolded state; and responding to the operation of folding the electronic equipment into a bracket state by a user, and dividing the full-screen display area into the first display area and the second display area.

With reference to some embodiments of the second aspect, in some embodiments, the electronic device is a multi-screen electronic device, the first display area is one display screen in the electronic device, and the second display area is another display screen in the electronic device.

In a third aspect, embodiments of the present application provide a chip system for application to an electronic device, the chip system comprising one or more processors for invoking computer instructions to cause the electronic device to perform a method as described in the first aspect and any possible implementation of the first aspect.

In a fourth aspect, embodiments of the present application provide a computer program product comprising instructions which, when run on an electronic device, cause the electronic device to perform a method as described in the first aspect and any possible implementation of the first aspect.

In a fifth aspect, an embodiment of the present application provides a computer readable storage medium comprising instructions which, when executed on an electronic device, cause the electronic device to perform a method as described in the first aspect and any possible implementation manner of the first aspect.

It will be appreciated that the electronic device provided in the second aspect, the chip system provided in the third aspect, the computer program product provided in the fourth aspect and the computer storage medium provided in the fifth aspect described above are all configured to perform the method provided by the embodiment of the present application. Therefore, the advantages achieved by the method can be referred to as the advantages of the corresponding method, and will not be described herein.

Drawings

FIG. 1 is an exemplary schematic diagram of an electronic device in a folded state, a flattened state, and a stand state, respectively, provided by an embodiment of the present application;

FIG. 2 is a schematic diagram of 2 exemplary interaction scenarios of a folding screen electronic device in a cradle state provided by an embodiment of the present application;

fig. 3 is a schematic view of a scene of content switching displayed when an electronic device folds a display screen into and out of a stand state in an embodiment of the present application;

Fig. 4 is a schematic structural diagram of an electronic device 100 according to an embodiment of the present application;

FIG. 5 is an exemplary software architecture block diagram of an electronic device 100 in accordance with an embodiment of the present application;

FIGS. 6A-6I are a set of exemplary user interface diagrams provided by embodiments of the present application;

FIGS. 7A-7B are schematic diagrams of another set of exemplary user interfaces provided by embodiments of the present application;

FIG. 8 is a schematic flow chart of an application control method according to an embodiment of the present application;

FIG. 9 is a schematic diagram of signaling interaction between an electronic device in and out of a stand-by state according to an embodiment of the present application;

fig. 10 is a signaling interaction schematic diagram after various types of controls in a remote control template displayed on a display area B are triggered in the embodiment of the present application;

fig. 11 is another flow chart of an application control method according to an embodiment of the present application.

Detailed Description

The terminology used in the following embodiments of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification of the present application and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include the plural forms as well, unless the context clearly indicates to the contrary. It should also be understood that the term "and/or" as used in this disclosure refers to and encompasses any or all possible combinations of one or more of the listed items.

The terms "first," "second," and the like, are used below for descriptive purposes only and are not to be construed as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature, and in the description of embodiments of the application, unless otherwise indicated, the meaning of "a plurality" is two or more.

For easy understanding, the following describes three folding states of the foldable mobile terminal by taking the electronic device in the embodiment of the present application as a dual-screen foldable mobile terminal as an example:

(1) Folding:

As shown in fig. 1 (a), an exemplary schematic view of a two-screen foldable terminal in a folded state is shown. The terminal comprises two screens, a large screen 102 which can be folded in and a small screen 101 which is external. When in the folded state, the width of the foldable screen of the terminal is only half of that of the unfolded state, so that the portable terminal is convenient to carry, and the small screen 101 can be normally used for realizing most functions of the terminal.

It will be appreciated that the folded configuration of the terminal in the example of a two-panel foldable terminal in fig. 1 may be other configurations in which the terminal is folded. For example, in the case of a two-screen, foldable terminal, the terminal may have only one large screen that is foldable and no other small screen. In the folded state, a part of the large screen is used for displaying a screen. For another example, some smaller foldable terminals may also be folded up and down, thereby making the folded state of the terminal smaller and more portable. And are not limited herein.

(2) Flattened state:

When the user spreads the terminal end shown in fig. 1 (a) to 180 degrees along the inner fold line 103 in the large screen 102, the terminal end may be in a flattened state as shown in fig. 1 (b).

When the terminal is in a flattened state, the foldable screen of the terminal becomes a flat large screen, and the large screen can be used for displaying pictures, so that better visual experience is brought to a user.

(3) And (3) supporting:

In the process that the user expands the folded state terminal shown in (a) of fig. 1 to the flattened state terminal shown in (b) of fig. 1 along the inner fold line 103 of the large screen 102, the foldable screen of the terminal is not folded in half, is not flattened, and forms an angle between 0 degrees and 180 degrees, so as to obtain the bracket state shown in (c) of fig. 1.

When the foldable screen is in a bracket state, the foldable screen can be displayed in a left-right split mode or in an up-down split mode. In the stand state, the foldable screen may be divided into two display areas, such as area a and area B shown in fig. 1 (c). The area a and the area B may display a screen and receive a user operation, respectively.

It will be appreciated that in some embodiments, even if the electronic device does not include a foldable screen, the electronic device may be considered to be in a stand-alone state as long as the electronic device includes a display screen that is divided into two display regions that form an angle of between 0 degrees and 180 degrees with each other.

In some implementations, a folding screen electronic device in a cradle state may provide some interesting interaction scenarios.

As shown in fig. 2 (a), an exemplary scene diagram when the application currently displayed by the electronic device in the stand state is a video playing application. The playing window of the video playing application can be displayed through the first display area facing the user, and the control key of the video playing application is displayed in the second display area forming a certain angle with the first display area, so that the user can control the video playing application more conveniently in the bracket state.

As shown in fig. 2 (b), an exemplary scenario diagram when the application currently displayed for the electronic device in the stand state is a game application is illustrated. The first display area facing the user can display the picture of the game application, and the second display area forming a certain angle with the first display area can display the control keys of the game application, so that the user can more conveniently perform game operation in the bracket state.

However, in order for a third party application currently displayed on an electronic device to achieve the effect shown in fig. 2 in a stand-by state, the third party application is required to develop an interface layout of a first display area and a second display area in the stand-by state by itself. If a third party application does not develop the interface layout of the first display area and the second display area in the bracket state, the third party application will not display a control interface in the second display area in the bracket state, and the second display area may be a black screen or may display a part of the screen of the third party application. Therefore, these third party applications, which do not develop the interface layout of the first display area and the second display area in the stand state, may have a problem in that the operation is relatively inconvenient in the stand state.

The third party application in the embodiment of the present application refers to an application program developed by a third party other than the system manufacturer of the electronic device.

By adopting the application control method provided by the embodiment of the application, the third party application can be prevented from being developed or only needs a small amount of development, the third party application which is currently displayed can be automatically switched to the first display area for display when the foldable electronic equipment is in the bracket state, and the remote controller interface corresponding to the third party application is displayed in the second display area, so that the operability of the electronic equipment is greatly improved.

The following will be described briefly with reference to fig. 3, in which a scene of switching contents displayed in a display screen of an electronic device is folded when the display screen is in or out of a stand state:

As shown in fig. 3 (a), when the electronic device is in the unfolded state, the window of the third party application a is currently displayed on the full screen of the display screen.

After the user folds the electronic device in the unfolded state to the stand state as shown in (b) of fig. 3, the display screen of the electronic device is divided into two display areas: a first display area facing the user, and a second display area at an angle to the first display area. Even if the developer of the third party application program a does not develop the interface layout of the first display area and the second display area in the bracket state, by adopting the application control method provided by the embodiment of the application, the electronic device can switch the window of the third party application program a currently being displayed in full screen to the first display area for display, and display the remote controller interface B corresponding to the third party application program a in the second display area.

Accordingly, when the user expands the electronic device in the stand state as shown in (b) of fig. 3 to the electronic device in the expanded state as shown in (a) of fig. 3, the first display area and the second display area are flattened and synthesized into a complete large display area, and the electronic device can display the window of the third party application program a in the large display area in a full screen mode.

In some embodiments of the present application, the remote control interface may also be referred to as a remote control window, and is not limited herein.

An exemplary electronic device 100 provided by an embodiment of the present application is first described below.

Fig. 4 is a schematic structural diagram of an electronic device 100 according to an embodiment of the present application.

The embodiment will be specifically described below taking the electronic device 100 as an example. It should be understood that electronic device 100 may have more or fewer components than shown, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The electronic device 100 may include: processor 110, external memory interface 120, internal memory 121, universal serial bus (universal serial bus, USB) interface 130, charge management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headset interface 170D, sensor module 180, keys 190, motor 191, indicator 192, camera 193, display 194, and subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It should be understood that the illustrated structure of the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (IMAGE SIGNAL processor, ISP), a controller, a memory, a video codec, a digital signal processor (DIGITAL SIGNAL processor, DSP), a baseband processor, and/or a neural Network Processor (NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller may be a neural hub and a command center of the electronic device 100, among others. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-INTEGRATED CIRCUIT, I2C) interface, an integrated circuit built-in audio (inter-INTEGRATED CIRCUIT SOUND, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

The I2C interface is a bi-directional synchronous serial bus comprising a serial data line (SERIAL DATA LINE, SDA) and a serial clock line (derail clock line, SCL). In some embodiments, the processor 110 may contain multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, charger, flash, camera 193, etc., respectively, through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, such that the processor 110 communicates with the touch sensor 180K through an I2C bus interface to implement a touch function of the electronic device 100.

The I2S interface may be used for audio communication. In some embodiments, the processor 110 may contain multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 via an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface, to implement a function of answering a call through the bluetooth headset.

PCM interfaces may also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface to implement a function of answering a call through the bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus for asynchronous communications. The bus may be a bi-directional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through a UART interface, to implement a function of playing music through a bluetooth headset.

The MIPI interface may be used to connect the processor 110 to peripheral devices such as a display 194, a camera 193, and the like. The MIPI interfaces include camera serial interfaces (CAMERA SERIAL INTERFACE, CSI), display serial interfaces (DISPLAY SERIAL INTERFACE, DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the photographing functions of electronic device 100. The processor 110 and the display 194 communicate via a DSI interface to implement the display functionality of the electronic device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal or as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, etc.

The SIM interface may be used to communicate with the SIM card interface 195 to perform functions of transferring data to or reading data from the SIM card.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transfer data between the electronic device 100 and a peripheral device. And can also be used for connecting with a headset, and playing audio through the headset. The interface may also be used to connect other electronic devices, such as AR devices, etc.

It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present application is only illustrative, and is not meant to limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also employ different interfacing manners in the above embodiments, or a combination of multiple interfacing manners.

The charge management module 140 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger.

The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional module, independent of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (WIRELESS FIDELITY, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation SATELLITE SYSTEM, GNSS), frequency modulation (frequency modulation, FM), near field communication (NEAR FIELD communication, NFC), infrared (IR), etc., applied to the electronic device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 150 of electronic device 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that electronic device 100 may communicate with a network and other devices through wireless communication techniques. The wireless communication techniques can include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (GENERAL PACKET radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation SATELLITE SYSTEM, GLONASS), a beidou satellite navigation system (beidou navigation SATELLITE SYSTEM, BDS), a quasi zenith satellite system (quasi-zenith SATELLITE SYSTEM, QZSS) and/or a satellite based augmentation system (SATELLITE BASED AUGMENTATION SYSTEMS, SBAS).

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a Liquid Crystal Display (LCD). The display panel may also be manufactured using organic light-emitting diodes (OLED), active-matrix organic LIGHT EMITTING diode (AMOLED), flexible light-emitting diodes (FLED), miniled, microled, micro-OLED, quantum dot LIGHT EMITTING diodes (QLED), or the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1. In the embodiment of the present application, if the electronic device 100 includes only 1 display screen 194, the display screen 194 is a foldable display screen.

The electronic device 100 may implement photographing functions through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the electronic device 100 may be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.

The internal memory 121 may include one or more random access memories (random access memory, RAM) and one or more non-volatile memories (NVM).

In the embodiment of the present application, the internal memory 121 may store different types of remote control templates, and may also store the application identifier, the correspondence between the application function identifier and the remote control template type identifier.

The random access memory may include a static random-access memory (SRAM), a dynamic random-access memory (dynamic random access memory, DRAM), a synchronous dynamic random-access memory (synchronous dynamic random access memory, SDRAM), a double data rate synchronous dynamic random-access memory (double data rate synchronous dynamic random access memory, DDR SDRAM, such as fifth generation DDR SDRAM is commonly referred to as DDR5 SDRAM), etc.;

the nonvolatile memory may include a disk storage device, a flash memory (flash memory).

The FLASH memory may include NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. divided according to an operation principle, may include single-level memory cells (SLC-LEVEL CELL), multi-level memory cells (multi-LEVEL CELL, MLC), triple-level memory cells (LEVEL CELL, TLC), quad-LEVEL CELL, QLC), etc. divided according to a memory cell potential order, may include general FLASH memory (english: universal FLASH storage, UFS), embedded multimedia memory card (eMMC) MEDIA CARD, eMMC), etc. divided according to a memory specification.

The random access memory may be read directly from and written to by the processor 110, may be used to store executable programs (e.g., machine instructions) for an operating system or other on-the-fly programs, may also be used to store data for users and applications, and the like.

The nonvolatile memory may store executable programs, store data of users and applications, and the like, and may be loaded into the random access memory in advance for the processor 110 to directly read and write.

The external memory interface 120 may be used to connect external non-volatile memory to enable expansion of the memory capabilities of the electronic device 100. The external nonvolatile memory communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and video are stored in an external nonvolatile memory.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The electronic device 100 may listen to music, or to hands-free conversations, through the speaker 170A.

A receiver 170B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When electronic device 100 is answering a telephone call or voice message, voice may be received by placing receiver 170B in close proximity to the human ear.

Microphone 170C, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 170C through the mouth, inputting a sound signal to the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may also be provided with three, four, or more microphones 170C to enable collection of sound signals, noise reduction, identification of sound sources, directional recording functions, etc.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be a USB interface 130 or a 3.5mm open mobile electronic device platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. The capacitance between the electrodes changes when a force is applied to the pressure sensor 180A. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 may also calculate the location of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example: and executing an instruction for checking the short message when the touch operation with the touch operation intensity smaller than the first pressure threshold acts on the short message application icon. And executing an instruction for newly creating the short message when the touch operation with the touch operation intensity being greater than or equal to the first pressure threshold acts on the short message application icon.

The gyro sensor 180B may be used to determine a motion gesture of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., x, y, and z axes) may be determined by gyro sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the electronic device 100, calculates the distance to be compensated by the lens module according to the angle, and makes the lens counteract the shake of the electronic device 100 through the reverse motion, so as to realize anti-shake. The gyro sensor 180B may also be used for navigating, somatosensory game scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, electronic device 100 calculates altitude from barometric pressure values measured by barometric pressure sensor 180C, aiding in positioning and navigation.

The magnetic sensor 180D includes a hall sensor. The electronic device 100 may detect the opening and closing of the flip cover using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip machine, the electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.

The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the electronic device 100 is stationary. The electronic equipment gesture recognition method can also be used for recognizing the gesture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, the electronic device 100 may range using the distance sensor 180F to achieve quick focus.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it may be determined that there is an object in the vicinity of the electronic device 100. When insufficient reflected light is detected, the electronic device 100 may determine that there is no object in the vicinity of the electronic device 100. The electronic device 100 can detect that the user holds the electronic device 100 close to the ear by using the proximity light sensor 180G, so as to automatically extinguish the screen for the purpose of saving power. The proximity light sensor 180G may also be used in holster mode, pocket mode to automatically unlock and lock the screen.

The ambient light sensor 180L is used to sense ambient light level. The electronic device 100 may adaptively adjust the brightness of the display 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust white balance when taking a photograph. Ambient light sensor 180L may also cooperate with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent false touches.

The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 may utilize the collected fingerprint feature to unlock the fingerprint, access the application lock, photograph the fingerprint, answer the incoming call, etc.

The temperature sensor 180J is for detecting temperature. In some embodiments, the electronic device 100 performs a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs a reduction in the performance of a processor located in the vicinity of temperature sensor 180J in order to reduce power consumption to implement thermal protection. In other embodiments, when the temperature is below another threshold, the electronic device 100 heats the battery 142 to avoid the low temperature causing the electronic device 100 to be abnormally shut down. In other embodiments, when the temperature is below a further threshold, the electronic device 100 performs boosting of the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperatures.

The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a different location than the display 194.

The keys 190 include a power-on key, a volume key, etc. The keys 190 may be mechanical keys. Or may be a touch key. The electronic device 100 may receive key inputs, generating key signal inputs related to user settings and function controls of the electronic device 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration alerting as well as for touch vibration feedback. For example, touch operations acting on different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also correspond to different vibration feedback effects by touching different areas of the display screen 194. Different application scenarios (such as time reminding, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card may be inserted into the SIM card interface 195, or removed from the SIM card interface 195 to enable contact and separation with the electronic device 100. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support Nano SIM cards, micro SIM cards, and the like. The same SIM card interface 195 may be used to insert multiple cards simultaneously. The types of the plurality of cards may be the same or different. The SIM card interface 195 may also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as communication and data communication.

Fig. 5 is a software configuration block diagram of the electronic device 100 according to the embodiment of the present application.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the system is divided into five layers, from top to bottom, an application layer, an interface layer, an application framework layer, runtime (run time) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages.

As shown in fig. 5, the application packages may include system applications (also referred to as system applications) such as cameras, gallery, calendar, phone calls, maps, navigation, WLAN, bluetooth, music, video, short messages, system control window applications, and some other third party applications such as conference applications, game applications, and the like.

The system control window application may be configured to display, when it is detected that the electronic device 100 is in a stand state, an application currently being displayed in a first display area of the electronic device 100, and display, in a second display area, a remote controller interface corresponding to the application currently being displayed, where the remote controller interface includes some controls. If the triggering operation of the user on the control in the remote controller interface of the second display area is received, the interface corresponding to the control provided by the interface layer can be called, and corresponding response can be carried out on the operation in the first display area.

The interface layer provides an application programming interface (application programming interface, API) for the application programs of the application layer. The application program can realize different functions by calling different interfaces.

As shown in fig. 5, in an embodiment of the present application, the interface layer may include a shelf control library.

The support control library is used for providing interfaces which can be called after the control displayed on the remote controller interface of the second display area is triggered so as to realize the preset function corresponding to the control. Different controls displayed on the remote controller interface can establish preset corresponding relations with different interfaces in the bracket control library.

Specifically, the bracket control library may include: the system comprises a system control interface, an input control interface, a hardware control interface, a touch mapping interface and a third party application custom operation interface.

The system control interface is called, so that the system control functions of returning to a desktop, displaying a status bar, displaying a latest task, calling a side bar and the like can be realized;

The function of inputting the keyboard and the mouse and returning to keys can be realized by calling the input control interface;

The functions of adjusting the sound of the electronic equipment and adjusting the brightness of the display screen can be realized by calling the hardware control interface;

by calling the touch mapping interface, the function of mapping the touch operation of the user on the second display area to the touch operation of the corresponding position in the first display area can be realized.

By calling the third party application custom operation interface, other custom control can be performed on the third party application, for example, functions of turning pages of a presentation document, sharing conference links and the like are realized on the conference application.

It can be understood that, if a third party application needs to be displayed in the first display area and a remote controller interface corresponding to the third party application needs to be displayed in the second display area, a control capable of calling the third party application custom operation interface is displayed in the remote controller interface, and after the control is triggered, a function of the third party application custom can be realized in the third party application, a developer of the third party application needs to integrate a system support state software development kit (software development kit, SDK) in the third party application, and an operation which needs to be executed in the third party application after calling the third party application custom operation interface is defined in the system support state SDK.

And because the control corresponding to the third party application custom operation interface is preset in the system control window application in the electronic equipment, even if the third party application needs to use the third party application custom operation interface, a developer of the third party application only needs to edit the operation of the interface needing to be called, and the control corresponding to the interface does not need to be developed again.

In addition, a developer of the third party application can customize the layout and the function of the control in the remote controller interface corresponding to the third party application through the system support SDK.

The application framework layer provides a programming framework for the application programming interfaces of the interface layer. The application framework layer includes a number of predefined functions.

As shown in fig. 5, the application framework layer may include a rack control proxy service, where some modules are included in the rack control proxy service to implement functions that need to be implemented when some interfaces in the rack control library of the interface layer are called.

Specifically, the support control proxy service may include: the device comprises a touch mapping module, an analog key mouse injection module, a hardware control module, a split screen controller layout module and a bracket state control module. Wherein:

The touch mapping module is used for mapping the touch operation of the user on the second display area to the touch operation of the corresponding position in the first display area. Functional support may be provided for the touch mapping interface of the interface layer.

And the simulated keyboard and mouse injection module is used for simulating input of a keyboard and mouse and returning keys to the first display area. Functional support may be provided for an input control interface of the interface layer.

And the hardware control module is used for realizing the functions of adjusting the sound of the electronic equipment and adjusting the brightness of the display screen. Functional support may be provided for a hardware control interface of the interface layer.

And the split-screen controller layout module is used for determining the layout of the controls or elements in the remote controller interface displayed in the second display area.

The support state control module is used for controlling the current display application to be displayed in a full screen mode in the unfolded state of the electronic equipment and to be displayed in a split screen mode in the support state of the electronic equipment. And displaying the current application in a first display area and displaying a remote controller interface corresponding to the current application in a second display area by the split screen combination.

The application framework layer may also include a window manager, a power manager, an input manager, a view system, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The power manager is for managing power related settings. For example, the power manager may receive instructions to adjust the current screen brightness, power down, etc.

The input manager is for generating an input event in response to a user input.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The Runtime (run time) includes core libraries and virtual machines. Run time is responsible for scheduling and management of the system.

The core library consists of two parts: one part is the function that the programming language (e.g., jave language) needs to call, and the other part is the core library of the system.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes the programming files (e.g., jave files) of the application layer and the application framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), two-dimensional graphics engines (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of two-Dimensional (2D) and three-Dimensional (3D) layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing 3D graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The kernel layer at least comprises a display driver, a camera driver, an audio driver, a sensor driver and a virtual card driver.

In the embodiment of the application, a plurality of remote controller templates corresponding to different functional pages in different applications can be stored in the system control window application. For example, a login page A of a game application A may correspond to a text-entry remote control template A, and a game operation page B of the game application A may correspond to a game operation remote control template B. For another example, all pages of an office-type application C may correspond to a text-entry remote control template C. The system control window application is preset with various remote controller templates corresponding to most of the existing applications on the market and the functional pages thereof.

It will be appreciated that different applications may have different application identifications, different function pages in an application may have different function page identifications, and different remote controller templates may have different remote controller template identifications. Exemplary, as shown in table 1 below, is an example of a correspondence between an application identifier, a function page identifier, and a remote control template identifier:

Application identification	Functional page identification	Remote controller template mark
			Application identification 1	Functional page identification 1	Remote controller template mark 1
Application identification 1	Functional page identification 2	Remote controller template mark 2
			Application identification 2	Functional page identification 1	Remote controller template mark 3
Application identifier 3	Functional page identification 3	Remote controller template mark 4
			······	······	······

TABLE 1

In some embodiments, the application identification is a package name of the application and the function page identification is a type name of the function page. When the electronic equipment enters a support state, the electronic equipment can determine a preset remote controller template matched with the application identifier and the function page identifier according to the package name of the application currently displayed on the display screen of the electronic equipment and the type of the displayed function page, so that the electronic equipment is switched to a first display area of the support state to display the function page of the application, and a second display area to display the matched remote controller template.

In some embodiments, the correspondence between the application identifier, the function page identifier, and the remote control template identifier may be stored in a file in the system control window application, which may be simply referred to as a page remote control template file. In some embodiments, the page remoting template file is an extensible markup language XML formatted file.

In some embodiments, the number, size, shape, color, interface elements to be displayed, and arrangement manner thereof, etc. of the controls to be displayed in each specific remote controller template may be stored in another file in the system control window application, which may be simply referred to as a template configuration file. In some embodiments, the template configuration file is also an extensible markup language, XML, formatted file.

The controls in the remote control template can be divided into the following five types:

Control type 1, control to directly control desktop. Triggering the control can realize the system control functions of returning to the desktop, displaying a status bar, displaying the latest task, calling a sidebar and the like. The control of this type has a preset corresponding relation with the system control interface of the interface layer.

Control type 2, control of direct injection of the keymouse event. The control can be triggered to realize forward, return, keyboard up and down, left and right, keyboard space, keyboard carriage return, long-time mouse pressing, other combination keys and the like. The control of the type has a preset corresponding relation with an input control interface of the interface layer.

Control type 3, control to directly control hardware. Triggering the control can realize play volume adjustment, brightness adjustment, vibration adjustment, microphone switch, volume adjustment and the like. The control of the type has a preset corresponding relation with a hardware control interface of the interface layer.

Control type 4, control for touch mapping conversion. Triggering the control can realize the function of mapping the touch operation of the user on the second display area to the touch operation of the corresponding position in the first display area. The control of the type has a preset corresponding relation with the touch mapping interface of the interface layer.

And the control type 5 is used for reserving controls of custom buttons for the third party application. The control of the type has a preset corresponding relation with a third party application self-defined operation interface of the interface layer. The specific functions of the control are defined by the system support SDK in the third party application, and other user-defined control on the third party application can be realized, for example, the functions of page turning of a presentation document, sharing of conference links and the like are realized on the conference application.

The number, size, shape, color and arrangement mode of the controls are preset in the remote controller template. Through the integrated system support SDK, the third party application can customize the functions corresponding to the third party application custom operation interface, and also can customize and adjust the number, the size, the shape, the color and the arrangement mode of each control when the application uses the remote controller template.

It will be appreciated that in some embodiments of the present application, the contents of the page remoting template file and the template configuration file may also be located in the same file, which is not limited herein.

It should be noted that, the page remote control template file and the template configuration file are both preset in the electronic device, specifically, may be preset in the system control window application, and are not brought by installing the third party application program.

In the following, with reference to the above-mentioned software and hardware structures of the exemplary electronic device 100, a description will be given of some exemplary user interfaces related to embodiments of the present application, taking a specific scenario in which several specific third-party applications switch between an electronic device folding from an unfolded state to a stand state display screen, respectively:

Scene one: take a game application a that does not integrate the system stand-alone SDK as an example.

As shown in FIG. 6A, a schematic diagram of an exemplary user interface 610 for the foldable electronic device 100 in an unfolded state to display a game operational page of the game application A in full screen. The user interface 610 displays a game screen of the game application a, a direction operation control 601, functional operation controls 602a to 602d, and a background song play control 603 in full screen, wherein:

a directional operation control 601 for controlling movement of a character in a game application in response to a user operation;

Functional operation controls 602 a-602 d for controlling the ability to trigger characters in a gaming application in response to user operations;

A background song play control 603 for opening a background song play control interface in response to a user operation.

In response to a user folding the electronic device 100 from the unfolded state shown in fig. 3 (a) to the stand state shown in fig. 3 (b), the display screen of the electronic device 100 is divided into two display areas: a first display area and a second display area. As shown in fig. 6B, the electronic device 100 displays the user interface 620 in a first display area and the user interface 630 in a second display area. The electronic device 100 displays a game operation page of the game application a in the user interface 620, with the display content being the same as the user interface 610. And, the electronic device 100 determines, according to the correspondence recorded in the page remote control template file in the system control window application, that the preset game operation page of the game application a matches with the remote control template B. And thus remote control template B is displayed in user interface 630 in accordance with the record of the remote control template B in the template configuration file. The remote control template B includes preset 6 controls 631 to 636 for touch mapping conversion, a volume adjustment control 637, and a brightness adjustment control 638. The electronic device 100 displays the preset controls in the remote control templates B in the user interface 630 according to the preset arrangement mode in the page remote control template file. Wherein:

A control 631 for performing touch map conversion for converting a user's touch map of the control 631 into a touch to the direction operation control 601;

controls 632-635 for performing touch mapping conversion, which are used for converting the touch mapping of the user to the controls 632-635 into touches to the functional operation controls 602 a-602 d;

a control 636 for performing touch mapping conversion, configured to convert a user's touch mapping to the control 636 into a touch to a background song playing control 603;

Volume adjustment control 637, a control of the type that directly controls hardware, for adjusting the volume of electronic device 100;

Brightness adjustment control 638, also a control of the type that directly controls hardware, is used to adjust the brightness of electronic device 100.

In some embodiments, in the case where the electronic device 100 displays the remote control template B on the user interface 630 according to the record in the template configuration file for the first time, the electronic device 100 may prompt the user whether to modify the controls and the arrangement manner in the remote control template B. The confirmation window for the modification prompt may be launched in the user interface 620 or may be launched in the user interface 630, which is not limited herein.

An exemplary illustration of the validation window 641 for making modification prompts popping up in the user interface 620 is shown in FIG. 6C. The confirmation window 641 may include prompt information: "do remote control template modified? "and a determination control 641a and a negation control 641b.

In some embodiments, as shown in FIG. 6C, in the event that confirmation window 641 is flicked in user interface 620, two touch mapping transformed controls 642a and 642B corresponding to determination control 641a and negative control 641B, respectively, may also be displayed in remote control template B of user interface 630.

In some embodiments, in response to a user clicking on the determination control 641a or the touch map converted control 642a, as shown in fig. 6D, the electronic device 100 may change the remote control template B to an editable state in which the remote control template B may display an add control 643, and a modify complete control 644.

In some embodiments, in response to a user clicking on the add control 643 in an editable state as shown in fig. 6D, the electronic device 100 may display an add control selection window 650 in the user interface 630, where the add control selection window 650 may include a return previous control 651 and a next page control 652, and may include some preset controls for user selection to add to the remote control template B, as shown in fig. 6E. For example, these preset controls may include: any of the five types of controls described above, including, but not limited to, a return desktop control 653, a keyboard enter control 654, a microphone switch control 655, a touch map conversion control 656, and the like.

In some embodiments, in response to a user clicking on a return desktop control 653 in the user interface shown in fig. 6E, the electronic device 100 may add the return desktop control 653 to the remote control template B as shown in fig. 6F. The return desktop control 653 can be adjusted in position in the remote control template B by dragging the return desktop control 653 or clicking on the top right-hand fork of the control to delete the control from the remote control template B in an editable state.

If the user also wants to add other controls, the add control 643 can be clicked again.

If the user has completed the current control addition, then the modify complete control 644 may be clicked to obtain the remote control template B as shown in FIG. 6G. The electronic device 100 may save the modified content of the remote control template B into the template configuration file.

In some embodiments, in the editable state as shown in fig. 6D, the user may change any control in the remote control template B to the editable state by clicking on that control. Taking the example of the user clicking on the touch map converted control 631 to change it to an editable state, as shown in fig. 6H, a fork that can delete the control may be displayed in the upper right corner of the control 631. The user thereof may drag the control 631 to adjust its position in the remote control template B. Since the control 631 is a control for performing touch mapping conversion, a target area frame 661 for touch mapping conversion of the control 631 can also be displayed in the user interface 620 of the first display area. The user can adjust the target position of the control 631 for touch mapping conversion by dragging the position of the target region box 661.

If the user completes the modification of the control, the user may click on the modification completion control 644, and the electronic device 100 may save the content modified by the remote control template B in the template configuration file.

In some embodiments, if the user clicks the modification completion control 644 to complete the addition or modification of the control, or if the user clicks the negative control 641B or the touch map converted control 642B to determine not to modify the remote control template B in the case of popping up the confirmation window 641 in the user interface as shown in fig. 6C, the electronic device 100 may also display a template modification control in the remote control template B so that the user clicks into the template editing state as he needs to modify the remote control template B.

In some embodiments, where the electronic device 100 displays a user interface as shown in fig. 6G, in response to a user's operation of clicking the control 631 in the remote control template B in the second display area, the electronic device 100 may map the operation into a clicking operation on the background song play control 603 in the first display area, as shown in fig. 6I, displaying the user interface 670 in the first display area, and displaying the user interface 680 in the second display area. The user interface 670 is a background song selection interface for game application a and the user interface 680 is an interface of the remote control template C corresponding to the background song selection interface for game application a recorded in the page remote control template file. The specific configuration of the remote control template C is also recorded in the template configuration file.

The user interface 670 includes a display of songs being played and information for selectable songs. The remote control template C displayed in the user interface 680 includes:

a return desktop control 682 that belongs to control type 1 above;

A return previous control 683, a previous control 684, a play/pause control 685, and a next control 686 belonging to control type 2 described above;

Volume adjustment control 681 and microphone switch control 689 belonging to control type 3 described above;

Controls 687 and 688 for touch map conversion, belonging to control type 4 described above. Wherein control 687 is used to translate touch operations to the page up region of the selectable menu, and control 688 translates touch operations to the page down region of the selectable menu.

In some embodiments, if the electronic device 100 displays the remote control template C according to the record in the remote control template C at the user interface 680 for the first time, the electronic device 100 may also prompt the user whether to modify the controls and the arrangement manner in the remote control template C. Reference may be made specifically to the descriptions of fig. 6C-6H, which are not repeated here.

In some embodiments, in response to a user clicking on the return-to-previous-level control 683 in the user interface 680 shown in fig. 6I, the electronic device 100 can switch back to displaying the user interface shown in fig. 6G.

Scene II: taking a conference application B integrated with a system rack SDK as an example.

As shown in fig. 7A, a schematic diagram of an exemplary user interface 710 for the foldable electronic device 100 in an expanded state displaying the meeting page of the meeting application B full screen. The user interface 710 displays the screen information of the lecturer and the head portrait information of the other lecturer at the current weekly regular meeting in full screen.

It will be appreciated that by clicking on the display screen, control controls are displayed in the user interface 710 for the user to control the meeting for the currently ongoing weekly occasion.

In response to a user folding the electronic device 100 from the unfolded state shown in fig. 3 (a) to the stand state shown in fig. 3 (b), the display screen of the electronic device 100 is divided into two display areas: a first display area and a second display area. As shown in fig. 7B, the electronic device 100 displays the user interface 720 in a first display area and displays the user interface 730 in a second display area. The electronic device 100 continues to display the meeting page of the meeting application B in the user interface 720, with the same display as the user interface 710. And, the electronic device 100 determines, according to the corresponding relationship recorded in the page remote control template file in the system control window application, that the preset conference page matched with the conference application B is the remote control template D. And therefore, the remote controller template D is displayed on the user interface 730 according to the record of the remote controller template D in the template configuration file. The remote controller template D comprises:

A return desktop control 737 belonging to control type 1 above;

returning a previous control 731 belonging to the control type 2;

brightness adjustment control 732, volume adjustment control 733, microphone switch control 734, and speaker switch control 735 belonging to control type 3 described above;

a custom leave control 736 is reserved for conference application B belonging to control type 5 described above. The leaving control 736 is obtained by the developer of the conference application B through selecting and adding one UI element and interface preset in the system control window application in the remote controller template D through the system support state SDK integrated in the conference application B, and modifying the corresponding interface function in a self-defining manner. The leave control 736 is for leaving the currently ongoing meeting in response to a user operation. This is a function specific to the conference application B, which cannot be directly implemented by some system controls preset in the system control window application.

The conference application B may update the template configuration file when the conference application B is installed in the electronic device 100 through the remote controller template D modified by the integrated system support SDK, or may acquire the remote controller template D from the conference application B when the remote controller template D is needed, which is not limited herein.

It will be appreciated that in some embodiments, if the electronic device 100 displays the remote control template D on the user interface 730 according to the record in the page remote control template file for the first time, the electronic device 100 may prompt the user whether to modify the controls and the arrangement manner in the remote control template D. Reference may be made specifically to the descriptions of fig. 6C-6H, which are not repeated here.

The following describes the application control method in the implementation of the present application in detail with reference to the above-described software and hardware structure of the exemplary electronic device 100 and an exemplary user interface:

s801: the electronic equipment displays a functional page A of the application program A in a full-screen display area in an unfolded state;

as shown in fig. 1 (b), the electronic device has a full screen display area when in the unfolded state. The electronic device may perform full-screen display of the functional page a of the application program a in the full-screen display area.

In some embodiments, application A may also be referred to as a first application, and function page A may also be referred to as a first function page, without limitation.

For example, the electronic device may refer to the user interface shown in fig. 6A or fig. 7A for displaying the user interface of the function page a of the application program a in the full-screen display area, which is not described herein.

S802: responding to the operation of folding the electronic equipment into a bracket state by a user, and dividing the full-screen display area into a display area A and a display area B by the electronic equipment;

as shown in fig. 3, after the user folds the electronic device from the unfolded state to the stand state, the electronic device may divide the full-screen display area into a display area a and a display area B.

In some embodiments, the display area a may also be referred to as a first display area, and the display area B may also be referred to as a second display area, which is not limited herein.

S803: the electronic equipment displays the functional page A in the display area A;

after the electronic device divides the full-screen display area into a display area a and a display area B, the functional page a currently being displayed in the full-screen display area may be switched to be displayed in the display area a.

For example, reference may be made to a user interface 620 as in FIG. 6B, or a user interface 720 as in FIG. 7B, which is not described in detail herein.

S804: the electronic equipment determines a remote controller template A corresponding to the function page A;

the electronic device stores a preset page remote controller template file, and as shown in the above table 1, the preset page remote controller template file includes a correspondence relationship between an application identifier, a function page identifier and a remote controller template identifier, where a correspondence relationship between the application program a, the function page a and the remote controller template a may be recorded.

Thus, the electronic device can determine the remote controller template a corresponding to the functional page a of the application program a based on the preset page remote controller template file.

S805: the electronic equipment displays the remote controller template A in the display area B according to the configuration information of the remote controller template A recorded in the preset template configuration file;

the electronic equipment is also stored with a preset template configuration file, and the preset template configuration file stores configuration information such as the number, the size, the shape, the color, the interface elements to be displayed, the arrangement mode and the like of the controls to be displayed in the specific remote controller templates.

Therefore, according to the preset template configuration file, the electronic device can display the remote controller template A in the display area B according to the configuration information of the remote controller template A.

In some embodiments, only controls belonging to control type 1, control type 2, control type 3, or control type 4 described above are included in the remote control template a, such as the remote control module shown in user interface 630 in fig. 6B. In this case, the system support SDK may not be integrated in the application a, and the developer of the application a does not need to perform any development or adaptation work for the remote controller template a.

In some embodiments, the remote control template a may further include a control belonging to the control type 5, that is, a control whose third party application may customize the control function, for example, a remote control module shown in the user interface 730 in fig. 6B. In this case, the system support SDK needs to be integrated in the application program a, and the developer of the application program a does not need to edit other types of controls, and does not need to edit the UI of the control belonging to the control type 5, but only needs to select one of a plurality of preset third-party custom control UIs and then perform custom editing on the functions of the control.

In some embodiments, if the electronic device is to display the remote control template a in the display area B for the first time, the electronic device 100 may prompt the user whether the remote control template a needs to be modified. Reference may be made specifically to the descriptions of fig. 6C-6H, which are not repeated here.

In the embodiment of the application, after the user folds the electronic equipment from the unfolded state to the bracket state, the electronic equipment can switch the function page A of the application program A currently displayed to the display area A after the split screen for display, automatically determine the remote controller template A matched with the function page A of the application program A according to the preset page remote controller template file and the preset template configuration file in the electronic equipment, and display the remote controller template A in the display area B. Because the page remote controller template file and the template configuration file are both preset by the electronic equipment, even if a developer of the third party application does not develop a remote controller aiming at the support state of the electronic equipment, the electronic equipment can automatically display the remote controller template A capable of remotely controlling part of functions of the third party application in the display area B after the electronic equipment is switched to the support state when the third party application is operated and the functional page A is displayed, and the operability of the electronic equipment is greatly improved.

The following describes an exemplary procedure of the signaling interaction in the electronic device 100 when executing the steps S802 to S805 described above, in conjunction with the signaling interaction diagram shown in fig. 9 and the software structure of the electronic device 100 shown in fig. 4:

S901: the sensor detects a user folding screen and determines that the electronic equipment enters a bracket state;

s902: the sensor informs the window manager that the electronic device has entered a stand-by state;

s903: the window manager informs the support state control module of monitoring that the electronic equipment enters the support state;

s904: the bracket state control module informs the split screen controller layout module to start the bracket split screen;

S905: the split screen controller layout module sends a split screen instruction to the window manager, and divides a full screen display area into a display area A and a display area B to finish bracket split screen;

S906: the bracket state control module informs the running third party application program A that the functional page A of the application program A displayed in the full-screen display area is switched to the display area A after the bracket is split for display;

s907: the third party application program A transmits a remote controller template A to the bracket state control module;

In some embodiments, if a system support SDK is integrated in the third party application program a, and a developer uses the system support SDK to perform custom editing on a remote controller template a corresponding to a function page a of the third party application program a (for example, a control belonging to a control type 5 is added, or the arrangement, color, size, and the like of the control is adjusted), when the third party application program a receives a notification sent by the support control module that the function page a has been switched to the display area a for display, the custom edited remote controller template a may be issued to the support control module. The bracket state control module can add the corresponding relation among the third party application program A, the functional page A and the remote controller template A to a preset page remote controller template file, and add the configuration information of the remote controller template A to a preset template configuration file.

In some embodiments, if the third party application a does not have the integrated system rack SDK, step S907 may not be performed.

S908: the support state control module analyzes and loads the remote controller template A;

The support state control module can analyze configuration information of a remote controller template A matched with a functional page A of a third party application program A from a preset page remote controller template file and a preset template configuration file, and load the remote controller template A;

In the above embodiment, after the user folds the electronic device from the unfolded state to the stand state, the electronic device may switch the function page a of the application program a currently being displayed to the display area a for display, and automatically display the remote controller template a matched with the function page a in the display area B. In other embodiments, after the user exits the expanded screen of the electronic device from the stand state, the electronic device may no longer display the remote control template a, and may perform full-screen display on the functional page a in a full-screen display area formed by combining the display area a and the display area B. The following describes an exemplary signaling interaction process within the electronic device 100 in this process with reference to fig. 9:

S909: the sensor detects that a user expands the screen, and determines that the electronic equipment exits from the bracket state;

s910: the sensor informs the window manager that the electronic device has exited the stand-by state;

s911: the window manager informs the bracket state control module of monitoring that the electronic equipment exits from the bracket state;

S912: the bracket state control module informs the split screen controller layout module to destroy the remote controller window;

It is understood that the remote control window is a window displaying a remote control template.

S913: the split-screen controller layout module informs the window manager to destroy the remote controller window;

s914: after destroying the remote controller window, the window manager carries out full-screen display on the functional page A in a full-screen display area combined by the display area A and the display area B, and informs the third party application program A that the functional page A is displayed in a full screen mode.

As another embodiment of the present application, after step S805 of fig. 8, the application control method may further include the steps of:

s806: responding to the operation of a user on a control A on a remote controller template A, and executing the operation corresponding to the control A on a function page A in a display area A by the electronic equipment;

Control a may be of any of the 5 control types described above. In conjunction with the signaling interaction diagram shown in fig. 10 and the software structure of the electronic device 100 shown in fig. 4, an exemplary description is given below of how to trigger corresponding functions on the function page a in the display area a when the control a belongs to one of the 5 control types:

1. For example, the control a is a notification display control, is a control for directly controlling a desktop, and belongs to the control type 1 described above:

Responsive to a user operating the notification presentation control at the remote control window, the stent control proxy service may obtain a notification presentation instruction. Based on the notification display instruction, the support control proxy service can notify the desktop to display the notification message through the status bar, so that a function of displaying the notification message through the status bar can be triggered on the function page A.

2. For example, control a is a control that returns to the previous level, is a control that directly injects a mouse event, and belongs to control type 2 described above:

And responding to the operation of the user on the return previous control in the remote controller window, and the bracket control proxy service can acquire the return previous instruction. Based on the return last level instruction, the stent control proxy service can inject a return instruction into the third party application A through the input manager, so that the return last level function can be triggered on the function page A.

3. For example, control a is a brightness adjustment control, is a control that directly controls hardware, and belongs to control type 3 described above:

And responding to the operation of the user on the brightness adjustment control in the remote controller window, and acquiring the brightness adjustment instruction by the bracket control proxy service. Based on the brightness adjustment instruction, the cradle control proxy service may send a brightness adjustment instruction to the power manager, thereby implementing adjustment of brightness of the display area a in which the functional page a is displayed.

4. For example, the control a is a direction operation control, is a control for performing touch mapping conversion, and belongs to the control type 4;

In response to the user's operation of the directional operation control in the remote controller window, the cradle control proxy service may acquire the action of the touch operation and the coordinates of the touch operation in the directional operation control in the display area B, map to the display area a, and then send to the input manager. The input manager may transmit the mapped action of the touch operation and coordinates of the touch operation to the third party application a so as to respond to the operation in the function page a.

5. For example, the control a is a conference leaving control, is a control for reserving a custom button for a third party application, and belongs to the control type 5;

Responsive to a user operation of the conference departure control at the remote control window, the cradle control proxy service may obtain a conference departure instruction. Since the conference leave instruction is configured by the third party application a through the system bracket state SDK in a self-defining manner, the bracket control proxy service may send the conference leave instruction to the third party application a. After receiving the meeting leaving instruction, the third party application a can leave the currently ongoing meeting on the function page a based on the custom function configuration of the meeting leaving instruction.

S807: responding to display switching operation of a user, and displaying a functional page B of an application program A in a display area A by the electronic equipment;

In the case where the function page a of the application program a is displayed in the display area a of the electronic device and the remote controller template a corresponding to the function page a is displayed in the display area B, the user can switch to displaying other function pages of the application program a. For example, reference may be made to fig. 6H-6I, which are not repeated here.

In some embodiments, the functional page B may also be referred to as a second functional page, which is not limited herein.

S808: the electronic equipment determines a remote controller template B corresponding to the functional page B;

after the display area a of the electronic device is switched to the function page B of the display application program a, the electronic device may determine, according to a preset page remote controller template file, a remote controller template B corresponding to the function page B.

The corresponding relation among the application program A, the functional page B and the remote controller template B is recorded in a page remote controller template file preset in the electronic equipment.

In some embodiments, the remote control template B may also be referred to as a second remote control template, which is not limited herein.

S809: the electronic equipment displays the remote controller template B according to the configuration information of the remote controller template B recorded in a preset template configuration file;

Similar to step S805, a description thereof will not be repeated here.

S810: in response to a user operation of the remote controller template B on the control B in the display area B, the electronic equipment executes an operation corresponding to the control B on the function page B in the display area A.

Similar to step S806, a detailed description is omitted here.

In the embodiment of the application, because the preset page remote controller template file stores the corresponding relations of different application program identifications, function page identifications and remote controller template identifications, when the display area A is switched to display different function pages, the electronic equipment can display the remote controller template corresponding to the function page in the display area B, thereby further improving the operability of the electronic equipment.

It can be understood that, if the user switches the display area a to display one function page (e.g., the function page C) of another application (e.g., the application B), the electronic device will also display a remote controller template C corresponding to the function page C of the application B in the display area B, which is not described herein.

In the above embodiments, the electronic device is taken as an example of a folding screen electronic device, and the application control method in the embodiments of the present application is described. In some embodiments, the electronic device may be another multi-screen electronic device, for example, an in-vehicle electronic device including at least two display screens, for example, or a multi-screen electronic device formed by interconnecting a plurality of single-screen electronic devices, which is not limited herein. The display screen in the multi-screen electronic device may be used as a display area, or may execute the application control method in the embodiment of the present application, as shown in fig. 11, which is another flow chart of the application control method in the embodiment of the present application:

s1101, the electronic device displays a first function page of a first application program in a first display area;

the first display area is a display screen in the electronic device.

S1102, the electronic equipment determines a first remote controller template corresponding to a first functional page, and the corresponding relation among the first application program, the first functional page and the first remote controller template is recorded in a page remote controller template file preset in the electronic equipment;

S1103, the electronic device displays the first remote controller template in a second display area according to the configuration information of the first remote controller template recorded in the preset template configuration file.

The second display area is another display screen of the electronic device different from the first display area.

As another embodiment of the present application, the application control method may further include the steps of:

S1104, responding to the operation of a user on a first control on a first remote controller template, and executing the operation corresponding to the first control on a first functional page in a first display area by the electronic equipment;

S1105, responding to display switching operation of a user, and displaying a second functional page of the first application program on a first display area by the electronic equipment;

S1106, the electronic equipment determines a second remote controller template corresponding to a second functional page, and the corresponding relation among the first application program, the second functional page and the second remote controller template is recorded in a page remote controller template file preset in the electronic equipment;

S1107, the electronic equipment displays the second remote controller template in the second display area according to the configuration information of the second remote controller template recorded in the preset template configuration file;

S1108, responding to the operation of a user on a second control on the second remote controller template, and executing the operation corresponding to the second control on a second functional page in the first display area by the electronic equipment.

Steps S1101 to S1108 are similar to steps S803 to S810, and are not described here.

The above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.

As used in the above embodiments, the term "when …" may be interpreted to mean "if …" or "after …" or "in response to determination …" or "in response to detection …" depending on the context. Similarly, the phrase "at the time of determination …" or "if detected (a stated condition or event)" may be interpreted to mean "if determined …" or "in response to determination …" or "at the time of detection (a stated condition or event)" or "in response to detection (a stated condition or event)" depending on the context.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present application, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), etc.

Those of ordinary skill in the art will appreciate that implementing all or part of the above-described method embodiments may be accomplished by a computer program to instruct related hardware, the program may be stored in a computer readable storage medium, and the program may include the above-described method embodiments when executed. And the aforementioned storage medium includes: ROM or random access memory RAM, magnetic or optical disk, etc.

Claims

1. An application control method, applied to an electronic device having a folding screen, the method comprising:

when the electronic equipment is in an unfolding state, the electronic equipment displays a first functional page of a first application program in a full-screen display area, wherein the first functional page comprises at least one operable control, and the first application program is a third party application installed in the electronic equipment by a user;

Responding to the operation of folding the electronic equipment into a bracket state, dividing the full-screen display area into a first display area and a second display area by the electronic equipment, determining a first remote controller template corresponding to the first functional page by the electronic equipment, and recording the corresponding relation among the first application program, the first functional page and the first remote controller template in a page remote controller template file preset in the electronic equipment;

The electronic equipment displays the first functional page in a first display area of a foldable display screen, and displays the first remote controller template in a second display area according to configuration information of the first remote controller template recorded in a preset template configuration file, wherein the second display area is a display area different from the first display area in the electronic equipment; the content of the first functional page in the unfolding state and the support state is the same; the configuration information of the first remote controller template records the number, the size, the shape and the color of the controls to be displayed in the second display area in the first remote controller template, the interface elements to be displayed and the arrangement mode of the interface elements; the first remote controller template comprises a first control;

When the first control is a control for performing touch mapping conversion, the first remote controller template further comprises a corresponding position for performing touch mapping conversion on the first control, wherein the corresponding position is in the first display area, and the first control is triggered to be used for mapping touch operation on the first control into touch operation on the corresponding position; the corresponding position comprises a second control; triggering and executing the same operation through the first control and the second control;

when the first control is a control of the electronic equipment for reserving a custom button for the first application program, the first control and the custom operation interface of the first application program have a preset corresponding relation, and the first application program comprises a system support state software development kit SDK; the system support state SDK is used for displaying the first control on the second display area by the electronic equipment, and the function of the first control is determined by the system support state SDK; the system support SDK defines the operation which needs to be executed in the first application program after the user-defined operation interface of the first application program is called;

when the first control is a control for directly controlling a desktop, responding to the operation of the first control, and triggering and starting a system control function corresponding to the first control by the electronic equipment through a preset corresponding relation between the first control and a system control interface;

When the first control is a control directly injected with a keyboard event, responding to the operation of the first control, and executing the keyboard input control corresponding to the first control by the electronic equipment through the preset corresponding relation between the first control and an input control interface;

when the first control is a control for directly controlling hardware, responding to the operation of the first control, and controlling the hardware corresponding to the first control by the electronic equipment through the corresponding relation between the first control and the hardware control interface.

2. The method according to claim 1, wherein the method further comprises:

And responding to the operation of the user on the first control, and executing the operation corresponding to the first control on the first functional page in the first display area by the electronic equipment.

3. The method according to claim 1, wherein the method further comprises:

Displaying a modification prompt window by the electronic equipment under the condition that the electronic equipment displays the first remote controller template in the second display area for the first time, wherein the modification prompt window is used for prompting a user to select whether to modify the first remote controller template;

the electronic equipment changes the first remote controller template displayed in the second display area into an editable state under the condition that the operation of confirming to modify the first remote controller template is received;

And under the condition that the operation of confirming not to modify the first remote controller template is received, the electronic equipment displays a template modification control in the first remote controller template, wherein the template modification control is used for enabling the first remote controller template to be changed into an editable state after being triggered.

4. A method according to claim 3, characterized in that the method further comprises:

after the first remote controller template is modified, the electronic equipment updates the content modified by the first remote controller template into the preset template configuration file.

5. The method according to claim 1, wherein the method further comprises:

responding to display switching operation of a user, and displaying a second functional page of a first application program on the first display area by the electronic equipment, wherein the second functional page is different from the first functional page;

the electronic equipment determines a second remote controller template corresponding to the second functional page, and the corresponding relation among the first application program, the second functional page and the second remote controller template is recorded in the preset page remote controller template file;

and the electronic equipment displays the second remote controller template in the second display area according to the configuration information of the second remote controller template recorded in the preset template configuration file, wherein the second remote controller template is different from the first remote controller template.

6. The method of any of claims 1-5, wherein the electronic device is a multi-screen electronic device, the first display area is one display screen of the electronic device, and the second display area is another display screen of the electronic device.

7. An electronic device, the electronic device comprising: one or more processors and memory;

The memory is coupled with the one or more processors, the memory for storing computer program code comprising computer instructions that the one or more processors invoke to cause the electronic device to perform the method of any of claims 1-6.

8. A chip system for application to an electronic device, the chip system comprising one or more processors to invoke computer instructions to cause the electronic device to perform the method of any of claims 1-6.

9. A computer program product comprising instructions which, when run on an electronic device, cause the electronic device to perform the method of any of claims 1-6.

10. A computer readable storage medium comprising instructions which, when run on an electronic device, cause the electronic device to perform the method of any of claims 1-6.