CN112445276A

CN112445276A - Folding screen display application method and electronic equipment

Info

Publication number: CN112445276A
Application number: CN201910817212.1A
Authority: CN
Inventors: 李卫; 李岳朋; 韦行海
Original assignee: Huawei Technologies Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2019-08-30
Filing date: 2019-08-30
Publication date: 2021-03-05
Also published as: WO2021036830A1

Abstract

The embodiment of the application provides a folding screen display application method and electronic equipment, relates to the technical field of electronics, and can improve the time utilization rate of a user in an application waiting scene and improve user experience in the process of using the electronic equipment by the user. The folding screen display application method is applied to electronic equipment comprising a folding screen, and specifically comprises the following steps: when the electronic equipment is in an unfolding state, displaying a first interface on the folding screen, wherein the first interface is a display interface of a first application; responding to the electronic equipment which is changed from the unfolded state to the folded state, displaying a second interface on a main screen of the electronic equipment, and continuously running a first application on the electronic equipment in a background, wherein the second interface is a display interface of the second application or the main interface of the electronic equipment, and the running state of the first application in the background is consistent with the running state of the first application in the foreground; in response to the electronic device transitioning from the folded state to the unfolded state, the electronic device displays a first interface.

Description

Folding screen display application method and electronic equipment

Technical Field

The embodiment of the application relates to the technical field of electronics, in particular to a method for displaying applications on a folding screen and electronic equipment.

Background

Currently, when a user operates an application on an electronic device, some waiting scenes exist in the application. For example, the process of matching the companions in a mobile game requires the user to wait for a certain time before joining the game team. For another example, a video application installed in a mobile phone may play an advertisement for a certain period of time before the video application plays a video, and the video application needs to start playing the video after the advertisement is played.

For some users, these waiting times are too long, which may result in the user wanting to switch to another application, and when the user switches back to the application again after switching to another application, it may be found that a wait again is necessary. For example, if the user switches the mobile phone application in the waiting scene of the game application, the game application will be suspended directly, and when the game application is switched to the foreground, the user needs to continue waiting from a previously cut-out time point or needs to reconnect with the server, which results in low time utilization rate of the user in the waiting scene and poor user experience.

Disclosure of Invention

The embodiment of the application provides a folding screen display application method and electronic equipment, and the time utilization rate of a user in an application waiting scene can be improved and the user experience can be improved in the process that the user uses the electronic equipment.

In order to achieve the technical purpose, the embodiment of the application adopts the following technical scheme:

in a first aspect, an embodiment of the present application provides a method for a folded screen display application, where the method may be applied to an electronic device including a folded screen, and the electronic device may be folded such that the folded screen forms a plurality of display areas, and the method may include: when the electronic equipment is in an unfolding state, displaying a first interface on the folding screen, wherein the first interface is a display interface of a first application; responding to the electronic equipment which is changed from the unfolded state to the folded state, displaying a second interface on a main screen of the electronic equipment, and continuously running a first application on the electronic equipment in a background, wherein the second interface is a display interface of the second application or the main interface of the electronic equipment, and the running state of the first application in the background is consistent with the running state of the first application in the foreground; in response to the electronic device transitioning from the folded state to the unfolded state, the electronic device displays a first interface.

When the electronic equipment is respectively in the unfolding state and the folding state, different application interfaces are displayed so as to meet the operation habits of users under different screen sizes. In addition, when the electronic equipment is changed from the unfolding state to the folding state, the running state of the first application in the background is consistent with the running state of the foreground, so that the electronic equipment is in the unfolding state after being unfolded, the first interface is displayed, for example, the first interface is a waiting scene, a user can display the second application through the folding electronic equipment, the time utilization rate of the user in the application waiting scene is improved, and better experience is brought to the user.

With reference to the first aspect, in one possible implementation, the first interface includes waiting information, and the method further includes: when the electronic equipment displays the first interface, the electronic equipment is changed from the unfolded state to the folded state, and the electronic equipment continues to run the first application in the background according to the first instruction of the waiting information; the first instruction is used for indicating the first application to continue running in the background according to the running state of the foreground.

It is to be appreciated that if wait information is included in the first interface, the electronic device can determine that the first interface is an interface of a wait scene. In response to the electronic device being changed from the unfolded state to the folded state, the electronic device may continue to run the first application in the background according to the first instruction of the waiting information. Because the running state of the first application in the background is consistent with the running state of the foreground, the utilization rate of the user on the waiting time in the first interface is improved, and the user experience is improved.

With reference to the first aspect, in one possible implementation, the electronic device continues to run the first application in the background, including: the electronic device intercepts a PAUSE command transmitted to the first application. Generally, when the electronic device switches an application from a foreground running to a background running, the electronic device may transmit a PAUSE command to the application. The PAUSE command is used to instruct the corresponding application to run in the background. In response to the PAUSE command, the application is decomposed into states in which processes run in the background, not in the foreground. In this embodiment, the electronic device may intercept the PAUSE command transmitted to the first application, so that the first application may continue to run in the background according to the foreground running state.

With reference to the first aspect, in another possible implementation, the electronic device continues to run the first application in the background, including: and the electronic equipment transmits a second instruction to the first application, wherein the second instruction is used for indicating the first application to continue to operate according to the foreground operation state.

With reference to the first aspect, in one possible implementation, the second interface may further include waiting information. The waiting information in the second interface can prompt the user of the waiting duration of the first application in real time, so that the user can control the electronic equipment to run the first application in the foreground when the waiting duration reaches, and the user cannot miss the time when the waiting duration of the first application is ended.

With reference to the first aspect, in one possible implementation, after the electronic device continues to run the first application in the background, before the electronic device redisplays the first interface in response to the electronic device transitioning from the collapsed state to the expanded state, the method further includes: when the remaining waiting time of the waiting message is over, or the preset time before the remaining waiting time of the waiting message is over, the electronic equipment displays a first prompt message; the first prompt message is used for indicating that the remaining waiting time of the waiting message is finished or about to be finished.

When the remaining waiting time of the waiting message is over, or the preset time before the remaining waiting time of the waiting message is over, the electronic device displays the first prompt message, which can be used for prompting the user to control the electronic device to run the first application in the foreground as soon as possible.

With reference to the first aspect, in a possible implementation manner, the displaying, by the electronic device, the first prompt information includes displaying, by the electronic device, the first prompt information on the second interface when the electronic device is in a folded state.

With reference to the first aspect, in a possible implementation manner, in response to the electronic device being converted from the folded state to the unfolded state, the electronic device displays a first interface, specifically including: when the remaining waiting time of the waiting information is over or after the remaining waiting time of the waiting information is over, the electronic equipment responds to the fact that the electronic equipment is changed from the folded state to the unfolded state, and displays a display interface of the first application after the remaining waiting time is over.

With reference to the first aspect, in one possible implementation manner, the remaining waiting duration may be included in the first instruction. The method may further comprise: the electronic equipment identifies the waiting information of the first interface and determines the remaining waiting time.

With reference to the first aspect, in one possible implementation, the second interface may be a display interface of a second application. The second application is one in which the electronic device runs in the background. Or the second application is an application in which the running times or running duration of the electronic device in a preset time is greater than a preset threshold. Alternatively, the second application is a preconfigured application in the electronic device.

With reference to the first aspect, in one possible implementation, when the electronic device continues to run the first application in the background, the method may further include: the electronic device may play audio information of the first application.

With reference to the first aspect, in one possible implementation, the waiting for information includes: a countdown icon, text information of waiting duration or pause information, etc.

In a second aspect, an embodiment of the present application provides an electronic device, including: a folding screen, memory, and one or more processors; the electronic device may be folded such that the folded screen forms a plurality of display areas; the folding screen, the memory, and the one or more processors are coupled. The memory is configured to store computer program code comprising computer instructions that, when executed by the one or more processors, control the foldable screen to display a first interface when the electronic device is in the unfolded state, the foldable screen being configured to display the first interface under the control of the processor, wherein the first interface is a display interface of a first application. The processor is further configured to, in response to the electronic device being converted from the unfolded state to the folded state, control the main screen of the electronic device in the folded state to display the second interface, and run the first application in the background, and the folded screen is configured to control the main screen of the electronic device in the folded state to display the second interface, where the second interface is a display interface of the second application or the second interface is a main interface of the electronic device, and a state of the first application running in the background is consistent with a state of the first application running in the foreground. The processor is further configured to control the foldable screen to display the first interface in response to the electronic device transitioning from the folded state to the unfolded state, and the foldable screen is further configured to display the first interface under control of the processor.

With reference to the second aspect, in a possible implementation manner, the first interface includes waiting information, and the processor is further configured to continue to run the first application in the background according to a first instruction of the waiting information after the electronic device is converted from the unfolded state to the folded state, where the first instruction is used to instruct the first application to continue to run in the background according to the foreground running state.

With reference to the second aspect, in a possible implementation manner, the processor is further configured to control the foldable screen to display the first prompt message when the remaining waiting duration of the waiting message is ended or at a preset time before the remaining waiting duration of the waiting message is ended, and the foldable screen is further configured to display the first prompt message under the control of the processor, where the first prompt message is used to indicate that the remaining duration of the waiting message is ended or is about to be ended.

With reference to the second aspect, in a possible implementation manner, when the electronic device is in a folded state, the processor is further configured to control the main screen in the folded state to display the first prompt message on the second interface, and the folding screen is further configured to display the first prompt message on the second interface.

With reference to the second aspect, in a possible implementation, the processor is further configured to control the foldable screen to display the display interface of the first application after the remaining waiting duration of the waiting information is ended in response to the electronic device being converted from the foldable state to the unfolded state when the remaining waiting duration of the waiting information is ended or after the remaining waiting duration of the waiting information is ended, and the foldable screen is further configured to display the display interface of the first application after the remaining waiting duration is ended.

With reference to the second aspect, in a possible implementation manner, the processor is further configured to identify waiting information in the first interface and determine a waiting duration.

With reference to the second aspect, in a possible implementation manner, the processor is further configured to play audio information of the first application.

In a third aspect, an embodiment of the present application further provides a chip system, where the chip system is applied to an electronic device including the folding screen. The electronic device may be folded such that the folded screen forms a plurality of display areas, the system-on-chip including one or more interface circuits and one or more processors. The interface circuit and the processor are interconnected by a line. The interface circuit is configured to receive a signal from a memory of the electronic device and to transmit the signal to the processor, the signal including computer instructions stored in the memory. When the processor executes the computer instructions, the electronic device performs the method as in the first aspect and any of its possible embodiments.

In a fourth aspect, embodiments of the present application provide a computer storage medium comprising computer instructions that, when executed on an electronic device, enable the electronic device to perform a method as in the first aspect and any possible implementation thereof.

In a fifth aspect, embodiments of the present application provide a computer program product, which when run on a computer causes the computer to perform the method according to the first aspect and any possible design thereof.

It is to be understood that beneficial effects achieved by the electronic device in the second aspect and any one of the possible implementations thereof, the chip system in the third aspect, the computer storage medium in the fourth aspect, and the computer program product in the fifth aspect can be referred to the beneficial effects in the first aspect and any one of the possible implementations thereof, and are not described herein again.

Drawings

Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 2 is a schematic structural diagram of another electronic device according to an embodiment of the present disclosure;

fig. 3 is a schematic hardware structure diagram of an electronic device according to an embodiment of the present disclosure;

fig. 4A is a schematic diagram illustrating a principle of calculating an included angle α between a screen a and a screen B according to an embodiment of the present application;

fig. 4B is a schematic diagram of an example of a geographic coordinate system according to an embodiment of the present disclosure;

fig. 5 is a schematic diagram illustrating an example software architecture of an electronic device according to an embodiment of the present disclosure;

fig. 6 is a schematic view of a display interface of an electronic device according to an embodiment of the present disclosure;

fig. 7 is a flowchart of a method for displaying and applying a foldable screen according to an embodiment of the present application;

FIG. 8 is a schematic view of a display interface of another electronic device according to an embodiment of the present application;

FIG. 9 is a schematic view of a display interface of another electronic device according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of a chip system according to an embodiment of the present disclosure.

Detailed Description

In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present embodiment, "a plurality" means two or more unless otherwise specified.

Taking an example that an Android system is installed on the electronic device, when the electronic device runs an application program, the electronic device system keeps an application process as long as possible. In the using process of the electronic equipment, when an application is quitted by a user and is not immediately checked and killed by the system, but when the memory of the Android system is insufficient, in order to establish a new process, or run a more important process for the system, or ensure the fluency of the system, the system can kill some processes according to the priority to recycle the memory. The Android system may determine which process to kill according to the relative importance degree of the processes of the different application programs to the user, or the Android system may determine which process to kill according to an application white list in the electronic device. Background keep-alive means that a process can run all the time in the background and keep in an undamaged state. For example: when the WeChat application runs in the background, the WeChat application can still receive messages sent by other electronic equipment, namely when the WeChat application runs in the background, if the system memory is insufficient, other processes kill in the WeChat application can be kept alive only, and the processes receiving the messages are kept alive. It can be understood that the method for keeping the process alive is that the system does not kill the process, that is, the system notifies the service program performing killing operation to skip the target process. Therefore, when an application runs in the background, the application is kept alive in the background, and the state of the application running in the background is not consistent with the state of the application running in the foreground, but certain processes of the application are guaranteed not to be killed by the system.

In a specific application, when the application run by the electronic device is a video application, in the process of playing the video, if it is detected that the user exits from the operation of the video application, the video application is switched to be run in the background by the electronic device. When the user switches back to the video application again, the electronic device cannot directly display the video interrupted by the last playing of the video application, but displays an interface of the video application. This approach does not guarantee that the application continues to run in the background. Particularly, when a current scene in one application is a waiting scene, such as advertisement playing time, leader video playing time or trailer video playing time in a video application, or a scene in which a player is waiting to join in a game application, and the like, in the waiting scene, a user can switch to other applications in the electronic device, and when the user switches back to the application again, the user still needs to continue waiting in the waiting scene, and background keep-alive can only ensure that the application is not killed, and cannot ensure that the application continues to run in the background.

For the electronic equipment comprising the folding screen, the application switching mode is similar to the electronic equipment with the non-folding screen, and the application switching mode cannot exert the characteristics of the electronic equipment with the folding screen. And the existing background keep-alive mode cannot really ensure that the application continues to run in the background. When a user uses an electronic device including a folding screen, the time utilization rate of the user in a waiting scene of an application should be improved, and a better experience is provided for the user.

Therefore, the application method of the folding screen display provided by the embodiment of the application can be applied to the electronic equipment comprising the folding screen, and in the using process of the electronic equipment, when the electronic equipment is in the unfolding state and the folding state, the electronic equipment displays different application interfaces. When the electronic equipment is in the unfolding state, the folding screen displays the interface of the first application. When the electronic device is converted from the unfolded state to the folded state, the electronic device displays the interface or the main interface of the second application, and the electronic device can continue to run the first application in the background. And the state of the first application running in the background is consistent with the state of the first application running in the foreground. When the electronic equipment is converted from the folded state to the unfolded state, the electronic equipment displays the display interface of the first application again. When the application runs in a background keep-alive mode, the running state of the application can be really guaranteed to be consistent with the running state of the foreground, and user experience is improved.

The electronic device including the folding screen in the embodiment of the application can be divided into two types: the electronic device with the foldable screen turned outwards is the one, and the electronic device with the foldable screen turned inwards is the other. The electronic device may be foldable such that the folded screen forms a plurality of display areas, e.g., the electronic device may be foldable along a fold screen edge or fold axis to form a first screen and a second screen.

For example, fig. 1 is a schematic product form of an electronic device folded outward according to an embodiment of the present application, and fig. 1 (a) is a schematic form of the electronic device 100 folded outward when fully unfolded. The electronic device 100 may be folded along the folding edge in the direction shown in fig. 1 (a) to form the first screen and the second screen shown in fig. 1 (b), the electronic device 100 may be further folded along the folding edge to form the form schematic diagram of the electronic device 100 shown in fig. 1 (c) after being completely folded, and the first screen and the second screen are opposite to each other after being completely folded by the electronic device 100. When the electronic device is in a folded state, the first screen or the second screen can be displayed as a main screen.

It is understood that when the electronic device is in the folded state, the interface may be displayed on the first screen or the second screen; when the electronic device is in the unfolded state, the interface can be displayed on the first screen and the second screen. The description of the unfolded state and the folded state of the electronic device may refer to the description of the following embodiments, which are not described herein.

For another example, please refer to fig. 2, which is a schematic product form diagram of an inward-folded electronic device 100 according to an embodiment of the present application. Fig. 2 (a) is a schematic view of the electronic device 100 folded inward in a fully unfolded state. The electronic apparatus 100 may be folded along the folded edge in the direction shown in fig. 2 (a) to form the first screen and the second screen shown in fig. 2 (b). The electronic device 100 continues to be folded along the folding edge, and the completely folded electronic device 100 shown in fig. 2 (c) can be formed. The electronic device 100 is fully folded with the first screen and the second screen opposite, both of which are not visible to the user. A line 201 shown in (c) of fig. 2 indicates a plane where the first screen and the second screen are in contact. In addition, the inwardly turned electronic device may further include a third screen. The third screen is arranged on the back of the first screen or the second screen. It will be appreciated that for an inwardly folded electronic device, the third screen is visible to the user in both the folded and unfolded states. When the electronic equipment is in a folded state, the interface is displayed on the third screen, and when the electronic equipment is in an unfolded state, the interface can be displayed on the first screen and the second screen.

It is worth mentioning that, for the electronic device turned outwards, when the electronic device is in the folded state, the first screen or the second screen may be used as the main screen. For the electronic equipment turned inwards, when the electronic equipment is in a folded state, the first screen and the second screen are invisible to a user, and the third screen is used as a main screen.

Generally, the included angle α between the first screen and the second screen of the electronic device including the foldable screen (including the electronic device folded outward and the electronic device folded inward) is in a range of [0 °, 180 ° ]. In the embodiment of the application, if alpha is [0 DEG, P ], the electronic equipment can be determined to be in a folded state; if α ∈ (P, 180 ° ], the electronic device may be determined to be in the unfolded state, or, if α ∈ [0 °, P), the electronic device may be determined to be in the folded state; if α ∈ [ P, 180 ° ], it can be determined that the electronic device is in the unfolded state. Where P is a preset angle threshold. P may be determined according to the usage habit of a large number of users using the folding screen; alternatively, P may be set in the electronic device by the user.

In some embodiments, when the angle α between the first screen and the second screen is greater than 90 °, the probability that the user wants to use the first screen and the second screen as a whole (i.e., as a complete display screen) is high according to the usage habit of most users. Therefore, the preset angle threshold P in the embodiment of the present application may be greater than 90 °. The value range of the preset angle threshold P may be (90 °, 180 °). For example, the preset angle threshold P may be 100 °, 120 °, 135 °, 140 °, 145 °, 150 °, or the like.

It should be noted that, at least two screens formed by folding the electronic device (including the electronic device turned inward and the electronic device turned outward) in the embodiment of the present application may be multiple screens that exist independently, or may be a complete screen of an integrated structure, and only is folded to form at least two parts.

For example, the folded screen may be a flexible folded screen. The flexible folding screen comprises a folding edge made of flexible materials. Part or all of the flexible folding screen is made of flexible materials. At least two screens formed by folding the flexible folding screen are a whole screen of an integral structure, and only the flexible folding screen is folded to form at least two parts.

For another example, the foldable screen of the electronic device may be a multi-screen foldable screen. The multi-screen folding screen may include a plurality (two or more) of screens. The plurality of screens are a plurality of individual display screens. The plurality of screens may be connected in turn by a folding shaft. Each screen can rotate around a folding shaft connected with the screen, and folding of the multi-screen folding screen is achieved.

In fig. 1 and fig. 2, the foldable screen in the embodiment of the present application is described by taking the foldable screen as an example. In addition, in the following embodiments of the present application, the method provided in the embodiments of the present application is also described by taking the foldable screen as a flexible foldable screen as an example.

For example, the electronic device in the embodiment of the present application may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a Personal Digital Assistant (PDA), an Augmented Reality (AR) \ Virtual Reality (VR) device, and the like including the above-mentioned folding screen, and the embodiment of the present application does not particularly limit the specific form of the electronic device.

Embodiments of the present application will be described in detail below with reference to the accompanying drawings. Please refer to fig. 3, which is a schematic structural diagram of an electronic device 100 according to an embodiment of the present disclosure. As shown in fig. 3, the electronic device 100 may include: the mobile terminal includes a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identity Module (SIM) card interface 195, and the like.

The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, and a bone conduction sensor 180M.

It is to be understood that the illustrated structure of the present embodiment does not constitute a specific limitation to the electronic apparatus 100. In other embodiments, electronic device 100 may include more or fewer components than shown, or combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.

The controller may be a neural center and a command center of the electronic device 100. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

It should be understood that the interface connection relationship between the modules illustrated in the present embodiment is only an exemplary illustration, and does not limit the structure of the electronic device 100. In other embodiments, the electronic device 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charging management module 140 is configured to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In some other embodiments, the power management module 141 may also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be disposed in the same device.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation.

The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.

The wireless communication module 160 may provide a solution for wireless communication applied to the electronic device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like.

The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150 and antenna 2 is coupled to wireless communication module 160 so that electronic device 100 can communicate with networks and other devices through wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), Long Term Evolution (LTE), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The electronic device 100 implements display functions via the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like.

The electronic device 100 may implement a shooting function through the ISP, the camera 193, the video codec, the GPU, the display 194, the application processor, and the like.

The ISP is used to process the data fed back by the camera 193. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. Applications such as intelligent recognition of the electronic device 100 can be realized through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

In the embodiment of the application, the NPU may identify the first interface of the first application through a picture identification algorithm, and determine a countdown duration of a countdown icon in the first interface of the first application.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

The internal memory 121 may be used to store computer-executable program code, which includes instructions. The processor 110 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121. For example, in the embodiment of the present application, the processor 110 may execute instructions stored in the internal memory 121, and the internal memory 121 may include a program storage area and a data storage area.

The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, phone book, etc.) created during use of the electronic device 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

The electronic device 100 may implement audio functions via the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110. The speaker 170A, also called a "horn", is used to convert the audio electrical signal into an acoustic signal. The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals.

The headphone interface 170D is used to connect a wired headphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used for sensing a pressure signal, and converting the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194.

The pressure sensor 180A may be a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, or the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic apparatus 100 may also calculate the touched position from the detection signal of the pressure sensor 180A. In some embodiments, the touch operations that are applied to the same touch position but different touch operation intensities may correspond to different operation instructions. In the embodiment of the present application, the electronic device 100 may collect, by the pressure sensor 180A, a pressing force (or referred to as a pressing pressure) of a touch operation input by a user on the touch screen (i.e., the display screen 194).

The gyro sensor 180B may be used to determine the motion attitude of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., the x, y, and z axes) may be determined by gyroscope sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects a shake angle of the electronic device 100, calculates a distance to be compensated for by the lens module according to the shake angle, and allows the lens to counteract the shake of the electronic device 100 through a reverse movement, thereby achieving anti-shake. The gyroscope sensor 180B may also be used for navigation, somatosensory gaming scenes. In the embodiment of the present application, the foldable screen of the electronic device 100 may be folded to form a plurality of screens. A gyro sensor 180B may be included in each screen for measuring the orientation (i.e., the directional vector of the orientation) of the corresponding screen. The electronic device 100 may determine the included angle between adjacent screens according to the measured angle change of the orientation of each screen.

It should be noted that, in the embodiment of the present application, the electronic device includes a foldable screen, and the foldable screen is divided into a plurality of display areas after the electronic device is folded, where each display area is referred to as a screen. A gyro sensor 180B may be included on each screen to measure the orientation (i.e., the directional vector of the orientation) of the corresponding screen. For example, as shown in fig. 1 (B), the electronic device is folded to form a first screen and a second screen, and the first screen and the second screen are both provided with a gyroscope sensor 180B therein, so that the orientations of the first screen and the second screen can be measured respectively. And the electronic equipment determines the included angle between the first screen and the second screen according to the measured orientation angle change of each screen.

For example, the electronic apparatus 100 is folded to form a first screen (illustrated as a screen) and a second screen (illustrated as B screen) illustrated in fig. 4A, the a screen is provided with the gyro sensor a, and the B screen is provided with the gyro sensor B. Here, the present embodiment describes a principle that the gyro sensor a measures the orientation of the a screen (i.e., the directional vector of the orientation), the gyro sensor B measures the orientation of the B screen (i.e., the directional vector of the orientation), and a principle that the electronic apparatus 100 calculates the angle α between the a screen and the B screen based on the orientation of the a screen and the orientation of the B screen.

Wherein the coordinate system of the gyro sensor is a geographical coordinate system. As shown in fig. 4B, the origin O of the geographic coordinate system is located at the point where the vehicle (i.e., the device containing the gyro sensor, such as the electronic device 100) is located, the x-axis points east (E) along the local latitudes, the y-axis points north (N) along the local meridian, and the z-axis points upward along the local geographic vertical line, and forms a right-hand orthogonal coordinate system with the x-axis and the y-axis. The plane formed by the x axis and the y axis is the local horizontal plane, and the plane formed by the y axis and the z axis is the local meridian plane. Thus, it can be understood that the coordinate system of the gyro sensor is: the gyroscope sensor is used as an origin O, the east direction along the local latitude line is used as an x axis, the north direction along the local meridian line is used as a y axis, and the upward direction along the local geographical vertical line (namely the opposite direction of the geographical vertical line) is used as a z axis.

The electronic apparatus 100 can measure the direction vector of the orientation of each screen in the coordinate system of the gyro sensor provided therein, using the gyro sensor 180B provided in each screen. For example, referring to the side view of the electronic device as shown in fig. 4A, the directional vector of the orientation of the a-screen measured by the electronic device in the coordinate system of gyro sensor a is vector z1, and the directional vector of the orientation of the B-screen in the coordinate system of gyro sensor B is vector z 2. The electronic device 100 utilizes equation (1):

the angle θ between vector z1 and vector z2 can be calculated.

As can be seen from fig. 4A, since the vector z1 is perpendicular to the a screen and the vector z2 is perpendicular to the B screen, the angle α between the a screen and the B screen can be obtained as 180 ° - θ. That is, the electronic device can determine the angle α between the a screen and the B screen according to the measured direction vector of the a screen in the coordinate system of the gyro sensor a (i.e., vector z1) and the direction vector of the B screen in the coordinate system of the gyro sensor B (i.e., vector z 2).

It should be noted that although the positions of the gyro sensors disposed in the a-screen and the B-screen do not overlap, that is, the origins of the coordinate systems of the gyro sensors disposed in the a-screen and the B-plane do not overlap, the x-axis, the y-axis, and the z-axis of the two coordinate systems are parallel, so that the coordinate systems of the gyro sensors disposed in the a-screen and the B-screen can be considered to be parallel. Thus, although the vector z1 and the vector z2 are not in the same coordinate system, the angle θ between the vector z1 and the vector z2 can be calculated by the above equation (1) because the axes of the two coordinate systems are parallel.

In some embodiments, the angle α between the a screen and the B screen can also be measured by one or more other sensors. For example, one acceleration sensor 180E may be provided in each of the folding screens. The electronic device 100 (e.g., the processor 110) may measure the motion acceleration of each screen as it is rotated using the acceleration sensor; and then calculating the rotation angle of one screen relative to the other screen according to the measured motion acceleration, namely the included angle alpha between the screen A and the screen B.

In other embodiments, the gyro sensor 180B may be a virtual gyro sensor formed by combining other sensors. The virtual gyroscope sensor can be used for calculating the included angle between adjacent screens of the folding screen, namely the included angle alpha between the screen A and the screen B.

The magnetic sensor 180D includes a hall sensor. The electronic device 100 may detect the opening and closing of the flip holster using the magnetic sensor 180D.

The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. The method can also be used for recognizing the posture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light to the outside through the light emitting diode. The electronic device 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100.

The ambient light sensor 180L is used to sense the ambient light level. Electronic device 100 may adaptively adjust the brightness of display screen 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 180L may also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 can utilize the collected fingerprint characteristics to unlock the fingerprint, access the application lock, photograph the fingerprint, answer an incoming call with the fingerprint, and so on.

The temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 implements a temperature processing strategy using the temperature detected by temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 performs a reduction in performance of a processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, the electronic device 100 heats the battery 142 when the temperature is below another threshold to avoid the low temperature causing the electronic device 100 to shut down abnormally. In other embodiments, when the temperature is lower than a further threshold, the electronic device 100 performs boosting on the output voltage of the battery 142 to avoid abnormal shutdown due to low temperature.

The touch sensor 180K is also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may be disposed on a surface of the electronic device 100, different from the position of the display screen 194.

In this embodiment, the electronic device 100 may detect a touch operation input by a user on the touch screen through the touch sensor 180K, and acquire one or more items of a touch position, a touch area, a touch direction, and a touch time of the touch operation on the touch screen. In some embodiments, the electronic device 100 may determine the touch position of the touch operation on the touch screen by combining the touch sensor 180K and the pressure sensor 180A.

The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The electronic apparatus 100 may receive a key input, and generate a key signal input related to user setting and function control of the electronic apparatus 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration cues, as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be brought into and out of contact with the electronic apparatus 100 by being inserted into the SIM card interface 195 or being pulled out of the SIM card interface 195. The electronic device 100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support a Nano SIM card, a Micro SIM card, a SIM card, etc.

The methods in the following embodiments may be implemented in the electronic device 100 having the above-described hardware structure.

The software system of the electronic device 100 may employ a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes an Android system with a layered architecture as an example, and exemplarily illustrates a software structure of the electronic device 100.

Fig. 5 is a block diagram of a software structure of the electronic device 100 according to an embodiment of the present disclosure. The layered architecture can divide the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into three layers, which are an application layer (referred to as an application layer), an application framework layer (referred to as a framework layer), and a kernel layer (also referred to as a driver layer) from top to bottom.

Wherein the application layer may comprise a series of application packages. As shown in fig. 5, the application layer may include a plurality of application packages such as application 1 and application 2. For example, the application package may be a camera, gallery, calendar, phone call, map, navigation, WLAN, bluetooth, music, video, short message, and desktop Launcher (Launcher) application.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. As shown in fig. 5, the framework layer may include a Window Manager (WMS), an Activity Manager (AMS), a content provider and view system, and the like. Optionally, the framework layer may further include a telephony manager, a resource manager, a notification manager, etc. (not shown in the drawings).

Among them, the window manager WMS is used to manage the window program. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like. The Activity manager AMS is used for managing Activity and is used for starting, switching and scheduling each component in the system, managing and scheduling application programs and the like.

The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

The view system may retrieve a stored data file through a content provider when constructing an interface (e.g., a desktop including application icons) and display the interface according to the retrieved data file. In some embodiments, modifications may also be made to the data files stored in the content provider when the interface is built.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver. The kernel layer is a layer between hardware and software. The kernel layer may contain display drivers, input/output device drivers (e.g., keyboard, touch screen, headphones, speakers, microphones, etc.), camera drivers, audio drivers, and sensor drivers, among others.

The kernel layer may generate a responsive input event (e.g., a folding screen unfolding event) according to the input operation and report the event to the application framework layer. Interface display (including a display mode of a main interface, a window display mode and the like) is set by an activity management server AMS of an application framework layer. And the window management server WMS of the application framework layer draws an interface according to the setting of the AMS, then sends the interface data to the display driver of the kernel layer, and the display driver displays the corresponding interface on the folding screen.

The display scheme provided by the embodiment of the application is realized based on a free window (freeform) characteristic of google and a multi-window multi-task infrastructure. The display process provided by the embodiment of the present application can be seen in fig. 5. As shown in fig. 5, in an embodiment of the present application, the Activity manager AMS may include an Activity native management module and an Activity extension module. The Activity native management module is used for managing Activity, and is responsible for starting, switching and scheduling each component in the system, managing and scheduling application programs and the like. The Activity expansion module is used for setting a display mode, a window display mode and the like of the main interface according to the folding state or the unfolding state of the folding screen.

It is understood that, during the process of displaying the interface on the electronic device 100, the foldable screen of the electronic device 100 may be switched from the folded state to the unfolded state or from the unfolded state to the folded state. At this time, the folding driver (i.e., input/output device driver) of the driver layer may detect the folding event input by the user. In the embodiment of the present application, the folding event may be triggered by the operation of the user controlling the folding screen to be converted from the folding state to the unfolding state, and is referred to as a folding event 1. Alternatively, the folding event may be triggered by a user controlling the operation of the folding screen from the unfolded state to the folded state, and is referred to as a folding event 2. The collapse driver may report the collapse event to a window manager WMS of the framework layer (i.e., the application framework layer).

The window manager WMS may listen to a collapse event, and may determine to switch a display size after listening to the collapse event. The window manager WMS transmits a display change event to the activity manager AMS, and the activity manager AMS sets the window mode and the attributes of the window. When monitoring the folding event 1, the window manager WMS may determine that the display becomes large, and send a display change event 1 to the activity manager AMS. The display change event 1 is used for triggering the activity manager AMS to switch the window mode from the full-screen mode to the multi-window mode or the single-window mode, and to adjust the attributes of the window. The view system acquires data in the content provider, determines a displayed application interface, and the activity manager acquires the display interface in the view system and displays the interface of the first application. When the window manager WMS listens to the collapse event 2, it may be determined that the display becomes small, and the display change event 2 is transmitted to the activity manager AMS. The display change event 2 is used to trigger the activity manager AMS to switch the window mode from the multi-window mode or the single-window mode to the full-screen mode, and to adjust the attributes of the window. The view system acquires data in the content provider, determines a displayed application interface, and the activity manager acquires the display interface in the view system and displays an interface of a second application.

Illustratively, if the first application is a game application, the electronic device is in an unfolded state, and the display interface of the first application is displayed on the folding screen. As shown in fig. 6 (a), when the first application is a game application, the interfaces of the game friends are matched. The electronic device is converted from the unfolded state to the folded state, and the electronic device displays an interface of the second application. As shown in fig. 6 (b), the display interface of which the first application is "WeChat". After a preset time, for example, 20 seconds, the electronic device is changed from the folded state to the unfolded state, and the electronic device displays the interface of the first application. As shown in fig. 6 (c), the electronic device is converted from the folded state to the unfolded state, and the electronic device displays the display interface of the first application.

For example, the electronic device is in an unfolded state and the folding screen displays an interface of a first application. In response to the display change event 2, the activity manager AMS may request the window manager WMS to draw a window and call a display driver display interface: the electronic equipment is in a folded state, the folding screen is divided into a plurality of display areas, and the interface or the main interface of the second application is displayed on the main screen of the electronic equipment in the folded state. In response to the display change event 1, the activity manager AMS may request the window manager WMS to draw a window and call a display driver display interface to: the folding screen of the electronic equipment is in an unfolding state, and an interface of the first application is displayed on the folding screen.

The following description will be made on a folding screen display application method in the present application, taking an electronic device as a mobile phone, and taking the mobile phone as an outward-folded mobile phone as an example. When the mobile phone which is turned outwards is in a folded state, the first screen or the second screen can be used as a main screen. The flow of the method is shown in fig. 7, and includes steps 701-703:

step 701: when the mobile phone is in the unfolding state, a first interface is displayed on the folding screen.

The first interface is a display interface of the first application. Illustratively, the first application may be any application program in the cell phone. For example, the first application may be a video application, a gaming application, a text messaging application, or an instant messaging application (e.g., WeChat), among others. When the first application is operated in the foreground, the mobile phone can be a display interface of the first application.

Step 702: and responding to the mobile phone converted from the unfolding state to the folding state, displaying a second interface on a main screen of the mobile phone, and continuously running the first application on the background by the mobile phone.

And the second interface is a display interface of the second application or a main interface of the mobile phone. The main interface of the mobile phone can comprise a plurality of application icons.

For example, the second application may be an application that the handset runs in the background; or the second application is any application of which the running times or running duration of the mobile phone in the preset time is greater than a preset threshold; or the second application is a pre-configured application in the mobile phone.

For example, in a preset time, the mobile phone counts the number of times each application is run or the running duration of each application, and if the number of times each application is run in the mobile phone application, which is "wechat", "microblog", and "QQ", exceeds a preset threshold, the mobile phone may select any one of the applications as the second application.

It should be noted that, in the embodiment of the present application, when the mobile phone runs the first application in the background, the running state of the first application in the background is consistent with the running state of the first application in the foreground.

The embodiment of the present application describes a specific method in which, in response to the mobile phone being converted from the unfolded state to the folded state, the mobile phone continues to run the first application in the background.

For example, if the first interface in the first application matches a scene for a game player when the mobile phone is in the expanded state, as shown in (a) in fig. 6, the scene matches a scene for another game player for the mobile phone user in the game application, where a countdown 601 is set in the scene, and when the mobile phone is changed from the expanded state to the collapsed state, the countdown duration of the first application is not suspended but may continue to count down as it is in the foreground state when the first application is in the background operation. For example, when the mobile phone is in the extended state, the remaining waiting time of the countdown of the first application is 20 seconds. And in response to the mobile phone being changed from the unfolded state to the folded state, the first application is switched to the background to continue running, and the main screen of the mobile phone displays the interface of the second application. And after the second application runs for 10 seconds in the foreground, the mobile phone is changed from the folded state to the unfolded state, the mobile phone displays the first application, and the remaining waiting time of countdown of the first application is 10 seconds. That is, when the first application runs in the background, the remaining wait period in the countdown icon of the first application does not stop, but can continue to count down in the background.

It should be noted that the Activity lifecycle in the Android system may include: 1) when the Activity is started, the system calls the onCreate method, then calls the onStart method, and finally calls the onResume, and the Activity enters a running state. 2) When the current Activity is overlaid or locked by other activities, the system calls the onPause method to pause the execution of the current Activity. 3) When the current Activity returns to the foreground from the covered state or the screen is unlocked, the system calls the onResume method and enters the running state again. 4) When the current Activity is transferred to a new Activity interface or a Home key is pressed to return to the main screen, and the system exits from the background, the system calls the onPause method firstly and then calls the onsop method to enter a stagnation state. 5) When the user falls back to the Activity, the system calls the onRestart method, then calls the onStart method, and finally calls the onResume method to enter the running state again. 6) The current Activity is in a covered state or a background invisible state, namely 2) and 4), the system memory is insufficient, the current Activity is killed, and then when the user returns the current Activity, the onCreate method, the onStart method and the onResume method are called again to enter a running state. 7) When the user exits the current Activity, the system calls the onPause method, then calls the onsop method, and finally calls the onDestore method to finish the current Activity.

According to the lifecycle of Activity in the Android system, when the mobile phone runs the first application on the foreground, the mobile phone responds to the situation that the mobile phone is changed from the unfolded state to the folded state, the mobile phone displays an interface of the second application on the main screen, the mobile phone switches the first application to the background to run, and the first application belongs to 4 of the lifecycle), the system calls an onPause () interface, and after the system calls the onPause () interface, the first application is suspended. Namely, when the mobile phone runs the second application in the foreground, the first application is suspended in the background. It will be appreciated that when the first application pauses in the background, the remaining wait period in the countdown icon for the first application will also pause without continuing to count down in the background.

Therefore, in the embodiment of the present application, the mobile phone continues to run the first application in the background according to the foreground running state, specifically: and when the mobile phone runs the first application in the background, continuously counting down the waiting time in the waiting information in the first interface.

The mobile phone can continue to run the first application in the background according to the foreground running state through the following two implementation modes.

Implementation (1): in response to the handset transitioning from the unfolded state to the folded state, the handset intercepts a PAUSE command transmitted to the first application.

When the first application runs in the background, the mobile phone intercepts a PAUSE command transmitted to the first application, so that the running state of the first application in the background is consistent with the running state of the first application in the foreground. For example, the handset does not call the onPause () interface. That is, when the first application runs in the background, the system does not call the onPause () interface, and the first application will not receive the PAUSE command sent by the system, so that the first application can continue to run in the background, the remaining waiting time of the first application will not be suspended, and the countdown can continue in the background.

Implementation (2): when the first application runs in the background, the mobile phone transmits a second instruction to the first application, and the second instruction is used for indicating the first application to continue running according to the running state of the foreground.

For example, when the first application runs in the background, the mobile phone may call the onPause () interface, and transmit the second instruction through the onPause () interface, to instruct the first application to continue to run according to the state of the foreground running. For example, when the first application runs in the background, the mobile phone may call the onPause () interface and transmit the second instruction through the onPause () interface, and at this time, the first application may continue to run in the background as it is in the foreground running state. For example, the remaining wait period for the first application may continue to count down in the background as it would in the foreground. In this implementation, when the mobile phone transmits the continue operation instruction through the onPause () interface, the operation logic of the first application needs to be modified.

Step 703: and responding to the mobile phone converted from the folding state to the unfolding state, and displaying a first interface by the mobile phone.

It can be understood that when the mobile phone is changed from the unfolded state to the folded state, the first application continues to run in the background, and the main screen of the mobile phone displays the second application. After the second application runs for the preset time, the mobile phone is changed from the folded state to the unfolded state, the mobile phone displays a first interface, the first application also runs for the preset time in the background, and the first interface is the display interface after the first application continues to run for the preset time in the background. As shown in fig. 6, (a) shows a first interface when the first application is a game application, (b) shows a display interface when the mobile phone is converted from the folded state to the unfolded state and displays the second application (for "WeChat"), and (c) shows a display interface when the mobile phone is converted from the folded state to the unfolded state and displays the first interface. The first interface is an interface of a game matched player, the time is 30 seconds when the countdown 601 is included in the diagram, the mobile phone is changed from the folding state to the unfolding state after the second interface runs for 20 seconds in the foreground, the mobile phone displays the first interface, and the countdown 601 in the first interface is 10 seconds.

Optionally, the first interface may further include waiting information. When the mobile phone is converted from the unfolding state to the folding state, the first application can be operated in the background according to the waiting information. For example, in response to the mobile phone being converted from the unfolded state to the folded state, the mobile phone continues to run the first application in the background according to the first instruction of the waiting message. The first instruction is used for indicating the first application to continue running in the background according to the running state of the foreground.

It is to be understood that the mobile phone may further identify that the first interface is an interface of a waiting scene according to waiting information included in the first interface. For example, when the first application is a game application, the first interface may be a game player matching interface shown in (a) of fig. 6, and it is necessary to wait for other players to join the game and then start the game. For another example, when the first application is a game application, the first interface may be a waiting interface when the game character dies, and the game character can resume the game after waiting for a preset time. For another example, the first application is a video application, the first interface may be an advertisement playing interface before playing the video, and the video needs to be played after the advertisement playing time is over.

For example, the waiting information of the first interface may include a waiting time. For example, the first interface is the game player matching interface shown in (a) in fig. 6, the waiting time 601 is 30 seconds, and the waiting time 601 is the time for waiting for other players to join the game. The current scenes in the application are all waiting scenes when the user needs to wait for a period of time, and the mobile phone can identify the waiting scenes in the application.

For example, the manner of identifying the current scene of the application as the waiting scene by the mobile phone may be that a scene identification channel is set in the mobile phone, where the scene identification channel may include a function, and the scene identification channel may identify the current scene of the application. For example, a first Application runs in the foreground, and a Software Development Kit (SDK) of the first Application may establish a connection with a scene recognition channel through an Application Program Interface (API). The scene recognition channel recognizes a first interface currently displayed by the first application and determines that the interface is an interface waiting for a scene. Or, the SDK of the first application sends a display instruction to the controller of the mobile phone through the API, where the display instruction is used to indicate that the first interface of the first application is a waiting scene.

It can be understood that the mobile phone may also use other manners to identify the display interface of the first application running in the foreground as the waiting scene, and the specific manner is not limited.

For example, the mobile phone may identify waiting information in the first interface, and if it is determined that the first interface includes the waiting information, determine that the first interface is a waiting interface. The waiting information in the first interface may be a countdown icon, a waiting duration text information, a pause information, or the like. For example, when the mobile phone recognizes that the first interface includes characters such as "advertisement time", "wait for matching", "wait for revival", or "countdown", it determines that the interface is a waiting interface.

When the user uses the mobile phone, the mobile phone is in an unfolded state. If the first interface is an interface of a waiting scene, the user wants to use other applications in the waiting time of the waiting scene, the mobile phone responds to the situation that the mobile phone is changed from the unfolding state to the folding state, the main screen of the mobile phone displays the second application, and the mobile phone runs the first application in the background. In order to provide better user experience, the mobile phone may remind the user when the waiting time in the waiting scene is over or about to be over, so that the user does not miss the time when the waiting time is over.

In some embodiments, the second interface may include wait information.

Illustratively, the first interface is an interface of a waiting scene, waiting information in the waiting scene is identified, and the waiting information in the first interface is displayed on the second interface. Or identifying the waiting information in the waiting scene, determining the remaining waiting time in the waiting information, and displaying the remaining waiting time on the second interface in a countdown mode. As shown in fig. 8 (a), the second interface is a "WeChat" interface, and the waiting information in the first interface is displayed on the second interface in a countdown manner.

In some embodiments, the second interface may also display the first prompt message. And when the remaining waiting time of the waiting message is finished, the mobile phone displays the first prompt message. Or, the mobile phone displays the first prompt message within a preset time before the remaining waiting time of the waiting message is finished. The first prompt message is used for indicating that the remaining waiting time of the waiting message is finished or about to be finished.

Illustratively, the first interface is an interface of a waiting scenario, and the remaining waiting duration in the waiting scenario is identified. As shown in fig. 8 (b), when the first application continues to run in the background, the mobile phone may obtain the remaining waiting duration in the first interface in real time, and when it is determined that the remaining waiting duration is over or is about to be over, display the first prompt message in the "WeChat" application interface.

For example, during use of the mobile phone by the user, the mobile phone is in an expanded state and the first application is a game application (e.g., Royal). The interface in the game application is an interface in which a game character dies to wait for revival, as shown in fig. 9 (a). When the mobile phone detects a folding event of the user, the mobile phone is changed from the unfolded state to the folded state, and the mobile phone displays an interface of a second application, wherein the second application is ' WeChat ', as shown in (b) of FIG. 9, wherein the ' WeChat ' interface includes waiting time of ' Rong of King. After the second application runs in the foreground for a preset time, for example, 30 seconds, the mobile phone detects the expansion event of the user, the mobile phone is changed from the folded state to the expanded state, the mobile phone displays an interface of 'glory of the king person', as shown in fig. 9 (c), the game role resumes, and the game continues. Since the first application continues to run in the background, the mobile phone may obtain the waiting time in the first application, and if it is detected that the game waiting time is less than 1 second, the mobile phone displays a pop-up prompt, as shown in fig. 9 (d). The change of the display interface of the mobile phone can be switched from (a) in fig. 9 to (b) in fig. 9, and from (b) in fig. 9 to (c) in fig. 9; alternatively, the process is switched from fig. 9 (a) to fig. 9 (b), from fig. 9 (b) to fig. 9 (d), and from fig. 9 (d) to fig. 9 (c).

In other embodiments, the mobile phone may further play audio information of the first application while the mobile phone runs the first application in the background and runs the second application in the foreground to display the second interface.

In one case, the handset runs the second application without using the audio resources of the handset. The mobile phone can play the audio information of the first application running in the background by using the audio resource. For example, the second application is a reading application, the user does not use the audio resource, the first application is a game application, and the first application can play game background music by using the audio resource of the mobile phone.

In another case, the handset needs to use the audio resources of the handset to run the second application. Therefore, resource conflict exists between the audio information of the first application played by the mobile phone through the audio resource and the audio information of the second application played by the mobile phone through the audio resource. In this case, the mobile phone may use the audio resource to play the audio information of the second application running in the foreground; or, the mobile phone may use the audio resource to play the audio information of the first application running in the background in the foreground motion state; or, the mobile phone may play the audio information of the application with higher priority in the first application and the second application by using the audio resource.

For example, when the audio of the first application and the audio of the second application conflict, the mobile phone may close the audio of the first application and play the audio of the second application. For example, when the mobile phone runs the "WeChat" on the foreground and runs the "Rong Ren glory" on the background, if the user clicks the voice information sent by the WeChat friend or plays the video or audio in the WeChat application, it can be considered that the audio of the "WeChat" and the "Rong Ren glory" conflicts, and the mobile phone closes the audio of the "Rong Ren glory" and plays the audio of the "WeChat".

In other embodiments, the mobile phone may run the second application in the foreground, and may always turn off the audio of the first application when the first application is running in the background, regardless of whether the audio of the first application and the audio of the second application conflict.

The mobile phone in the embodiment of the application can respond to the change of the state and display different application interfaces. The method specifically comprises the steps of displaying an interface of a first application in an expansion state, responding to the change from the expansion state to a folding state, displaying an interface of a second application by the mobile phone, and enabling the first application to run in a background, wherein the running state of the first application in the background is consistent with the running state in a foreground. And responding to the mobile phone converted from the folded state to the unfolded state, and displaying a display interface of the first application by the mobile phone. The time utilization rate under the waiting scene can be improved, and the user experience is improved.

Other embodiments of the present application provide an electronic device, which may include: the folding screen, memory, and one or more processors described above. The folding screen, memory and processor are coupled. The memory is for storing computer program code comprising computer instructions. When the processor executes the computer instructions, the electronic device may perform various functions or steps performed by the mobile phone in the above-described method embodiments. The structure of the electronic device may refer to the structure of the electronic device 100 shown in fig. 3.

The embodiment of the present application further provides a chip system, as shown in fig. 10, the chip system includes at least one processor 1001 and at least one interface circuit 1002. The processor 1001 and the interface circuit 1002 may be interconnected by wires. For example, the interface circuit 1002 may be used to receive signals from other devices (e.g., a memory of an electronic device). Also for example, the interface circuit 1002 may be used to send signals to other devices, such as the processor 1001. Illustratively, the interface circuit 1002 may read instructions stored in the memory and send the instructions to the processor 1001. The instructions, when executed by the processor 1001, may cause the electronic device to perform the various steps in the embodiments described above. Of course, the chip system may further include other discrete devices, which is not specifically limited in this embodiment of the present application.

The embodiment of the present application further provides a computer storage medium, where the computer storage medium includes computer instructions, and when the computer instructions are run on the electronic device, the electronic device is enabled to execute each function or step executed by the mobile phone in the foregoing method embodiment.

The embodiment of the present application further provides a computer program product, which when running on a computer, causes the computer to execute each function or step executed by the mobile phone in the above method embodiments.

Through the description of the above embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical functional division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another device, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, that is, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partially contributed to by the prior art, or all or part of the technical solutions may be embodied in the form of a software product, where the software product is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A folding screen display application method, applied to an electronic device including a folding screen, the electronic device being foldable such that the folding screen forms a plurality of display areas, the method comprising:

when the electronic equipment is in an unfolded state, displaying a first interface on the folding screen, wherein the first interface is a display interface of a first application;

in response to the electronic device being converted from the unfolded state to the folded state, displaying a second interface on the main screen when the electronic device is in the folded state, and continuing to run the first application on the background by the electronic device, wherein the second interface is a display interface of the second application or the second interface is a main interface of the electronic device, and the state of the first application running on the background is consistent with the state of the first application running on the foreground;

in response to the electronic device transitioning from the collapsed state to the expanded state, the electronic device displays the first interface.

2. The method of claim 1, wherein the first interface includes wait information; the method further comprises the following steps:

when the electronic device displays the first interface, the electronic device is changed from the unfolded state to the folded state, and the electronic device continues to run the first application in the background according to the first instruction of the waiting information;

the first instruction is used for indicating the first application to continue to run in the background according to the running state of the foreground.

3. The method of claim 1 or 2, wherein the electronic device continues to run the first application in the background, comprising:

the electronic equipment intercepts a PAUSE command transmitted to the first application;

alternatively, the first and second electrodes may be,

and the electronic equipment transmits a second instruction to the first application, wherein the second instruction is used for indicating the first application to continue to operate according to the state of the foreground operation.

4. The method of claim 2, wherein the second interface further comprises the wait information.

5. The method of claim 2 or 4, wherein in response to the electronic device transitioning from the unfolded state to the folded state, the home screen while the electronic device is in the folded state displays a second interface, and wherein after the electronic device continues to run the first application in the background,

before the electronic device displays the first interface in response to the electronic device transitioning from the folded state to the unfolded state, the method further comprises:

when the remaining waiting time of the waiting message is finished or the preset time before the remaining waiting time of the waiting message is finished, the electronic equipment displays a first prompt message;

the first prompt message is used for indicating that the remaining waiting time of the waiting message is finished or about to be finished.

6. The method of claim 5, wherein the electronic device displays a first prompt comprising:

and when the electronic equipment is in the folded state, displaying the first prompt message on the second interface.

7. The method according to claim 5 or 6, wherein the electronic device displaying the first interface in response to the electronic device transitioning from the folded state to the unfolded state comprises:

the electronic equipment is in wait for when the remaining wait duration of information finishes or wait for after the remaining wait duration of information finishes, respond to the electronic equipment by fold condition changes into expand the state, the electronic equipment shows after the remaining wait duration finishes the display interface of first application.

8. The method of claim 2, wherein the first instruction includes a remaining wait duration, the method further comprising:

and the electronic equipment identifies the waiting information of the first interface and determines the remaining waiting time.

9. The method of any of claims 1-8, wherein the second interface is a display interface of the second application;

the second application is an application that the electronic device runs in the background; alternatively, the first and second electrodes may be,

the second application is any application of which the running times or running duration of the electronic equipment in a preset time is greater than a preset threshold; alternatively, the first and second electrodes may be,

the second application is a pre-configured application in the electronic device.

10. The method of any of claims 1-9, wherein the electronic device continues to run the first application in the background, the method further comprising:

and the electronic equipment plays the audio information of the first application.

11. The method according to any of claims 2, 4-8, wherein the waiting information comprises: a countdown icon, a waiting duration text message, or a pause message.

12. An electronic device, characterized in that the electronic device comprises: a folding screen, memory, and one or more processors; the electronic device may be folded such that the folded screen forms a plurality of display areas; the folding screen, the memory, and the one or more processors are coupled; the memory for storing computer program code comprising computer instructions which, when executed by the one or more processors, cause the electronic device to perform the method of any of claims 1-11.

13. A chip system, wherein the chip system is applied to an electronic device comprising a folding screen; the electronic device may be folded such that the folded screen forms a plurality of display areas; the chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected through a line; the interface circuit is to receive a signal from a memory of the electronic device and to send the signal to the processor, the signal comprising computer instructions stored in the memory; the electronic device performs the method of any of claims 1-11 when the processor executes the computer instructions.

14. A computer storage medium comprising computer instructions that, when executed on an electronic device, cause the electronic device to perform the method of any of claims 1-11.

15. A computer program product, characterized in that, when the computer program product is run on a computer, it causes the computer to perform the method according to any of claims 1-11.