CN117389437A

CN117389437A - Multi-window display method and equipment

Info

Publication number: CN117389437A
Application number: CN202210791020.XA
Authority: CN
Inventors: 李伟; 张亚男; 何天璐
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2022-07-05
Filing date: 2022-07-05
Publication date: 2024-01-12
Also published as: WO2024007966A1

Abstract

The application discloses a multi-window display method and equipment, and relates to the field of electronic equipment. The method comprises the following steps: the electronic equipment displays a first window on a display screen in a full screen manner, and displays a second window in a first area of the display screen; the second window is positioned on the upper layer of the first window, and the display area of the second window is smaller than that of the first window; the electronic equipment receives a first operation, wherein the first operation is used for indicating to display a virtual keyboard; in response to the first operation, the electronic device displays a second window in a second area of the display screen, displays a first window in a third area of the display screen, and displays a virtual keyboard in a fourth area of the display screen; wherein the second region, the third region and the fourth region do not overlap each other. Therefore, the virtual keyboard can be prevented from shielding the content displayed in the window, and the use experience of a user for using multi-window display can be improved.

Description

Multi-window display method and equipment

Technical Field

The present disclosure relates to the field of electronic devices, and in particular, to a method and an apparatus for displaying multiple windows.

Background

At present, terminals such as mobile phones are electronic devices with high use frequency in daily life and work of people. A great part of life and work of people can be completed on the mobile phone. In order to improve the processing efficiency of the mobile phone, the mobile phone can be displayed in multiple windows, and different contents can be displayed in each window, so that a user can conveniently process services in different windows respectively. However, when the user uses multiple windows, the user experience is affected due to the problems of the virtual keyboard shielding interface content and the like.

Disclosure of Invention

The embodiment of the application provides a multi-window display method and equipment, which can avoid shielding window contents when a virtual keyboard is called out and improve the input efficiency of a terminal.

In order to achieve the above purpose, the present application adopts the following technical scheme:

in a first aspect, the present application provides a multi-window display method, which may be applied to an electronic device, the method including: the electronic equipment displays a first window on a display screen in a full screen manner, and displays a second window in a first area of the display screen; the second window is positioned on the upper layer of the first window, and the display area of the second window is smaller than that of the first window; the electronic equipment receives a first operation, wherein the first operation is used for indicating to display a virtual keyboard; in response to the first operation, the electronic device displays a second window in a second area of the display screen, displays a first window in a third area of the display screen, and displays a virtual keyboard in a fourth area of the display screen; wherein the second region, the third region and the fourth region do not overlap each other.

According to the method, when the electronic equipment displays the virtual keyboard, the size of the full-screen window can be automatically adjusted, so that the virtual keyboard is prevented from shielding window display contents.

In one possible design, the first region and the second region are identical. That is, the size and position of the second window may not be adjusted, and only the position and size of the first window may be adjusted.

In one possible design, the first region is different from the second region. The second window displayed in the first area is the same as the second window displayed in the second area in size; alternatively, the second window displayed in the first region is different in size from the second window displayed in the second region, and the second window displayed in the second region is smaller in size than the second window displayed in the first region. That is, the size/position of the second window may also be adjusted.

In one possible design, the size of the second window displayed in the second area is smaller than the size of the second window displayed in the first area, comprising: the height of the second window displayed in the second area is smaller than the height of the second window displayed in the first area.

In one possible design, the electronic device displays a second window in a second area of the display screen, a first window in a third area of the display screen, and a virtual keyboard in a fourth area of the display screen, including: the electronic equipment draws a virtual keyboard in a fixed area of the display screen; the fourth area is the fixed area; the electronic device determines the area except the virtual keyboard in the display screen as a drawing area allowing drawing of the application window; the electronic equipment draws a first window and a second window in the drawing area; the drawing region includes a second region and a third region.

In the implementation manner, the first window and the second window are drawn in the area except the virtual keyboard, so that the virtual keyboard can be prevented from shielding the window display content.

In one possible design, the electronic device scales the first window from a first size to a second size. By the method, the content displayed by the first window can be proportionally adjusted.

In one possible design, in response to the first operation, the electronic device displays a second window in a second area of the display screen and a first window in a third area of the display screen, including: in response to the first operation, reducing the first window to enable the second window to be displayed in the second area of the display screen, and enabling the first window to be displayed in the third area of the display screen; or, in response to the first operation, zooming out the first window, moving up and left, or moving up and right the second window such that the second window is displayed in the second area of the display screen and the first window is displayed in the third area of the display screen; or, in response to the first operation, zooming out the first window, moving up and left, or moving up and right the second window, and zooming out the second window such that the second window is displayed in the second area of the display screen and the first window is displayed in the third area of the display screen.

In one possible design, the second region, the third region, and the fourth region fill the display region of the display screen.

In the implementation manner, the display area of the display screen is just filled with the second window displayed in the second area, the first window displayed in the third area and the fourth window displayed in the virtual keyboard, so that the display efficiency of the display screen and the attractiveness of interface display can be improved.

In one possible design, the method further comprises: the electronic device receives a drag operation acting on adjacent edges of the first window and the second window; in response to the drag operation, the electronic device controls the second region to be adjusted to a fifth region, and controls the third region to be adjusted to a sixth region, the fifth region displaying the second window, the sixth region displaying the first window.

In the implementation manner, after the first window and the second window are automatically adjusted, the user can further adjust the sizes of the first window and the second window, so that the flexibility of multi-window display is improved.

In one possible design, the first operation is an operation that acts on the second window. For example, the first operation is an operation of an input box acting on the second window.

In one possible design, the method further comprises: the electronic device receives a second operation acting on the first window or the second window; and responding to the second operation, enabling the virtual keyboard to disappear, enabling the electronic equipment to display a first window on the display screen in a full screen mode, and displaying a second window in a first area of the display screen.

In the implementation manner, after the virtual keyboard disappears, the first window and the second window can restore the original display state, and the operation experience of the user can be improved.

In one possible design, the method further comprises: the electronic equipment receives a first preset operation; responding to the first preset operation, the electronic equipment displays a second window on the display screen in a full screen mode, and displays a first window in a seventh area of the display screen; wherein the first region and the seventh region are the same or different.

In this implementation manner, the electronic device may switch the display modes of the first window and the second window through a first preset operation.

In a second aspect, the present application provides a multi-window display method, which may be applied to an electronic device, the method including: the electronic equipment displays a first window on a display screen in a full screen manner, and displays a second window in a first area of the display screen; the second window is positioned on the upper layer of the first window, and the display area of the second window is smaller than that of the first window; the electronic equipment receives a first preset operation; responding to the first preset operation, the electronic equipment displays a second window on the display screen in a full screen mode, and displays a first window in a seventh area of the display screen; wherein the first region and the seventh region are the same or different.

In one possible design, the first preset operation is a gesture operation acting on the second window, or the first preset operation is a click operation acting on a switch control of the second window.

Through the method provided by the application, the electronic equipment can conveniently switch the display modes of the full-screen window and the small window through the first preset operation, so that the experience of using multi-window display by a user is improved.

In a third aspect, a display apparatus is provided, the apparatus being applicable to an electronic device, the apparatus may include: the display unit is used for displaying a first window on a display screen of the electronic equipment in a full screen mode, and displaying a second window in a first area of the display screen; the second window is positioned on the upper layer of the first window, and the display area of the second window is smaller than that of the first window; an input unit for receiving a first operation for instructing display of a virtual keyboard; the display unit is also used for responding to the first operation, displaying a second window in a second area of the display screen, displaying a first window in a third area of the display screen and displaying a virtual keyboard in a fourth area of the display screen; wherein the second region, the third region and the fourth region do not overlap each other.

In a fourth aspect, a display device is provided, the device being applicable to an electronic apparatus, the device may include: the display unit is used for displaying a first window on a display screen of the electronic equipment in a full screen mode, and displaying a second window in a first area of the display screen; the second window is positioned on the upper layer of the first window, and the display area of the second window is smaller than that of the first window; an input unit for receiving a first preset operation; the display unit is also used for responding to the first preset operation, the electronic equipment displays a second window on the display screen in a full screen manner, and displays the first window in a seventh area of the display screen; wherein the first region and the seventh region are the same or different.

In a fifth aspect, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by an electronic device, cause the electronic device to implement the method as in the first aspect or any of the possible implementations of the first aspect, or to implement the method as in the second aspect or any of the possible implementations of the second aspect.

In a sixth aspect, an electronic device is provided that includes a display screen, one or more processors, and a memory; the display screen, the processor and the memory are coupled; the memory is used to store computer program code comprising computer instructions which, when executed by an electronic device, cause the electronic device to perform the method according to the first aspect or any of the possible implementations of the first aspect or to perform the method according to the second aspect or any of the possible implementations of the second aspect.

In a seventh aspect, a computer program product is provided, comprising computer readable code, or a non-transitory computer readable storage medium carrying computer readable code, which when run in an electronic device, a processor in the electronic device performs the method of any one of the first aspect or possible implementations of the first aspect, or performs the method of any one of the second aspect or possible implementations of the second aspect.

It will be appreciated that the advantages achieved by the display device according to the third aspect, the display device according to the fourth aspect, the computer readable storage medium according to the fifth aspect, the electronic apparatus according to the sixth aspect, and the computer program product according to the seventh aspect provided above may refer to the advantages as in the first aspect and any one of the possible implementations thereof, and the advantages as in the second aspect and any one of the possible implementations thereof, which are not repeated herein.

Drawings

Fig. 1 is a schematic diagram of a display interface in the related art according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a display interface according to another related art provided in an embodiment of the present application;

FIG. 3 is a schematic diagram of a display interface according to another related art according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a display interface according to another related art according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 6 is a schematic diagram of a software architecture of an electronic device according to an embodiment of the present application;

fig. 7 is a schematic diagram of a multi-window display method according to an embodiment of the present application;

FIG. 8 is a schematic diagram of a display interface according to an embodiment of the present disclosure;

FIG. 9 is a schematic diagram of another multi-window display method according to an embodiment of the present application;

FIG. 10 is a schematic diagram of yet another multi-window display method according to an embodiment of the present application;

FIG. 11 is a schematic diagram of yet another multi-window display method according to an embodiment of the present application;

FIG. 12 is a schematic diagram of yet another multi-window display method according to an embodiment of the present application;

FIG. 13 is a schematic diagram of yet another multi-window display method according to an embodiment of the present application;

FIG. 14 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application;

FIG. 15 is a schematic diagram of yet another multi-window display method according to an embodiment of the present application;

FIG. 16 is a schematic diagram of yet another multi-window display method according to an embodiment of the present application;

FIG. 17 is a schematic diagram of yet another multi-window display method according to an embodiment of the present application;

fig. 18 is a schematic software structure of an electronic device according to an embodiment of the present application;

FIG. 19 is a schematic flow chart diagram of a multi-window display method provided in an embodiment of the present application;

FIG. 20 is a schematic flow chart of another multi-window display method provided in an embodiment of the present application

Fig. 21 is a schematic diagram of a display device according to an embodiment of the present disclosure;

fig. 22 is a schematic diagram of a system on chip according to an embodiment of the present application.

Detailed Description

In the following, some terms in the embodiments of the present application are explained for easy understanding by those skilled in the art.

At least one of the embodiments of the present application includes one or more; wherein, a plurality refers to greater than or equal to two. In addition, it should be understood that in the description herein, the words "first," "second," and the like are used solely for the purpose of distinguishing between the descriptions and not necessarily for the purpose of indicating or implying a relative importance or order. For example, the first window and the second window do not represent the importance of both or the order of both, only for distinguishing descriptions. In the embodiment of the present application, "and/or" merely describes the association relationship, which means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.

References to directional terms in the embodiments of the present application, such as "upper", "lower", "left", "right", "inner", "outer", etc., are merely with reference to the directions of the drawings, and thus, the directional terms are used in order to better and more clearly describe and understand the embodiments of the present application, rather than to indicate or imply that the devices or elements referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the embodiments of the present application.

Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the specification. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.

To improve processing efficiency, multiple windows may be displayed on an electronic device (e.g., a cell phone). For example, when the electronic device receives an operation for opening the multi-window, the multi-window is displayed. Among them, the operation for opening the multiple windows may be various types of operations. One implementation, please refer to (a) in fig. 1, is that the electronic device displays a window a, which is an exemplary video playing window. The smart multi-window application bar 101 may be invoked when the electronic device receives an operation to slide inward from the right edge (or left edge) of the screen or an operation to slide inward from the right edge (or left edge) of the screen and pause for a certain period of time, as shown in (b) of fig. 1. The smart multi-window application bar 101 includes icons of various applications, such asIcons of the memo, etc. When the electronic device receives +.A. in the application bar 101 for smart multi-window>The operation of the icon of (a) can be opened +.>I.e. a multi-window interface as shown in fig. 1 (c). The interface shown in fig. 1 (c) includes a window B and a window a, where the window B is located at an upper layer of the window a. Thus, multiple windows can be opened in the manner shown in FIG. 1. At this time, as shown in (d) of fig. 1, when the user clicks the input box in the window B to perform text input, the virtual keyboard area is displayed in the bottom area of the screen, and the virtual keyboard area blocks the video picture being played in the window a, which greatly affects the user experience. In addition, the user may have the purpose of operating the window B at this time, and the display size of the window B is small, which is inconvenient for the user to operate, and therefore, the user may switch the window B to full-screen display, for example, by an operation of dragging the window B to the center of the screen, or by an operation of a control on the window B, or the like, as shown in (e) of fig. 1. However, at this time, the user cannot watch the video pictures in the window a at the same time, which affects the efficiency of using the electronic device for the user. Further, the user may open the window a corresponding to the video application again through the smart multi-window application bar 101 shown in (B) of fig. 1, and the operation process is similar to the process of opening the window B shown in (B) and (c) of fig. 1, and will not be repeated. As shown in (f) of fig. 1, at this time, window a is positioned at an upper layer of window B, and the user can use the chat application and the video play application at the same time.

In another implementation manner, referring to fig. 2 (a), the electronic device displays a window a, and the window a is an exemplary video playing window, and when a user receives a notification message during watching a video played in the window a, and when the electronic device receives a click operation or a drop-down operation of the user on the notification message, the electronic device may open a window B of an application corresponding to the notification message, that is, display a multi-window interface as shown in fig. 2 (B). Similar to fig. 1, the user may click on an input box in window B for an input operation, or may switch window B to a full screen display.

It should be noted that fig. 1 and fig. 2 only exemplify two ways of opening multiple windows, and in practical applications, multiple windows may also be opened by other ways (for example, a manner of tapping a screen by a finger joint), which is not an example.

Illustratively, as shown in (c) and (d) in fig. 1 and (B) in fig. 2, the window a may be a window displayed full screen (or understood as an application interface displayed full screen), and the window B may be a small window displayed in suspension on the window a, i.e., the display area of the window B is smaller than the window a. For example, window B may be a free (freeform) widget (or free window). The free widget may be considered a system level floating window, and the use of the free widget function may cause the entire application window to be displayed in the form of a free widget. The free widget is displayed on top whether the user switches pages or opens other applications or desktops. Illustratively, a free widget may be understood as having the functionality of dynamically changing movements, size scaling, etc. on a display screen. Various interfaces can be opened in the free portlets. For example, the free widget may use view (view) technology to layout, draw, etc. information (text, image, etc.) within the interface, presenting the user with various styles of interfaces. In some embodiments, the newly opened interface in the free widget may overlay the previously opened interface.

In some embodiments, the position of a widget (e.g., window B) may be moved while the electronic device displays multiple windows. For example, referring to (a) in fig. 3, when an operation (e.g., a long press and drag operation at any position within a blank area of the status bar 301) is received for the status bar 301 of the window B, the position of the window B may be changed as in (B) in fig. 3. In other embodiments, the size of a small window (e.g., window B) may be scaled when the electronic device displays multiple windows. For example, referring to (a) of fig. 4, when an operation of dragging leftward with respect to the left edge of the window B is received, the width of the small window B may become large, as in (B) of fig. 4. The size of the small window may be scaled equally, or the width or height may be increased only, which is not limited in this application. It will be appreciated that upon positional change and/or dimensional scaling of the free widget, the free widget inner interface may also be correspondingly positional change and/or dimensional scaling to accommodate the change in the free widget.

It can be seen that, in the related art, when a user opens a new interface (e.g., opens a new application through a smart multi-window application bar or clicks on a notification message), the new interface is displayed in a small window form, and it is inconvenient for the user to operate the newly opened interface due to the small window size. If the user switches the new interface to full-screen display, the original window disappears, and the subsequent user needs to open the original full-screen display window again, so that the user experience of using the multi-window interface is affected. In addition, when the user calls out the virtual keyboard, the displayed area of the virtual keyboard can shield the original full-screen display interface, so that the use experience of the user is affected.

Based on the above, the embodiment of the application provides a multi-window display method, which can be applied to electronic equipment. By adopting the method provided by the embodiment, the display modes of the full-screen window and the small window can be conveniently switched. In addition, when the virtual keyboard is displayed on the display screen, the full-screen window can be automatically reduced, and the position and the size of the small window can be automatically adjusted, so that the virtual keyboard is prevented from shielding the full-screen window and/or display contents in the small window. In this way, the user's experience of using a multi-window display may be improved.

For example, the electronic device in the embodiments of the present application may be a mobile phone (such as a folding screen mobile phone, a tablet PC, a handheld computer, a PC, a cellular phone, a personal digital assistant (personal digital assistant, PDA), a wearable device (such as a smart watch), a vehicle-mounted computer, a game console, and an augmented reality (augmented reality, AR) \virtual reality (VR) device, and the specific form of the terminal is not limited in this embodiment. In addition, the technical scheme provided by the embodiment can be applied to other electronic equipment (or mobile terminal) besides the electronic equipment, such as intelligent home equipment (e.g. television) and the like.

The implementation of the examples of the present application will be described in detail below with reference to the accompanying drawings.

In this embodiment, an electronic device is taken as an example of a mobile phone. Fig. 5 is a schematic structural diagram of a mobile phone according to an embodiment of the present application. The method in the following embodiments may be implemented in a mobile phone having the above-described hardware structure.

As shown in fig. 5, the cellular phone may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and the like. Optionally, the handset may also include a mobile communication module 150, a subscriber identity module (subscriber identification module, SIM) card interface 195, and the like.

The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It should be understood that the structure illustrated in this embodiment is not limited to a specific configuration of the mobile phone. In other embodiments, the handset may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller can be a neural center and a command center of the mobile phone. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a SIM interface, and/or a USB interface, among others.

The charge management module 140 is configured to receive a charge input from a charger. The charging management module 140 can also supply power to the mobile phone through the power management module 141 while charging the battery 142. The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 may also receive input from the battery 142 to power the handset.

The wireless communication function of the mobile phone can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the handset may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

When the handset includes the mobile communication module 150, the mobile communication module 150 may provide a solution for wireless communication including 2G/3G/4G/5G, etc. applied to the handset. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional module, independent of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wi-Fi network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), NFC, infrared (IR), etc. applied to a mobile phone. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, the antenna 1 and the mobile communication module 150 of the handset are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the handset can communicate with a network and other devices through wireless communication technology. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).

The cell phone implements display functions through the GPU, the display 194, and the application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (flex), a mini, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the handset may include 1 or N display screens 194, N being a positive integer greater than 1.

The cell phone may implement photographing functions through an ISP, a camera 193, a video codec, a GPU, a display 194, an application processor, and the like. In some embodiments, the handset may include 1 or N cameras 193, N being a positive integer greater than 1.

The external memory interface 120 may be used to connect to an external memory card, such as a Micro SD card, to extend the memory capabilities of the handset. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.

The internal memory 121 may be used to store computer executable program code including instructions. The processor 110 executes various functional applications of the cellular phone and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the handset (e.g., audio data, phonebook, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.

The handset may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. When a touch operation is applied to the display 194, the mobile phone detects the intensity of the touch operation according to the pressure sensor 180A. The cell phone may also calculate the location of the touch based on the detection signal of the pressure sensor 180A.

The gyro sensor 180B may be used to determine the motion gesture of the handset. The air pressure sensor 180C is used to measure air pressure. The magnetic sensor 180D includes a hall sensor. The mobile phone can detect the opening and closing of the flip leather sheath by using the magnetic sensor 180D. The acceleration sensor 180E can detect the magnitude of acceleration of the mobile phone in various directions (typically three axes). A distance sensor 180F for measuring a distance. The mobile phone can use the proximity light sensor 180G to detect that the user holds the mobile phone close to the ear for communication, so as to automatically extinguish the screen to achieve the purpose of saving electricity. The proximity light sensor 180G may also be used in holster mode, pocket mode to automatically unlock and lock the screen. The ambient light sensor 180L is used to sense ambient light level. The fingerprint sensor 180H is used to collect a fingerprint. The mobile phone can realize fingerprint unlocking, access to an application lock, fingerprint photographing, fingerprint incoming call answering and the like by utilizing the collected fingerprint characteristics. The temperature sensor 180J is for detecting temperature.

The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may be disposed on the surface of the mobile phone at a different location than the display 194.

The bone conduction sensor 180M may acquire a vibration signal. The keys 190 include a power-on key, a volume key, etc. The keys 190 may be mechanical keys. Or may be a touch key. The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration alerting as well as for touch vibration feedback. The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc.

When the handset includes a SIM card interface 195, the SIM card interface 195 is used to connect to a SIM card. The SIM card may be inserted into the SIM card interface 195 or removed from the SIM card interface 195 to enable contact and separation with the handset. The mobile phone can support 1 or N SIM card interfaces, and N is a positive integer greater than 1. The mobile phone realizes the functions of communication, data communication and the like through interaction between the SIM card and the network. In some embodiments, the handset employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the handset and cannot be separated from the handset.

In the embodiment of the application, taking an Android system as an example of a software system of the electronic device, a software structure of the electronic device is illustrated. Fig. 6 is a schematic diagram of a software architecture of a terminal according to an embodiment of the present application.

The software structure of the electronic device may be a hierarchical architecture, e.g. the software may be divided into several layers, each layer having a distinct role and division of effort. The layers communicate with each other through a software interface. Assuming the electronic device is an Android system, it may include an application layer (abbreviated as application layer), an application framework layer (abbreviated as framework layer), a hardware layer, and so on.

The application package can comprise application programs such as cameras, gallery, calendar, call, map, navigation, WLAN, bluetooth, music, video, short message and the like.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions. For example, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like. Wherein the window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like. The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc. The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture. The telephony manager is used to provide the communication functions of the electronic device 100. Such as the management of call status (including on, hung-up, etc.). The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like. The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. For example, a notification manager is used to inform that the download is complete, a message alert, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.

Android run time includes a core library and virtual machines. Android run time is responsible for scheduling and management of the Android system. The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android. Wherein the application layer and the application framework layer run in the virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like. The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc. The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications. Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc. The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like. The 2D graphics engine is a drawing engine for 2D drawing.

In other embodiments, the system library may further include a window processing module for controlling the hiding, appearance, shrinking, enlarging, and the like of the window. It should be noted that, the window processing module may be a module in a system library, or may be a module in another layer, for example, an application framework layer or a kernel layer, which is not limited in the embodiments of the present application.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The following exemplarily illustrates a process flow of the multi-window display method provided in the embodiment of the present application, taking a software structure shown in fig. 6 as an example.

For example, when a first window and a second window are displayed on a display screen of an electronic device, a touch sensor in a hardware layer receives a first input event that acts on the second window. The first input event includes an operation type, an operation time, a position on the display screen, and the like. The touch sensor reports the first input event to a higher layer, such as a window processing module in a system library. And if the high-level determines that the input event is a click operation aiming at an input box in the second window, calling a display driver to display the virtual keyboard on the display screen.

The following describes the technical solutions provided in the embodiments of the present application in detail.

Fig. 7 is a schematic diagram of a multi-window display method according to an embodiment of the present application. As shown in fig. 7 (a), the electronic device displays the first window full screen. The first window displays a first application, wherein the first application may be any application in the electronic device. Illustratively, the first application is a video playback application. The user receives a notification message during the process of watching the video, wherein the notification message can be from a second application in the electronic device, and the second application can be any application in the electronic device. The first application and the second application are illustratively different applications. For example, the second application is a chat application. And in the preset time, if the user executes clicking operation or pull-down operation on the notification message, the electronic device can open a second application corresponding to the notification message in a second window. As shown in (b) of fig. 7, in response to a click operation or a pull-down operation of the notification message by the user, the second window displays an interface corresponding to the notification message, wherein the second window is a window displayed in full screen. Meanwhile, the first window can be automatically switched to be displayed in a small window mode, the first window is positioned on the upper layer of the second window, and the display area of the first window is smaller than that of the second window. In this embodiment, when the user receives the notification message, since the newly opened message is likely to be a message that the user wishes to pay attention to, the electronic device may open an application window corresponding to the notification message in a full-screen form, so that the user can perform temporary processing on the newly received message.

In one possible implementation, the size and scale of the initial widget may be default after the auto-switch, e.g., the widget may default to a vertically displayed window as shown in (b) of fig. 7. In another possible implementation manner, the size and the proportion of the initial widget after automatic switching may be determined according to the interface content, for example, as shown in (c) in fig. 7, when the video interface played in full screen is displayed in the first window, the initial widget after automatic switching may be a window displayed in a lateral direction, so that the proportion of the content displayed in the widget and the widget may be more matched. In yet another possible implementation, the size of the initial widget after the auto-switch may be determined according to the type of application, e.g., video application corresponds to a landscape widget and chat application corresponds to a portrait widget. The present application is not limited in this regard.

In the above embodiment, the notification message is taken as an example, and the procedure may be similar to that described above when the user opens the widget through other operations. For example, when the user opens a new application by calling out the smart multi-window application bar, the newly opened application window may be displayed in full screen form, and the application window previously displayed in full screen is automatically switched to the widget display.

In some embodiments, when the user processes the temporary task (e.g., replies to the chat message) in the second window that is displayed in full screen, and needs to continue to process the main task (e.g., watch video) in the first window, the user may switch the display forms (or window forms) of the first window and the second window through a first preset operation. By way of example, the display form of the window may include a full screen display, a widget display, and the like. As shown in (d) of fig. 7, in response to the first preset operation, the first window is switched to full-screen display again, the second window is switched to small-window display, the second window is located at the upper layer of the first window, and the display area of the second window is smaller than that of the first window. Alternatively, the user may perform the first preset operation again, so that the first window is switched to the small window display, and the second window is switched to the full screen display, that is, the display form shown in (b) of fig. 7 or (c) of fig. 7. It can be understood that by executing the first preset operation, the user can freely switch the display forms of the first window and the second window, and freely select to perform full-screen processing on the tasks in the first window or the second window under the condition of not interrupting the tasks in the first window and the second window, so that the efficiency of using the multi-window operation by the user is improved.

In one possible implementation, the first preset operation may be a gesture operation. The first preset operation may be a gesture operation acting on the widget, or a gesture operation acting on the full-screen window, or a gesture operation of dragging the widget to a specific hot zone of the full-screen window, which is not limited in this application. In another possible implementation, as shown in FIG. 8, a switch control 801, a minimize control 802, a close control 803, and the like may be displayed in a status bar in a widget. When an operation is received for the switch control 801 in the status bar of the widget, the widget may be switched to a full screen window, while the full screen window is switched to the widget. When an operation is received for the minimize control 802 within the status bar of the widget, the widget may be minimized, e.g., switched to a smaller sized widget or a reminder bar. When an operation is received for the close control 803 within the status bar of the widget, the widget may be closed, i.e., only a full screen window is displayed on the display screen. In yet another possible implementation, the first preset operation may be an operation on a preset physical key or virtual key, optionally the physical key or virtual key may be preset by the system or predefined by the user. Taking the example of operating a physical key, the user may switch the display forms of the first window and the second window by pressing the volume key twice in succession. It will be appreciated that the first preset operation may be other operations, which are not limited in this application.

Correspondingly, the background process flow corresponding to the embodiment shown in fig. 7 is described in detail below. Taking a main task as a task corresponding to a first application displayed in a first window, and a temporary task as a task corresponding to a second application displayed in a second window as an example, the background processing flow may include the following steps:

step one, the electronic equipment displays a first window of a first application in a full screen mode;

step two, the electronic equipment receives a task of a second application;

third, the electronic equipment displays a second window of the second application in a full screen mode, and the small window displays a first window of the first application;

step four, the electronic equipment receives the operation of switching the first window and the second window from the user;

step five, the electronic equipment displays a first window of the first application in a full screen mode, and displays a second window of the second application in a small window mode.

In the embodiment shown in fig. 7, only one small window exists on the full-screen window, and the user can switch the display forms of the first window and the second window through a first preset operation. In other embodiments, there may be multiple portlets on a full screen window, and the user may switch the display modality of the target portlets and full screen window by manipulating the target portlets. For example, as shown in fig. 9 (a), the electronic device displays a second window full screen, and superimposes the first window and the third window displayed in the small window on the second window. As shown in (b) of fig. 9, in response to a second preset operation acting on the first window, the first window may be switched to full-screen display, and the second window may be switched to widget display. That is, the user-actuated target widget may switch the display form between a full screen window and a full screen window. Similarly, in response to a second preset operation acting on the third window, the third window may be switched to full-screen display, and the second window may be switched to widget display (not shown). Optionally, the second preset operation may be a gesture operation acting on the target widget, an operation acting on a control of the target widget, or the like, which is not limited in this application.

Fig. 10 is a schematic diagram of another multi-window display method according to an embodiment of the present application. As shown in (a) of fig. 10, the electronic device displays a first window full screen, the first window displaying a first application. And a second window displayed in the form of a small window is overlapped on the first window, the second window is positioned at the upper right corner of the display screen, and the second window displays a second application. Wherein the first application and the second application may be any application in the electronic device. For example, when the user clicks an input box in the second window to perform text input, a virtual keyboard region may be displayed on the display screen. Alternatively, the virtual keyboard region may be a fixed region of the display screen, such as a bottom region of the display screen.

In order to avoid the occlusion of the virtual keyboard region to the display content of the first window and the second window, when the user clicks an input box in the second window to trigger the display of the virtual keyboard region, the electronic device may determine a region except for the virtual keyboard region on the display screen as a drawing region allowing the application window to be drawn, and draw the first window and the second window in the drawing region. The following is a detailed description.

In a possible implementation manner, as shown in (b) of fig. 10, when the user clicks the input box in the second window to perform text input, the height of the second window is H1, the height of the virtual keyboard area is H2, and the sum of H1 and H2 does not exceed the height of the display area of the display screen of the electronic device. The first window may be scaled down to avoid occlusion of the first window by the virtual keyboard region. For example, the width of the second window is W1, and the width of the first window may be automatically adjusted to W2, where the sum of W1 and W2 is equal to the width of the display area of the display screen of the electronic device. Further, the height of the first window may be obtained based on the width W2 of the first window after adjustment and the aspect ratio of the first window.

Alternatively, the first window may be scaled down in accordance with other manners. For example, the height of the first window may be automatically adjusted to H1, and the width of the first window may be obtained based on the adjusted height H1 of the first window and the original aspect ratio of the first window. The present application is not limited in this regard.

In another possible implementation manner, as shown in (c) of fig. 10, when the user clicks the input box in the second window to perform text input, the height of the second window is H1, the height of the virtual keyboard area is H2, and the sum of H1 and H2 does not exceed the height of the display area of the display screen of the electronic device. The width of the first window may be adjusted according to the width of the second window. For example, the width of the second window is W1, and the width of the first window may be automatically adjusted to W2, where the sum of W1 and W2 is equal to the width of the display area of the display screen of the electronic device. In addition, the height of the second window can be adjusted to be the same as that of the first window, namely, H1, so that a better display effect is obtained.

In still another possible implementation manner, as shown in (d) of fig. 10, when the user clicks the input box in the second window to perform text input, the height of the second window may be adjusted to H3, the height of the virtual keyboard area is H2, and the sum of H2 and H3 is equal to the height of the display area of the display screen of the electronic device. The second window may be adjusted according to the remaining display area of the display screen. For example, the height of the second window may be adjusted to be the same as the first window, i.e. to be H3, and the width of the second window may be automatically adjusted to be W2, where the sum of W1 and W2 is equal to the width of the display area of the display screen of the electronic device. In the implementation manner, when the user clicks the input frame in the second window to display the virtual keyboard region, the sizes of the first window and the second window can be adjusted to fill the display region of the display screen, so that the display efficiency of the display screen and the attractiveness of interface display are improved.

In the embodiment shown in fig. 10, when the user clicks the input box in the second window to perform text input, the size of the first window may be automatically adjusted, and finally, the first window, the second window and the virtual keyboard area are all not overlapped, so that shielding of window contents when the virtual keyboard area is displayed is avoided, and the use experience of the user is improved.

Fig. 11 is a schematic diagram of another multi-window display method according to an embodiment of the present application. As shown in (a) of fig. 11, the electronic device displays a first window full screen, the first window displaying a first application. And a second window displayed in the form of a small window is overlapped on the first window, the second window is positioned in the middle right area of the display screen, and the second window displays a second application. Wherein the first application and the second application may be any application in the electronic device. As shown in (b) of fig. 11, when the user clicks an input box in the second window for text input, a screen bottom area may display a virtual keyboard area. The height of the second window is H1, the height of the virtual keyboard area is H2, and the sum of H1 and H2 does not exceed the height of the display area of the display screen of the electronic equipment. For example, the position of the second window may be changed to avoid occlusion of the display content of the second window by the virtual keyboard region. As shown in fig. 11 (b), the second window may be moved to the upper right corner of the display screen.

It will be appreciated that the position of the second window may be moved according to the actual situation, e.g. the second window may be moved upwards, upwards and to the left, upwards and to the right, etc. Alternatively, the moving direction of the second window may be related to the position where the second window is initially displayed, for example, the second window may be moved upward and rightward when the second window is initially displayed in the middle right area of the display screen, and for example, the second window may be moved upward and leftward when the second window is initially displayed in the middle left area of the display screen, which is not limited in this application.

In addition, the first window may be scaled down in an equal proportion, or the width of the first window may be adjusted according to the width of the second window, or the height of the first window may be adjusted according to the height of the second window, or the sizes of the first window and the second window may be adjusted to fill the display area of the display screen. The specific adjustment manner may be referred to as related description of the embodiment shown in fig. 10, which is not repeated herein.

In the embodiment shown in fig. 11, when the user clicks the input box in the second window to perform text input, the position of the second window may be moved, and the size of the first window may be automatically adjusted, so that the first window, the second window and the virtual keyboard area are not overlapped, thereby avoiding shielding the contents of the first window and the second window when the virtual keyboard area is displayed, and improving the user experience of the user.

Fig. 12 is a schematic diagram of another multi-window display method according to an embodiment of the present application. As shown in (a) of fig. 12, the electronic device displays a first window full screen, the first window displaying a first application. And a second window displayed in the form of a small window is overlapped on the first window, the second window is positioned at the upper right corner of the display screen, and the second window displays a second application. Wherein the first application and the second application may be any application in the electronic device. For example, when the user clicks an input box in the second window to perform text input, a virtual keyboard region may be displayed at the bottom of the screen.

In one possible implementation, as shown in (b) of fig. 12, the sum of the original height H1 of the second window and the virtual keyboard region H2 is greater than the height of the display screen display region. Therefore, when the user clicks the input box in the second window to perform text input, the height of the second window may be reduced to H4. The sum of H2 and H4 is equal to the height of the display area of the display screen, so that the shielding of the virtual keyboard area to the second window is avoided. In addition, the first window can be reduced in an equal proportion, so that shielding of the virtual keyboard area on the first window is avoided. For example, the height of the first window may be adjusted to be the same as the first window, i.e., to be H4. Further, the width of the first window may be obtained based on the height H4 of the first window after adjustment and the aspect ratio of the first window.

As shown in fig. 12 (b), after the first window is scaled down in equal proportion, the sum of the height H4 of the first window and the height H2 of the virtual keyboard region is equal to the height of the display region of the display screen. In other embodiments, after the first window is scaled down, the sum of the width of the first window and the width of the second window may be equal to the width of the display area of the display screen. In other embodiments, after the first window is scaled down, the sum of the width of the first window and the width of the second window may be smaller than the width of the display area of the display screen, and the sum of the height of the first window and the height of the second window may be smaller than the height of the display area of the display screen. In still other embodiments, after the first window is scaled down, the display area of the display screen of the electronic device may be exactly filled with the first window, the second window, and the virtual keyboard area.

In another possible implementation, as in (c) of fig. 12, the sum of the original height H1 of the second window and the virtual keyboard region H2 is greater than the height of the display area of the display screen. Therefore, when the user clicks the input box in the second window to perform text input, the height of the second window may be reduced to H4. The sum of H2 and H4 is equal to the height of the display area of the display screen, so that the shielding of the virtual keyboard area to the second window is avoided. In addition, the second window may be adjusted according to the remaining display area of the display screen. For example, the height of the second window may be adjusted to be the same as the height of the first window, that is, to be H4, and the width of the second window may be automatically adjusted to be W2, where the sum of W1 and W2 is equal to the width of the display area of the display screen of the electronic device. In the implementation manner, when the user clicks the input frame in the second window to display the virtual keyboard region, the sizes of the first window and the second window can be adjusted to fill the display region of the display screen, so that the display efficiency of the display screen and the attractiveness of interface display are improved.

In the embodiment shown in fig. 11, when the user clicks the input box in the second window to input text, the size of the second window can be automatically adjusted because the sum of the original height of the first window and the height of the virtual keyboard area is greater than the height of the display area of the display screen, and the size of the first window can also be automatically adjusted, and finally, the first window, the second window and the virtual keyboard area are not overlapped, so that shielding of the contents of the first window and the second window when the virtual keyboard area is displayed is avoided, and the use experience of the user is improved.

Optionally, if the second window is located in the middle area of the display screen before the input box in the second window is clicked, when the user clicks the input box in the second window to input text, the position of the second window moves similarly to the embodiment shown in fig. 11, so as to avoid the shielding of the virtual keyboard area to the display content of the second window. For example, the second window may be moved to the upper right corner of the display screen. In addition, the sizes of the first window and the second window may be adjusted similarly to those shown in fig. 12 (b) and 12 (c), for example, the height of the second window shown in fig. 12 (b) is reduced to H4, and the height of the first window is adjusted to H4 and scaled down equally. It will be appreciated that the position of the second window may be scaled down and moved according to the actual situation, e.g. the second window may be moved up and scaled down, moved up and left and scaled down, moved up and right and scaled down, etc.

In the embodiments shown in fig. 10 to 12, when the user clicks the input box in the second window to trigger displaying the virtual keyboard region, the position of the first window and/or the second window may be moved according to the actual situation, and the size of the first window and/or the second window may be adjusted according to the actual situation, so that the first window, the second window and the virtual keyboard region are displayed on the display screen without overlapping each other. It will be appreciated that the embodiments shown in fig. 10 to 12 only show exemplary adjustment manners of the first window and the second window, and that other adjustment manners of the first window and the second window are also possible, which are not limited in this application.

In the embodiments shown in fig. 10 to 12, the exemplary description is given taking the example that the user clicks the input box in the second window to trigger displaying the virtual keyboard area, it may be understood that in other embodiments, the user clicks the input box in the first window to trigger displaying the virtual keyboard area, or the user triggers displaying the virtual keyboard area in other manners. When the virtual keyboard area is displayed on the display screen, the adjustment methods of the first window and the second window may refer to the related descriptions in the above embodiments, which are not described herein.

In some embodiments, when the virtual keyboard is collapsed, e.g., the user clicks on an area other than the virtual keyboard area to collapse the virtual keyboard, the position and/or size of the window may resume the display state prior to the adjustment. For example, as shown in (a) of fig. 13, when the user clicks the video play area in the first window, the positions and sizes of the first window and the second window may be restored to the window display state before adjustment (i.e., the state shown in (a) of fig. 12) as shown in (b) of fig. 13.

Correspondingly, the background process flow corresponding to the embodiment shown in fig. 10 to 13 is described in detail below. Taking a main task as a task corresponding to a first application displayed in a first window, and a temporary task as a task corresponding to a second application displayed in a second window as an example, the background processing flow may include the following steps:

step one, the electronic equipment displays a first window of a first application in a full screen mode, and displays a second window of a second application in a small window mode;

step two, the electronic equipment receives the operation of displaying the virtual keyboard;

step three, the position and/or the size of the first window and/or the second window are/is adjusted;

fourth, the electronic equipment displays the first window, the second window and the virtual keyboard area in a non-overlapping mode;

Step five, the electronic equipment receives the operation of packing up the virtual keyboard area;

and step six, the electronic equipment resumes the full screen display of the first window of the first application and the small window display of the second window of the second application.

Illustratively, the first window and the second window may resume the original display position and/or size.

Optionally, after the first window and/or the second window are automatically adjusted, the user may further adjust the size of the first window and/or the second window. In one embodiment, as shown in fig. 14, the user may adjust the size of the first window and the second window, respectively. For example, when the user presses the right edge of the first window and drags left as shown in (a) of fig. 14, the width of the first window gradually decreases as shown in (b) of fig. 14. For another example, the width of the second window gradually decreases as the user holds the left edge of the second window and drags to the right. In another embodiment, when the user adjusts the width of one of the first window and the second window, the width of the other window is also adjusted accordingly. For example, as shown in (a) of fig. 15, the sum of the widths of the first window and the second window is equal to the width of the display area of the display screen, at this time, when the user presses the adjacent edges of the first window and the second window and drags left, as shown in (b) of fig. 15, the width of the first window gradually decreases, and at the same time, the width of the second window gradually increases. For another example, when the user presses the adjacent edges of the first window and the second window and drags to the right, the width of the first window gradually increases and the width of the second window gradually decreases.

Optionally, after the first window and/or the second window are automatically adjusted, the user may further adjust the positions of the first window and the second window, for example, exchange the positions of the first window and the second window, etc.

In the embodiments shown in fig. 14 to 15, after the first window and/or the second window are automatically adjusted, the user may further manually adjust the size and/or the position of the first window and/or the second window, thereby further improving the user experience of the multi-window display.

In some embodiments, two or more portlets may be superimposed on a full screen window. Fig. 16 is a schematic diagram of another multi-window display method according to an embodiment of the present application. As shown in (a) of fig. 16, the electronic device displays a first window full screen, the first window displaying a first application. And superposing a second window and a third window which are displayed in a small window form on the first window, wherein the second window displays a second application, and the third window displays a third application. The first application, the second application and the third application may be any application in the electronic device. For example, when a user clicks on an input box in a widget to trigger the display of a virtual keyboard region, the user-active widget and/or full screen window may automatically adjust. For example, as shown in (a) of fig. 16, when the user clicks the input box in the second window to trigger the display of the virtual keyboard region, the second window and the first window displayed full screen may be automatically adjusted to the state shown in (b) of fig. 16, and the third window may be temporarily hidden, e.g., disappeared from the display screen or reduced to a hint bar or the like. For another example, as shown in (c) of fig. 16, when the user clicks the input box in the third window to trigger the display of the virtual keyboard region, the third window and the first window displayed full screen may be automatically adjusted to the state shown in (d) of fig. 16, and the second window may be temporarily hidden. Alternatively, since the second window is located in the right region of the display region before adjustment and the third window is located in the left region of the display region, as shown in (b) of fig. 16, the second window after adjustment may be located in the upper right corner of the display region, as shown in (d) of fig. 16, and the third window after adjustment may be located in the upper left corner of the display region. It should be noted that fig. 16 only schematically illustrates one possible way of adjusting the full-screen window and the small window, and the way of automatically adjusting the positions and sizes of the full-screen window and the small window may also refer to the related descriptions of the embodiments shown in fig. 10 to 12, which are not described herein. Optionally, the window after automatic adjustment may also be manually adjusted as shown in fig. 14 or 15.

In the embodiment shown in fig. 16, when more than one widget exists in the display area, when the user clicks the input box in the target widget to trigger the virtual keyboard display area, the size of the full-screen window, i.e. the first window, can be automatically adjusted, and the adjusted first window, the target widget clicked by the user and the virtual keyboard area can be displayed without overlapping each other. While other portlets may be portlets that the user does not wish to pay attention to at this time, and thus other portlets may be temporarily hidden, e.g., disappear from the display or zoom into a reminder bar, etc. Therefore, the display area can display the task which the user hopes to concentrate on at the moment, and meanwhile, the shielding of the virtual keyboard area to the display content is avoided, and the use experience of the user is improved.

In some embodiments, when two or more portlets are superimposed on a full screen window, the user may also trigger the display of the virtual keyboard region by clicking on an input box on the full screen window. At this time, the full screen window and/or the target widget may be automatically adjusted to display the full screen window, the target widget, and the virtual keyboard region without overlapping each other, for example. Alternatively, the target widget may be a widget recently operated by the user, a widget recently opened by the user, or a widget of a preset certain application, etc. The manner in which the full-screen widget and the target widget are automatically adjusted may also be referred to in the related description of the embodiments shown in fig. 10 to 12, which is not described herein. Optionally, the window after automatic adjustment may also be manually adjusted as shown in fig. 14 or 15.

For example, in the embodiment shown in fig. 16, when the virtual keyboard is collapsed, e.g., the user clicks on an area outside the virtual keyboard area to collapse the virtual keyboard, the position and/or size of the window may resume the display state prior to the adjustment. For example, when the user clicks on an area other than the virtual keyboard area, the position and size of each window may be restored from the state shown in (b) of fig. 16 to the state shown in (a) of fig. 16, and the third window may be redisplayed. For another example, when the user clicks on an area other than the virtual keyboard area, the position and size of each window may be restored from the state shown in (d) of fig. 16 to the state shown in (c) of fig. 16, and the second window may be redisplayed.

Fig. 17 is a schematic diagram of another multi-window display method according to an embodiment of the present application. As shown in (a) of fig. 17, the electronic device displays a first window and a second window in a split screen mode, the first window displaying a first application, and the second window displaying a second application. Wherein the first application and the second application may be any application in the electronic device. As shown in (b) of fig. 17, when the user clicks an input box in the second window for text input, a screen bottom area may display a virtual keyboard area. For example, the sizes of the first window and the second window may be automatically adjusted to avoid occlusion of the display content of the first window and the second window by the virtual keyboard region. As shown in (b) of fig. 17, the height of the first window and the second window is reduced, the width is kept unchanged, and after the adjustment, the first window, the second window and the virtual keyboard area fill up the display area of the display screen. Optionally, the user may further adjust the position and size of the first window and the second window. For example, when the user presses and drags left the adjacent edges of the first window and the second window, the width of the first window gradually decreases, and at the same time, the width of the second window gradually increases. For another example, the user may exchange the locations of the first window and the second window. Also, when the user clicks on an area other than the virtual keyboard area, the positions and/or sizes of the first window and the second window may resume the split screen display state before adjustment.

It can be understood that in the above embodiment, after the size of the window is changed, the interface displayed in the window may still be the original interface, but the content of the interface may be adaptively adjusted according to the size and the proportion of the window so as to match the display proportion of the window.

Fig. 18 is a schematic software structure of an electronic device according to an embodiment of the present application. As shown in fig. 18, the electronic device may include a main task application, a temporary task application, an input method application, a multitasking unit, a window management unit, an input management unit, and a graphic display unit. The main task application may be the first application in the foregoing embodiment, the temporary task application may be the second application in the foregoing embodiment, and the input method application may be the application for displaying the virtual keyboard area in the foregoing embodiment. The multi-task processing unit can be responsible for monitoring interaction events of users, monitoring input triggering and stowing events of the input management unit, processing state switching of main tasks and temporary tasks, calculating display positions, areas, sizes and the like of multi-task windows. The window management unit may initialize the display of the window, change the sizes and positions of the windows of the main task application and the temporary task application according to the instruction of the multitasking unit, and notify the main task application and the temporary task application of the change in the sizes and positions of the windows. The input management unit can be used for monitoring interaction events of users and controlling triggering and stowing of input method application. The graphic display unit may be used to display interfaces of the main task application, the temporary task application, and the input method application.

For example, when the user clicks an input box in the temporary task application (for example, the second application) to perform text input, the input management unit may monitor the operation of clicking the input box by the user, and trigger the input method application. The input management unit may inform the multitasking unit that the window to which the input method is applied has changed. The multitasking unit may then calculate the location, area and size of the primary task application (e.g., the first application), the temporary task application, and the input method application display. Further, the multitasking unit may notify the window management unit to change the positions, areas and sizes of the display of the main task application, the temporary task application and the input method application, and notify the main task application, the temporary task application and the input method application of the window management unit. Finally, the main task application, the temporary task application and the input method application inform the graphic display unit to redraw the window, and finally the adjusted interface is displayed.

Fig. 19 shows a schematic flowchart of a multi-window display method provided in an embodiment of the present application, where the method may be performed by an electronic device. The method comprises the following steps:

s1901: the electronic device displays a first window on the display screen in a full screen mode, and displays a second window in a first area of the display screen.

S1902: the electronic device receives a first operation.

The first operation may be an operation in which the user clicks an input box of the first window or the second window, for example.

S1903: and responding to the first operation, the electronic equipment displays a second window in a second area of the display screen, displays a first window in a third area of the display screen, and displays a virtual keyboard in a fourth area of the display screen. Wherein the second region, the third region and the fourth region do not overlap each other.

In some embodiments, the first region and the second region may be the same, i.e., the display position and size of the second window remain unchanged. For example, as shown in fig. 10 (b) and (c), the display positions and the sizes of the second windows are the same before and after the virtual keyboard region is displayed.

In other embodiments, the first region and the second region may be different. In one possible implementation, as shown in fig. 11, the second window displayed in the first area is the same size but at a different location than the second window displayed in the second area. In another possible implementation, as shown in fig. 12, the second window displayed in the first area is different in size from the second window displayed in the second area, and the second window displayed in the second area is smaller in size than the second window displayed in the first area. For example, the height of the second window displayed in the second region is smaller than the height of the second window displayed in the first region.

In some embodiments, the electronic device may draw a virtual keyboard in a fixed area of the display screen, and the fourth area is the fixed area; the electronic device may determine an area of the display screen other than the virtual keyboard as a drawing area that allows drawing of the application window; further, the electronic device may draw the first window and the second window in the drawing area. Wherein the drawing area includes the above-described second area and third area.

In some embodiments, the electronic device may scale the first window from a first size to a second size. For example, as shown in fig. 10 (b), the first window is scaled down.

In some embodiments, after receiving the first operation, the electronic device zooms out the first window such that the second window is displayed in the second area of the display screen and the first window is displayed in the third area of the display screen, for example as shown in fig. 10 (b). Or, after receiving the first operation, the electronic device zooms out the first window, moves up and left, or moves up and right to cause the second window to be displayed in the second area of the display screen, and the first window to be displayed in the third area of the display screen, for example, as shown in (b) of fig. 11, the electronic device zooms out the first window, moves up and right. Or after the electronic device receives the first operation, shrinking the first window, moving upwards and leftwards, or moving upwards and rightwards, and shrinking the second window to display the second window in the second area of the display screen and display the first window in the third area of the display screen.

In some embodiments, the second region, the third region, and the fourth region fill up a display region of the display screen. For example, as shown in (d) of fig. 10, the second window displayed in the second area, the first window displayed in the third area, and the virtual keyboard displayed in the fourth area just fill up the display area of the display screen.

In some embodiments, the electronic device receives a drag operation that acts on adjacent edges of the first window and the second window; in response to the drag operation, the electronic device controls the second region to be adjusted to a fifth region, and controls the third region to be adjusted to a sixth region, the fifth region displaying the second window, the sixth region displaying the first window. For example, as shown in fig. 15, when the user presses the adjacent edges of the first window and the second window and drags left, the display area of the first window gradually decreases, and at the same time, the display area of the second window gradually increases.

In some embodiments, the electronic device receives a second operation on the first window or the second window; and responding to the second operation, enabling the virtual keyboard to disappear, enabling the electronic equipment to display a first window on the display screen in a full screen mode, and displaying the second window in a first area of the display screen. For example. As shown in fig. 13, when the virtual keyboard is retracted, the position and size of the window can be restored to the window display state before adjustment.

Fig. 20 shows a schematic flow chart of another multi-window display method provided in an embodiment of the present application, which may be performed by an electronic device. The method comprises the following steps:

s2001: the electronic device displays a first window on the display screen in a full screen mode, and displays a second window in a first area of the display screen.

S2002: the electronic device receives a first preset operation.

The first preset operation may be a gesture operation, an operation on a control, or an operation on a preset physical key or virtual key, for example.

S2003: and responding to the first preset operation, the electronic equipment displays a second window on the display screen in a full screen mode, and displays the first window in a seventh area of the display screen.

For example, as shown in fig. 7, the user may switch the display forms of the first window and the second window through a first preset operation. As shown in (d) of fig. 7, the first window is displayed full screen, and the second window is displayed in the form of a small window. As shown in (b) and (c) of fig. 7, the second window is displayed full screen, and the first window is displayed in the form of a small window. Further, as shown in (b) and (d) in fig. 7, the first region is the same as the seventh region. Alternatively, as shown in (c) and (d) of fig. 7, the first region and the seventh region are different.

Fig. 21 is a schematic diagram of a display device according to an embodiment of the present application. As shown in fig. 21, the apparatus may be applied to an electronic device, and the apparatus may include: a display unit 2101 and an input unit 2102.

In some embodiments, the display unit 2101 is configured to display a first window on a display screen of the electronic device in a full screen manner, and display a second window on a first area of the display screen.

An input unit 2102 for receiving a first operation.

The display unit 2101 is further configured to display, after receiving the first operation, a second window in a second area of the display screen, a first window in a third area of the display screen, and a virtual keyboard in a fourth area of the display screen. Wherein the second region, the third region and the fourth region do not overlap each other.

In still other embodiments, the display unit 2101 is configured to display a first window on a display screen of the electronic device in full screen, and display a second window on a first area of the display screen.

An input unit 2102 for receiving a first preset operation.

The display unit 2101 is further configured to display a second window on the display screen in a full screen manner after receiving the first preset operation, and display the first window in a seventh area of the display screen.

The more detailed description about the display unit 2101 and the input unit 2102 can be directly obtained by referring to the related description in the above embodiment, and will not be repeated here.

The embodiment of the application also provides a display device, which can be applied to electronic equipment such as the electronic equipment (e.g. mobile phone) in the embodiment. The apparatus may include: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to cause the display device to implement the functions or steps performed by the electronic device (e.g., mobile phone) in the above-described method embodiments.

The embodiment of the present application further provides an electronic device (the electronic device may be an electronic device, for example, may be a mobile phone in the foregoing embodiment), where the electronic device may include: a display screen, a memory, and one or more processors. The display, memory, and processor are coupled. The memory is for storing computer program code, the computer program code comprising computer instructions. When the processor executes the computer instructions, the electronic device may perform the various functions or steps performed by the electronic device (e.g., a cell phone) in the above-described method embodiments. Of course, the electronic device includes, but is not limited to, the display screen, memory, and one or more processors described above. For example, the structure of the electronic device may refer to the structure of the cellular phone shown in fig. 5.

The embodiment of the application also provides a chip system, which can be applied to electronic equipment such as the electronic equipment (e.g. mobile phone) in the embodiment. As shown in fig. 22, the system-on-chip includes at least one processor 2201 and at least one interface circuit 2202. The processor 2201 may be a processor in an electronic device as described above. The processor 2201 and the interface circuit 2202 may be interconnected by wires. The processor 2201 may receive and execute computer instructions from the memory of the electronic device described above through the interface circuit 2202. The computer instructions, when executed by the processor 2201, cause the electronic device to perform the steps performed by the handset in the embodiments described above. Of course, the chip system may also include other discrete devices, which are not specifically limited in this embodiment of the present application.

The embodiment of the application also provides a computer readable storage medium for storing computer instructions for operating an electronic device, such as the electronic device (e.g., a mobile phone).

Embodiments of the present application also provide a computer program product comprising computer instructions for an electronic device, such as the electronic device (e.g., a mobile phone) described above.

It will be apparent to those skilled in the art from this description that, for convenience and brevity of description, only the above-described division of the functional modules is illustrated, and in practical application, the above-described functional allocation may be performed by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to perform all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another apparatus, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and the parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a readable storage medium. Based on such understanding, the technical solution of the embodiments of the present application may be essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions for causing a device (may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read Only Memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

The foregoing is merely a specific embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered in the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A multi-window display method, wherein the method is applied to an electronic device, the method comprising:

the electronic equipment displays a first window on a display screen in a full screen manner, and displays a second window in a first area of the display screen; the second window is positioned on the upper layer of the first window, and the display area of the second window is smaller than that of the first window;

the electronic equipment receives a first operation, wherein the first operation is used for indicating to display a virtual keyboard;

responding to the first operation, the electronic equipment displays the second window in a second area of the display screen, displays the first window in a third area of the display screen, and displays the virtual keyboard in a fourth area of the display screen;

wherein the second region, the third region and the fourth region do not overlap each other.

2. The method of claim 1, wherein the first region is the same as the second region.

3. The method of claim 1, wherein the first region is different from the second region;

the second window displayed in the first area is the same size as the second window displayed in the second area; or alternatively

The second window displayed in the first region is different in size from the second window displayed in the second region, and the second window displayed in the second region is smaller in size than the second window displayed in the first region.

4. A method according to claim 3, the second window displayed in the second region having a smaller size than the second window displayed in the first region, comprising:

the height of the second window displayed in the second area is smaller than the height of the second window displayed in the first area.

5. The method of any of claims 1-4, wherein the electronic device displaying the second window in a second area of the display screen, displaying the first window in a third area of the display screen, and displaying the virtual keyboard in a fourth area of the display screen, comprises:

the electronic equipment draws the virtual keyboard in a fixed area of the display screen; the fourth region is the fixed region;

the electronic equipment determines the area except the virtual keyboard in the display screen as a drawing area allowing drawing of an application window;

The electronic equipment draws the first window and the second window in the drawing area; the drawing region includes the second region and the third region.

6. The method of any one of claims 1-5, wherein the electronic device scale-down the first window from a first size to a second size.

7. The method of any of claims 1-6, wherein in response to the first operation, the electronic device displays the second window in a second area of the display screen and the first window in a third area of the display screen, comprising:

in response to the first operation, shrinking the first window to enable the second window to be displayed in a second area of the display screen, and enabling the first window to be displayed in a third area of the display screen; or alternatively

In response to the first operation, zooming out the first window, moving up and left, or moving up and right the second window so that the second window is displayed in a second area of the display screen and the first window is displayed in a third area of the display screen; or alternatively

And in response to the first operation, zooming out the first window, moving upwards and leftwards, or moving upwards and rightwards, zooming out the second window, so that the second window is displayed in a second area of the display screen, and displaying the first window in a third area of the display screen.

8. The method of any one of claims 1 to 7, wherein the second region, the third region, and the fourth region fill a display area of the display screen.

9. The method according to any one of claims 1 to 8, further comprising:

the electronic device receives a drag operation acting on adjacent edges of the first window and the second window;

and responding to the dragging operation, the electronic equipment controls the second area to be adjusted to a fifth area, and controls the third area to be adjusted to a sixth area, wherein the fifth area displays the second window, and the sixth area displays the first window.

10. The method of claim 1, wherein the first operation is an operation that acts on the second window.

11. The method according to claim 1, wherein the method further comprises:

the electronic device receiving a second operation acting on the first window or the second window;

and responding to the second operation, enabling the virtual keyboard to disappear, enabling the electronic equipment to display the first window in a full screen mode on a display screen, and displaying the second window in the first area of the display screen.

12. The method of claim 11, wherein the method further comprises:

the electronic equipment receives a first preset operation;

responding to the first preset operation, the electronic equipment displays the second window on the display screen in a full screen manner, and displays the first window in a seventh area of the display screen; wherein the first region and the seventh region are the same or different.

13. An electronic device, comprising:

a processor, a memory, and one or more programs;

wherein the one or more programs are stored in the memory, the one or more programs comprising instructions, which when executed by the processor, cause the electronic device to perform the method steps of any of claims 1-12.

14. A computer readable storage medium for storing a computer program which, when run on a computer, causes the computer to perform the method of any one of claims 1 to 12.

15. A computer program product comprising a computer program which, when run on a computer, causes the computer to perform the method of any of the preceding claims 1 to 12.