WO2024007966A1

WO2024007966A1 - Multi-window display method and device

Info

Publication number: WO2024007966A1
Application number: PCT/CN2023/104198
Authority: WO
Inventors: 李伟; 张亚男; 何天璐
Original assignee: 华为技术有限公司
Priority date: 2022-07-05
Filing date: 2023-06-29
Publication date: 2024-01-11
Also published as: CN117389437A

Abstract

The present application relates to the field of electronic devices, and discloses a multi-window display method and a device. The method comprises: an electronic device displays a first window on a display screen in a full-screen mode, and displays a second window in a first region of the display screen, wherein the second window is located on the first window, and the display area of the second window is smaller than the display area of the first window; the electronic device receives a first operation, the first operation being used for instructing to display a virtual keyboard; and in response to the first operation, the electronic device displays the second window in a second region of the display screen, displays the first window in a third region of the display screen, and displays the virtual keyboard in a fourth region of the display screen, wherein the second region, the third region, and the fourth region do not overlap each other. Thus, the virtual keyboard can be prevented from blocking the content displayed in the windows, and the use experience of users when using multi-window display can be improved.

Description

A multi-window display method and device

This application claims priority for the Chinese patent application with application number 202210791020. rights, the entire contents of which are incorporated herein by reference.

Technical field

The present application relates to the field of electronic equipment, and in particular, to a multi-window display method and equipment.

Background technique

At present, terminals such as mobile phones have become electronic devices that are frequently used in people's daily lives and work. A large part of people's lives and work can be completed on mobile phones. In order to improve the processing efficiency of the mobile phone, multiple windows can be displayed on the mobile phone, and different content can be displayed in each window, making it convenient for users to handle business in different windows. However, when users currently use multiple windows, they will face problems such as the virtual keyboard blocking the interface content, which affects the user experience.

Contents of the invention

Embodiments of the present application provide a multi-window display method and device, which can avoid blocking the window content when calling up the virtual keyboard and improve the input efficiency of the terminal.

In order to achieve the above purpose, this application adopts the following technical solutions:

In a first aspect, this application provides a multi-window display method, which can be applied to electronic devices. The method includes: the electronic device displays a first window in the full screen of the display screen, and displays a second window in the first area of the display screen; wherein , the second window is located on the upper layer of the first window, and the display area of the second window is smaller than the display area of the first window; the electronic device receives the first operation, the first operation is used to instruct the display of the virtual keyboard; in response to the first operation, The electronic device displays the second window in the second area of the display screen, displays the first window in the third area of the display screen, and displays the virtual keyboard in the fourth area of the display screen; wherein the second area, the third area and the fourth area Do not overlap each other.

Through the method provided by this application, when the electronic device displays a virtual keyboard, the size of the full-screen window can be automatically adjusted, thereby avoiding the virtual keyboard from blocking the window display content.

In one possible design, the first and second areas are identical. That is to say, the size and position of the second window may not be adjusted, and only the position and size of the first window may be adjusted.

In one possible design, the first area is different from the second area. The second window displayed in the first area has the same size as the second window displayed in the second area; or, the second window displayed in the first area has the same size as the second window displayed in the second area. Differently, the size of the second window displayed in the second area is smaller than the size of the second window displayed in the first area. That said, the size/position of the second window can also be adjusted.

In a possible design, the size of the second window displayed in the second area is smaller than the size of the second window displayed in the first area, including: the height of the second window displayed in the second area is smaller than the height of the second window displayed in the first area. The height of the second window displayed in an area.

In a possible design, the electronic device displays a second window in a second area of the display screen, displays a first window in a third area of the display screen, and displays a virtual keyboard in a fourth area of the display screen, including: the electronic device displays A virtual keyboard is drawn in a fixed area of the display screen; the fourth area is the fixed area; the electronic device determines the area in the display screen other than the virtual keyboard as a drawing area that allows drawing of the application window; the electronic device draws the first window in the drawing area and a second window; the drawing area includes a second area and a third area.

In this implementation, by drawing the first window and the second window in an area other than the virtual keyboard, it is possible to avoid the virtual keyboard from blocking the window display content.

In one possible design, the electronic device reduces the first window from the first size to the second size in equal proportions. Through this method, the content displayed in the first window can be adjusted proportionally.

In one possible design, in response to the first operation, the electronic device displays a second window in a second area of the display screen, and displays a first window in a third area of the display screen, including: in response to the first operation, Reduce the first window so that the second window is displayed in the second area of the display screen and the first window is displayed in the third area of the display screen; or, in response to the first operation, reduce the first window, move upward, upward and Move the second window to the left, or move it up and to the right, so that the second window is displayed in the second area of the display screen, and the first window is displayed in the third area of the display screen; or, in response to the first operation, zoom out The first window moves up, up and to the left, or the second window moves up and to the right, and the second window is reduced so that the second window is displayed in a second area of the display screen, and in a third area of the display screen Show first window.

In a possible design, the second area, the third area and the fourth area fill the display area of the display screen.

In this implementation, the second window displayed in the second area, the first window displayed in the third area, and the fourth window displayed by the virtual keyboard exactly fill the display area of the display screen, which can improve the efficiency of the display screen and the interface display. of aesthetics.

In a possible design, the method further includes: the electronic device receives a drag operation acting on adjacent edges of the first window and the second window; in response to the drag operation, the electronic device controls the second area to adjust to the fifth area, and control the third area to be adjusted to the sixth area, the fifth area displays the second window, and the sixth area displays the first window.

In this implementation, after the first window and the second window are automatically adjusted, the user can further adjust the sizes of the first window and the second window to improve the flexibility of multi-window display.

In a possible design, the first operation is an operation that acts on the second window. For example, the first operation is an operation that acts on the input box of the second window.

In a possible design, the method further includes: the electronic device receives a second operation that acts on the first window or the second window; in response to the second operation, the virtual keyboard disappears, and the electronic device displays the first full-screen display on the display screen. window to display a second window in the first area of the display screen.

In this implementation, after the virtual keyboard disappears, the first window and the second window can be restored to their original display status, which can improve the user's operating experience.

In a possible design, the method further includes: the electronic device receives a first preset operation; in response to the first preset operation, the electronic device displays the second window in the full screen of the display screen, and displays the second window in the seventh area of the display screen. A first window; wherein the first area and the seventh area are the same or different.

In this implementation manner, the electronic device can switch the display form of the first window and the second window through the first preset operation.

In a second aspect, the present application provides a multi-window display method, which method can be applied to electronic devices. The method includes: the electronic device displays a first window in the full screen of the display screen, and displays a second window in the first area of the display screen; wherein , the second window is located on the upper layer of the first window, and the display area of the second window is smaller than the display area of the first window; the electronic device receives the first preset operation; in response to the first preset operation, the electronic device displays the full screen on the display screen The second window displays the first window in the seventh area of the display screen; wherein the first area and the seventh area are the same or different.

In a possible design, the first preset operation is a gesture operation acting on the second window, or the first preset operation is a click operation acting on the switching control of the second window.

Through the method provided by this application, the electronic device can conveniently switch the display form of the full-screen window and the small window through the first preset operation, thereby improving the user's experience of using multi-window display.

A third aspect provides a display device, which can be applied to electronic equipment. The device can include: a display unit configured to display a first window in full screen on a display screen of the electronic device, and to display a second window in a first area of the display screen. Window; wherein, the second window is located on the upper layer of the first window, and the display area of the second window is smaller than the display area of the first window; the input unit is used to receive the first operation, the first operation is used to instruct the display of the virtual keyboard; display The unit is further configured to display a second window in a second area of the display screen, a first window in a third area of the display screen, and a virtual keyboard in a fourth area of the display screen in response to the first operation; wherein, the The second area, the third area and the fourth area do not overlap with each other.

A fourth aspect provides a display device, which can be applied to electronic equipment. The device can include: a display unit configured to display a first window in full screen on a display screen of the electronic device, and to display a second window in a first area of the display screen. window; wherein, the second window is located on the upper layer of the first window, and the display area of the second window is smaller than the display area of the first window; the input unit is used to receive the first preset operation; the display unit is also used to respond to the third window. In a preset operation, the electronic device displays the second window in the full screen of the display screen, and displays the first window in the seventh area of the display screen; wherein the first area and the seventh area are the same or different.

A fifth aspect provides a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by an electronic device, the electronic device enables the electronic device to implement the first aspect or any of the possible implementations of the first aspect. The method described above, or the method described in any one of the second aspect or possible implementations of the second aspect is implemented.

In a sixth aspect, an electronic device is provided. The electronic device includes a display screen, one or more processors and a memory; the display screen, the processor and the memory are coupled; the memory is used to store computer program code, and the computer program code includes computer instructions, When the computer instructions are executed by the electronic device, the electronic device is caused to perform the method as described in any one of the first aspect or the possible implementation of the first aspect, or to perform the second aspect or the possible implementation of the second aspect. any one of the methods.

In a seventh aspect, a computer program product is provided, including computer readable code, or a non-volatile computer readable storage medium carrying the computer readable code. When the computer readable code is run in an electronic device, the electronic device The processor in the device performs the method described in any one of the first aspect or the possible implementation of the first aspect, or performs the second aspect or the possible implementation of the second aspect. The method described in any of the possible implementation methods.

It can be understood that the above-mentioned display device according to the third aspect, the display device according to the fourth aspect, the computer-readable storage medium according to the fifth aspect, the electronic device according to the sixth aspect, and the seventh aspect The beneficial effects that can be achieved by the computer program product can be referred to the beneficial effects of the first aspect and any possible implementation thereof, and the beneficial effects of the second aspect and any possible implementation thereof. The effect will not be described here.

Description of the drawings

Figure 1 is a schematic diagram of a display interface in a related technology provided by an embodiment of the present application;

Figure 2 is a schematic diagram of a display interface in another related technology provided by an embodiment of the present application;

Figure 3 is a schematic diagram of a display interface in yet another related technology provided by an embodiment of the present application;

Figure 4 is a schematic diagram of a display interface in yet another related technology provided by an embodiment of the present application;

Figure 5 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

Figure 6 is a schematic diagram of the software architecture of an electronic device provided by an embodiment of the present application;

Figure 7 is a schematic diagram of a multi-window display method provided by an embodiment of the present application;

Figure 8 is a schematic diagram of a display interface provided by an embodiment of the present application;

Figure 9 is a schematic diagram of another multi-window display method provided by an embodiment of the present application;

Figure 10 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application;

Figure 11 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application;

Figure 12 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application;

Figure 13 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application;

Figure 14 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application;

Figure 15 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application;

Figure 16 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application;

Figure 17 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application;

Figure 18 is a schematic diagram of the software structure of an electronic device provided by an embodiment of the present application;

Figure 19 is a schematic flow chart of a multi-window display method provided by an embodiment of the present application;

Figure 20 is a schematic flow chart of another multi-window display method provided by an embodiment of the present application.

Figure 21 is a schematic diagram of the composition of a display device provided by an embodiment of the present application;

Figure 22 is a schematic diagram of the composition of a chip system provided by an embodiment of the present application.

Detailed ways

In the following, some terms used in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

The at least one involved in the embodiments of this application includes one or more; where multiple means greater than or equal to two. In addition, it should be understood that in the description of this specification, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood to express or imply relative importance, nor can they be understood to express Or suggestive order. For example, the first window and the second window do not represent the importance of the two or the order of the two, but are only used to differentiate the description. In the embodiment of this application, "and/or" only describes the association relationship, indicating that three relationships can exist, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone. these three situations. In addition, the character "/" in this article generally indicates that the related objects are an "or" relationship.

The directional terms mentioned in the embodiments of the present application, such as "upper", "lower", "left", "right", "inner", "outer", etc., are only for reference to the direction of the drawings. Therefore, use The orientation terms are used to describe and understand the embodiments of the present application better and more clearly, but do not indicate or imply that the device or component referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present application. Limitations of Application Examples.

Reference in this specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the specification. Therefore, the phrases "in one embodiment", "in some embodiments", "in other embodiments", "in other embodiments", etc. appearing in different places in this specification are not necessarily References are made to the same embodiment, but rather to "one or more but not all embodiments" unless specifically stated otherwise. The terms “including,” “includes,” “having,” and variations thereof all mean “including but not limited to,” unless otherwise specifically emphasized.

In order to improve processing efficiency, multiple windows can be displayed on electronic devices (such as mobile phones). For example, when the electronic device receives an operation for opening multiple windows, the multiple windows are displayed. Among them, the operation for opening multiple windows can be various types of operations. One implementation method is that, see (a) in Figure 1, the electronic device displays window A. For example, window A is a video playback window. When the electronic device receives from the screen When you slide inward from the right edge (or left edge) or slide inward from the right edge (or left edge) of the screen and pause for a certain period of time, the smart multi-window application bar 101 can be called up, as shown in (b in Figure 1 ) shown. The smart multi-window application bar 101 includes icons for various applications, such as icon, memo icon, etc. When the electronic device receives a message for the smart multi-window application bar 101 The operation of the icon can be opened Window B displays the multi-window interface as shown in (c) in Figure 1. The interface shown in (c) in Figure 1 includes window B and window A, where window B is located on the upper layer of window A. Therefore, multiple windows can be opened in the manner shown in Figure 1. At this time, as shown in (d) in Figure 1, when the user clicks on the input box in window B to input text, the virtual keyboard area will be displayed at the bottom of the screen, and the virtual keyboard area blocks the video screen being played in window A. , which will have a greater impact on the user experience. In addition, the user's purpose at this time may be to operate window B, but the display size of window B is small and inconvenient for the user to operate. Therefore, the user can switch window B to full-screen display, for example, by dragging By operating window B to the center of the screen, or by operating controls on window B, as shown in (e) in Figure 1, window B is switched to full-screen display. However, at this time, the user cannot watch the video images in window A at the same time, which affects the user's efficiency in using the electronic device. Further, the user can open the window A corresponding to the video application again through the smart multi-window application bar 101 as shown in (b) of Figure 1. The operation process is the same as that shown in (b) and (c) of Figure 1 The process of opening window B is similar and will not be described again. As shown in (f) in Figure 1, at this time, window A is located on the upper layer of window B, and the user can use the chat application and the video playback application at the same time.

Another implementation method is, please refer to (a) in Figure 2. The electronic device displays window A. For example, window A is a video playback window. While the user is watching the video played in window A, he receives A notification message. When the electronic device receives the user's click operation or pull-down operation on the notification message, it can open window B of the application corresponding to the notification message, that is, display the multi-window interface as shown in (b) of Figure 2. Similar to Figure 1, the user can click on the input box in window B to perform input operations, or switch window B to full-screen display.

It should be noted that Figure 1 and Figure 2 are only examples of two ways to open multiple windows. In actual applications, multiple windows can also be opened through other ways (such as tapping the screen with your knuckles). Embodiments of the present application Not giving examples one by one.

For example, as shown in (c) and (d) in Figure 1 and (b) in Figure 2, window A may be a full-screen window (or understood as a full-screen application interface), and window B may be A small window is displayed suspended on window A, that is, the display area of window B is smaller than that of window A. For example, window B may be a freeform small window (or called: free window). The free small window can be considered as a system-level floating window. Using the free small window function, the entire application window can be displayed in the form of a free small window. Regardless of whether the user switches pages or opens other applications or desktops, this free small window remains on top. For example, a free small window can be understood as having functions such as dynamic movement, size scaling, etc. on the display screen. Various interfaces can be opened in the free small window. For example, free small windows can use view technology to lay out and draw information (text, images, etc.) in the interface to display various styles of interfaces to users. In some embodiments, a newly opened interface in a free window can overwrite a previously opened interface.

In some embodiments, when the electronic device displays multiple windows, the position of the small window (such as window B) can be moved. For example, please refer to (a) in Figure 3. When an operation on the status bar 301 of window B is received (such as a long press and drag operation anywhere in the blank area of the status bar 301), the window can be changed. The position of B is as shown in (b) in Figure 3. In other embodiments, when the electronic device displays multiple windows, the size of the small window (such as window B) can be scaled. For example, please refer to (a) in Figure 4. When a drag operation to the left for the left edge of window B is received, the width of small window B can become larger, as in (b) in Figure 4. In addition, the size of the small window can be scaled proportionally, or only the width or height can be increased, which is not limited in this application. It can be understood that when the position of the free small window is changed and/or the size is scaled, the interface in the free small window can also be correspondingly changed in position and/or resized to adapt to the change of the free small window.

It can be seen that in related technologies, when a user opens a new interface (for example, opening a new application through the smart multi-window application bar, or clicking on a notification message), the new interface will be displayed in the form of a small window. Due to the size of the small window It is small and it is inconvenient for users to operate the newly opened interface. If the user switches the new interface to full-screen display, the original window will disappear, and subsequent users need to open the original full-screen window again, which affects the user's experience of using the multi-window interface. In addition, when the user calls up the virtual keyboard, the area displayed by the virtual keyboard will block the original full-screen display interface, affecting the user experience.

Based on this, embodiments of the present application provide a multi-window display method, which can be applied to electronic devices. Using the method provided by this embodiment, the display forms of the full-screen window and the small window can be switched conveniently. In addition, when the virtual keyboard is displayed on the display screen, the full-screen window can be automatically reduced, and the small window can be automatically adjusted in position and size, thereby avoiding the virtual keyboard from blocking the content displayed in the full-screen window and/or the small window. In this way, the user's experience using multi-window display can be improved.

For example, the electronic device in the embodiment of the present application can be a mobile phone (such as a folding screen mobile phone, a candy bar mobile phone), a tablet computer, a handheld computer, a PC, a cellular phone, a personal digital assistant (PDA), a wearable Equipment (such as smart watches), vehicle-mounted computers, game consoles, and augmented reality (AR)/virtual reality (VR) equipment, etc. This embodiment does not place special restrictions on the specific form of the terminal. In addition, the technical solution provided by this embodiment can be applied not only to the above-mentioned electronic devices (or mobile terminals), but also to other electronic devices, such as smart home devices (such as televisions).

The implementation of the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

In this embodiment, the electronic device is a mobile phone as an example. Please refer to FIG. 5 , which is a schematic structural diagram of a mobile phone provided by an embodiment of the present application. The methods in the following embodiments can be implemented in a mobile phone with the above hardware structure.

As shown in Figure 5, the mobile phone may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, and an antenna. 1. Antenna 2, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193 and display screen 194, etc. Optionally, the mobile phone may also include a mobile communication module 150, a subscriber identification module (subscriber identification module, SIM) card interface 195, etc.

Among them, the sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and an environment. Light sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the mobile phone. In other embodiments, the mobile phone may include more or fewer components than shown in the figures, or some components may be combined, or some components may be separated, or may be arranged differently. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) wait. Among them, different processing units can be independent devices or integrated in one or more processors.

The controller can be the nerve center and command center of the phone. The controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. Interfaces may include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver and transmitter (universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, SIM interface, and/or USB interface, etc.

The charging management module 140 is used to receive charging input from the charger. While the charging management module 140 charges the battery 142, it can also provide power to the mobile phone through the power management module 141. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 can also receive input from the battery 142 to power the mobile phone.

The wireless communication function of the mobile phone can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in a phone can be used to cover a single or multiple communication bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.

When the mobile phone includes the mobile communication module 150, the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G that are applied to the mobile phone. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be disposed in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

A modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194. In some implementations In this example, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the mobile phone including wireless local area networks (WLAN) (such as Wi-Fi network), Bluetooth (bluetooth, BT), global navigation satellite system (global navigation satellite system, GNSS), Wireless communication solutions such as frequency modulation (FM), NFC, and infrared technology (infrared (IR)). The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

In some embodiments, the antenna 1 of the mobile phone is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the mobile phone can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi) -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).

The mobile phone implements display functions through the GPU, display screen 194, and application processor. The GPU is an image processing microprocessor and is connected to the display screen 194 and the application processor. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, videos, etc. Display 194 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode). emitting diode (AMOLED), flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diode (QLED), etc. In some embodiments, the mobile phone may include 1 or N display screens 194, where N is a positive integer greater than 1.

The mobile phone can realize the shooting function through the ISP, camera 193, video codec, GPU, display 194 and application processor. In some embodiments, the mobile phone may include 1 or N cameras 193, where N is a positive integer greater than 1.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. Such as saving music, videos, etc. files in external memory card.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The processor 110 executes instructions stored in the internal memory 121 to execute various functional applications and data processing of the mobile phone. The internal memory 121 may include a program storage area and a data storage area. Among them, the stored program area can store an operating system, at least one application program required for a function (such as a sound playback function, an image playback function, etc.). The storage data area can store data created during the use of the mobile phone (such as audio data, phone book, etc.). In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

The mobile phone can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playback, recording, etc.

The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, pressure sensor 180A may be disposed on display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. When a touch operation is performed on the display screen 194, the mobile phone detects the strength of the touch operation according to the pressure sensor 180A. The mobile phone can also calculate the touch position based on the detection signal of the pressure sensor 180A.

The gyro sensor 180B can be used to determine the movement posture of the mobile phone. Air pressure sensor 180C is used to measure air pressure. Magnetic sensor 180D includes a Hall sensor. The mobile phone can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. The acceleration sensor 180E can detect the acceleration of the mobile phone in various directions (generally three axes). Distance sensor 180F for measuring distance. The mobile phone can use the proximity light sensor 180G to detect when the user is holding the mobile phone close to the ear to talk, so that the screen can be automatically turned off to save power. The proximity light sensor 180G can also be used in holster mode, and pocket mode automatically unlocks and locks the screen. The ambient light sensor 180L is used to sense ambient light brightness. Fingerprint sensor 180H is used to collect fingerprints. The mobile phone can use the collected fingerprint characteristics to unlock the fingerprint, access the application lock, take pictures with the fingerprint, answer incoming calls with the fingerprint, etc. Temperature sensor 180J is used to detect temperature.

Touch sensor 180K, also called "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K It forms a touch screen with the display screen 194, also called a "touch screen". The touch sensor 180K is used to detect a touch operation on or near the touch sensor 180K. The touch sensor can pass the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the mobile phone in a position different from that of the display screen 194 .

Bone conduction sensor 180M can acquire vibration signals. The buttons 190 include a power button, a volume button, etc. Key 190 may be a mechanical key. It can also be a touch button. The motor 191 can generate vibration prompts. The motor 191 can be used for vibration prompts for incoming calls and can also be used for touch vibration feedback. The indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, or may be used to indicate messages, missed calls, notifications, etc.

When the mobile phone includes a SIM card interface 195, the SIM card interface 195 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation from the mobile phone. The mobile phone can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The mobile phone interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the mobile phone uses an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the mobile phone and cannot be separated from the mobile phone.

In the embodiment of this application, the software system of the electronic device is the Android system as an example to illustrate the software structure of the electronic device. Please refer to FIG. 6 , which is a schematic diagram of the software architecture of a terminal provided by an embodiment of the present application.

The software structure of electronic equipment can be a layered architecture. For example, the software can be divided into several layers, and each layer has clear roles and division of labor. The layers communicate through software interfaces. Assuming that the electronic device is an Android system, it may include an application layer (referred to as the application layer), an application framework layer (referred to as the framework layer) (framework, FWK), a hardware layer, and so on.

Among them, the application package can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions. For example, the application framework layer can include window managers, content providers, view systems, phone managers, resource managers, notification managers, etc. Among them, the window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc. Content providers are used to store and retrieve data and make this data accessible to applications. Said data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls that display text, controls that display pictures, etc. A view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures. The phone manager is used to provide communication functions of the electronic device 100 . For example, call status management (including connected, hung up, etc.). The resource manager provides various resources to applications, such as localized strings, icons, pictures, layout files, video files, and more. The notification manager allows applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be notifications that appear in the status bar at the top of the system in the form of charts or scroll bar text, such as notifications for applications running in the background, or notifications that appear on the screen in the form of conversation windows. For example, text information is prompted in the status bar, a beep sounds, the electronic device vibrates, the indicator light flashes, etc.

Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system. The core library contains two parts: one is the functional functions that need to be called by the Java language, and the other is the core library of Android. Among them, the application layer and application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and application framework layer into binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions. System libraries can include multiple functional modules. For example: surface manager (surface manager), media libraries (Media Libraries), 3D graphics processing libraries (for example: OpenGL ES), 2D graphics engines (for example: SGL), etc. The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition, and layer processing. 2D Graphics Engine is a drawing engine for 2D drawing.

In other embodiments, the system library may also include a window processing module for controlling the hiding, appearance, shrinking, and enlarging of windows. It should be noted that the window processing module may be a module in the system library, or may be a module in other layers, such as a module in the application framework layer or the kernel layer, which is not limited in the embodiment of the present application.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

The following takes the software structure shown in Figure 6 as an example to illustrate the processing flow of the multi-window display method provided by the embodiment of the present application.

For example, when a first window and a second window are displayed on the display screen of the electronic device, the touch sensor in the hardware layer receives a first input event acting on the second window. The first input event includes operation type, operation time, position on the display screen, etc. Touch sensors will be the first Input events are reported to higher levels, such as the window processing module in the system library. The higher level determines that the input event is a click operation on the input box in the second window, and then calls the display driver to display the virtual keyboard on the display screen.

The technical solutions provided by the embodiments of the present application are described in detail below.

Figure 7 is a schematic diagram of a multi-window display method provided by an embodiment of the present application. As shown in (a) of Figure 7, the electronic device displays the first window in full screen. The first window displays a first application, where the first application may be any application in the electronic device. For example, the first application is a video playback application. While the user is watching the video, he or she receives a notification message. The notification message may come from a second application in the electronic device, and the second application may be any application in the electronic device. For example, the first application and the second application are different applications. For example, the second application is a chat application. Within the preset time, if the user performs a click operation or a pull-down operation on the notification message, the electronic device can open the second application corresponding to the notification message in the second window. As shown in (b) of FIG. 7 , in response to the user's click operation or pull-down operation on the notification message, the second window displays an interface corresponding to the notification message, where the second window is a window displayed in full screen. At the same time, the first window can be automatically switched to a small window for display. The first window is located on the upper layer of the second window, and the display area of the first window is smaller than the display area of the second window. In this embodiment, when the user receives the notification message, since the newly opened message is likely to be the message that the user wants to pay attention to, the electronic device can open the application window corresponding to the notification message in full screen form to facilitate the user to view the newly received message. Perform temporary processing.

In one possible implementation, the size and proportion of the initial small window after automatic switching may be default. For example, as shown in (b) of Figure 7 , the small window may default to a vertically displayed window. In another possible implementation, the size and proportion of the initial small window after automatic switching can be determined based on the interface content. For example, as shown in (c) in Figure 7, when a full-screen video interface is displayed in the first window , the initial small window after automatic switching can be a horizontally displayed window, which can make the content displayed in the small window more consistent with the proportion of the small window. In another possible implementation, the size of the initial small window after automatic switching can be determined according to the type of application. For example, a video application corresponds to a horizontal small window, and a chat application corresponds to a vertical small window. This application does not limit this.

It should be noted that in the above embodiment, the user receives the notification message as an example. When the user opens the small window through other operations, the above process can also be similar. For example, when a user opens a new application by calling up the smart multi-window application bar, the newly opened application window can be displayed in full screen form, and the application window that was previously displayed in full screen will automatically switch to a small window display.

In some embodiments, when the user is processing a temporary task (such as replying to a chat message) in the full-screen second window and needs to continue processing the main task (such as watching a video) in the first window, the user can use the first preset The operation switches the display form (or window form) of the first window and the second window. For example, the display form of the window may include full-screen display, small window display, etc. As shown in (d) in Figure 7, in response to the first preset operation, the first window is switched to full-screen display again, and the second window is switched to small window display. The second window is located on the upper layer of the first window. The display area is smaller than the display area of the first window. Optionally, the user can perform the first preset operation again to switch the first window to a small window display and the second window to a full-screen display, that is, as shown in (b) in Figure 7 or (c) in Figure 7 the display format shown. It can be understood that by performing the first preset operation, the user can freely switch the display forms of the first window and the second window, and freely choose whether to display the first window or the second window without interrupting the tasks in the first window and the second window. Tasks in the second window are processed in full screen, thereby improving the user's efficiency in multi-window operations.

In a possible implementation, the first preset operation may be a gesture operation. For example, the first preset operation may be a gesture operation that acts on a small window, or a gesture operation that acts on a full-screen window, or a gesture operation that drags a small window to a specific hotspot of the full-screen window, etc. This application does not cover this. Make limitations. In another possible implementation, as shown in Figure 8, the status bar in the small window may display a switching control 801, a minimizing control 802, a closing control 803, etc. When receiving an operation for the switching control 801 in the status bar of the small window, the small window can be switched to a full-screen window, and at the same time, the full-screen window is switched to a small window. When receiving an operation for the minimize control 802 in the status bar of the small window, the small window can be minimized, for example, switched to a smaller window or a prompt bar. When receiving an operation for the close control 803 in the status bar of the small window, the small window can be closed, that is, only the full-screen window is displayed on the display screen. In another possible implementation, the first preset operation may be an operation on a preset physical key or virtual key. Optionally, the physical key or virtual key may be preset by the system or predefined by the user. Taking the operation of physical buttons as an example, the user can switch the display mode of the first window and the second window by pressing the volume key twice in succession. It can be understood that the first preset operation can also be other operations, which is not limited in this application.

Correspondingly, the background processing flow corresponding to the embodiment shown in Figure 7 will be described in detail below. Taking the main task as the task corresponding to the first application displayed in the first window and the temporary task as the task corresponding to the second application displayed in the second window as an example, the background processing process may include the following steps:

Step 1: The electronic device displays the first window of the first application in full screen;

Step 2: The electronic device receives the task of the second application;

Step 3: The electronic device displays the second window of the second application in full screen and displays the first window of the first application in a small window;

Step 4: The electronic device receives the user's operation and switches the first window and the second window;

Step 5: The electronic device displays the first window of the first application in full screen and displays the second window of the second application in a small window.

In the embodiment shown in Figure 7, there is only one small window on the full-screen window, and the user can switch the first window and the second window through the first preset operation. The display form of the mouth. In some other embodiments, there may be multiple small windows on the full-screen window, and the user can switch the display modes of the target small window and the full-screen window by operating on the target small window. For example, as shown in (a) of FIG. 9 , the electronic device displays the second window in full screen, and the first window and the third window displayed in small windows are superimposed on the second window. As shown in (b) of FIG. 9 , in response to the second preset operation acting on the first window, the first window can be switched to full-screen display, and the second window can be switched to small window display. In other words, the display mode of the target small window acted by the user can be switched between the full-screen window and the small window targeted by the user. Similarly, in response to the second preset operation on the third window, the third window can be switched to full-screen display, and the second window can be switched to small window display (not shown in the figure). Optionally, the second preset operation may be a gesture operation acting on the target small window, an operation acting on a control of the target small window, etc. This application does not limit this.

Figure 10 is a schematic diagram of another multi-window display method provided by an embodiment of the present application. As shown in (a) of Figure 10, the electronic device displays the first window in full screen, and the first window displays the first application. A second window displayed in the form of a small window is superimposed on the first window. The second window is located in the upper right corner of the display screen, and the second window displays the second application. The first application and the second application may be any application in the electronic device. For example, when the user clicks on the input box in the second window to input text, the virtual keyboard area may be displayed on the display screen. Optionally, the virtual keyboard area may be a fixed area of the display screen, such as the bottom area of the display screen.

In order to avoid the virtual keyboard area blocking the display content of the first window and the second window, when the user clicks the input box in the second window to trigger the display of the virtual keyboard area, the electronic device can display the area other than the virtual keyboard area on the display screen. A drawing area that allows drawing of the application window is determined, and the first window and the second window are drawn in the drawing area. Detailed introduction is given below.

In one possible implementation, as shown in (b) of Figure 10, when the user clicks the input box in the second window to input text, the height of the second window is H1 and the height of the virtual keyboard area is H2. The sum of H1 and H2 does not exceed the height of the display area of the electronic device display screen. The first window can be reduced proportionally, thereby avoiding the virtual keyboard area from blocking the first window. For example, the width of the second window is W1, and the width of the first window can be automatically adjusted to W2, where the sum of W1 and W2 is equal to the width of the display area of the electronic device display screen. Further, the height of the first window can be obtained based on the adjusted width W2 of the first window and the original aspect ratio of the first window.

Optionally, the first window can also be proportionally reduced according to other methods. For example, the height of the first window can be automatically adjusted to H1, and the width of the first window can be obtained based on the adjusted height H1 of the first window and the original aspect ratio of the first window. This application does not limit this.

In another possible implementation, as shown in (c) in Figure 10, when the user clicks the input box in the second window to input text, the height of the second window is H1 and the height of the virtual keyboard area is H2. , the sum of H1 and H2 does not exceed the height of the display area of the electronic device display screen. The width of the first window can be adjusted according to the width of the second window. For example, the width of the second window is W1, and the width of the first window can be automatically adjusted to W2, where the sum of W1 and W2 is equal to the width of the display area of the electronic device display screen. In addition, the height of the second window can be adjusted to be the same as the first window, that is, to H1, to obtain better display effects.

In another possible implementation, as shown in (d) in Figure 10, when the user clicks the input box in the second window to input text, the height of the second window can be adjusted to H3, the height of the virtual keyboard area is H2, the sum of H2 and H3 is equal to the height of the display area of the electronic device display screen. The second window can be adjusted according to the remaining display area of the display screen. For example, the height of the second window can be adjusted to be the same as the first window, that is, adjusted to H3, and the width of the second window can be automatically adjusted to W2, where the sum of W1 and W2 is equal to the width of the display area of the electronic device. . In this implementation, when the user clicks the input box in the second window to display the virtual keyboard area, the sizes of both the first window and the second window can be adjusted to fill the display area of the display screen, thereby improving the display quality of the display screen. efficiency and the beauty of the interface display.

In the embodiment shown in Figure 10, when the user clicks the input box in the second window to input text, the size of the first window can be automatically adjusted, and ultimately the first window, the second window and the virtual keyboard area do not overlap, so that This avoids blocking the window content when displaying the virtual keyboard area, improving the user experience.

Figure 11 is a schematic diagram of another multi-window display method provided by an embodiment of the present application. As shown in (a) of Figure 11, the electronic device displays the first window in full screen, and the first window displays the first application. A second window displayed in the form of a small window is superimposed on the first window. The second window is located in the middle right area of the display screen, and the second window displays the second application. The first application and the second application may be any application in the electronic device. As shown in (b) of Figure 11, when the user clicks on the input box in the second window to input text, the virtual keyboard area may be displayed in the bottom area of the screen. The height of the second window is H1, the height of the virtual keyboard area is H2, and the sum of H1 and H2 does not exceed the height of the display area of the electronic device display screen. For example, the position of the second window can be changed to avoid the virtual keyboard area from blocking the content displayed in the second window. As shown in (b) of Figure 11, the second window can be moved to the upper right corner of the display screen.

It can be understood that the position of the second window can be moved according to the actual situation. For example, the second window can be moved upward, upward and left, upward and right, etc. Optionally, the moving direction of the second window may be related to its initial display position. For example, when the second window is initially displayed in the middle right area of the display screen, the second window may move upward and to the right. For example, the second window may move upward and to the right. When the window is initially displayed in the middle left area of the display screen, the second window can move upward and to the left, and this application does not impose restrictions on this.

In addition, the first window can be reduced proportionally, or the width of the first window can be adjusted according to the width of the second window, or the height of the first window can be adjusted according to the height of the second window, or the first window and The size of the second window can be adjusted to fill the display area of the display screen. For specific adjustment methods, please refer to the relevant expressions of the embodiment shown in FIG. 10 , which will not be described again in this application.

In the embodiment shown in Figure 11, when the user clicks the input box in the second window to input text, the position of the second window can be moved, and the size of the first window can be automatically adjusted. Finally, the first window, the second window The windows and the virtual keyboard area do not overlap, thereby avoiding the obstruction of the contents of the first window and the second window when the virtual keyboard area is displayed, and improving the user experience.

Figure 12 is a schematic diagram of another multi-window display method provided by an embodiment of the present application. As shown in (a) of Figure 12, the electronic device displays the first window in full screen, and the first window displays the first application. A second window displayed in the form of a small window is superimposed on the first window. The second window is located in the upper right corner of the display screen, and the second window displays the second application. The first application and the second application may be any application in the electronic device. For example, when the user clicks on the input box in the second window to input text, a virtual keyboard area may be displayed at the bottom of the screen.

In one possible implementation, as shown in (b) of FIG. 12 , the sum of the original height H1 of the second window and the virtual keyboard area H2 is greater than the height of the display area of the display screen. Therefore, when the user clicks on the input box in the second window to input text, the height of the second window can be reduced to H4. The sum of H2 and H4 is equal to the height of the display area of the display screen, thereby avoiding the virtual keyboard area from blocking the second window. In addition, the first window can be reduced proportionally, thereby avoiding the virtual keyboard area from blocking the first window. For example, the height of the first window can be adjusted to be the same as the first window, that is, adjusted to H4. Further, the width of the first window can be obtained based on the adjusted height H4 of the first window and the original aspect ratio of the first window.

As shown in (b) of Figure 12, after the first window is scaled down, the sum of the height H4 of the first window and the height H2 of the virtual keyboard area is equal to the height of the display area of the display screen. In other embodiments, after the first window is scaled down, the sum of the width of the first window and the width of the second window may be equal to the width of the display area of the display screen. In other embodiments, after the first window is scaled down, the sum of the width of the first window and the width of the second window may be smaller than the width of the display area of the display screen, and the height of the first window is equal to the height of the second window. The sum is less than the height of the display area of the display. In some embodiments, after the first window is scaled down, the first window, the second window and the virtual keyboard area can exactly fill the display area of the electronic device display screen.

In another possible implementation, as shown in (c) of Figure 12, the sum of the original height H1 of the second window and the virtual keyboard area H2 is greater than the height of the display area of the display screen. Therefore, when the user clicks on the input box in the second window to enter text, the height of the second window can be reduced to H4. The sum of H2 and H4 is equal to the height of the display area of the display screen, thereby avoiding the virtual keyboard area from blocking the second window. In addition, the second window can be adjusted according to the remaining display area of the display screen. For example, the height of the second window can be adjusted to be the same as the height of the first window, that is, adjusted to H4, and the width of the second window can be automatically adjusted to W2, where the sum of W1 and W2 is equal to the display area of the electronic device display. width. In this implementation, when the user clicks the input box in the second window to display the virtual keyboard area, the sizes of both the first window and the second window can be adjusted to fill the display area of the display screen, thereby improving the display quality of the display screen. efficiency and the beauty of the interface display.

In the embodiment shown in Figure 11, when the user clicks the input box in the second window to input text, since the sum of the original height of the first window and the virtual keyboard area is greater than the height of the display area of the display screen, the size of the second window can be Automatically adjust, and the size of the first window can also be automatically adjusted. In the end, the first window, the second window and the virtual keyboard area do not overlap, thus avoiding the interference of the contents of the first window and the second window when the virtual keyboard area is displayed. Occlusion improves the user experience.

Optionally, if the user clicks on the input box in the second window, the second window is located in the middle area of the display screen. When the user clicks on the input box in the second window for text input, the position of the second window is similar to that shown in Figure 11. In the embodiment, the movement is performed to avoid the virtual keyboard area from blocking the display content of the second window. For example, the second window can be moved to the upper right corner of the display. In addition, the sizes of the first window and the second window can be adjusted accordingly as shown in (b) and (c) in Figure 12 , for example, the height of the second window as shown in (b) in Figure 12 is reduced. Small is H4, the height of the first window is adjusted to H4 and scaled down. It can be understood that the position of the second window can be reduced and moved according to the actual situation. For example, the second window can be moved upward and reduced, moved upward and left and reduced, moved upward and right and reduced, etc.

In the above embodiments shown in Figures 10 to 12, when the user clicks the input box in the second window to trigger the display of the virtual keyboard area, the position of the first window and/or the second window can be moved according to the actual situation. And/or the size of the second window can be adjusted according to actual conditions to display the first window, the second window and the virtual keyboard area without overlapping each other on the display screen. It can be understood that the embodiments described in Figures 10 to 12 only provide exemplary adjustment methods for the first window and the second window. The first window and the second window can also have other more adjustment methods. This application provides This is not limited.

In the above embodiments shown in Figures 10 to 12, the user clicks on the input box in the second window to trigger the display of the virtual keyboard area as an example for illustrative introduction. It can be understood that in other embodiments, the user can also click on the first The input box in the window triggers the display of the virtual keyboard area, or the user triggers the display of the virtual keyboard area through other methods. When the virtual keyboard area is displayed on the display screen, the adjustment methods of the first window and the second window can refer to the relevant introductions in the above embodiments, and will not be described in detail here.

In some embodiments, when the virtual keyboard is retracted, for example, when the user clicks on an area outside the virtual keyboard area to retract the virtual keyboard, the position and/or size of the window can be restored to the display state before adjustment. For example, as shown in (a) in Figure 13, when the user clicks on the video playback area in the first window, as shown in (b) in Figure 13, the positions and sizes of the first window and the second window can be restored. The window display state before adjustment (that is, the state shown in (a) in Figure 12).

Correspondingly, the background processing flow corresponding to the embodiment shown in Figures 10 to 13 will be described in detail below. Taking the main task as the task corresponding to the first application displayed in the first window and the temporary task as the task corresponding to the second application displayed in the second window as an example, the background processing process may include the following steps:

Step 1: The electronic device displays the first window of the first application in full screen and displays the second window of the second application in a small window;

Step 2: The electronic device receives the operation of displaying the virtual keyboard;

Step 3: Adjust the position and/or size of the first window and/or the second window;

Step 4: The electronic device displays the first window, the second window and the virtual keyboard area without overlapping each other;

Step 5: The electronic device receives the operation to close the virtual keyboard area;

Step 6: The electronic device resumes displaying the first window of the first application in full screen and displaying the second window of the second application in a small window.

For example, the first window and the second window can be restored to their original display positions and/or sizes.

Optionally, after the first window and/or the second window are automatically adjusted, the user can further adjust the size of the first window and/or the second window. In one implementation, as shown in Figure 14, the user can adjust the sizes of the first window and the second window respectively. For example, as shown in (a) of Figure 14, when the user presses and holds the right edge of the first window and drags it to the left, as shown in (b) of Figure 14, the width of the first window gradually decreases. For another example, when the user presses and holds the left edge of the second window and drags it to the right, the width of the second window gradually decreases. In another implementation, when the user adjusts the width of one of the first window and the second window, the width of the other window will also be adjusted accordingly. For example, as shown in (a) of Figure 15, the sum of the widths of the first window and the second window is equal to the width of the display area of the display screen. At this time, when the user presses and holds the adjacent edges of the first window and the second window When dragging to the left, as shown in (b) in Figure 15, the width of the first window gradually decreases, and at the same time, the width of the second window gradually increases. For another example, when the user presses and holds the adjacent edges of the first window and the second window and drags them to the right, the width of the first window gradually increases and the width of the second window gradually decreases.

Optionally, after the first window and/or the second window are automatically adjusted, the user can further adjust the positions of the first window and the second window, for example, exchange the positions of the first window and the second window, etc.

In the above embodiments shown in FIGS. 14 and 15 , after the first window and/or the second window are automatically adjusted, the user can further manually adjust the size and/or position of the first window and/or the second window, thereby further Improved user experience for multi-window displays.

In some embodiments, two or more small windows may be superimposed on the full-screen window. Figure 16 is a schematic diagram of another multi-window display method provided by an embodiment of the present application. As shown in (a) of Figure 16, the electronic device displays the first window in full screen, and the first window displays the first application. The first window is superimposed with a second window and a third window displayed in the form of small windows. The second window displays the second application, and the third window displays the third application. The first application, the second application and the third application may be any application in the electronic device. For example, when the user clicks on the input box in the small window to trigger the display of the virtual keyboard area, the small window and/or the full-screen window acted upon by the user can be automatically adjusted. For example, as shown in (a) of Figure 16, when the user clicks the input box in the second window to trigger the display of the virtual keyboard area, the second window and the first window displayed in full screen can be automatically adjusted as shown in (a) of Figure 16 b), and the third window can be temporarily hidden, such as disappearing from the display or shrinking to a prompt bar, etc. For another example, as shown in (c) in Figure 16, when the user clicks on the input box in the third window to trigger the display of the virtual keyboard area, the third window and the first window displayed in full screen can be automatically adjusted to as shown in Figure 16 The state shown in (d), while the second window can be temporarily hidden. Optionally, since the second window is located in the right area of the display area before adjustment, and the third window is located in the left area of the display area, as shown in (b) of Figure 16, the second window after adjustment can be located in the display area. The upper right corner of the display area, as shown in (d) in Figure 16, the adjusted third window can be located in the upper left corner of the display area. It should be noted that Figure 16 only schematically shows one possible way to adjust the full-screen window and small windows. For the automatic adjustment of the position and size of the full-screen window and small windows, please refer to the embodiments shown in Figures 10 to 12 The relevant description will not be repeated here in this application. Optionally, the automatically adjusted window can also be adjusted manually as shown in Figure 14 or Figure 15.

In the embodiment shown in Figure 16, when there is more than one small window in the display area, and when the user clicks the input box in the target small window to trigger the virtual keyboard display area, the size of the full-screen window, that is, the first window, can be automatically adjusted. The last first window, the target small window clicked by the user, and the virtual keyboard area can be displayed without overlapping each other. Other small windows may be small windows that the user does not want to pay attention to at this time. Therefore, other small windows can be temporarily hidden, such as disappearing from the display screen or shrinking to a prompt bar. Therefore, the display area can display the tasks that the user wants to focus on at this time, while also avoiding the virtual keyboard area from blocking the display content, improving the user experience.

In some embodiments, when two or more small windows are superimposed on the full-screen window, the user can also trigger the display of the virtual keyboard area by clicking on the input box on the full-screen window. At this time, for example, the full-screen window and/or the target small window can be automatically adjusted to display the full-screen window, the target small window, and the virtual keyboard area without overlapping each other. Optionally, the target small window can be the small window most recently operated by the user and the window most recently opened by the user. a small window, or a preset small window for a certain application, etc. For the method of automatic adjustment of the full-screen small window and the target small window, reference can also be made to the relevant descriptions of the embodiments shown in FIGS. 10 to 12 , which will not be described again in this application. Optionally, the automatically adjusted window can also be adjusted manually as shown in Figure 14 or Figure 15.

For example, in the embodiment shown in Figure 16, when the virtual keyboard is retracted, for example, when the user clicks on an area outside the virtual keyboard area to retract the virtual keyboard, the position and/or size of the window can be restored to the display state before adjustment. For example, when the user clicks an area outside the virtual keyboard area, the position and size of each window can be restored from the state shown in (b) in Figure 16 to the state shown in (a) in Figure 16. The third window Can be redisplayed. For another example, when the user clicks on an area outside the virtual keyboard area, the position and size of each window can be restored from the state shown in (d) in Figure 16 to the state shown in (c) in Figure 16 . Secondly, The window can be redisplayed.

Figure 17 is a schematic diagram of another multi-window display method provided by an embodiment of the present application. As shown in (a) of FIG. 17 , the electronic device displays a first window and a second window in a split-screen mode, the first window displays a first application, and the second window displays a second application. The first application and the second application may be any application in the electronic device. As shown in (b) of Figure 17, when the user clicks on the input box in the second window to input text, the virtual keyboard area may be displayed in the bottom area of the screen. For example, the sizes of the first window and the second window can be automatically adjusted to avoid the virtual keyboard area from blocking the display content of the first window and the second window. As shown in (b) of Figure 17 , the height of the first window and the second window is reduced and the width remains unchanged. After adjustment, the first window, the second window and the virtual keyboard area fill the display area of the display screen. Optionally, the user can further adjust the position and size of the first window and the second window. For example, when the user presses and holds the adjacent edge of the first window and the second window and drags it to the left, the width of the first window gradually decreases, and at the same time, the width of the second window gradually increases. For another example, the user can swap the positions of the first window and the second window. Similarly, when the user clicks on an area outside the virtual keyboard area, the position and/or size of the first window and the second window can be restored to the split-screen display state before adjustment.

It can be understood that in the above embodiment, after the size of the window changes, the interface displayed in the window can still be the original interface, but the content of the interface can be adaptively adjusted according to the size and proportion of the window to match the display proportion of the window. .

Figure 18 is a schematic diagram of the software structure of an electronic device provided by an embodiment of the present application. As shown in FIG. 18 , the electronic device may include a main task application, a temporary task application, an input method application, a multitasking unit, a window management unit, an input management unit and a graphics display unit. The main task application may be the first application in the aforementioned embodiment, the temporary task application may be the second application in the aforementioned embodiment, and the input method application may be the application used to display the virtual keyboard area in the aforementioned embodiment. The multi-tasking processing unit can be responsible for monitoring user interaction events, monitoring input triggering and closing events of the input management unit, processing the status switching between main tasks and temporary tasks, calculating the display position, area and size of the multi-tasking window, etc. The window management unit can initialize the display of the window, change the size and position of the main task application and temporary task application windows according to the instructions of the multitasking unit, and notify the main task application and temporary task application windows of changes in size and position. The input management unit can be used to monitor user interaction events and control the triggering and closing of input method applications. The graphic display unit can be used to display the interfaces of the main task application, the temporary task application and the input method application.

For example, when the user clicks on the input box in the temporary task application (for example, the second application) to input text, the input management unit can monitor the user's click on the input box and trigger the input method application. The input snap-in can notify the multi-tasking snap-in that the window of the input method application has changed. Then, the multitasking unit may calculate the position, area, and size displayed by the main task application (eg, the first application), the temporary task application, and the input method application. Further, the multi-tasking processing unit can notify the window management unit to change the display position, area and size of the main task application, temporary task application and input method application, and the window management unit notifies the main task application, temporary task application and input method application. Finally, the main task application, the temporary task application and the input method application notify the graphics display unit to redraw the window and display the final adjusted interface.

Figure 19 shows a schematic flowchart of a multi-window display method provided by an embodiment of the present application. The method can be executed by an electronic device. The method includes:

S1901: The electronic device displays the first window in the full screen of the display screen, and displays the second window in the first area of the display screen.

S1902: The electronic device receives the first operation.

For example, the first operation may be an operation in which the user clicks on the input box of the first window or the second window.

S1903: In response to the first operation, the electronic device displays the second window in the second area of the display screen, the first window in the third area of the display screen, and the virtual keyboard in the fourth area of the display screen. Among them, the second area, the third area and the fourth area do not overlap with each other.

In some embodiments, the first area and the second area may be the same, that is, the display position and size of the second window remain unchanged. For example, as shown in (b) and (c) in Figure 10, the display position and size of the second window are the same before and after the virtual keyboard area is displayed.

In other embodiments, the first area and the second area may be different. In a possible implementation, as shown in FIG. 11 , the second window displayed in the first area and the second window displayed in the second area have the same size but different positions. In another possible implementation, as shown in Figure 12, the size of the second window displayed in the first area and the second window displayed in the second area are different, and the size of the second window displayed in the second area is smaller than The size of the second window displayed in the first area. For example, the height of the second window displayed in the second area is smaller than that in the first area. The height of the second window displayed by the field.

In some embodiments, the electronic device can draw the virtual keyboard in a fixed area of the display screen, and the fourth area is the fixed area; the electronic device can determine the area of the display screen other than the virtual keyboard as a drawing area that allows drawing of the application window; Furthermore, the electronic device can draw the first window and the second window in the drawing area. Wherein, the drawing area includes the above-mentioned second area and third area.

In some embodiments, the electronic device may proportionally reduce the first window from the first size to the second size. For example, as shown in (b) of Figure 10, the first window is scaled down.

In some embodiments, after receiving the first operation, the electronic device shrinks the first window so that the second window is displayed in the second area of the display screen and the first window is displayed in the third area of the display screen, for example, in Figure 10 shown in (b). Alternatively, after receiving the first operation, the electronic device shrinks the first window, moves it upward, moves it upward and to the left, or moves the second window upward and to the right, so that the second window is displayed in the second area of the display screen. The first window is displayed in the third area of the screen. For example, as shown in (b) in FIG. 11 , the electronic device reduces the first window and moves the second window upward and to the right. Alternatively, after receiving the first operation, the electronic device shrinks the first window, moves it upward, moves it upward and to the left, or moves the second window upward and to the right, and shrinks the second window so that it is displayed in the second area of the display screen. The second window displays the first window in the third area of the display screen.

In some embodiments, the second area, the third area and the fourth area fill the display area of the display screen. For example, as shown in (d) of FIG. 10 , the second window displayed in the second area, the first window displayed in the third area, and the virtual keyboard displayed in the fourth area exactly fill the display area of the display screen.

In some embodiments, the electronic device receives a drag operation acting on adjacent edges of the first window and the second window; in response to the drag operation, the electronic device controls the adjustment of the second area to the fifth area, and controls the adjustment of the third area. It is the sixth area, the fifth area displays the second window, and the sixth area displays the first window. For example, as shown in Figure 15, when the user presses and holds the adjacent edge of the first window and the second window and drags it to the left, the display area of the first window gradually decreases, and at the same time, the display area of the second window gradually increases. big.

In some embodiments, the electronic device receives a second operation that acts on the first window or the second window; in response to the second operation, the virtual keyboard disappears, and the electronic device displays the first window in full screen on the display screen, and in the first part of the display screen area displays the second window. For example. As shown in Figure 13, when the virtual keyboard is retracted, the position and size of the window can be restored to the window display state before adjustment.

Figure 20 shows a schematic flowchart of another multi-window display method provided by an embodiment of the present application. This method can be executed by an electronic device. The method includes:

S2001: The electronic device displays the first window in the full screen of the display screen, and displays the second window in the first area of the display screen.

S2002: The electronic device receives the first preset operation.

For example, the first preset operation may be a gesture operation, an operation on a control, or an operation on a preset physical key or virtual key, etc.

S2003: In response to the first preset operation, the electronic device displays the second window in the full screen of the display screen and displays the first window in the seventh area of the display screen.

For example, as shown in Figure 7, the user can switch the display form of the first window and the second window through a first preset operation. As shown in (d) in Figure 7, the first window is displayed in full screen, and the second window is displayed in the form of a small window. As shown in (b) and (c) in Figure 7, the second window is displayed in full screen, and the first window is displayed in the form of a small window. Furthermore, as shown in (b) and (d) in FIG. 7 , the first area is the same as the seventh area. Or, as shown in (c) and (d) in FIG. 7 , the first area and the seventh area are different.

FIG. 21 is a schematic diagram of the composition of a display device provided by an embodiment of the present application. As shown in Figure 21, the device can be applied to electronic equipment, and the device can include: a display unit 2101 and an input unit 2102.

In some embodiments, the display unit 2101 is configured to display the first window in full screen on the display screen of the electronic device, and display the second window in the first area of the display screen.

The input unit 2102 is used to receive the first operation.

The display unit 2101 is further configured to, after receiving the first operation, display a second window in the second area of the display screen, display the first window in the third area of the display screen, and display the virtual keyboard in the fourth area of the display screen. Among them, the second area, the third area and the fourth area do not overlap with each other.

The input unit 2102 is used to receive the first preset operation.

The display unit 2101 is also configured to display the second window in the full screen of the display screen and display the first window in the seventh area of the display screen after receiving the first preset operation.

More detailed descriptions about the display unit 2101 and the input unit 2102 can be obtained directly by referring to the relevant descriptions in the above embodiments, and will not be described again here.

An embodiment of the present application also provides a display device, which can be applied to electronic equipment, such as the electronic equipment (such as a mobile phone) in the above embodiment. The device may include: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions so that the display device implements various functions performed by the electronic device (such as a mobile phone) in the above method embodiment or step.

An embodiment of the present application also provides an electronic device (the electronic device may be an electronic device, such as the mobile phone in the above embodiment). The electronic device may include: a display screen, a memory, and one or more processors. The display, memory and processor are coupled. The memory is used to store computer program code, which includes computer instructions. When the processor executes computer instructions, the electronic device can perform various functions or steps performed by the electronic device (such as a mobile phone) in the above method embodiments. Of course, the electronic device includes but is not limited to the above-mentioned display screen, memory and one or more processors. For example, the structure of the electronic device may refer to the structure of the mobile phone shown in FIG. 5 .

Embodiments of the present application also provide a chip system, which can be applied to electronic devices, such as the electronic devices (such as mobile phones) in the previous embodiments. As shown in Figure 22, the chip system includes at least one processor 2201 and at least one interface circuit 2202. The processor 2201 may be the processor in the above-mentioned electronic device. The processor 2201 and the interface circuit 2202 may be interconnected via wires. The processor 2201 can receive and execute computer instructions from the memory of the above-mentioned electronic device through the interface circuit 2202. When the computer instructions are executed by the processor 2201, the electronic device can be caused to perform various steps performed by the mobile phone in the above embodiments. Of course, the chip system may also include other discrete devices, which are not specifically limited in the embodiments of this application.

Embodiments of the present application also provide a computer-readable storage medium for storing computer instructions run by an electronic device, such as the above-mentioned electronic device (such as a mobile phone).

An embodiment of the present application also provides a computer program product, which includes computer instructions run by an electronic device, such as the above-mentioned electronic device (such as a mobile phone).

Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In practical applications, the above functions can be allocated according to needs. Different functional modules are completed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components may be The combination can either be integrated into another device, or some features can be omitted, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated. The components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. . Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application are essentially or contribute to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium , including several instructions to cause a device (which can be a microcontroller, a chip, etc.) or a processor to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned storage media include: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program code.

The above contents are only specific implementation modes of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be covered by the protection scope of the present application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims

A multi-window display method, characterized in that the method is applied to electronic devices, and the method includes:

The electronic device displays a first window in the full screen of the display screen, and displays a second window in a first area of the display screen; wherein the second window is located on an upper layer of the first window, and the display of the second window The area is smaller than the display area of the first window;

The electronic device receives a first operation, the first operation is used to instruct display of a virtual keyboard;

In response to the first operation, the electronic device displays the second window in a second area of the display screen, displays the first window in a third area of the display screen, and displays the first window in a third area of the display screen. The fourth area displays the virtual keyboard;

Wherein, the second area, the third area and the fourth area do not overlap with each other.
The method of claim 1, wherein the first area and the second area are the same.
The method of claim 1, wherein the first area and the second area are different;

The second window displayed in the first area is the same size as the second window displayed in the second area; or

The size of the second window displayed in the first area is different from that of the second window displayed in the second area, and the size of the second window displayed in the second area is smaller than that in the second area. The size of the second window displayed in the first area.
The method of claim 3, wherein the size of the second window displayed in the second area is smaller than the size of the second window displayed in the first area, including:

The height of the second window displayed in the second area is smaller than the height of the second window displayed in the first area.
The method according to any one of claims 1 to 4, characterized in that the electronic device displays the second window in a second area of the display screen, and displays the second window in a third area of the display screen. The first window displays the virtual keyboard in the fourth area of the display screen, including:

The electronic device draws the virtual keyboard in a fixed area of the display screen; the fourth area is the fixed area;

The electronic device determines an area of the display screen other than the virtual keyboard as a drawing area that allows drawing of the application window;

The electronic device draws the first window and the second window in the drawing area; the drawing area includes the second area and the third area.
The method according to any one of claims 1 to 5, characterized in that the electronic device proportionally reduces the first window from the first size to the second size.
The method according to any one of claims 1 to 6, characterized in that, in response to the first operation, the electronic device displays the second window in a second area of the display screen, and in the The third area of the display screen displays the first window, including:

In response to the first operation, shrinking the first window so that the second window is displayed in a second area of the display screen and the first window is displayed in a third area of the display screen; or

In response to the first operation, the first window is reduced, the second window is moved upward, upward and left, or upward and right, so that the second window is displayed in a second area of the display screen. A second window displays the first window in a third area of the display screen; or

In response to the first operation, the first window is reduced, the second window is moved upward, upward and left, or the second window is moved upward and right, and the second window is reduced so that on the display The second window is displayed in the second area of the screen, and the first window is displayed in the third area of the display screen.
The method according to any one of claims 1 to 7, characterized in that the second area, the third area and the fourth area fill the display area of the display screen.
The method according to any one of claims 1 to 8, characterized in that the method further includes:

The electronic device receives a drag operation acting on adjacent edges of the first window and the second window;

In response to the drag operation, the electronic device controls the second area to be adjusted to a fifth area, and controls the third area to be adjusted to a sixth area, and the fifth area displays the second window, so The sixth area displays the first window.
The method of claim 1, wherein the first operation is an operation acting on the second window.
The method of claim 1, further comprising:

The electronic device receives a second operation acting on the first window or the second window;

In response to the second operation, the virtual keyboard disappears, the electronic device displays the first window in the full screen of the display screen, and displays the second window in the first area of the display screen.
The method according to claim 11, characterized in that, the method further includes:

The electronic device receives a first preset operation;

In response to the first preset operation, the electronic device displays the second window in the full screen of the display screen, and displays the first window in the seventh area of the display screen; wherein the first area and the third window Seven areas are the same or different.
An electronic device, characterized by including:

processor, memory, and, one or more programs;

Wherein, the one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the tasks of claims 1 to The method steps described in any one of 12.
A computer-readable storage medium, characterized in that the computer-readable storage medium is used to store a computer program. When the computer program is run on a computer, it causes the computer to execute any one of claims 1 to 12. method described in the item.
A computer program product, characterized in that it includes a computer program, which when the computer program is run on a computer, causes the computer to perform the method according to any one of claims 1 to 12.