WO2024007966A1 - Procédé et dispositif d'affichage multi-fenêtres - Google Patents

Procédé et dispositif d'affichage multi-fenêtres Download PDF

Info

Publication number
WO2024007966A1
WO2024007966A1 PCT/CN2023/104198 CN2023104198W WO2024007966A1 WO 2024007966 A1 WO2024007966 A1 WO 2024007966A1 CN 2023104198 W CN2023104198 W CN 2023104198W WO 2024007966 A1 WO2024007966 A1 WO 2024007966A1
Authority
WO
WIPO (PCT)
Prior art keywords
window
area
display
display screen
electronic device
Prior art date
Application number
PCT/CN2023/104198
Other languages
English (en)
Chinese (zh)
Inventor
李伟
张亚男
何天璐
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2024007966A1 publication Critical patent/WO2024007966A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04809—Textured surface identifying touch areas, e.g. overlay structure for a virtual keyboard

Definitions

  • the present application relates to the field of electronic equipment, and in particular, to a multi-window display method and equipment.
  • terminals such as mobile phones have become electronic devices that are frequently used in people's daily lives and work. A large part of people's lives and work can be completed on mobile phones.
  • multiple windows can be displayed on the mobile phone, and different content can be displayed in each window, making it convenient for users to handle business in different windows.
  • problems such as the virtual keyboard blocking the interface content, which affects the user experience.
  • Embodiments of the present application provide a multi-window display method and device, which can avoid blocking the window content when calling up the virtual keyboard and improve the input efficiency of the terminal.
  • this application provides a multi-window display method, which can be applied to electronic devices.
  • the method includes: the electronic device displays a first window in the full screen of the display screen, and displays a second window in the first area of the display screen; wherein , the second window is located on the upper layer of the first window, and the display area of the second window is smaller than the display area of the first window; the electronic device receives the first operation, the first operation is used to instruct the display of the virtual keyboard; in response to the first operation, The electronic device displays the second window in the second area of the display screen, displays the first window in the third area of the display screen, and displays the virtual keyboard in the fourth area of the display screen; wherein the second area, the third area and the fourth area Do not overlap each other.
  • the size of the full-screen window can be automatically adjusted, thereby avoiding the virtual keyboard from blocking the window display content.
  • the first and second areas are identical. That is to say, the size and position of the second window may not be adjusted, and only the position and size of the first window may be adjusted.
  • the first area is different from the second area.
  • the second window displayed in the first area has the same size as the second window displayed in the second area; or, the second window displayed in the first area has the same size as the second window displayed in the second area.
  • the size of the second window displayed in the second area is smaller than the size of the second window displayed in the first area. That said, the size/position of the second window can also be adjusted.
  • the size of the second window displayed in the second area is smaller than the size of the second window displayed in the first area, including: the height of the second window displayed in the second area is smaller than the height of the second window displayed in the first area. The height of the second window displayed in an area.
  • the electronic device displays a second window in a second area of the display screen, displays a first window in a third area of the display screen, and displays a virtual keyboard in a fourth area of the display screen, including: the electronic device displays A virtual keyboard is drawn in a fixed area of the display screen; the fourth area is the fixed area; the electronic device determines the area in the display screen other than the virtual keyboard as a drawing area that allows drawing of the application window; the electronic device draws the first window in the drawing area and a second window; the drawing area includes a second area and a third area.
  • the electronic device reduces the first window from the first size to the second size in equal proportions. Through this method, the content displayed in the first window can be adjusted proportionally.
  • the electronic device in response to the first operation, displays a second window in a second area of the display screen, and displays a first window in a third area of the display screen, including: in response to the first operation, Reduce the first window so that the second window is displayed in the second area of the display screen and the first window is displayed in the third area of the display screen; or, in response to the first operation, reduce the first window, move upward, upward and Move the second window to the left, or move it up and to the right, so that the second window is displayed in the second area of the display screen, and the first window is displayed in the third area of the display screen; or, in response to the first operation, zoom out
  • the first window moves up, up and to the left, or the second window moves up and to the right, and the second window is reduced so that the second window is displayed in a second area of the display screen, and in a third area of the display screen Show first window.
  • the second area, the third area and the fourth area fill the display area of the display screen.
  • the second window displayed in the second area, the first window displayed in the third area, and the fourth window displayed by the virtual keyboard exactly fill the display area of the display screen, which can improve the efficiency of the display screen and the interface display. of aesthetics.
  • the method further includes: the electronic device receives a drag operation acting on adjacent edges of the first window and the second window; in response to the drag operation, the electronic device controls the second area to adjust to the fifth area, and control the third area to be adjusted to the sixth area, the fifth area displays the second window, and the sixth area displays the first window.
  • the user can further adjust the sizes of the first window and the second window to improve the flexibility of multi-window display.
  • the first operation is an operation that acts on the second window.
  • the first operation is an operation that acts on the input box of the second window.
  • the method further includes: the electronic device receives a second operation that acts on the first window or the second window; in response to the second operation, the virtual keyboard disappears, and the electronic device displays the first full-screen display on the display screen. window to display a second window in the first area of the display screen.
  • the first window and the second window can be restored to their original display status, which can improve the user's operating experience.
  • the method further includes: the electronic device receives a first preset operation; in response to the first preset operation, the electronic device displays the second window in the full screen of the display screen, and displays the second window in the seventh area of the display screen.
  • a first window wherein the first area and the seventh area are the same or different.
  • the electronic device can switch the display form of the first window and the second window through the first preset operation.
  • the present application provides a multi-window display method, which method can be applied to electronic devices.
  • the method includes: the electronic device displays a first window in the full screen of the display screen, and displays a second window in the first area of the display screen; wherein , the second window is located on the upper layer of the first window, and the display area of the second window is smaller than the display area of the first window; the electronic device receives the first preset operation; in response to the first preset operation, the electronic device displays the full screen on the display screen
  • the second window displays the first window in the seventh area of the display screen; wherein the first area and the seventh area are the same or different.
  • the first preset operation is a gesture operation acting on the second window, or the first preset operation is a click operation acting on the switching control of the second window.
  • the electronic device can conveniently switch the display form of the full-screen window and the small window through the first preset operation, thereby improving the user's experience of using multi-window display.
  • a third aspect provides a display device, which can be applied to electronic equipment.
  • the device can include: a display unit configured to display a first window in full screen on a display screen of the electronic device, and to display a second window in a first area of the display screen. Window; wherein, the second window is located on the upper layer of the first window, and the display area of the second window is smaller than the display area of the first window; the input unit is used to receive the first operation, the first operation is used to instruct the display of the virtual keyboard; display The unit is further configured to display a second window in a second area of the display screen, a first window in a third area of the display screen, and a virtual keyboard in a fourth area of the display screen in response to the first operation; wherein, the The second area, the third area and the fourth area do not overlap with each other.
  • a fourth aspect provides a display device, which can be applied to electronic equipment.
  • the device can include: a display unit configured to display a first window in full screen on a display screen of the electronic device, and to display a second window in a first area of the display screen. window; wherein, the second window is located on the upper layer of the first window, and the display area of the second window is smaller than the display area of the first window; the input unit is used to receive the first preset operation; the display unit is also used to respond to the third window.
  • the electronic device displays the second window in the full screen of the display screen, and displays the first window in the seventh area of the display screen; wherein the first area and the seventh area are the same or different.
  • a fifth aspect provides a computer-readable storage medium on which computer program instructions are stored.
  • the electronic device When the computer program instructions are executed by an electronic device, the electronic device enables the electronic device to implement the first aspect or any of the possible implementations of the first aspect.
  • the method described above, or the method described in any one of the second aspect or possible implementations of the second aspect is implemented.
  • an electronic device in a sixth aspect, includes a display screen, one or more processors and a memory; the display screen, the processor and the memory are coupled; the memory is used to store computer program code, and the computer program code includes computer instructions,
  • the electronic device is caused to perform the method as described in any one of the first aspect or the possible implementation of the first aspect, or to perform the second aspect or the possible implementation of the second aspect. any one of the methods.
  • a computer program product including computer readable code, or a non-volatile computer readable storage medium carrying the computer readable code.
  • the computer readable code When the computer readable code is run in an electronic device, the electronic device
  • the processor in the device performs the method described in any one of the first aspect or the possible implementation of the first aspect, or performs the second aspect or the possible implementation of the second aspect. The method described in any of the possible implementation methods.
  • Figure 1 is a schematic diagram of a display interface in a related technology provided by an embodiment of the present application.
  • Figure 2 is a schematic diagram of a display interface in another related technology provided by an embodiment of the present application.
  • Figure 3 is a schematic diagram of a display interface in yet another related technology provided by an embodiment of the present application.
  • Figure 4 is a schematic diagram of a display interface in yet another related technology provided by an embodiment of the present application.
  • Figure 5 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • Figure 6 is a schematic diagram of the software architecture of an electronic device provided by an embodiment of the present application.
  • Figure 7 is a schematic diagram of a multi-window display method provided by an embodiment of the present application.
  • Figure 8 is a schematic diagram of a display interface provided by an embodiment of the present application.
  • Figure 9 is a schematic diagram of another multi-window display method provided by an embodiment of the present application.
  • Figure 10 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application.
  • Figure 11 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application.
  • Figure 12 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application.
  • Figure 13 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application.
  • Figure 14 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application.
  • Figure 15 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application.
  • Figure 16 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application.
  • Figure 17 is a schematic diagram of yet another multi-window display method provided by an embodiment of the present application.
  • Figure 18 is a schematic diagram of the software structure of an electronic device provided by an embodiment of the present application.
  • Figure 19 is a schematic flow chart of a multi-window display method provided by an embodiment of the present application.
  • Figure 20 is a schematic flow chart of another multi-window display method provided by an embodiment of the present application.
  • Figure 21 is a schematic diagram of the composition of a display device provided by an embodiment of the present application.
  • Figure 22 is a schematic diagram of the composition of a chip system provided by an embodiment of the present application.
  • the at least one involved in the embodiments of this application includes one or more; where multiple means greater than or equal to two.
  • words such as “first” and “second” are only used for the purpose of distinguishing the description, and cannot be understood to express or imply relative importance, nor can they be understood to express Or suggestive order.
  • the first window and the second window do not represent the importance of the two or the order of the two, but are only used to differentiate the description.
  • "and/or" only describes the association relationship, indicating that three relationships can exist, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone. these three situations.
  • the character "/" in this article generally indicates that the related objects are an "or" relationship.
  • multiple windows can be displayed on electronic devices (such as mobile phones).
  • the electronic device receives an operation for opening multiple windows
  • the multiple windows are displayed.
  • the operation for opening multiple windows can be various types of operations.
  • One implementation method is that, see (a) in Figure 1, the electronic device displays window A.
  • window A is a video playback window.
  • the smart multi-window application bar 101 can be called up, as shown in (b in Figure 1 ) shown.
  • the smart multi-window application bar 101 includes icons for various applications, such as icon, memo icon, etc.
  • Window B displays the multi-window interface as shown in (c) in Figure 1.
  • the interface shown in (c) in Figure 1 includes window B and window A, where window B is located on the upper layer of window A. Therefore, multiple windows can be opened in the manner shown in Figure 1.
  • the virtual keyboard area will be displayed at the bottom of the screen, and the virtual keyboard area blocks the video screen being played in window A. , which will have a greater impact on the user experience.
  • the user's purpose at this time may be to operate window B, but the display size of window B is small and inconvenient for the user to operate. Therefore, the user can switch window B to full-screen display, for example, by dragging By operating window B to the center of the screen, or by operating controls on window B, as shown in (e) in Figure 1, window B is switched to full-screen display.
  • window B is switched to full-screen display.
  • the user cannot watch the video images in window A at the same time, which affects the user's efficiency in using the electronic device. Further, the user can open the window A corresponding to the video application again through the smart multi-window application bar 101 as shown in (b) of Figure 1.
  • window A is located on the upper layer of window B, and the user can use the chat application and the video playback application at the same time.
  • window A is a video playback window. While the user is watching the video played in window A, he receives A notification message. When the electronic device receives the user's click operation or pull-down operation on the notification message, it can open window B of the application corresponding to the notification message, that is, display the multi-window interface as shown in (b) of Figure 2. Similar to Figure 1, the user can click on the input box in window B to perform input operations, or switch window B to full-screen display.
  • Figure 1 and Figure 2 are only examples of two ways to open multiple windows. In actual applications, multiple windows can also be opened through other ways (such as tapping the screen with your knuckles). Embodiments of the present application Not giving examples one by one.
  • window A may be a full-screen window (or understood as a full-screen application interface)
  • window B may be A small window is displayed suspended on window A, that is, the display area of window B is smaller than that of window A.
  • window B may be a freeform small window (or called: free window).
  • the free small window can be considered as a system-level floating window.
  • the free small window function the entire application window can be displayed in the form of a free small window. Regardless of whether the user switches pages or opens other applications or desktops, this free small window remains on top.
  • a free small window can be understood as having functions such as dynamic movement, size scaling, etc. on the display screen.
  • Various interfaces can be opened in the free small window.
  • free small windows can use view technology to lay out and draw information (text, images, etc.) in the interface to display various styles of interfaces to users.
  • a newly opened interface in a free window can overwrite a previously opened interface.
  • the position of the small window can be moved.
  • the window can be changed.
  • the position of B is as shown in (b) in Figure 3.
  • the size of the small window can be scaled.
  • the width of small window B can become larger, as in (b) in Figure 4.
  • the size of the small window can be scaled proportionally, or only the width or height can be increased, which is not limited in this application. It can be understood that when the position of the free small window is changed and/or the size is scaled, the interface in the free small window can also be correspondingly changed in position and/or resized to adapt to the change of the free small window.
  • the new interface when a user opens a new interface (for example, opening a new application through the smart multi-window application bar, or clicking on a notification message), the new interface will be displayed in the form of a small window. Due to the size of the small window It is small and it is inconvenient for users to operate the newly opened interface. If the user switches the new interface to full-screen display, the original window will disappear, and subsequent users need to open the original full-screen window again, which affects the user's experience of using the multi-window interface. In addition, when the user calls up the virtual keyboard, the area displayed by the virtual keyboard will block the original full-screen display interface, affecting the user experience.
  • embodiments of the present application provide a multi-window display method, which can be applied to electronic devices.
  • the display forms of the full-screen window and the small window can be switched conveniently.
  • the full-screen window can be automatically reduced, and the small window can be automatically adjusted in position and size, thereby avoiding the virtual keyboard from blocking the content displayed in the full-screen window and/or the small window. In this way, the user's experience using multi-window display can be improved.
  • the electronic device in the embodiment of the present application can be a mobile phone (such as a folding screen mobile phone, a candy bar mobile phone), a tablet computer, a handheld computer, a PC, a cellular phone, a personal digital assistant (PDA), a wearable Equipment (such as smart watches), vehicle-mounted computers, game consoles, and augmented reality (AR)/virtual reality (VR) equipment, etc.
  • PDA personal digital assistant
  • AR augmented reality
  • VR virtual reality
  • This embodiment does not place special restrictions on the specific form of the terminal.
  • the technical solution provided by this embodiment can be applied not only to the above-mentioned electronic devices (or mobile terminals), but also to other electronic devices, such as smart home devices (such as televisions).
  • the electronic device is a mobile phone as an example.
  • FIG. 5 is a schematic structural diagram of a mobile phone provided by an embodiment of the present application. The methods in the following embodiments can be implemented in a mobile phone with the above hardware structure.
  • the mobile phone may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, and an antenna.
  • a processor 110 an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, and an antenna.
  • Antenna 2 wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193 and display screen 194, etc.
  • the mobile phone may also include a mobile communication module 150, a subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and an environment.
  • the structure illustrated in this embodiment does not constitute a specific limitation on the mobile phone.
  • the mobile phone may include more or fewer components than shown in the figures, or some components may be combined, or some components may be separated, or may be arranged differently.
  • the components illustrated may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) wait.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • NPU neural-network processing unit
  • different processing units can be independent devices or integrated in one or more processors.
  • the controller can be the nerve center and command center of the phone.
  • the controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.
  • the processor 110 may also be provided with a memory for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.
  • processor 110 may include one or more interfaces.
  • Interfaces may include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver and transmitter (universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, SIM interface, and/or USB interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • UART universal asynchronous receiver and transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM interface SIM interface
  • USB interface universal asynchronous receiver/transmitter
  • the charging management module 140 is used to receive charging input from the charger. While the charging management module 140 charges the battery 142, it can also provide power to the mobile phone through the power management module 141.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the power management module 141 can also receive input from the battery 142 to power the mobile phone.
  • the wireless communication function of the mobile phone can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in a phone can be used to cover a single or multiple communication bands. Different antennas can also be reused to improve antenna utilization.
  • Antenna 1 can be reused as a diversity antenna for a wireless LAN.
  • antennas may be used in conjunction with tuning switches.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G that are applied to the mobile phone.
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.
  • the mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation.
  • at least part of the functional modules of the mobile communication module 150 may be disposed in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.
  • a modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.
  • the demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194.
  • the modem processor may be a separate device.
  • the modem processor may be independent of the processor 110 and may be provided in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the mobile phone including wireless local area networks (WLAN) (such as Wi-Fi network), Bluetooth (bluetooth, BT), global navigation satellite system (global navigation satellite system, GNSS), Wireless communication solutions such as frequency modulation (FM), NFC, and infrared technology (infrared (IR)).
  • WLAN wireless local area networks
  • Bluetooth blue, BT
  • global navigation satellite system global navigation satellite system
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC global navigation satellite system
  • IR infrared technology
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the antenna 1 of the mobile phone is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the mobile phone can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi) -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the mobile phone implements display functions through the GPU, display screen 194, and application processor.
  • the GPU is an image processing microprocessor and is connected to the display screen 194 and the application processor.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 194 is used to display images, videos, etc.
  • Display 194 includes a display panel.
  • the display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • AMOLED organic light-emitting diode
  • FLED flexible light-emitting diode
  • Miniled MicroLed, Micro-oLed, quantum dot light emitting diode (QLED), etc.
  • the mobile phone may include 1 or N display screens 194, where N is a positive integer greater than 1.
  • the mobile phone can realize the shooting function through the ISP, camera 193, video codec, GPU, display 194 and application processor.
  • the mobile phone may include 1 or N cameras 193, where N is a positive integer greater than 1.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. Such as saving music, videos, etc. files in external memory card.
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the processor 110 executes instructions stored in the internal memory 121 to execute various functional applications and data processing of the mobile phone.
  • the internal memory 121 may include a program storage area and a data storage area.
  • the stored program area can store an operating system, at least one application program required for a function (such as a sound playback function, an image playback function, etc.).
  • the storage data area can store data created during the use of the mobile phone (such as audio data, phone book, etc.).
  • the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
  • the mobile phone can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playback, recording, etc.
  • the pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals.
  • pressure sensor 180A may be disposed on display screen 194 .
  • the mobile phone detects the strength of the touch operation according to the pressure sensor 180A.
  • the mobile phone can also calculate the touch position based on the detection signal of the pressure sensor 180A.
  • the gyro sensor 180B can be used to determine the movement posture of the mobile phone.
  • Air pressure sensor 180C is used to measure air pressure.
  • Magnetic sensor 180D includes a Hall sensor.
  • the mobile phone can use the magnetic sensor 180D to detect the opening and closing of the flip leather case.
  • the acceleration sensor 180E can detect the acceleration of the mobile phone in various directions (generally three axes).
  • Distance sensor 180F for measuring distance.
  • the mobile phone can use the proximity light sensor 180G to detect when the user is holding the mobile phone close to the ear to talk, so that the screen can be automatically turned off to save power.
  • the proximity light sensor 180G can also be used in holster mode, and pocket mode automatically unlocks and locks the screen.
  • the ambient light sensor 180L is used to sense ambient light brightness.
  • Fingerprint sensor 180H is used to collect fingerprints. The mobile phone can use the collected fingerprint characteristics to unlock the fingerprint, access the application lock, take pictures with the fingerprint, answer incoming calls with the fingerprint, etc.
  • Temperature sensor 180J is
  • Touch sensor 180K also called “touch panel”.
  • the touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K It forms a touch screen with the display screen 194, also called a "touch screen”.
  • the touch sensor 180K is used to detect a touch operation on or near the touch sensor 180K.
  • the touch sensor can pass the detected touch operation to the application processor to determine the touch event type.
  • Visual output related to the touch operation may be provided through display screen 194 .
  • the touch sensor 180K may also be disposed on the surface of the mobile phone in a position different from that of the display screen 194 .
  • Bone conduction sensor 180M can acquire vibration signals.
  • the buttons 190 include a power button, a volume button, etc.
  • Key 190 may be a mechanical key. It can also be a touch button.
  • the motor 191 can generate vibration prompts.
  • the motor 191 can be used for vibration prompts for incoming calls and can also be used for touch vibration feedback.
  • the indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, or may be used to indicate messages, missed calls, notifications, etc.
  • the SIM card interface 195 is used to connect the SIM card.
  • the SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation from the mobile phone.
  • the mobile phone can support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • the mobile phone interacts with the network through the SIM card to realize functions such as calls and data communication.
  • the mobile phone uses an eSIM, that is, an embedded SIM card.
  • the eSIM card can be embedded in the mobile phone and cannot be separated from the mobile phone.
  • the software system of the electronic device is the Android system as an example to illustrate the software structure of the electronic device.
  • FIG. 6 is a schematic diagram of the software architecture of a terminal provided by an embodiment of the present application.
  • the software structure of electronic equipment can be a layered architecture.
  • the software can be divided into several layers, and each layer has clear roles and division of labor.
  • the layers communicate through software interfaces.
  • the electronic device is an Android system, it may include an application layer (referred to as the application layer), an application framework layer (referred to as the framework layer) (framework, FWK), a hardware layer, and so on.
  • the application package can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.
  • the application framework layer provides an application programming interface (API) and programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer can include window managers, content providers, view systems, phone managers, resource managers, notification managers, etc.
  • the window manager is used to manage window programs.
  • the window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • Content providers are used to store and retrieve data and make this data accessible to applications. Said data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
  • the view system includes visual controls, such as controls that display text, controls that display pictures, etc.
  • a view system can be used to build applications.
  • the display interface can be composed of one or more views.
  • a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide communication functions of the electronic device 100 . For example, call status management (including connected, hung up, etc.).
  • the resource manager provides various resources to applications, such as localized strings, icons, pictures, layout files, video files, and more.
  • the notification manager allows applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also be notifications that appear in the status bar at the top of the system in the form of charts or scroll bar text, such as notifications for applications running in the background, or notifications that appear on the screen in the form of conversation windows. For example, text information is prompted in the status bar, a beep sounds, the electronic device vibrates, the indicator light flashes, etc.
  • Android Runtime includes core libraries and virtual machines.
  • Android runtime is responsible for the scheduling and management of the Android system.
  • the core library contains two parts: one is the functional functions that need to be called by the Java language, and the other is the core library of Android.
  • the application layer and application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and application framework layer into binary files.
  • the virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions.
  • System libraries can include multiple functional modules. For example: surface manager (surface manager), media libraries (Media Libraries), 3D graphics processing libraries (for example: OpenGL ES), 2D graphics engines (for example: SGL), etc.
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition, and layer processing.
  • 2D Graphics Engine is a drawing engine for 2D drawing.
  • the system library may also include a window processing module for controlling the hiding, appearance, shrinking, and enlarging of windows.
  • the window processing module may be a module in the system library, or may be a module in other layers, such as a module in the application framework layer or the kernel layer, which is not limited in the embodiment of the present application.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
  • the touch sensor in the hardware layer receives a first input event acting on the second window.
  • the first input event includes operation type, operation time, position on the display screen, etc.
  • Touch sensors will be the first Input events are reported to higher levels, such as the window processing module in the system library. The higher level determines that the input event is a click operation on the input box in the second window, and then calls the display driver to display the virtual keyboard on the display screen.
  • Figure 7 is a schematic diagram of a multi-window display method provided by an embodiment of the present application.
  • the electronic device displays the first window in full screen.
  • the first window displays a first application, where the first application may be any application in the electronic device.
  • the first application is a video playback application.
  • the notification message may come from a second application in the electronic device, and the second application may be any application in the electronic device.
  • the first application and the second application are different applications.
  • the second application is a chat application.
  • the electronic device can open the second application corresponding to the notification message in the second window.
  • the second window displays an interface corresponding to the notification message, where the second window is a window displayed in full screen.
  • the first window can be automatically switched to a small window for display. The first window is located on the upper layer of the second window, and the display area of the first window is smaller than the display area of the second window.
  • the electronic device when the user receives the notification message, since the newly opened message is likely to be the message that the user wants to pay attention to, the electronic device can open the application window corresponding to the notification message in full screen form to facilitate the user to view the newly received message. Perform temporary processing.
  • the size and proportion of the initial small window after automatic switching may be default.
  • the small window may default to a vertically displayed window.
  • the size and proportion of the initial small window after automatic switching can be determined based on the interface content. For example, as shown in (c) in Figure 7, when a full-screen video interface is displayed in the first window , the initial small window after automatic switching can be a horizontally displayed window, which can make the content displayed in the small window more consistent with the proportion of the small window.
  • the size of the initial small window after automatic switching can be determined according to the type of application. For example, a video application corresponds to a horizontal small window, and a chat application corresponds to a vertical small window. This application does not limit this.
  • the user receives the notification message as an example.
  • the above process can also be similar. For example, when a user opens a new application by calling up the smart multi-window application bar, the newly opened application window can be displayed in full screen form, and the application window that was previously displayed in full screen will automatically switch to a small window display.
  • the user when the user is processing a temporary task (such as replying to a chat message) in the full-screen second window and needs to continue processing the main task (such as watching a video) in the first window, the user can use the first preset The operation switches the display form (or window form) of the first window and the second window.
  • the display form of the window may include full-screen display, small window display, etc.
  • the first window in response to the first preset operation, the first window is switched to full-screen display again, and the second window is switched to small window display.
  • the second window is located on the upper layer of the first window.
  • the display area is smaller than the display area of the first window.
  • the user can perform the first preset operation again to switch the first window to a small window display and the second window to a full-screen display, that is, as shown in (b) in Figure 7 or (c) in Figure 7 the display format shown. It can be understood that by performing the first preset operation, the user can freely switch the display forms of the first window and the second window, and freely choose whether to display the first window or the second window without interrupting the tasks in the first window and the second window. Tasks in the second window are processed in full screen, thereby improving the user's efficiency in multi-window operations.
  • the first preset operation may be a gesture operation.
  • the first preset operation may be a gesture operation that acts on a small window, or a gesture operation that acts on a full-screen window, or a gesture operation that drags a small window to a specific hotspot of the full-screen window, etc.
  • the status bar in the small window may display a switching control 801, a minimizing control 802, a closing control 803, etc.
  • the switching control 801 in the status bar of the small window the small window can be switched to a full-screen window, and at the same time, the full-screen window is switched to a small window.
  • the small window When receiving an operation for the minimize control 802 in the status bar of the small window, the small window can be minimized, for example, switched to a smaller window or a prompt bar.
  • the small window When receiving an operation for the close control 803 in the status bar of the small window, the small window can be closed, that is, only the full-screen window is displayed on the display screen.
  • the first preset operation may be an operation on a preset physical key or virtual key.
  • the physical key or virtual key may be preset by the system or predefined by the user. Taking the operation of physical buttons as an example, the user can switch the display mode of the first window and the second window by pressing the volume key twice in succession. It can be understood that the first preset operation can also be other operations, which is not limited in this application.
  • the background processing flow corresponding to the embodiment shown in Figure 7 will be described in detail below.
  • the background processing process may include the following steps:
  • Step 1 The electronic device displays the first window of the first application in full screen
  • Step 2 The electronic device receives the task of the second application
  • Step 3 The electronic device displays the second window of the second application in full screen and displays the first window of the first application in a small window;
  • Step 4 The electronic device receives the user's operation and switches the first window and the second window;
  • Step 5 The electronic device displays the first window of the first application in full screen and displays the second window of the second application in a small window.
  • the user can switch the first window and the second window through the first preset operation.
  • the display form of the mouth there may be multiple small windows on the full-screen window, and the user can switch the display modes of the target small window and the full-screen window by operating on the target small window.
  • the electronic device displays the second window in full screen, and the first window and the third window displayed in small windows are superimposed on the second window.
  • the first window in response to the second preset operation acting on the first window, the first window can be switched to full-screen display, and the second window can be switched to small window display.
  • the display mode of the target small window acted by the user can be switched between the full-screen window and the small window targeted by the user.
  • the third window can be switched to full-screen display, and the second window can be switched to small window display (not shown in the figure).
  • the second preset operation may be a gesture operation acting on the target small window, an operation acting on a control of the target small window, etc. This application does not limit this.
  • Figure 10 is a schematic diagram of another multi-window display method provided by an embodiment of the present application.
  • the electronic device displays the first window in full screen, and the first window displays the first application.
  • a second window displayed in the form of a small window is superimposed on the first window.
  • the second window is located in the upper right corner of the display screen, and the second window displays the second application.
  • the first application and the second application may be any application in the electronic device.
  • the virtual keyboard area may be displayed on the display screen.
  • the virtual keyboard area may be a fixed area of the display screen, such as the bottom area of the display screen.
  • the electronic device can display the area other than the virtual keyboard area on the display screen.
  • a drawing area that allows drawing of the application window is determined, and the first window and the second window are drawn in the drawing area.
  • the height of the second window is H1 and the height of the virtual keyboard area is H2.
  • the sum of H1 and H2 does not exceed the height of the display area of the electronic device display screen.
  • the first window can be reduced proportionally, thereby avoiding the virtual keyboard area from blocking the first window.
  • the width of the second window is W1
  • the width of the first window can be automatically adjusted to W2, where the sum of W1 and W2 is equal to the width of the display area of the electronic device display screen.
  • the height of the first window can be obtained based on the adjusted width W2 of the first window and the original aspect ratio of the first window.
  • the first window can also be proportionally reduced according to other methods.
  • the height of the first window can be automatically adjusted to H1, and the width of the first window can be obtained based on the adjusted height H1 of the first window and the original aspect ratio of the first window. This application does not limit this.
  • the height of the second window is H1 and the height of the virtual keyboard area is H2.
  • the sum of H1 and H2 does not exceed the height of the display area of the electronic device display screen.
  • the width of the first window can be adjusted according to the width of the second window.
  • the width of the second window is W1
  • the width of the first window can be automatically adjusted to W2, where the sum of W1 and W2 is equal to the width of the display area of the electronic device display screen.
  • the height of the second window can be adjusted to be the same as the first window, that is, to H1, to obtain better display effects.
  • the height of the second window can be adjusted to H3, the height of the virtual keyboard area is H2, the sum of H2 and H3 is equal to the height of the display area of the electronic device display screen.
  • the second window can be adjusted according to the remaining display area of the display screen. For example, the height of the second window can be adjusted to be the same as the first window, that is, adjusted to H3, and the width of the second window can be automatically adjusted to W2, where the sum of W1 and W2 is equal to the width of the display area of the electronic device. .
  • the sizes of both the first window and the second window can be adjusted to fill the display area of the display screen, thereby improving the display quality of the display screen. efficiency and the beauty of the interface display.
  • the size of the first window can be automatically adjusted, and ultimately the first window, the second window and the virtual keyboard area do not overlap, so that This avoids blocking the window content when displaying the virtual keyboard area, improving the user experience.
  • Figure 11 is a schematic diagram of another multi-window display method provided by an embodiment of the present application.
  • the electronic device displays the first window in full screen, and the first window displays the first application.
  • a second window displayed in the form of a small window is superimposed on the first window.
  • the second window is located in the middle right area of the display screen, and the second window displays the second application.
  • the first application and the second application may be any application in the electronic device.
  • the virtual keyboard area may be displayed in the bottom area of the screen.
  • the height of the second window is H1
  • the height of the virtual keyboard area is H2
  • the sum of H1 and H2 does not exceed the height of the display area of the electronic device display screen.
  • the position of the second window can be changed to avoid the virtual keyboard area from blocking the content displayed in the second window.
  • the second window can be moved to the upper right corner of the display screen.
  • the position of the second window can be moved according to the actual situation.
  • the second window can be moved upward, upward and left, upward and right, etc.
  • the moving direction of the second window may be related to its initial display position. For example, when the second window is initially displayed in the middle right area of the display screen, the second window may move upward and to the right. For example, the second window may move upward and to the right.
  • the second window When the window is initially displayed in the middle left area of the display screen, the second window can move upward and to the left, and this application does not impose restrictions on this.
  • the first window can be reduced proportionally, or the width of the first window can be adjusted according to the width of the second window, or the height of the first window can be adjusted according to the height of the second window, or the first window and The size of the second window can be adjusted to fill the display area of the display screen.
  • the relevant expressions of the embodiment shown in FIG. 10 please refer to the relevant expressions of the embodiment shown in FIG. 10 , which will not be described again in this application.
  • Figure 12 is a schematic diagram of another multi-window display method provided by an embodiment of the present application.
  • the electronic device displays the first window in full screen, and the first window displays the first application.
  • a second window displayed in the form of a small window is superimposed on the first window.
  • the second window is located in the upper right corner of the display screen, and the second window displays the second application.
  • the first application and the second application may be any application in the electronic device. For example, when the user clicks on the input box in the second window to input text, a virtual keyboard area may be displayed at the bottom of the screen.
  • the sum of the original height H1 of the second window and the virtual keyboard area H2 is greater than the height of the display area of the display screen. Therefore, when the user clicks on the input box in the second window to input text, the height of the second window can be reduced to H4.
  • the sum of H2 and H4 is equal to the height of the display area of the display screen, thereby avoiding the virtual keyboard area from blocking the second window.
  • the first window can be reduced proportionally, thereby avoiding the virtual keyboard area from blocking the first window.
  • the height of the first window can be adjusted to be the same as the first window, that is, adjusted to H4.
  • the width of the first window can be obtained based on the adjusted height H4 of the first window and the original aspect ratio of the first window.
  • the sum of the height H4 of the first window and the height H2 of the virtual keyboard area is equal to the height of the display area of the display screen.
  • the sum of the width of the first window and the width of the second window may be equal to the width of the display area of the display screen.
  • the sum of the width of the first window and the width of the second window may be smaller than the width of the display area of the display screen, and the height of the first window is equal to the height of the second window. The sum is less than the height of the display area of the display.
  • the first window, the second window and the virtual keyboard area can exactly fill the display area of the electronic device display screen.
  • the sum of the original height H1 of the second window and the virtual keyboard area H2 is greater than the height of the display area of the display screen. Therefore, when the user clicks on the input box in the second window to enter text, the height of the second window can be reduced to H4.
  • the sum of H2 and H4 is equal to the height of the display area of the display screen, thereby avoiding the virtual keyboard area from blocking the second window.
  • the second window can be adjusted according to the remaining display area of the display screen.
  • the height of the second window can be adjusted to be the same as the height of the first window, that is, adjusted to H4, and the width of the second window can be automatically adjusted to W2, where the sum of W1 and W2 is equal to the display area of the electronic device display. width.
  • the sizes of both the first window and the second window can be adjusted to fill the display area of the display screen, thereby improving the display quality of the display screen. efficiency and the beauty of the interface display.
  • the size of the second window can be Automatically adjust, and the size of the first window can also be automatically adjusted.
  • the first window, the second window and the virtual keyboard area do not overlap, thus avoiding the interference of the contents of the first window and the second window when the virtual keyboard area is displayed. Occlusion improves the user experience.
  • the second window is located in the middle area of the display screen.
  • the position of the second window is similar to that shown in Figure 11.
  • the movement is performed to avoid the virtual keyboard area from blocking the display content of the second window.
  • the second window can be moved to the upper right corner of the display.
  • the sizes of the first window and the second window can be adjusted accordingly as shown in (b) and (c) in Figure 12 , for example, the height of the second window as shown in (b) in Figure 12 is reduced. Small is H4, the height of the first window is adjusted to H4 and scaled down.
  • the position of the second window can be reduced and moved according to the actual situation. For example, the second window can be moved upward and reduced, moved upward and left and reduced, moved upward and right and reduced, etc.
  • the user clicks on the input box in the second window to trigger the display of the virtual keyboard area as an example for illustrative introduction. It can be understood that in other embodiments, the user can also click on the first The input box in the window triggers the display of the virtual keyboard area, or the user triggers the display of the virtual keyboard area through other methods.
  • the adjustment methods of the first window and the second window can refer to the relevant introductions in the above embodiments, and will not be described in detail here.
  • the position and/or size of the window can be restored to the display state before adjustment.
  • the positions and sizes of the first window and the second window can be restored.
  • the window display state before adjustment that is, the state shown in (a) in Figure 12).
  • the background processing process may include the following steps:
  • Step 1 The electronic device displays the first window of the first application in full screen and displays the second window of the second application in a small window;
  • Step 2 The electronic device receives the operation of displaying the virtual keyboard
  • Step 3 Adjust the position and/or size of the first window and/or the second window
  • Step 4 The electronic device displays the first window, the second window and the virtual keyboard area without overlapping each other;
  • Step 5 The electronic device receives the operation to close the virtual keyboard area
  • Step 6 The electronic device resumes displaying the first window of the first application in full screen and displaying the second window of the second application in a small window.
  • the first window and the second window can be restored to their original display positions and/or sizes.
  • the user can further adjust the size of the first window and/or the second window.
  • the user can adjust the sizes of the first window and the second window respectively.
  • the width of the first window gradually decreases.
  • the width of the second window gradually decreases.
  • the width of the other window will also be adjusted accordingly.
  • the sum of the widths of the first window and the second window is equal to the width of the display area of the display screen.
  • the width of the first window gradually decreases, and at the same time, the width of the second window gradually increases.
  • the width of the first window gradually increases and the width of the second window gradually decreases.
  • the user can further adjust the positions of the first window and the second window, for example, exchange the positions of the first window and the second window, etc.
  • the user can further manually adjust the size and/or position of the first window and/or the second window, thereby further Improved user experience for multi-window displays.
  • FIG. 16 is a schematic diagram of another multi-window display method provided by an embodiment of the present application.
  • the electronic device displays the first window in full screen, and the first window displays the first application.
  • the first window is superimposed with a second window and a third window displayed in the form of small windows.
  • the second window displays the second application, and the third window displays the third application.
  • the first application, the second application and the third application may be any application in the electronic device. For example, when the user clicks on the input box in the small window to trigger the display of the virtual keyboard area, the small window and/or the full-screen window acted upon by the user can be automatically adjusted.
  • the second window and the first window displayed in full screen can be automatically adjusted as shown in (a) of Figure 16 b), and the third window can be temporarily hidden, such as disappearing from the display or shrinking to a prompt bar, etc.
  • the third window and the first window displayed in full screen can be automatically adjusted to as shown in Figure 16 The state shown in (d), while the second window can be temporarily hidden.
  • the second window is located in the right area of the display area before adjustment, and the third window is located in the left area of the display area, as shown in (b) of Figure 16
  • the second window after adjustment can be located in the display area.
  • the upper right corner of the display area, as shown in (d) in Figure 16 the adjusted third window can be located in the upper left corner of the display area.
  • Figure 16 only schematically shows one possible way to adjust the full-screen window and small windows.
  • the automatically adjusted window can also be adjusted manually as shown in Figure 14 or Figure 15.
  • the size of the full-screen window that is, the first window
  • the last first window, the target small window clicked by the user, and the virtual keyboard area can be displayed without overlapping each other.
  • Other small windows may be small windows that the user does not want to pay attention to at this time. Therefore, other small windows can be temporarily hidden, such as disappearing from the display screen or shrinking to a prompt bar. Therefore, the display area can display the tasks that the user wants to focus on at this time, while also avoiding the virtual keyboard area from blocking the display content, improving the user experience.
  • the user can also trigger the display of the virtual keyboard area by clicking on the input box on the full-screen window.
  • the full-screen window and/or the target small window can be automatically adjusted to display the full-screen window, the target small window, and the virtual keyboard area without overlapping each other.
  • the target small window can be the small window most recently operated by the user and the window most recently opened by the user. a small window, or a preset small window for a certain application, etc.
  • the automatically adjusted window can also be adjusted manually as shown in Figure 14 or Figure 15.
  • the position and/or size of the window can be restored to the display state before adjustment.
  • the position and size of each window can be restored from the state shown in (b) in Figure 16 to the state shown in (a) in Figure 16.
  • the third window Can be redisplayed.
  • the position and size of each window can be restored from the state shown in (d) in Figure 16 to the state shown in (c) in Figure 16 .
  • the window can be redisplayed.
  • Figure 17 is a schematic diagram of another multi-window display method provided by an embodiment of the present application.
  • the electronic device displays a first window and a second window in a split-screen mode
  • the first window displays a first application
  • the second window displays a second application.
  • the first application and the second application may be any application in the electronic device.
  • the virtual keyboard area may be displayed in the bottom area of the screen.
  • the sizes of the first window and the second window can be automatically adjusted to avoid the virtual keyboard area from blocking the display content of the first window and the second window.
  • the height of the first window and the second window is reduced and the width remains unchanged.
  • the first window, the second window and the virtual keyboard area fill the display area of the display screen.
  • the user can further adjust the position and size of the first window and the second window. For example, when the user presses and holds the adjacent edge of the first window and the second window and drags it to the left, the width of the first window gradually decreases, and at the same time, the width of the second window gradually increases.
  • the user can swap the positions of the first window and the second window.
  • the position and/or size of the first window and the second window can be restored to the split-screen display state before adjustment.
  • the interface displayed in the window can still be the original interface, but the content of the interface can be adaptively adjusted according to the size and proportion of the window to match the display proportion of the window. .
  • FIG. 18 is a schematic diagram of the software structure of an electronic device provided by an embodiment of the present application.
  • the electronic device may include a main task application, a temporary task application, an input method application, a multitasking unit, a window management unit, an input management unit and a graphics display unit.
  • the main task application may be the first application in the aforementioned embodiment
  • the temporary task application may be the second application in the aforementioned embodiment
  • the input method application may be the application used to display the virtual keyboard area in the aforementioned embodiment.
  • the multi-tasking processing unit can be responsible for monitoring user interaction events, monitoring input triggering and closing events of the input management unit, processing the status switching between main tasks and temporary tasks, calculating the display position, area and size of the multi-tasking window, etc.
  • the window management unit can initialize the display of the window, change the size and position of the main task application and temporary task application windows according to the instructions of the multitasking unit, and notify the main task application and temporary task application windows of changes in size and position.
  • the input management unit can be used to monitor user interaction events and control the triggering and closing of input method applications.
  • the graphic display unit can be used to display the interfaces of the main task application, the temporary task application and the input method application.
  • the input management unit can monitor the user's click on the input box and trigger the input method application.
  • the input snap-in can notify the multi-tasking snap-in that the window of the input method application has changed.
  • the multitasking unit may calculate the position, area, and size displayed by the main task application (eg, the first application), the temporary task application, and the input method application.
  • the multi-tasking processing unit can notify the window management unit to change the display position, area and size of the main task application, temporary task application and input method application, and the window management unit notifies the main task application, temporary task application and input method application.
  • the main task application, the temporary task application and the input method application notify the graphics display unit to redraw the window and display the final adjusted interface.
  • Figure 19 shows a schematic flowchart of a multi-window display method provided by an embodiment of the present application.
  • the method can be executed by an electronic device.
  • the method includes:
  • S1901 The electronic device displays the first window in the full screen of the display screen, and displays the second window in the first area of the display screen.
  • S1902 The electronic device receives the first operation.
  • the first operation may be an operation in which the user clicks on the input box of the first window or the second window.
  • the electronic device In response to the first operation, the electronic device displays the second window in the second area of the display screen, the first window in the third area of the display screen, and the virtual keyboard in the fourth area of the display screen. Among them, the second area, the third area and the fourth area do not overlap with each other.
  • the first area and the second area may be the same, that is, the display position and size of the second window remain unchanged.
  • the display position and size of the second window are the same before and after the virtual keyboard area is displayed.
  • the first area and the second area may be different.
  • the second window displayed in the first area and the second window displayed in the second area have the same size but different positions.
  • the size of the second window displayed in the first area and the second window displayed in the second area are different, and the size of the second window displayed in the second area is smaller than The size of the second window displayed in the first area.
  • the height of the second window displayed in the second area is smaller than that in the first area. The height of the second window displayed by the field.
  • the electronic device can draw the virtual keyboard in a fixed area of the display screen, and the fourth area is the fixed area; the electronic device can determine the area of the display screen other than the virtual keyboard as a drawing area that allows drawing of the application window; Furthermore, the electronic device can draw the first window and the second window in the drawing area.
  • the drawing area includes the above-mentioned second area and third area.
  • the electronic device may proportionally reduce the first window from the first size to the second size. For example, as shown in (b) of Figure 10, the first window is scaled down.
  • the electronic device shrinks the first window so that the second window is displayed in the second area of the display screen and the first window is displayed in the third area of the display screen, for example, in Figure 10 shown in (b).
  • the electronic device shrinks the first window, moves it upward, moves it upward and to the left, or moves the second window upward and to the right, so that the second window is displayed in the second area of the display screen.
  • the first window is displayed in the third area of the screen. For example, as shown in (b) in FIG. 11 , the electronic device reduces the first window and moves the second window upward and to the right.
  • the electronic device shrinks the first window, moves it upward, moves it upward and to the left, or moves the second window upward and to the right, and shrinks the second window so that it is displayed in the second area of the display screen.
  • the second window displays the first window in the third area of the display screen.
  • the second area, the third area and the fourth area fill the display area of the display screen.
  • the second window displayed in the second area, the first window displayed in the third area, and the virtual keyboard displayed in the fourth area exactly fill the display area of the display screen.
  • the electronic device receives a drag operation acting on adjacent edges of the first window and the second window; in response to the drag operation, the electronic device controls the adjustment of the second area to the fifth area, and controls the adjustment of the third area. It is the sixth area, the fifth area displays the second window, and the sixth area displays the first window. For example, as shown in Figure 15, when the user presses and holds the adjacent edge of the first window and the second window and drags it to the left, the display area of the first window gradually decreases, and at the same time, the display area of the second window gradually increases. big.
  • the electronic device receives a second operation that acts on the first window or the second window; in response to the second operation, the virtual keyboard disappears, and the electronic device displays the first window in full screen on the display screen, and in the first part of the display screen area displays the second window.
  • the virtual keyboard when the virtual keyboard is retracted, the position and size of the window can be restored to the window display state before adjustment.
  • Figure 20 shows a schematic flowchart of another multi-window display method provided by an embodiment of the present application. This method can be executed by an electronic device. The method includes:
  • S2001 The electronic device displays the first window in the full screen of the display screen, and displays the second window in the first area of the display screen.
  • S2002 The electronic device receives the first preset operation.
  • the first preset operation may be a gesture operation, an operation on a control, or an operation on a preset physical key or virtual key, etc.
  • S2003 In response to the first preset operation, the electronic device displays the second window in the full screen of the display screen and displays the first window in the seventh area of the display screen.
  • the user can switch the display form of the first window and the second window through a first preset operation.
  • the first window is displayed in full screen, and the second window is displayed in the form of a small window.
  • the second window is displayed in full screen, and the first window is displayed in the form of a small window.
  • the first area is the same as the seventh area.
  • the first area and the seventh area are different.
  • FIG. 21 is a schematic diagram of the composition of a display device provided by an embodiment of the present application. As shown in Figure 21, the device can be applied to electronic equipment, and the device can include: a display unit 2101 and an input unit 2102.
  • the display unit 2101 is configured to display the first window in full screen on the display screen of the electronic device, and display the second window in the first area of the display screen.
  • the input unit 2102 is used to receive the first operation.
  • the display unit 2101 is further configured to, after receiving the first operation, display a second window in the second area of the display screen, display the first window in the third area of the display screen, and display the virtual keyboard in the fourth area of the display screen.
  • the second area, the third area and the fourth area do not overlap with each other.
  • the display unit 2101 is configured to display the first window in full screen on the display screen of the electronic device, and display the second window in the first area of the display screen.
  • the input unit 2102 is used to receive the first preset operation.
  • the display unit 2101 is also configured to display the second window in the full screen of the display screen and display the first window in the seventh area of the display screen after receiving the first preset operation.
  • An embodiment of the present application also provides a display device, which can be applied to electronic equipment, such as the electronic equipment (such as a mobile phone) in the above embodiment.
  • the device may include: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions so that the display device implements various functions performed by the electronic device (such as a mobile phone) in the above method embodiment or step.
  • An embodiment of the present application also provides an electronic device (the electronic device may be an electronic device, such as the mobile phone in the above embodiment).
  • the electronic device may include: a display screen, a memory, and one or more processors.
  • the display, memory and processor are coupled.
  • the memory is used to store computer program code, which includes computer instructions.
  • the processor executes computer instructions, the electronic device can perform various functions or steps performed by the electronic device (such as a mobile phone) in the above method embodiments.
  • the electronic device includes but is not limited to the above-mentioned display screen, memory and one or more processors.
  • the structure of the electronic device may refer to the structure of the mobile phone shown in FIG. 5 .
  • Embodiments of the present application also provide a chip system, which can be applied to electronic devices, such as the electronic devices (such as mobile phones) in the previous embodiments.
  • the chip system includes at least one processor 2201 and at least one interface circuit 2202.
  • the processor 2201 may be the processor in the above-mentioned electronic device.
  • the processor 2201 and the interface circuit 2202 may be interconnected via wires.
  • the processor 2201 can receive and execute computer instructions from the memory of the above-mentioned electronic device through the interface circuit 2202.
  • the electronic device can be caused to perform various steps performed by the mobile phone in the above embodiments.
  • the chip system may also include other discrete devices, which are not specifically limited in the embodiments of this application.
  • Embodiments of the present application also provide a computer-readable storage medium for storing computer instructions run by an electronic device, such as the above-mentioned electronic device (such as a mobile phone).
  • an electronic device such as the above-mentioned electronic device (such as a mobile phone).
  • An embodiment of the present application also provides a computer program product, which includes computer instructions run by an electronic device, such as the above-mentioned electronic device (such as a mobile phone).
  • an electronic device such as the above-mentioned electronic device (such as a mobile phone).
  • the disclosed devices and methods can be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of modules or units is only a logical function division.
  • there may be other division methods for example, multiple units or components may be The combination can either be integrated into another device, or some features can be omitted, or not implemented.
  • the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated.
  • the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. . Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit.
  • the above integrated units can be implemented in the form of hardware or software functional units.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium.
  • the technical solutions of the embodiments of the present application are essentially or contribute to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium , including several instructions to cause a device (which can be a microcontroller, a chip, etc.) or a processor to execute all or part of the steps of the methods described in various embodiments of this application.
  • the aforementioned storage media include: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program code.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Digital Computer Display Output (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente demande se rapporte au domaine des dispositifs électroniques, et concerne un procédé et un dispositif d'affichage à fenêtres multiples. Le procédé comprend les étapes suivantes : un dispositif électronique affiche une première fenêtre sur un écran d'affichage dans un mode plein écran, et affiche une seconde fenêtre dans une première région de l'écran d'affichage, la seconde fenêtre étant située sur la première fenêtre, et la zone d'affichage de la seconde fenêtre étant plus petite que la zone d'affichage de la première fenêtre ; le dispositif électronique reçoit une première opération, la première opération étant utilisée pour ordonner l'affichage d'un clavier virtuel ; et en réponse à la première opération, le dispositif électronique affiche la seconde fenêtre dans une deuxième région de l'écran d'affichage, affiche la première fenêtre dans une troisième région de l'écran d'affichage, et affiche le clavier virtuel dans une quatrième région de l'écran d'affichage, la deuxième région, la troisième région et la quatrième région ne se chevauchant pas l'une l'autre. Ainsi, il est possible d'empêcher le clavier virtuel de bloquer le contenu affiché dans les fenêtres, et l'expérience d'utilisation d'utilisateurs lors de l'utilisation d'un affichage à fenêtres multiples peut être améliorée.
PCT/CN2023/104198 2022-07-05 2023-06-29 Procédé et dispositif d'affichage multi-fenêtres WO2024007966A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210791020.XA CN117389437A (zh) 2022-07-05 2022-07-05 一种多窗口显示方法及设备
CN202210791020.X 2022-07-05

Publications (1)

Publication Number Publication Date
WO2024007966A1 true WO2024007966A1 (fr) 2024-01-11

Family

ID=89437883

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/104198 WO2024007966A1 (fr) 2022-07-05 2023-06-29 Procédé et dispositif d'affichage multi-fenêtres

Country Status (2)

Country Link
CN (1) CN117389437A (fr)
WO (1) WO2024007966A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2854013A1 (fr) * 2013-09-30 2015-04-01 Samsung Electronics Co., Ltd Procédé d'affichage dans un dispositif électronique et dispositif électronique correspondant
US20150121284A1 (en) * 2013-10-28 2015-04-30 Lenovo (Beijing) Co., Ltd. Method for information processing and electronic apparatus thereof
CN107678667A (zh) * 2017-09-18 2018-02-09 维沃移动通信有限公司 一种虚拟键盘显示方法及移动终端
CN110661917A (zh) * 2019-08-07 2020-01-07 华为技术有限公司 一种显示方法及电子设备
CN111669459A (zh) * 2020-04-23 2020-09-15 华为技术有限公司 键盘显示方法、电子设备和计算机可读存储介质
CN111857532A (zh) * 2020-07-30 2020-10-30 京东方科技集团股份有限公司 虚拟键盘显示方法、装置及电子设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2854013A1 (fr) * 2013-09-30 2015-04-01 Samsung Electronics Co., Ltd Procédé d'affichage dans un dispositif électronique et dispositif électronique correspondant
US20150121284A1 (en) * 2013-10-28 2015-04-30 Lenovo (Beijing) Co., Ltd. Method for information processing and electronic apparatus thereof
CN107678667A (zh) * 2017-09-18 2018-02-09 维沃移动通信有限公司 一种虚拟键盘显示方法及移动终端
CN110661917A (zh) * 2019-08-07 2020-01-07 华为技术有限公司 一种显示方法及电子设备
CN111669459A (zh) * 2020-04-23 2020-09-15 华为技术有限公司 键盘显示方法、电子设备和计算机可读存储介质
CN111857532A (zh) * 2020-07-30 2020-10-30 京东方科技集团股份有限公司 虚拟键盘显示方法、装置及电子设备

Also Published As

Publication number Publication date
CN117389437A (zh) 2024-01-12

Similar Documents

Publication Publication Date Title
WO2021027747A1 (fr) Procédé et dispositif d'affichage d'interface
WO2021018067A1 (fr) Procédé de gestion de fenêtre flottante et dispositif associé
WO2021036571A1 (fr) Procédé d'édition de bureau et dispositif électronique
WO2021129326A1 (fr) Procédé d'affichage d'écran et dispositif électronique
WO2021103981A1 (fr) Procédé et appareil de traitement d'affichage à écran divisé, et dispositif électronique
EP3848786B1 (fr) Procédé de commande d'affichage pour une barre de navigation de système, interface utilisateur graphique et dispositif électronique
WO2021000881A1 (fr) Procédé de division d'écran et dispositif électronique
WO2021057868A1 (fr) Procédé de commutation d'interface et dispositif électronique
WO2021036628A1 (fr) Procédé de commande tactile pour dispositif à écran pliable et dispositif à écran pliable
WO2021063098A1 (fr) Procédé de réponse d'écran tactile, et dispositif électronique
EP4209874A1 (fr) Procédé et appareil de démarrage d'application, et dispositif électronique
CN111443836B (zh) 一种暂存应用界面的方法及电子设备
WO2022222752A1 (fr) Procédé d'affichage et appareil associé
WO2022042285A1 (fr) Procédé d'affichage d'interface de programme d'application et dispositif électronique
EP4209877A1 (fr) Procédé et dispositif d'affichage de fenêtre
WO2021190524A1 (fr) Procédé de traitement de capture d'écran, interface utilisateur graphique et terminal
WO2022057512A1 (fr) Procédé et appareil à écran divisé et dispositif électronique
WO2020238759A1 (fr) Procédé d'affichage d'interface et dispositif électronique
WO2021057699A1 (fr) Procédé de commande d'un dispositif électronique à écran flexible et dispositif électronique
WO2023035888A1 (fr) Procédé d'affichage, dispositif électronique et support de stockage
WO2023051511A1 (fr) Procédé de déplacement d'icône, interface graphique associée et dispositif électronique
WO2022213831A1 (fr) Procédé d'affichage de commande et dispositif associé
WO2022002213A1 (fr) Procédé et appareil d'affichage de résultat de traduction, et dispositif électronique
WO2021042878A1 (fr) Procédé photographique et dispositif électronique
WO2024007966A1 (fr) Procédé et dispositif d'affichage multi-fenêtres

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23834733

Country of ref document: EP

Kind code of ref document: A1