WO2023226975A1

WO2023226975A1 - Display method and electronic device

Info

Publication number: WO2023226975A1
Application number: PCT/CN2023/095766
Authority: WO
Inventors: 张羽翕; 王海军
Original assignee: 华为技术有限公司
Priority date: 2022-05-24
Filing date: 2023-05-23
Publication date: 2023-11-30
Also published as: CN117149008A

Abstract

A display method and an electronic device. The electronic device displays a first window; in response to a first operation for selecting first information in the first window, a second window appears on a display screen; the second window is located on an upper layer of the first window, and the display area of the second window is smaller than the display area of the first window; and in response to a second operation for dragging the first information into the second window, the first information is processed in the second window. By means of the method, when the electronic device displays the first window, if the first information in the first window needs to be processed by means of the second window, the second window is called, i.e., the second window does not shield the first window all the time and does not affect the operation of a user on the first window, and after the second window is called, the first information can be processed in the second window by means of the operation of dragging the first information into the second window, so that the operation is convenient and fast, and the user experience is good.

Description

Display method and electronic device

Cross-references to related applications

This application claims priority to the Chinese patent application submitted to the China Patent Office on May 24, 2022, with the application number 202210570699.X and the application name "A display method and electronic device". The entire content is incorporated herein by reference. Applying.

Technical field

The present application relates to the field of electronic technology, and in particular, to a display method and electronic equipment.

Background technique

With the development of mobile devices, people's daily life is increasingly dependent on mobile devices. Taking mobile phones as an example, a large part of people's lives and work can be completed on mobile phones. In order to improve the processing efficiency of the mobile phone, multiple windows can be displayed on the mobile phone, and different content can be displayed in each window, making it convenient for users to handle business in different windows.

However, due to the small display screen of mobile phones, when the mobile phone displays multiple windows, the upper window often blocks the lower window. For example, as shown in Figure 1, two windows are displayed on the mobile phone, window A and window B. Window A blocks the content of window B. In this way, when the user wants to process business in window B, window A needs to be hidden or reduced. After window A is hidden or reduced, if the user needs to switch to window A to handle business, he or she needs to open window A again or enlarge window A. Obviously, this process is very cumbersome and affects the user experience.

Contents of the invention

The purpose of this application is to provide a display method and electronic device to improve the interactive experience during multi-window display.

In a first aspect, a display method is provided, applied to an electronic device, the electronic device has a display screen, the method includes: displaying a first window; responding to a first step for selecting first information in the first window. Operation, a second window appears on the display screen; the second window is located on the upper layer of the first window, and the display area of the second window is smaller than the display area of the first window; in response to the The second operation of dragging the first information into the second window is to process the first information in the second window.

That is to say, when the electronic device displays the first window, when the second window is needed to process the first information in the first window, the second window can be called up through user operation (first operation), and the second window is suspended above the first window. On one window and the display area is small, in other words, the first window will not always be blocked by the second window, and the user's business processing progress in the first window will not be affected. Moreover, if the user wants to process the first information in the first window through the second window (for example, copy the first information into the second window), he only needs to drag the first information into the second window. Easy to operate and high user experience.

In some embodiments, processing the first information in the second window includes multiple situations, such as situation 1: copying the first information into the second window; situation 2, in Search related information of the first information in the second window; for example, the second window is a window of a browser application, and the first information is searched in the browser application; case 3, open all the information in the second window Describe the first information, for example, the first information is a picture, the second window automatically displays Shown as the window of the photo album application, that is, the picture in the first window is opened through the photo album application.

That is to say, when the electronic device displays the first window, if the user wants to copy the first information in the first window to the second window, or search for related information of the first information in the second window (for example, while browsing Search the first information in the browser application), you can call up the second window through the first operation and make the second window process the first information through the second operation. In other words, for cross-window information copying, content search and other processes, the operation is more convenient , higher user experience.

In a possible design, the first operation includes: a long press operation on the first information, or a drag operation after performing a long press operation on the first information. That is, when the electronic device displays the first window, if a second window is needed to process the first information in the first window, you can long press the first information or start dragging the first information to call up the second window. The second window will not always block the first window and will not affect the user's business processing progress in the first window. It should be understood that the first operation can also be other types of operations, which are not limited by the embodiments of this application.

In a possible design, the second operation is a subsequent operation in which the finger does not leave the display screen after the first operation. To put it simply, the second operation and the first operation are continuous and have no interval. In other words, after performing the first operation, the user continues to perform the second operation without leaving the screen with his finger. For example, the first operation is a long press operation on the first information, and the second operation is a drag operation continued without leaving the screen after the long press operation on the first information. In this way, users can operate smoothly, conveniently and have a better experience.

In a possible design, the second window and the first window are windows of the same application, or windows of different applications. That is to say, when the electronic device displays the first window, it can call up a second window that belongs to the same application as the first window, or a second window that belongs to a different application from the first window through user operation (i.e., the first operation). . For example, the first window is a window of a browser application, and the second window is a window of an instant messaging application, realizing information processing between windows of different applications.

In a possible design, the second window satisfies at least one of the following conditions:

The second window is a window with information insertion bits; or,

The second window is the last window displayed on the display screen before the first window, or,

The second window is a window of a second application; wherein the second application includes at least one of: a background running application, an application in the electronic device with a usage frequency greater than a preset frequency, and a specific application, and the specific application Applications include default applications of the electronic device or user-specified applications.

It can be understood that, in addition to the above conditions, the second window can also meet other conditions (for example, a specific/fixed window set by the user), etc., which are not limited by the embodiments of this application.

In a possible design, after processing the first information in the second window, the second window performs at least one of the following steps:

The second window is hidden; or

The second window displays a first preset duration and is automatically hidden after the first preset duration; or,

The second window displays a second preset duration. If no operation in the second window is received within the second preset duration, the second window is hidden; or,

Upon receiving an operation within the first window, the second window is hidden; or,

The second window displays a third preset duration. If an operation in the first window is received within the third preset duration, the second window is hidden.

That is to say, after the second window processes the first information, it can be hidden. In this case, the first window is no longer blocked, and the user can continue to process business in the first window, and the user experience is high.

In a possible design, hiding the second window includes: the second window disappears from the display screen, Alternatively, the second window is displayed in a reduced size; or, the second window is displayed in a reduced size, and when an interactive operation in the first window is received, the reduced second window disappears.

That is to say, when the second window is hidden, it can disappear directly, or the display can be reduced, or it can be reduced and disappeared first and then completely hidden, etc. In short, the second window is hidden after processing the first information and no longer blocks the second window. With one window, users can continue to process business in the first window, and the user experience is high.

In one possible design, in response to a first operation for selecting the first information in the first window, a second window appears on the display screen, including: in response to a first operation for selecting the first window In response to the first operation of dragging the first information to the first information, a prompt box of the second window appears on the display screen, and the second window runs in the background; The second operation in the second window, processing the first information in the second window includes: in response to the second operation for dragging the first information to the prompt box, the second The window processes the first information in the background, or in response to the second operation for dragging the first information to the prompt box, the prompt box expands into the second window. When the third When a piece of information is dragged into the second window, the first information is processed in the second window.

That is to say, when the electronic device calls up the second window, it calls up the prompt box of the second window. It should be understood that the prompt box of the second window occupies a smaller display area than the second window and blocks the first window. smaller. The user can process the first information in the second window by dragging the first information in the first window to the prompt box in the second window. In this way, the second window is always displayed in the form of a prompt box, which is very important to the display. The screen occlusion is very small and will hardly affect the user's business processing in the first window. Or, when the user drags the first information in the first window to the prompt box of the second window, the prompt box expands into the second window, and the first information is processed in the second window. This facilitates the user to accurately process the first information in the second window. information processing within.

In a possible design, in response to the second operation of dragging the information to the prompt box, the prompt box expands into the second window. When the first information is dragged to When within the second window, processing the first information within the second window includes:

In response to the operation of dragging the first information to the prompt box, the prompt box expands into a second window;

In response to the operation of dragging the first information to the second window, the second window is enlarged and displayed. When the first information is dragged to the enlarged second window, in the The first information is processed within the enlarged second window.

That is to say, when the user drags the first information to the prompt box, the prompt box first expands into a second window. At this time, the second window can be displayed in a smaller area. When the user continues to drag the first information to the third window, When dragging two windows, the second window is enlarged and displayed until the first information is dragged into the second window, and the second window processes the first information. In this way, at the beginning, the prompt box blocks the lower layer very little. If the user drags the first information, it means that the user has the intention to process the first information through the second window, and the prompt box expands into the second window. If The user continues to drag the first information to the second window, and the second window is enlarged to facilitate the user to view the processing of the first information in the second window.

In one possible design, the second window is enlarged and displayed, including: the second window is directly enlarged to the first preset area; or, as the drag operation approaches the distance of the second window , the display area of the second window is gradually enlarged to the second preset area. For example, when the user drags the first information, when the user's finger gradually approaches the second window, the second window gradually enlarges. Since the second window gradually enlarges, the time required for the user to drag the first information into the second window can be shortened. In other words, as the second window gradually enlarges, the distance between the user's finger and the second window gradually shrinks, and the first information can be easily dragged into the second window, which is convenient to operate.

In a possible design, the first preset area and/or the second preset area is smaller than or equal to the display area. the entire display area of the screen. For example, the first preset area includes: one quarter of the area of the display screen, or the entire display area of the display screen; the second preset area includes: one quarter of the display screen. An area, or the entire display area of the display screen.

In a possible design, the second window is enlarged for display, including: when the second window has an information insertion position, the second window is enlarged to a first area, and the first area is smaller than the display area. The size of the screen; when the second window has multiple information insertion positions, the second window is enlarged to a second area or the full screen of the display screen, and the second area is smaller than the size of the display screen. The second area is larger than the first area. It can be understood that when there is an information insertion position in the second window, there will be no insertion position error when the first information is inserted into the second window, so the second window can be displayed in a smaller area. When there are multiple information insertion slots in the second window, in order to facilitate the user to accurately insert the first information into a certain insertion slot, the second window is displayed in a larger area, which will not cause the first information to be inserted in the wrong position and improve user experience.

In one possible design, in response to the first operation for selecting the first information in the first window, a second window appears on the display screen, including: in response to the first operation for selecting the first information in the first window. In the first operation of the first information, the second window and the third window appear on the display screen at the same time; the third window and the second window are located above the first window, and the second window and the second window appear on the display screen at the same time. The display area of the third window is smaller than the display area of the first window.

That is to say, when the electronic device displays the first window, it can call up multiple windows through the first operation, and the multiple windows are displayed with a smaller display area. If the user wants to process the first information in the first window through the second window among multiple windows, he only needs to drag the first information into the second window. This method is not only convenient to operate, but also allows the user to Selecting a target window for processing the first information (for example, the second window) among the multiple windows that are called up provides a higher user experience.

In a possible design, the first window, the second window and the third window are windows of the same application or different applications.

In a possible design, the second window has an information insertion position, and when the third window does not have an information insertion position, the third window is displayed differently from the second window to prompt the user what the information insertion position is. The second window can process the first information, and the third window cannot process the first information. It is understandable that some windows cannot insert information, so when these windows are called up, they can be displayed differently from other windows, so that users will not drag the first window in the first window to these windows, improving the accuracy of the operation. sex.

In a possible design, the method further includes: receiving a drag operation for moving any one of the second window and the third window to the edge of the display screen; responding to the drag operation Drag operation to hide the second window and the third window together. That is to say, after calling up multiple windows, if the user drags one of the windows to the edge of the display screen, multiple windows can be hidden together, realizing rapid hiding of multiple windows, easy operation, and avoiding affecting the user's first viewing experience. Business processing within the window.

In a possible design, hiding the second window and the third window together includes: the second window and the third window disappearing together or reducing the display together. In this way, when the user's intention of dragging to hide a floating window is recognized, all floating windows superimposed on the first window can be hidden together, thereby reducing the blocking of the first window screen by the floating window. In this way, all floating windows can be hidden at once, reducing user interaction steps.

In a possible design, when the second window and the third window disappear together, the method further includes: restoring the display of the second window and the third window together through a one-key operation. Location and/or area. That is to say, when all floating windows disappear together, all hidden floating windows can be called up with one-click operation. There is no need to call them out one by one, which saves operation steps.

In a possible design, when the second window and the third window are reduced for display together, the method further includes: receiving an operation for the reduced second window, restoring the second window. The display position and/or area of the window, the third window remains in a reduced display state; or, upon receiving an operation for the reduced second window, the display positions of the second window and the third window are restored together. and/or area. For example, the second window and the third window are both reduced and displayed in the form of prompt boxes. One way is that when the user clicks the prompt box of the second window, only the area and/or position of the second window is restored, and the third window remains unchanged. Reduce the display. Another method is that when the user clicks the prompt box of the second window, the areas and/or positions of the second window and the third window are restored together, which can save operating steps.

In a second aspect, a display method is also provided, applied to an electronic device, where the electronic device includes a display screen, and the method includes:

A first window and a second window are displayed on the display screen, the second window is located above the first window and the display area of the second window is smaller than the display area of the first window;

In response to a drag operation for dragging the first information in the first window to the second window, the second window is enlarged and displayed, and the first information is processed in the enlarged second window. .

In one possible design, processing the first information within the enlarged second window includes:

Copy the first information into the enlarged second window, or search for information related to the first information in the enlarged second window.

In a possible design, displaying the first window and the second window on the display screen includes: displaying prompt information of the first window and the second window on the display screen; responding to the The drag operation of the first information in the first window to the second window, and the enlarged display of the second window includes: in response to the operation of dragging the first information in the first window to the second window. By dragging the prompt information, the second window is enlarged and displayed.

In one possible design, in response to a drag operation for dragging the first information to the second window, the second window is enlarged and displayed, including:

As the drag operation approaches the second window, the display area of the second window is gradually enlarged.

In a possible design, the area of the second window is enlarged to a preset area, and the preset area is a default area of the electronic device or an area set by the user.

In a possible design, the method further includes: when the second window has an information insertion position, the second window is enlarged to a first area, and the first area is smaller than the size of the display screen; When the second window has multiple information insertion positions, the second window is enlarged to the full screen of the display screen.

In a third aspect, a display method is also provided, applied to an electronic device, the electronic device includes a display screen, and the method includes:

In response to a drag operation for moving the first information in the first window to the second window, process the first information in the second window;

In response to the first operation in the first window, the second window is reduced to display or hidden.

In a possible design, processing the first information in the second window includes: copying the first information into the second window, or searching for all the information in the second window. information related to the first information.

In a possible design, the first operation includes: a click operation at any position within the first window; or a selection operation on information in the first window.

In a possible design, in response to a first operation in the first window, the second window shrinks the display or hiding, including: in response to the drag operation being released, the second window is reduced to display or hidden.

In a possible design, a first window and a second window are displayed on the display screen, including:

A first window is displayed on the display screen;

The second window appears in response to a selection operation on the first information within the first window.

In a possible design, displaying the first window and the second window on the display screen includes: displaying prompt information of the first window and the second window on the display screen; responding to the The drag operation of the first information in the first window to the second window, and processing the first information in the second window includes: responding to the method for transferring the first information in the first window Drag and drop the prompt information to the second window to process the first information in the second window.

In one possible design, in response to a drag operation for transferring the first information in the first window to the prompt information in the second window, the first information is processed in the second window, The method includes: in response to a drag operation for moving the first information in the first window to the prompt information in the second window, the second window is enlarged and displayed, and processed in the enlarged second window. the first information.

In a fourth aspect, a display method is also provided, applied to an electronic device, the electronic device includes a display screen, and the method includes:

A first window, a second window and a third window are displayed on the display screen, the second window and the third window are located above the first window, and the second window and the third window are The display area is smaller than the display area of the first window;

In response to a drag operation for dragging any one of the second window and the third window to the edge of the display screen, the second window and the third window are reduced, displayed or hidden together.

In a possible design, the method further includes: in response to a drag operation for moving the first information in the first window to the second window, processing the first information in the second window. a message; and/or,

In response to a drag operation for dragging the second information in the first window to the third window, the second information is processed in the third window.

In a possible design, processing the first information in the second window includes: copying the first information into the second window, or searching for all the information in the second window. information related to the first information; processing the second information in the third window includes: copying the second information to the third window, or searching for all the information in the third window. information related to the second information.

In a possible design, the second window has an information insertion bit, and when the third window does not have an information insertion bit, the third window is displayed differently from the second window to prompt the user that the information insertion bit is not available. Copy the information in the first window to the third window.

In a fifth aspect, an electronic device is also provided, including:

processor, memory, and, one or more programs;

Wherein, the one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the first aspect as described above. to the method steps described in any one of the fourth aspects.

In a sixth aspect, a computer-readable storage medium is also provided. The computer-readable storage medium is used to store a computer program. When the computer program is run on a computer, it causes the computer to execute the above-mentioned first aspect to the third aspect. The method steps described in any of the four aspects.

In a seventh aspect, a computer program product is also provided, including a computer program. When the computer program calculates When running on the computer, the computer is caused to execute the method steps described in any one of the above first to fourth aspects.

In an eighth aspect, embodiments of the present application further provide a chip, which is coupled to a memory in an electronic device and used to call a computer program stored in the memory and execute the technical solution of the second or third aspect of the embodiment of the present application. , "Coupling" in the embodiment of this application means that two components are directly or indirectly combined with each other.

For the beneficial effects of the above-mentioned second aspect to the eighth aspect, please refer to the beneficial effects of the first aspect and will not be repeated.

Description of the drawings

Figure 1 is a schematic diagram of a multi-window display provided by an embodiment of the present application;

Figure 2A is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present application;

Figure 2B is a schematic diagram of the software structure of the electronic device provided by an embodiment of the present application;

Figure 3 is a schematic diagram of an electronic device opening multiple windows according to an embodiment of the present application;

Figure 4 is a schematic diagram of multi-window movement or scaling provided by an embodiment of the present application;

Figure 5 is a schematic diagram of a cross-window information pasting process provided by an embodiment of the present application;

Figure 6 is a schematic diagram of an application scenario provided by an embodiment of the present application;

Figure 7A is a schematic diagram of another application scenario provided by an embodiment of the present application;

Figure 7B is a schematic diagram of another application scenario provided by an embodiment of the present application;

Figure 8 is a schematic diagram of calling up a second window provided by an embodiment of the present application;

Figure 9 is a schematic diagram of hiding the second window provided by an embodiment of the present application;

Figures 10A and 10B are schematic diagrams of the background processing flow provided by an embodiment of the present application;

Figure 11 is another schematic diagram of calling up the second window provided by an embodiment of the present application;

Figure 12 is a schematic diagram of cross-window information processing provided by an embodiment of the present application;

Figure 13 is a schematic diagram of the window enlargement process provided by an embodiment of the present application;

Figure 14 is another schematic diagram of the window enlargement process provided by an embodiment of the present application;

Figure 15 is a schematic diagram of the background processing flow provided by an embodiment of the present application;

Figure 16 is a schematic diagram of multi-window calling provided by an embodiment of the present application;

Figure 17 is a schematic diagram of multi-window hiding provided by an embodiment of the present application;

Figure 18 is another schematic diagram of multi-window hiding provided by an embodiment of the present application;

Figure 19 is a schematic diagram of the background processing flow provided by an embodiment of the present application;

Figure 20 is another schematic diagram of multi-window calling provided by an embodiment of the present application;

Figure 21 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

In the following, some terms used in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

The at least one involved in the embodiments of this application includes one or more; where multiple means greater than or equal to two. In addition, it should be understood that in the description of this specification, words such as "first" and "second" are only used for the purpose of distinguishing the description, and cannot be understood to express or imply relative importance, nor can they be understood to express Or suggestive order. For example, the first window and the second window do not represent the importance of the two or the order of the two, but are only used to differentiate the description. In the embodiment of this application, "and/or" only describes the association relationship, indicating that three relationships can exist, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone. these three situations. In addition, in this article The character "/" generally indicates that the related objects are an "or" relationship.

The directional terms mentioned in the embodiments of the present application, such as "upper", "lower", "left", "right", "inner", "outer", etc., are only for reference to the direction of the drawings. Therefore, use The orientation terms are used to describe and understand the embodiments of the present application better and more clearly, but do not indicate or imply that the device or component referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present application. Limitations of Application Examples.

Reference in this specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the specification. Therefore, the phrases "in one embodiment", "in some embodiments", "in other embodiments", "in other embodiments", etc. appearing in different places in this specification are not necessarily References are made to the same embodiment, but rather to "one or more but not all embodiments" unless specifically stated otherwise. The terms “including,” “includes,” “having,” and variations thereof all mean “including but not limited to,” unless otherwise specifically emphasized.

The display method provided by the embodiment of the present application is suitable for electronic devices. The electronic device has a display function, such as at least one display screen. In some embodiments, the electronic device may be a portable electronic device such as a mobile phone, a tablet, or a laptop; it may also be a wearable device such as a watch or a bracelet; or it may be a smart home device such as a television or a refrigerator; Or, it can also be a vehicle-mounted device, etc., or it can also be a virtual reality (Virtual Reality, VR) device, an augmented reality (Augmented Reality, AR) device, a mixed reality technology (Mixed Reality, MR) device, etc., in short The embodiments of this application do not limit the specific type of electronic equipment.

Figure 2A shows a schematic structural diagram of an electronic device. The electronic device is, for example, a mobile phone. As shown in Figure 2A, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, and a battery 142. Antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, Display 194, and subscriber identification module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) wait. Among them, different processing units can be independent devices or integrated in one or more processors. Among them, the controller can be the nerve center and command center of the electronic device. The controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions. The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface. interface, pulse code modulation (PCM) interface, universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), universal input and output (general- purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and/or universal serial bus (USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (derail clock line, SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 can separately couple the touch sensor 180K, charger, flash, camera 193, etc. through different I2C bus interfaces. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to implement the touch function of the electronic device 100 .

The I2S interface can be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 can be coupled with the audio module 170 through the I2S bus to implement communication between the processor 110 and the audio module 170 . In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface to implement the function of answering calls through a Bluetooth headset.

The PCM interface can also be used for audio communications to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface to implement the function of answering calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 and the wireless communication module 160 . For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 . MIPI interfaces include camera serial interface (CSI), display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the shooting function of the electronic device 100 . The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the electronic device 100 .

The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, display screen 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc.

The USB interface 130 is an interface that complies with the USB standard specification, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through them. This interface can also be used to connect other electronic devices, such as AR devices, etc.

It can be understood that the interface connection relationships between the modules illustrated in the embodiment of the present invention are only schematic illustrations and do not constitute a structural limitation of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The wireless communication function of the electronic device can be through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, implementation of modem processor and baseband processor. Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.

The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied to electronic devices. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be disposed in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.

The wireless communication module 160 can provide wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), and global navigation satellite systems for use in electronic devices. (global navigation satellite system, GNSS), frequency modulation (FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

In some embodiments, the antenna 1 of the electronic device is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi) -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).

The display screen 194 is used to display the display interface of the application, etc. Display 194 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode). emitting diode (AMOLED), flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device may include 1 or N display screens 194, where N is a positive integer greater than 1.

The electronic device 100 can implement the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like. Among them, the ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera sensor through the lens, the optical signal is converted into an electrical signal, and the camera sensor The software passes the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The processor 110 executes instructions stored in the internal memory 121 to execute various functional applications and data processing of the electronic device. The internal memory 121 may include a program storage area and a data storage area. Among them, the stored program area can store the operating system and the software code of at least one application program (such as iQiyi application, WeChat application, etc.). The storage data area can store data (such as images, videos, etc.) generated during the use of the electronic device. In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, save pictures, videos, etc. files on an external memory card.

The electronic device can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playback, recording, etc.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .

Speaker 170A, also called "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music through one or more speakers 170A, or listen to external playback scenarios such as hands-free calls.

The receiver 170B, also called "earpiece", may be one or more and is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a call or a voice message, the voice can be heard by bringing the receiver 170B close to the human ear.

Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak close to the microphone 170C with the human mouth and input the sound signal to the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones, which in addition to collecting sound signals, may also implement a noise reduction function. In other embodiments, the electronic device 100 can also be equipped with three, four or more microphones to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions, etc.

The headphone interface 170D is used to connect wired headphones. The headphone interface can be a USB interface, or it can be a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, pressure sensor 180A may be disposed on display screen 194 .

The gyro sensor 180B can be used to determine the motion posture of the electronic device. In some embodiments, the angular velocity of the electronic device about three axes (ie, x, y, and z axes) may be determined by gyro sensor 180B. The gyro sensor 180B can be used for image stabilization.

Air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

Magnetic sensor 180D includes a Hall sensor. Electronic devices can use magnetic sensors 180D to detect the opening of flip-top leather cases combine. In some embodiments, when the electronic device is a flip machine, the electronic device may detect opening and closing of the flip according to the magnetic sensor 180D. Then, based on the detected opening and closing status of the leather case or the opening and closing status of the flip cover, features such as automatic unlocking of the flip cover are set.

The acceleration sensor 180E can detect the acceleration of the electronic device in various directions (generally three axes). When the electronic device is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices and be used in horizontal and vertical screen switching, pedometer and other applications.

Distance sensor 180F for measuring distance. Electronic devices can measure distance via infrared or laser. In some embodiments, when shooting a scene, the electronic device can utilize the distance sensor 180F to measure distance to achieve fast focusing.

Proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. Electronic devices emit infrared light through light-emitting diodes. Electronic devices use photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device. When insufficient reflected light is detected, the electronic device can determine that there is no object near the electronic device. Electronic devices can use the proximity light sensor 180G to detect when the user holds the electronic device close to the ear and talk, so that the screen can be automatically turned off to save power. The proximity light sensor 180G can also be used in holster mode, and pocket mode automatically unlocks and locks the screen.

The ambient light sensor 180L is used to sense ambient light brightness. The electronic device can adaptively adjust the brightness of the display screen 194 based on perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device is in the pocket to prevent accidental touching.

Fingerprint sensor 180H is used to collect fingerprints. Electronic devices can use the collected fingerprint characteristics to unlock fingerprints, access application locks, take photos with fingerprints, answer incoming calls with fingerprints, etc.

Temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device uses the temperature detected by the temperature sensor 180J to execute the temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device reduces the performance of a processor located near the temperature sensor 180J in order to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device heats the battery 142 to prevent the low temperature from causing abnormal shutdown of the electronic device. In some other embodiments, when the temperature is lower than another threshold, the electronic device performs boosting on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

Touch sensor 180K, also called "touch panel". The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation on or near the touch sensor 180K. The touch sensor can pass the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device at a location different from that of the display screen 194 .

Bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human body's vocal part. The bone conduction sensor 180M can also contact the human body's pulse and receive blood pressure beating signals.

The buttons 190 include a power button, a volume button, etc. Key 190 may be a mechanical key. It can also be a touch button. The electronic device can receive key input and generate key signal input related to user settings and function control of the electronic device. The motor 191 can generate vibration prompts. The motor 191 can be used for vibration prompts for incoming calls and can also be used for touch vibration feedback. For example, touch operations for different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. The indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, or may be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into the SIM card interface 195, or pull it out from the SIM card interface 195 to achieve contact and separation from the electronic device.

It can be understood that the components shown in FIG. 2A do not constitute a specific limitation to the electronic device. Electronic devices in embodiments of the present invention may include more or fewer components than in Figure 2A. In addition, the combination/connection relationship between the components in Figure 2A can also be adjusted and modified.

FIG. 2B shows a software structure block diagram of an electronic device provided by an embodiment of the present application.

The software structure of electronic equipment can be a layered architecture. For example, the software can be divided into several layers, and each layer has clear roles and division of labor. The layers communicate through software interfaces. Assuming that the electronic device is an Android system, it may include an application layer (referred to as the application layer), an application framework layer (referred to as the framework layer) (framework, FWK), a hardware layer, and so on.

Among them, the application package can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions. For example, the application framework layer can include window managers, content providers, view systems, phone managers, resource managers, notification managers, etc. Among them, the window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc. Content providers are used to store and retrieve data and make this data accessible to applications. Said data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls that display text, controls that display pictures, etc. A view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures. The phone manager is used to provide communication functions of the electronic device 100 . For example, call status management (including connected, hung up, etc.). The resource manager provides various resources to applications, such as localized strings, icons, pictures, layout files, video files, and more. The notification manager allows applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be notifications that appear in the status bar at the top of the system in the form of charts or scroll bar text, such as notifications for applications running in the background, or notifications that appear on the screen in the form of conversation windows. For example, text information is prompted in the status bar, a beep sounds, the electronic device vibrates, the indicator light flashes, etc.

Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system. The core library contains two parts: one is the functional functions that need to be called by the Java language, and the other is the core library of Android. Among them, the application layer and application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and application framework layer into binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions. System libraries can include multiple functional modules. For example: surface manager (surface manager), media libraries (Media Libraries), 3D graphics processing libraries (for example: OpenGL ES), 2D graphics engines (for example: SGL), etc. The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition, and layer processing. 2D Graphics Engine is a drawing engine for 2D drawing.

In other embodiments, the system library may also include a window processing module for controlling the hiding, appearance, shrinking, and enlarging of windows. It should be noted that the window processing module can be a module in the system library, or it can be Modules in other layers, such as modules in the application framework layer or kernel layer, are not limited in this embodiment of the application.

The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

The following takes the software structure shown in FIG. 2B as an example to illustrate the processing flow of the display method provided by the embodiment of the present application.

For example, when the first window is displayed on the display screen of the electronic device, the touch sensor in the hardware layer receives the first input event. The first input event includes operation type, operation time, position on the display screen, etc. The touch sensor reports the first input event to a higher level, such as the window processing module in the system library. The high-level layer determines that the first input event is a selection operation for the first information in the first window, and then calls the display driver to display the second window on the display screen. For example, the high-level layer (eg, window processing module) can display the second window through FreeForm window technology (will be introduced later). After the display screen displays the second window, if the touch sensor receives an input event again, such as a second input event, the second input event is reported to a higher level, such as a window processing module. The window processing module determines that the second input event is a drag operation of the first information to the second window, and then controls the second window to process the first information, for example, copies the first information to the second window or in the second window. Search for information related to the first information, etc.

The following mainly takes the electronic device as a mobile phone as an example, and introduces the display method of the present application in detail with reference to the accompanying drawings.

In order to improve processing efficiency, multiple windows can be displayed on electronic devices (such as mobile phones). For example, when the phone receives an operation to open multiple windows, the multiple windows are displayed. Among them, the operation for opening multiple windows can be various types of operations. One possible implementation method is, please refer to (a) in Figure 3, the mobile phone displays window A. When receiving an operation of sliding inward from the right edge (or left edge) of the screen or an operation of sliding inward from the right edge (or left edge) of the screen and pausing for a certain period of time, the smart multi-window application bar 301 is called up, as shown in Figure 3 As shown in (b). The smart multi-window application bar 301 includes icons of various applications, such as icons of Application 1 to Application 3. Assume that the electronic device receives an operation for the icon of application 1 in the smart multi-window application bar 301, and then opens window B of application 1, that is, displays the multi-window interface 302 as shown in (c) of Figure 3. The interface 302 includes window B and window A. Window B is located above window A. Therefore, multiple windows can be opened through the method shown in Figure 3. However, it should be noted that Figure 3 is only an example of a method for opening multiple windows. In actual applications, other methods (such as knuckle tapping) can also be used to open multiple windows. (click the screen) to open multiple windows. The embodiments of this application will not give examples one by one.

For example, window A may be a window displayed in full screen (or understood as an application interface displayed in full screen), and window B may be a small window displayed suspended on window A. That is, the display area of window B is smaller than that of window A. For example, window B can be a free (FreeForm) window (or: free small window). A free window can be considered a system-level floating window. For the meaning of the free window, please refer to the following introduction. In some embodiments, when the electronic device displays multiple windows, the position of the small window (eg, window B) can be moved. For example, please refer to (a) in Figure 4. When an operation on the status bar 401 of window B is received (such as a long press and drag operation anywhere in the blank area of the status bar 401), the window can be changed. The position of B is as shown in (b) in Figure 4.

In other embodiments, when the electronic device displays multiple windows, the size of the small window (eg, window B) can be adjusted, that is, it can be reduced or enlarged. For example, please refer to (c) in Figure 4. When an operation on the button 402 in the status bar 401 of window B is received, window B is enlarged and displayed, for example, window B completely covers window A, for example, full screen display, as shown in Figure 4 of(d). For another example, please refer to (e) in Figure 4. When an operation on the key 403 in the status bar 401 of window B is received, window B is minimized, as in (f) in Figure 4. In (f) of Figure 4, after window B is minimized, a prompt box 404 may be displayed on window A. The prompt box 404 is used to prompt the user that window B is minimized. For example, when an operation (for example, a click operation) on the prompt box 404 is received, window B can be restored, for example, restored to the image shown in FIG. As shown in (e) in 4.

It is understandable that when an electronic device displays multiple windows, the window located on the lower layer will be blocked by the window located on the upper layer. At this time, if the user wants to process business in the lower window, he needs to move the upper window or reduce the size of the upper window, for example, minimize the upper window. For example, continuing to take (c) in Figure 3 as an example, window B is located above window A. If the user wants to process business in window A, he needs to manually move the position of window B, or minimize window B. After window B is minimized, if the user needs to switch to operate in window B, he or she needs to open window B again. Obviously, this process is more cumbersome.

To facilitate understanding, for an example, please refer to (a) in Figure 5. The electronic device displays window A and window B, and window B is located above window A. If the user wants to copy the information in window A to window B, he needs to perform the following steps:

Step 1, minimize window B. For example, as shown in (a) of Figure 5, when the electronic device receives an operation of clicking the button 403, window B is minimized to the prompt box 404 in (b) of Figure 5.

Step 2, copy the information in window A. For example, as shown in (b) of Figure 5, window A includes text information "Huawei", and the user copies the text information in window A (for example, the user selects the text information in window A and long-presses to copy).

Step 3: Open window B again and paste the information in window B. For example, as shown in (b) of Figure 5 , when the electronic device receives the operation of clicking the prompt box 404, it opens window B again. The user pastes information in window B, for example, long presses in window B to call up the paste button and clicks the paste button to complete the copy (the paste process is not shown in the figure), as shown in (c) in Figure 5 .

The above steps 1 to 3 complete the process of copying information from window A to window B. If the user still needs to return to window A to handle business, he needs to minimize window B again. It can be seen that when the electronic device displays multiple windows, if the user needs to copy the information in the lower window to the upper window, the operation is very cumbersome and seriously affects the user experience. Of course, the electronic device also requires multiple operation steps to copy the information in the upper window to the lower window. Continuing to take Figure 5 as an example, step 1 is to copy the information in the upper window B. Step 2: Close the upper window B. Step 3. Paste the information into lower window A. 4. Open window B again. Obviously, the steps are very complicated.

In order to prevent the lower window from being blocked by the upper window and affecting the business processing of the lower window, embodiments of the present application provide a solution. When the electronic device displays the first window, if a second window is needed, the second window can be called up so that The second window is displayed above the first window; if the second window is not needed, the second window can be hidden. In this way, the second window (upper window) will not always block the first window (lower window), improving the interactive experience. For example, when the electronic device displays the first window, the second window is needed. For example, the situation includes: when the electronic device displays the first window, the second window is needed to process the information in the first window. For example, the first window needs to be The information in the first window needs to be copied to the second window, or the second window needs to be used to search for the information in the first window, or the first information needs to be opened in the second window, etc.

For example, when the electronic device displays the first window, in response to the first preset operation (for example, the first operation for selecting the first information in the first window), the second window appears on the display screen; in response to the first Two preset operations (for example, a second operation for dragging the first information to the second window) to process the first information in the second window. That is to say, at a certain moment, only the first window can be displayed on the display screen of the electronic device. When the second window is needed to process the first information in the first window, the second window can be called up. In this way, the first window can be displayed on the display screen of the electronic device. The window will not always be blocked by the second window, which will not affect the operating experience of the first window. Moreover, if the user wants to process the first information in the first window through the second window (for example, copy the first information into the second window), he only needs to drag the first information into the second window. Easy to operate.

Two application scenarios provided by the embodiments of this application are introduced below, but this application is not limited to the following two application scenarios.

Application scenario one

Exemplarily, as in (a) of Figure 6, the electronic device displays a first window. The first window may be a window of any application in the electronic device (eg, instant messaging application, memo, photo album, browser, etc.). In (a) of Figure 6 , taking the first window as a window of a browser application in an electronic device as an example, text information, picture information, etc. are displayed in the first window. The user can perform various operations in the first window, for example, select information in the first window and copy the selected/selected information. In order to facilitate the user to copy the information selected in the first window to the second window, the electronic device can automatically appear the second window.

For example, as shown in (b) of FIG. 6 , when the electronic device receives the first preset operation, a second window appears on the display screen. Exemplarily, the first preset operation includes, for example: a selection operation on the first information in the first window (such as a long press operation on the first information in the first window), or performing a selection operation on the first information in the first window. An operation that lasts for N seconds without letting go after a selection operation (such as a long press operation on the first information in the first window). N is a positive integer, which can be set by default or customized, or performed on the first information in the first window. Start the drag operation after selecting the operation. The first information may be text, pictures, etc. in the first window, which is not limited in the embodiment of the present application. In (b) of FIG. 6 , it is taken as an example that the first information is text. It can be understood that, continuing to refer to (b) in FIG. 6 , before receiving the long press operation on the first information, the electronic device may further include: determining the first information. For example, a click operation at any position in the first window is received, the start cursor and the end cursor are called, and the information between the start cursor and the end cursor is determined to be the first information. It should be understood that the user can change the positions of the start cursor and the end cursor, and, in order to facilitate the user to distinguish, the first information between the start cursor and the end cursor is displayed differently from other information in the first window, such as highlighting or dark background. .

It should be noted that in Figure 6, the second window is a chat window with a certain contact in an instant messaging application as an example. In fact, the second window can also be a window of other applications, which will be introduced later.

Continuing to refer to (b) in FIG. 6 , after the second window appears, if the electronic device receives the second preset operation, it copies the first information into the second window. For example, the second preset operation is an operation of dragging the first information to the second window and dragging the first information into the second window. For example, combining (b) and (c) in Figure 6, when the electronic device receives a drag operation of dragging the first information into the input box of the second window, the first information is copied to the second window (immediately In the input box of the chat window of a communication application), if the user wants to send the information in the input box to the other party, just click the send button in the second window. Or, combining (b) and (d) in Figure 6, after the electronic device receives the drag operation of dragging the first information into the input box of the second window, the first information is directly sent to the second window. To the other party, there is no need to copy the first information to the input box and then the user manually clicks the send button, which saves operations.

Optionally, while the floating element corresponding to the first information moves on the screen of the electronic device, the electronic device can display a corresponding prompt (such as a prompt in the form of a corner mark) according to the area where the floating element is currently located to remind the user of the current location. Whether the region supports interaction. For example, combined with (c) in Figure 6, when the first information moves to an interactive area, such as the area where the input box is located, a corner mark (for example, a plus sign, etc.) can be displayed on the first information to prompt the user for the current area. Support interaction. After the user releases drag at the input box, the first information can be pasted into the input box.

In addition, for example, during the dragging process, the electronic device can also display an animation in which the shadow of the dragged object moves with the user's finger, for example, the shadow of text or pictures. Or it can be understood that the electronic device can display the object dragged by the user as a floating element, and during the dragging process, the electronic device can display the animation of the floating element moving with the finger. Therefore, in this application, dragging the first information can also be understood as dragging the floating element corresponding to the first information. It should be noted that the scene shown in Figure 6 includes two operations, the selection operation of the first information in the first window, and the dragging operation of dragging the first information into the second window. Each operation can be two operations that are independent of each other, that is, after executing the After the selection operation of the first information, the finger can leave the screen, and then perform the drag operation on the first information; of course, the two operations can also be consecutive and without gaps, that is, after the selection operation on the first information is completed After that, the finger does not leave the screen and directly performs the drag operation on the first information. In this case, the operation is smoother and more convenient.

As can be seen from Figure 6, when the user wants to copy the information in the current window (i.e., the first window) to another window (i.e., the second window), he only needs to select the information in the current window, or select the information in the current window and Start the drag operation to call up the second window, and then drag the selected information to the second window to complete the copy. For easier understanding, please compare Figure 6 with Figure 5. Through comparison, we can see that in Figure 5, copying the information in one window to another window requires at least three steps, but in Figure 6, copying the information in one window to another window Window copying can be completed in one step (selecting information and dragging it), simplifying the operation process and improving user experience.

Application scenario two

Exemplarily, as shown in (a) of FIG. 7A , the electronic device displays a first window. Taking the first window as a memo application window in the electronic device as an example, text information is displayed in the first window. The user can select information in the first window and search for the selected/selected information, for example, search on the Internet. In order to facilitate the user to search the information selected in the first window, the electronic device can automatically appear the second window.

For example, as shown in (b) of FIG. 7A , when the electronic device receives the first preset operation, a second window appears on the display screen. Exemplarily, the first preset operation includes: a selection operation on the first information in the first window, or an operation of selecting the first information in the first window and then starting dragging. For details, see the operation of dragging the first information in the first window. The description of the first preset operation will not be repeated in order to save space.

It should be noted that in FIG. 7A , the second window is a browser application as an example. In fact, the second window can also be a window of other applications, which will be introduced later.

Continuing to refer to (b) in FIG. 7A , after the second window appears, if the electronic device receives the second preset operation, it searches for the first information in the second window. For example, the second preset operation is an operation of dragging the first information to the second window and dragging the first information into the second window. For example, combining (b) and (c) in Figure 7A, when the electronic device receives a drag operation of dragging the first information to the input box of the second window, the first information is input in the input box of the second window. , if the user wants to search the first information, just click the search button in the second window. Or, combining (b) and (d) in Figure 7A, after the electronic device receives the drag operation of dragging the first information to the input box of the second window, the second window directly displays the first information. Search results eliminate the need for users to manually click the search button, which saves operations.

It should be noted that the scene shown in Figure 7A includes two operations, the selection operation of the first information in the first window, and the dragging operation of dragging the first information into the second window. The introduction of each operation can be seen in Figure 6 and will not be repeated. It can be seen from Figure 7A that when the user wants to search for information in the current window (i.e. the first window), he only needs to select the information in the current window, or select the information in the current window and start the drag and drop operation. Call up the second window, and then drag the selected information into the second window to complete the search. The operation is convenient and the user experience is high.

Application scenario three

For example, please refer to (a) in FIG. 7B. The electronic device displays a first window. The first window is a window of a browser application as an example. The first window includes text, pictures, etc. Generally, the pictures in the first window are thumbnails. In order to see the pictures clearly, the user can open the pictures in the first window. In order to facilitate the user to open the picture in the first window, the electronic device can automatically appear the second window.

For example, please refer to (b) in Figure 7B. When the electronic device receives the first preset operation for the picture, it calls out the Second window, the second window is an application window used to open pictures, such as photo album, picture browser, painting and other application windows. Referring to (c) in FIG. 7B , when the electronic device receives the second preset operation for the picture, it uses the photo album application to open the picture in the second window. (c) in Figure 7B takes the second window occupying 1/4 of the display screen as an example. The second window can also occupy a larger area (such as full screen) to facilitate the user to view the enlarged image in the second window, or You can also graffiti or perform other processing on the image in the second window. For the first preset operation and the second preset operation, please refer to the above and will not be repeated.

The technical solutions provided by the embodiments of the present application are described in detail below. To facilitate understanding, the following description mainly takes application scenario one as an example. It should be understood that the same applies to application scenario two or other application scenarios.

Embodiment 1

As shown in (a) of Figure 8, the electronic device displays a first window, and the first window includes first information. The first window may be a window of any application in the electronic device, for example, it may be the first window of the browser application in FIG. 6 or the first window of the memo application in FIG. 7A, and so on. The first information may be text or images in the first window, which is not limited in this application.

In some embodiments, when the electronic device receives the first preset operation, the second window automatically appears on the display screen. The second window is located on an upper layer of the first window, and its display area is smaller than that of the first window. For example, the first preset operation may include: a selection operation on the first information in the first window (for example, a long press operation on the first information); or, a selection operation on the first information in the first window. The operation lasts for N seconds without letting go. N is a positive integer. The specific value of N can be set by the user or the system default setting; or, after selecting the first information in the first window, do not let go and start dragging. (or move) operation. It should be understood that this is an example of how to implement the first preset operation. In actual applications, other types of operations are also possible, as long as the second window can be called up.

For example, the second window may be a window with an information insertion position, so that the information in the first window can be pasted into the second window. Alternatively, the second window is a window last displayed by the electronic device before displaying the first window. For example, if the user chats with contact A in the chat window with the contact, and then opens a website and finds certain information with the intention of sharing the information with contact A, then when the web page window is displayed, You can call up the chat window with Contact A and drag the information in the web page window into the chat window with Contact A. The operation is fast and convenient. Or, the second window is a window running an application in the background. Alternatively, the second window is a window of an application in the electronic device whose usage frequency is greater than the preset frequency. Generally, applications that are used more frequently are applications that are commonly used or liked by users. In this way, the windows of applications that are commonly used or liked by users can be quickly called up. Alternatively, the second window is a window of a specific application, and the specific application may be, for example, a default application in the electronic device or a user-specified application.

The second window and the first window may be windows of different applications or different windows of the same application.

Taking the second window and the first window corresponding to different applications as an example, that is, the first window corresponds to the first application, the second window corresponds to the second application, and the first application and the second application are different. For example, the second application may satisfy at least one of the following conditions:

(a) The second application is a specific application. The so-called specific application can be an application set by the system by default or a user-defined application. For example, if the user has set the second application to be an instant messaging application in advance, then when the electronic device receives the first preset operation, the window of the instant messaging application will be called up. For another example, if the second application is a memo application, then when the electronic device receives the first preset operation, it calls up the memo window. In this way, the user can record the browsed information into the memo at any time. In this method, when the electronic device displays the first window of the first application, the second window of the specific application is called up through the first preset operation. There is no need for the user to manually open the specific application. The operation is convenient, and the user can Frequently used applications or favorite applications are set as specific applications, so that the first window of the first application is displayed on the electronic device When you open your mouth, you can easily call up the window of your frequently used applications or favorite applications.

(b) The second application is an application running in the background. For example, applications that were opened in the foreground before the first application was run in the foreground. For example, before (a) in Figure 8, the electronic device runs the second application in the foreground (for example, displays the second window of the second application), the user switches the second application to the background, and the first window of the first application opens in the foreground, Then, when the electronic device receives the first preset operation, the second window of the second application is called up.

(c) The second application is an application that the user uses more frequently than the preset frequency within the preset time period. The preset time period may be one day, 12 hours, 3 hours, etc., and the specific value is not limited in the embodiment of this application.

(d) The second application is an application related to the content selected by the user. When the electronic device receives the first preset operation, it can automatically identify the second application that needs to be opened in the second window based on the content dragged by the user. For example, when the content dragged by the user is a picture, the second application can be a photo album application. When the user drags the picture to the second window, the picture can be opened using the photo album application and displayed in the second window.

In some embodiments, the second window may be any window of the second application. For example, the second window is the window that was last opened by the second application, or the second window is a preset window of the second application. The preset window is, for example, a window set by the system by default (for example, it is opened when the second application is started. the first window) or the window set by the user. Taking the second application as an instant messaging application as an example, the user can set the second window to be a chat window with contact A in the instant messaging application. In this way, when the electronic device displays the first window of the first application, the user can quickly call up the instant messaging application through the first preset operation, and what is called up is the chat with contact A that has been preset by the user in the instant messaging application. window.

Taking the second window and the first window corresponding to the same application as an example, that is, the first window and the second window are different windows of the first application. In this case, the second window can satisfy at least one of the following conditions:

(e) The second window is the default window of the first application. The so-called default window may be a system default window of the first application (for example, the first window opened when the first application is started) or a window set by the user. Taking the first application as an instant messaging application as an example, the preset window of the first application may be, for example, a chat window with contact A in the first application. Then, when the electronic device displays the first window of the instant messaging application, the first preset window is used. Set the operation to automatically appear the chat window with contact A in the instant messaging application.

(f) The second window is the last window displayed by the first application before the first window is displayed. It can also be understood that the interface displayed in the second window is the upper-level interface of the interface displayed in the first window. For example, if the first application first opens the second window and then opens the first window, and the first window covers the second window, that is, the second window is no longer displayed in the foreground, then the user can call up the second window through the first preset operation.

(g) The second window is a window whose opening frequency is greater than the preset frequency in the first application within the preset time period. Taking the first application as an instant messaging application as an example, the user opens the chat window with contact A relatively frequently within a certain period of time. Therefore, when the electronic device displays the first window of the instant messaging application, the user can open the chat window through the first preset window. Assume that the operation calls up the chat window with contact A in the instant messaging application, that is, the second window, which is in line with the user's recent usage habits.

In some embodiments, when the second window appears, it can be displayed at any position on the display screen. For example, in Figure 8, the second window is displayed in the upper right corner area of the display screen when it appears. Of course, it can also be displayed in the upper left corner area, lower left corner area, lower right corner area, etc. of the display screen. This is not limited by the embodiment of the present application. . Alternatively, the display position when the second window appears can be the position set by the system by default, or the position when the second window disappeared (or was folded) last time, or the position set by the user in advance. In short, this application is The display position of the second window is not limited.

In other embodiments, when the second window appears, the occupied display area may be a preset area, for example, 1/4 of the display screen, or the entire display screen; alternatively, the display area of the second window may also be set by the user. .

After the second window appears on the display screen of the electronic device, if the second preset operation is received, the second window can The first information is processed, as in (c) in Figure 8. For example, the second preset operation may include: an operation of dragging the first information into the second window, or an operation of dragging the first information into the second window and staying there for a preset period of time, etc. .

Considering that there may be one or more information insertion positions in the second window, if there is one information insertion position, the second preset operation may be to drag the first information to any position in the second window. For example, in Figure 6, there is only one information insertion position in the second window, that is, the information insertion position in the input box. In this case, the second preset operation may be to drag the first information to the input box of the second window. within the second window, or it can also be dragged to other positions in the second window. That is, there is no strict requirement to drag the first information into the input box and the first information can be filled into the input box. User requirements lower. If there are multiple information insertion slots in the second window, the second preset operation may be to drag the first information to a certain insertion slot where the user needs to insert the first information among the multiple information insertion slots in the second window. Precise insertion of information.

It should be noted that the first preset operation is mentioned above, and the second preset operation is mentioned here. These two operations can be two independent operations. For example, the first preset operation is for the first information. Long press operation, the second preset operation is an operation of touching the screen again to drag the first information after the finger leaves the screen after the long press operation. Alternatively, these two operations can also be continuous (or continuous), uninterrupted operations. For example, the first preset operation is a long press operation on the first information, and the second preset operation is the long press operation. Non-stop, that is, the operation of dragging the first information without leaving the finger. For another example, the first preset operation is the operation of long pressing the first information and starting to drag. The second preset operation is the operation of dragging the first information without leaving the finger. screen and continue dragging the first information. In other words, the user can achieve the purpose of calling up the second window and processing the first information in the first window through the second window through continuous and uninterrupted operations, making the operation more convenient and smooth. Among them, processing the first information in the second window includes, for example: copying the first information into the second window (i.e., application scenario 1 in the above figure 6), or searching for the first information in the second window (i.e., the above figure). Application scenario two in Figure 7A), or open the first information in the second window (ie, application scenario three in Figure 7B above).

In some embodiments, after the second window processes the first information, it may always be displayed on the display screen, or it may be automatically hidden (for example, the second window is switched back to the background).

For example, the second preset operation is a drag operation of dragging the first information into the second window. When it is detected that the drag operation is released (that is, the finger leaves the screen), the second window is automatically hidden.

For another example, after the second window processes the first information, it waits for a preset period of time and then automatically hides.

For another example, after the second window processes the first information, it waits for a preset time period. If no operation in the second window is received within the preset time period, the second window is automatically hidden.

For another example, after the second window processes the first information, if it receives the third preset operation in the first window, the second window is automatically hidden. In one implementation, the third preset operation may be, for example, a click operation (single or double-click) anywhere in the first window. For example, after the user copies the information in the first window to the second window, the user may still need to process business in the first window. At this time, the user can click in the first window to automatically hide the second window. to avoid blocking the first window and affecting the user's business processing in the first window. In another implementation, the third preset operation may be, for example, a specific interactive operation within the first window, such as complex interactive operations such as swiping, pinching with two fingers, zooming in with two fingers, multi-finger operations, etc. In this way, when the user needs to perform complex interactions within the first window, the second window can be automatically hidden. It should be noted that the "hiding of the second window" mentioned in the above embodiment may include: completely disappearing, or reducing the display to block the first window as little as possible. For example, please refer to (a) in Figure 9. The second window is reduced to a prompt box 901, which is displayed in the upper right corner of the display screen. For another example, the second window may be reduced to the prompt box 404 shown in (b) of FIG. 5 . In this case, the second window will not block the first window too much, and the user can continue to process the business in the first window.

In some embodiments, there is a possible situation: the second window is first reduced in size and then completely disappears. For example, taking (c) in Figure 8 as an example, after the second window appears, a second preset operation is received, and the second preset operation is a drag operation of dragging the first information into the second window. For example, when it is detected that the drag operation is released (that is, the finger leaves the screen), the second window is reduced and displayed, as shown in (a) in Figure 9 . After the second window is reduced and displayed, if the third preset operation is received in the first window, the second window disappears completely, as shown in (b) of Figure 9 . That is to say, when the user drags the first information into the second window and releases his finger, the second window is shrunk and displayed. When the user performs the third preset operation in the first window, the second window is not displayed at all. For the third preset operation, please refer to the previous introduction.

In other embodiments, the electronic device determines whether the second window needs to be hidden or always displayed on the display screen based on the execution degree of the second preset operation. As mentioned above, the second default operation is a drag operation of dragging the first information to the second window. For example, although the drag operation drags the first information in the direction of the second window, it does not drag the first information to the direction of the second window. If the information is dragged into the second window, it means that the user may have made a mistake. Then after the drag operation is released, the second window can be hidden. For another example, if the drag operation drags the first information into the second window, or not only drags it into the second window and stays there for a certain period of time, it means that the user wants to copy the first information to the second window. , the second window can always be displayed on the display screen. This is because the user may copy the first information to the second window and perform corresponding processing in the second window in the next step, so the second window is always displayed. , waiting for user processing. Of course, after the second window processes the first information, it can also be automatically hidden after waiting for a preset period of time. Or, wait for a preset time period, and if no operation in the second window is received within the preset time period, the second window is automatically hidden. Or, if the third preset operation in the first window is received, the second window is automatically hidden, and so on.

Correspondingly, the background processing process corresponding to the embodiment shown in Figure 8 will be described below with reference to Figures 10A and 10B. For the convenience of description, take the second window as the window of the second application running in the background of the electronic device as an example, as shown in Figure 10A. The background process includes the following steps:

Step 1: The electronic device displays the second window of the second application in the foreground.

Step 2: The electronic device switches the second application to the background and records the background application list.

Step 3: Open the first window of the first application in the foreground of the electronic device.

Step 4: The electronic device receives the selection operation of the first information in the first window.

Step 5: The electronic device determines the second application according to the background application list.

Step 6: The second window of the second application appears on the front desk of the electronic device.

For example, the electronic device may use FreeForm window technology to display the second window on the display screen. For example, the FreeForm window can be understood as having the functions of dynamic movement, size scaling, etc. on the display screen, as shown in Figure 10B, and various interfaces can be opened in the FreeForm window. For example, the FreeForm window can use view technology to lay out and draw information (text, images, etc.) in the interface to display various styles of interfaces to users. In some embodiments, the newly opened interface in the FreeForm window can overwrite the previously opened interface, as shown in Figure 10B. It can be understood that when the FreeForm window undergoes position changes and/or size scaling, the interface within the FreeForm window also undergoes corresponding position changes and/or size scaling to adapt to the changes in the FreeForm window.

Step 7: The electronic device receives the drag operation of the first information.

Step 8: The electronic device copies the first information into the second window.

Step 9. The electronic device hides the second window.

Embodiment 2

In the previous embodiment 1 (for example, FIG. 8 ), the second window occupies a certain display area when it appears. For example, in (b) of FIG. 8 , the second window occupies 1/4 of the display screen when it appears. In this second embodiment, when the second window appears, you can to occupy a smaller display area, so as not to block the first window as much as possible.

For example, please refer to (a) in Figure 11. The electronic device displays a first window, and the first window includes first information. When the electronic device receives the selection operation for the first information, a second window appears on the display screen, as shown in (b) in Figure 11 , and the second window is displayed in the form of a prompt box 1101. For example, the prompt box 1101 may be a box that does not include text, images and other information, that is, the specific information in the second window cannot be seen through the prompt box 1101. For example, the prompt box 1101 may only occupy a part of the area near the edge of the display screen so as not to block the first window as much as possible. The prompt box 1101 of the second window may have various designs, such as a rectangular or square prompt box, etc., which are not limited in the embodiment of this application. It should be noted that (b) in Figure 11 displays the second window in the form of a prompt box 1101. In practical applications, the second window can also be displayed in other ways, and in short, it occupies a smaller area. .

In the second embodiment, after the second window is displayed in the form of prompt box 1101, the second window can process the first information in the first window. For example, continuing to refer to (b) in Figure 11, when receiving a drag operation to drag the first information to the prompt box 1101, the second window processes the first information, for example, the first information is copied to the second window. The first information is searched in the window (such as the application scenario one in the previous article) or the first information is searched in the second window (such as the application scenario two in the previous article) or the first information is opened in the second window (such as the application scenario three in the previous article). In some embodiments, in order to prompt the user that the first information is successfully dragged to the prompt box 1101 of the second window, the prompt box 1101 can be highlighted (for example, highlighted or darkened), as shown in (c) in Figure 11 shown. That is to say, after the user drags the first information in the first window to the prompt box of the second window, the second window is highlighted. In this way, the user can know that the first information has been successfully dragged to the second window. For example, the prompt box 1101 may be highlighted all the time or restored to its original state after being highlighted for a period of time, for example, from the dark display in (c) of Figure 11 to the normal display in (b) of Figure 11 . It is worth noting that in the method shown in Figure 11, the second window appears in the form of a prompt box 1101 and is not expanded and displayed. During this process, the user does not see the information in the second window and is not interested in the first window. The degree of occlusion is very small. Of course, the user can also expand the second window through a certain operation (for example, a click operation on the prompt box 1101). For example, the expanded second window looks like (c) in Figure 8 .

In other embodiments, after the second window is displayed in the form of prompt box 1101 and before the second window processes the first information (or the first information is not dragged into the second window), the second window may be enlarged and displayed. , to show the user the specific content of the second window. For example, please refer to (a) in Figure 12. The electronic device displays a first window, and the first window includes first information. When the electronic device receives the selection operation for the first information, a prompt box 1101 of the second window appears on the display screen, as shown in (b) of Figure 12 . At this time, the second window has not yet appeared on the display screen. When the drag operation of the first information to the prompt box 1101 is received, the prompt box 1101 expands into a second window, as shown in (c) in Figure 12 . When it is determined that the first information is dragged into the second window, or the first information is dragged into the second window and stays for a certain period of time, or it is determined that the first information is dragged into the second window and released, in the Process the first information in the second window (for example, copy the first information to the second window), as shown in (d) in Figure 12. One possible scenario is that when the electronic device displays the first window, if the user selects the first information in the first window, considering that the user may want to copy the first information to the second window, the second window appears first. Prompt box. If the user drags the first information to the prompt box, it is determined that the user wants to copy the first information to the second window. At this time, the prompt box is displayed as the second window. When the first information is dragged to the second window inside, copy the first information to the second window. Of course, if the user selects the first information and the prompt box of the second window appears, but the user does not drag the first information to the prompt box of the second window, it means that the user does not want to copy the first information to the second window. You can cancel the display of the prompt box of the second window.

In the embodiment shown in Figure 12, when the prompt box is expanded into the second window, the second window occupies a certain display area. In other embodiments, when the prompt box is expanded into the second window, the second window first smaller area is displayed, then Display enlarged. The magnification method of the second window includes at least one of method A and method B. Method A, the second window is directly enlarged to the preset area, for example, occupying 1/4 of the entire display screen. Zoom in B and the second window gradually enlarges. For example, the enlarged area of the second window is related to the distance from the user's finger that generates the drag operation to the second window (for example, the center point of the second window). The closer the distance, the larger the area of the second window. For example, please refer to 13(a). It is assumed that before dragging the first information, a prompt box is displayed on the display screen. When you start dragging or drag to a certain moment, the prompt box expands into a second window, as shown in (b) in Figure 13. At this time, the distance A from the second window to the user's finger is A, and the second window occupies an area A. As shown in (c) in Figure 13, at a certain moment during the dragging process, the distance between the user's finger and the second window shrinks to distance B. Distance B is smaller than distance A. The second window occupies area B, and area B is larger than area A. . That is, as the user's finger gradually approaches the second window, the area of the second window gradually enlarges until the user's finger enters the second window and stops enlarging, as shown in (d) of Figure 13 . In other embodiments, the second window gradually enlarges as the user's finger approaches, but stops enlarging when it reaches a preset area, which is, for example, 1/4 of the display screen. That is to say, when the second window area occupies 1/4 of the display screen, it will no longer continue to enlarge as the finger approaches. Of course, in some embodiments, the second window is gradually enlarged as the finger approaches until it is enlarged to occupy the entire displayable area on the display screen, that is, the second window is displayed in full screen.

There is a possible situation: the electronic device determines whether the second window should be enlarged to a preset area (for example, 1/4 of the display screen) or full screen based on the properties of the second window. For example, the electronic device may support one or more preset areas of the second window, such as 1/4 of the display screen, 1/3 of the display screen, 1/2 of the display screen, full screen, etc. Further, as mentioned above, the electronic device can determine the area to which the second window needs to be enlarged based on the number of information insertion bits in the second window. Optionally, the greater the number of inserted bits in the second window, the larger the corresponding preset area after the second window is enlarged. For example, when the electronic device determines that there is only one information insertion position in the second window (for example, the position of the cursor can be displayed), the second window can be enlarged to a preset area (for example, 1/4 of the display screen). For example, as shown in (a) of Figure 14, the second window is a chat window of an instant messaging application, in which there is only one information insertion position (ie, input box), so the chat window only needs to be enlarged to 1/4 of the display screen. It should be understood that there is only one information insertion position in the second window, and the user does not need to choose where to insert the first information, so the second window does not need to be enlarged too much. For another example, when the electronic device determines that there are multiple information insertion positions in the second window, the second window can be enlarged to the full screen or 1/3 of the display screen. For example, as shown in (b) of Figure 14, taking the second window as a memo application window, since there are multiple information insertion positions in this window, it is not sure where the user wants to insert the first information, so the The second window is enlarged to full screen to facilitate the user to select the insertion position of the first information. In the second embodiment, the second window can also be automatically hidden after it appears (for example, the second window is switched back to the background). The hiding method of the second window described in the first embodiment is also applicable to the second embodiment. For example, the second window is first displayed as a prompt box and then enlarged; then, the second window is first reduced and then completely disappeared.

Correspondingly, the background processing process corresponding to the second embodiment (for example, Figure 12) will be described below with reference to Figure 15. For the convenience of description, take the second window as the window of the second application running in the background of the electronic device as an example, as shown in Figure 15. The background process includes the following steps:

Among them, steps one to seven are the same as in Figure 10B, so they will not be repeated here. Step 8 and subsequent steps that are different from those in Figure 10B are introduced below.

Step 8: Determine the real-time position (x, y) of the drag operation. The real-time position (x, y) is the real-time position of the user's finger when performing a drag operation. For example, in (a) and (b) of Figure 13 above, during the process of the first information being dragged , the real-time position of the user's finger changes.

Step 9: Scale the second window according to (x, y). For example, as shown in Figure 13 above, as the user's finger (ie, the real-time position (x, y) of the drag operation) gradually approaches the second window, the area of the second window gradually enlarges.

Step 10: Determine the number of inserted bits in the second window.

Step 11: Determine whether the second window is enlarged to a preset area or to full screen according to the number of inserted bits in the second window. For example, as shown in (a) of Figure 14 above, when the number of inserted bits in the second window is 1, the second window can be enlarged to a preset area such as 1/4 of the display screen, and then as shown in (b of Figure 14 ), when the number of inserted bits in the second window is multiple, the second window is enlarged to full screen.

It should be understood that steps ten and eleven are optional steps that can be executed or not, so they are represented by dotted lines in the figure. If not executed, for example, the second window will be enlarged to the preset area or full screen or the area set by the user by default. etc.

Step 12: Determine whether at least one of the following conditions is met: 1. Determine whether the second window is the target window based on (x, y). For example, it is determined whether (x, y) is located in the second window. If so, it means that the second window is the target window, and the second window processes the first information. 2. Determine whether the second window supports the insertion of the first information. For example, it is determined whether the first information is text information, and if so, the insertion of the first information is supported. Or, determine whether there is an insertion bit in the second window, and if so, support the insertion of the first information.

Embodiment 3

In the previous Embodiment 1 and Embodiment 2, when the electronic device displays the first window, a window, that is, the second window is called up through user operation. In the third embodiment, when the electronic device displays the first window, multiple windows can be called up through user operation (ie, the first preset operation). In order to facilitate the distinction, the multiple windows are respectively the second window and the third window. The window is used as an example for explanation.

For example, please refer to (a) in Figure 16. The electronic device displays a first window, and the first window includes first information. If the first preset operation (for example, the selection operation for the first information) is received, the second window and the third window appear on the display screen, as shown in (b) of Figure 16 .

At this time, the display screen includes three windows, a first window, a second window and a third window. At least two of these three windows may respectively correspond to different applications, or may correspond to the same application, which is not limited by the embodiments of this application. . If the first window corresponds to the first application, the second window corresponds to the second application, and the third window corresponds to the third application, it is assumed that the first application, the second application, and the third application are different, where the second application and/or the third application Conditions (a)-(d) as described in Embodiment 1 above can be satisfied. For convenience of description, the details will not be repeated. Assuming that the first application, the second application, and the third application are the same, the second window and the third window can satisfy conditions (e)-(g) as in the previous embodiment 1.

In some embodiments, the second window and the third window may overlap or not overlap. For example, in (b) of FIG. 16 , the second window and the third window do not overlap as an example. For the display position and display area of the second window and the third window, please refer to the previous description of Embodiment 1 (it should be understood that the areas of the second window and the third window may be the same or different), and will not be repeated.

In this way, the electronic device calls up multiple windows at the same time, and the user can choose which window among the multiple windows to process the first information. For example, continuing to refer to (b) in Figure 16, when a drag operation of the first information to the second window is received, and the first information is dragged into the second window, the first process is processed in the second window. information (for example, copy the first information to the second window or search the first information in the second window or open the first information in the second window), as shown in (c) in Figure 16 . Of course, if a drag operation of dragging the first information to the third window is received and the first information is dragged into the third window, the first information is processed in the third window.

In some embodiments, after multiple windows are called up, they may always be displayed on the display screen, or they may be automatically hidden. In some embodiments, when the second window is hidden, the third window may also be hidden. For the hiding method of the second window, please refer to the previous description of Embodiment 1, and the details will not be repeated. For another example, please refer to (a) in Figure 17. When a drag operation of the second window or the third window to the right edge of the display screen is received, the second window and the third window are hidden together. As shown in (b) in Figure 17. It should be noted that Figure 17 takes dragging the third window to the right edge of the display screen as an example. You can also drag the second window or the third window to the left edge, upper edge, lower edge of the display screen, etc. Hide both windows.

It can be understood that when the user drags one of the multiple floating windows (for example, the second window or the third window) to hide the window, it is determined that the user believes that the floating window blocks the content of the first window. Therefore, when the user's intention of dragging to hide a floating window is recognized, all floating windows superimposed on the first window can be hidden together, thereby reducing the blocking of the first window screen by the floating window. In this way, all floating windows can be hidden at once, reducing user interaction steps.

In Figure 17, hiding two windows means that the two windows completely disappear. After the two windows completely disappear, one-click operation can be performed (for example, interactive operations such as sliding up, down, left, and right in the display screen) Call up the two hidden windows at the same time. In some embodiments, hiding two windows may also refer to shrinking and displaying two windows. For example, please refer to (a) in Figure 18. When receiving the drag operation of the third window to the right edge of the display screen, the second window and the third window are reduced together, for example, reduced to a prompt box or smaller size. window. As shown in (b) of Figure 18, both the second window and the third window are displayed in the right area of the display screen in the form of prompt boxes. In other embodiments, the second window and the third window may first be reduced in size and then disappear completely. For example, in (b) of FIG. 18 , if the electronic device receives the third preset operation in the first window, the prompt box of the second window and the prompt box of the third window can disappear completely.

In the above embodiment, when the second window and the third window are reduced to a prompt box, optionally, after that, when the user clicks or drags the prompt box, the display of the window corresponding to the prompt box can be restored (for example, the prompt box is The window corresponding to the prompt box is restored to its previous position and/or size), or the display of all windows is restored (for example, all previously hidden windows are restored to their previous position and/or size). For example, when the user clicks the prompt box corresponding to the second window in (b) of Figure 18, the display of the second window can be restored. For another example, when the user clicks the prompt box corresponding to the second window in (b) of Figure 18, the display of the second window and the third window can be restored at the same time. In this way, the user can restore all the prompt boxes by clicking the prompt box once. The display of floating windows reduces user interaction steps.

Correspondingly, the background processing process corresponding to the multi-window hiding process (for example, Figure 18) in Embodiment 3 will be described below with reference to Figure 19. As shown in Figure 19, the background process includes the following steps:

Step 1. Display multiple windows. For example, a first window, a second window and a third window, where the second window and the third window are located on the upper layer of the first window, as shown in (a) of Figure 18 .

Step 2: Record the position and/or area of the second window and the third window.

Step 3: Receive a drag operation for any one of the second window and the third window.

It should be noted that steps two and three can also be performed at the same time.

Step 4: Make sure the reduction conditions are met. For example, when the drag operation is to drag the window (either the second window or the third window) to the edge (left edge or right edge) of the display screen, it is determined that the reduction condition is met.

Step 5: The second window and the third window are reduced and displayed together. For example, as shown in (b) of Figure 18, the second window and the third window are respectively reduced to prompt boxes.

In the above steps one to five, when the electronic device displays multiple windows, if the user's intention of dragging to hide a floating window is recognized, all floating windows superimposed on the first window can be hidden together to reduce interaction operations.

Step 6: Receive an operation on the prompt box of the second window, for example, a click operation.

Step 7: Restore the position and/or area of the second window, that is, the position and/or area of the second window recorded in step 2.

Step 8: Restore the position and/or area of the second window and the third window together, that is, the position and/or area of the second window recorded in step 2.

It should be noted that after performing step six, you can perform either step seven or step eight. Among them, when the user clicks the prompt box of the second window in step seven, only the area and/or position of the second window is restored, and the third window is still reduced and displayed. In step eight, when the user clicks the prompt box of the second window, the areas and/or positions of the second window and the third window are restored together, which can save operating steps.

In the previous embodiment, when multiple windows are called up at the same time, each window occupies a larger area. For example, in Figure 16, the second window and the third window occupy a larger area. Considering that this affects the first window, The blocking area of the window is relatively large, so in other embodiments, when multiple windows are called up, each window can appear in the form of a prompt box. For example, please refer to (a) in FIG. 20 , the electronic device displays a first window, and the first window includes first information. When receiving a selection operation on the first information, or receiving an operation on selecting the first information and starting dragging, the prompt box of the second window and the prompt box of the third window appear on the display screen, as shown in Figure 20 (b).

In some embodiments, the display styles of the prompt box of the second window and the prompt box of the third window may be the same or different. For example, if there is an information insertion position in the second window, the prompt box of the second window will be displayed normally. If there is no information insertion position in the third window, then there will be slashes or grayscale display in the prompt box of the third window to remind the user. Unable to copy information within third window. In this way, although the prompt boxes of multiple windows are called up, certain prompts will be given to the user to facilitate the user to quickly find the target window to paste information.

In some embodiments, the window that needs to be enlarged and displayed may be determined based on the user's drag direction and/or drag trajectory. For example, continuing to refer to (b) in Figure 20, assuming that the user drags the first information to the prompt box of the second window, the second window gradually enlarges, for example, as the dragging finger gradually moves closer to the second window , the area of the second window is gradually enlarged, and when the first information is dragged into the second window, the first information is pasted in the second window, as shown in (c) in Figure 20 . It should be noted that in (b) of Figure 20, both the second window and the third window are reduced and displayed at the edge. When a drag operation for the first information is received, the second window and the third window can be displayed according to the drag direction and/or drag operation. The drag trajectory determines which prompt box the drag operation points to, and which prompt box is pointed to will enlarge the window corresponding to the prompt box. For the window magnification method, please refer to the description of the previous embodiment, and the details will not be repeated here.

In other embodiments, when the user drags the first information to the prompt box of the second window and/or the prompt box of the third window, the user may be prompted whether the first information can be input in the window. For example, there is an information insertion position in the second window. When the user drags the first information to the prompt box of the second window, a corner mark (such as a plus sign, check mark, etc.) can be displayed on the dragged first information. To prompt the user to input the first information in the second window. At this time, the area of the second window is enlarged and displayed. For another example, there is no information insertion position in the third window. When the user drags the first information to the prompt box of the third window, a corner mark (such as a cross, etc.) can be displayed on the dragged first information. The user is prompted not to input the first information in the third window. At this time, the area of the third window may not be enlarged and displayed, or may be enlarged and displayed but does not support the user's input of the first information.

In some embodiments, the number of multiple windows brought up by the electronic device may have a maximum value. For example, the multiple windows that are called up include: the windows of all applications opened in the background, the windows of all recently opened applications (where the most recent can be a week or a day, etc.), all specific applications (for example, the user has set up multiple specific applications, For specific applications (see above), at least one of the windows. Alternatively, the electronic device can select one or more applications among many applications and call up the window of the selected application. For example, you can select an application that is frequently used or an application that is opened at a close time from all the applications running in the background, and call up the window of the selected application.

Figure 21 is a schematic structural diagram of an electronic device 2100 provided by an embodiment of the present application. The electronic device 2100 may be the aforementioned electronic device (such as a mobile phone). As shown in Figure 21, the electronic device 2100 may include: one or more processors 2101; one or more memories 2102; a communication interface 2103, and one or more computer programs 2104, The various devices described above may be connected through one or more communication buses 2105. Where the one or more computer programs 2104 are stored in the memory 2102 and configured to be executed by the one or more processors 2101, the one or more computer programs 2104 include instructions. For example, when the electronic device 2100 is the mobile phone mentioned above, the instruction can be used to perform the steps related to the mobile phone in the above corresponding embodiment, for example, the steps shown in FIG. 10A. The communication interface 2103 is used to implement communication between the electronic device 2100 and other devices. For example, the communication interface may be a transceiver.

In the above-mentioned embodiments provided by the present application, the method provided by the embodiments of the present application is introduced from the perspective of an electronic device (such as a mobile phone) as the execution subject. In order to implement each function in the method provided by the above embodiments of the present application, the electronic device may include a hardware structure and/or a software module to implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above functions is performed as a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

As used in the above embodiments, depending on the context, the terms "when" or "after" may be interpreted to mean "if..." or "after" or "in response to determining..." or "in response to detecting …”. Similarly, depending on the context, the phrase "when determining..." or "if (stated condition or event) is detected" may be interpreted to mean "if it is determined..." or "in response to determining..." or "on detecting (stated condition or event)” or “in response to detecting (stated condition or event)”. In addition, in the above embodiments, relational terms such as first and second are used to distinguish one entity from another entity, without limiting any actual relationship and order between these entities.

Reference in this specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Therefore, the phrases "in one embodiment", "in some embodiments", "in other embodiments", "in other embodiments", etc. appearing in different places in this specification are not necessarily References are made to the same embodiment, but rather to "one or more but not all embodiments" unless specifically stated otherwise. The terms “including,” “includes,” “having,” and variations thereof all mean “including but not limited to,” unless otherwise specifically emphasized.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in accordance with the embodiments of the present invention are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., the computer instructions may be transferred from a website, computer, server, or data center Transmission to another website, computer, server or data center by wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains one or more available media integrated. The available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), etc. As long as there is no conflict, the solutions of the above embodiments can be used in combination.

It should be noted that part of this patent application document contains content protected by copyright. The copyright owner retains copyright except in making copies of the contents of the patent document or records in the Patent Office.

Claims

A display method, characterized in that it is applied to an electronic device, the electronic device has a display screen, and the method includes:

Show the first window;

In response to the first operation for selecting the first information in the first window, a second window appears on the display screen; the second window is located above the first window, and the display of the second window The area is smaller than the display area of the first window;

In response to a second operation for dragging the first information into the second window, the first information is processed within the second window.
The method of claim 1, wherein processing the first information within the second window includes:

Copy the first information to the second window; or,

Search for information related to the first information in the second window; or

Open the first information in the second window.
The method according to claim 1, characterized in that:

The first operation includes: a long press operation on the first information, or a drag operation after performing a long press operation on the first information.
The method according to claim 1, characterized in that:

The second operation is a subsequent operation in which the finger does not leave the display screen after the first operation.
The method of claim 1, wherein the second window and the first window are windows of the same application, or windows of different applications.
The method according to any one of claims 1-5, characterized in that the second window satisfies at least one of the following conditions:

The second window is a window with information insertion bits; or,

The second window is the last window displayed on the display screen before the first window, or,

The second window is a window of a second application; wherein the second application includes at least one of: a background running application, an application in the electronic device with a usage frequency greater than a preset frequency, and a specific application, and the specific application Applications include default applications of the electronic device or user-specified applications.
The method according to claim 1, characterized in that, after processing the first information in the second window, at least one of the following steps is also performed:

The second window is hidden; or

The second window displays a first preset duration and is automatically hidden after the first preset duration; or,

The second window displays a second preset time period. If the second window does not receive a message within the second preset time period, Within the operation, the second window is hidden; or,

Upon receiving an operation within the first window, the second window is hidden; or,

The second window displays a third preset duration. If an operation in the first window is received within the third preset duration, the second window is hidden.
The method according to claim 7, characterized in that hiding the second window includes:

The second window disappears from the display screen, or,

The second window is reduced and displayed; or,

The second window is displayed in a reduced size, and when an interactive operation in the first window is received, the reduced second window disappears.
The method according to claim 1, characterized in that:

In response to a first operation for selecting first information in the first window, a second window appears on the display screen, including:

In response to the first operation for selecting the first information in the first window, a prompt box of the second window appears on the display screen, and the second window runs in the background;

In response to the second operation for dragging the first information into the second window, processing the first information in the second window includes:

In response to the second operation for dragging the first information to the prompt box, the second window processes the first information in the background, or in response to the second operation for dragging the first information to the prompt box. The second operation of dragging the prompt box is to expand the prompt box into the second window. When the first information is dragged into the second window, the processing is performed in the second window. First information.
The method according to claim 9, characterized in that, in response to the second operation of dragging the information to the prompt box, the prompt box is expanded into the second window, and when the first When information is dragged into the second window, processing the first information in the second window includes:

In response to the operation of dragging the first information to the prompt box, the prompt box expands into a second window;

In response to the operation of dragging the first information to the second window, the second window is enlarged and displayed. When the first information is dragged to the enlarged second window, in the The first information is processed within the enlarged second window.
The method according to claim 10, characterized in that the second window is enlarged and displayed, including:

The second window is directly enlarged to the first preset area; or,

As the first information approaches the second window, the display area of the second window is gradually enlarged to a second preset area.
The method of claim 11, wherein the first preset area and/or the second preset area is less than or equal to the entire display area of the display screen.
The method according to claim 10, characterized in that the second window is enlarged and displayed, including:

When the second window has an information insertion position, the second window is enlarged to a first area, and the first area is smaller than the size of the display screen;

When the second window has multiple information insertion positions, the second window is enlarged to a second area or the full screen of the display screen, the second area is smaller than the size of the display screen, and the second area is larger than the size of the display screen. the first area.
The method according to claim 1, characterized in that:

In response to the first operation for selecting the first information in the first window, a second window appears on the display screen, including:

In response to the first operation for selecting the first information in the first window, a second window and a third window appear simultaneously on the display screen;

The third window and the second window are located on an upper layer of the first window, and the display area of the second window and the third window is smaller than the display area of the first window.
The method of claim 14, wherein the first window, the second window and the third window are windows of the same application or different applications.
The method of claim 14, wherein the second window has an information insertion bit, and when the third window does not have an information insertion bit, the third window is displayed differently from the second window. , to remind the user that the second window can process the first information, and the third window cannot process the first information.
The method of claim 14, further comprising:

Receive a drag operation for dragging any one of the second window and the third window toward the edge of the display screen;

In response to the drag operation, the second window and the third window are hidden together.
The method of claim 17, wherein hiding the second window and the third window together includes:

The second window and the third window disappear together or are reduced in size.
The method according to claim 18, characterized in that when the second window and the third window disappear together, it further includes:

Through one-key operation, the display positions and/or areas of the second window and the third window are restored together.
The method according to claim 18, characterized in that when the second window and the third window are reduced and displayed together, the method further includes:

Receive an operation for the reduced second window, restore the display position and/or area of the second window, and maintain the reduced display state of the third window; or,

After receiving the operation for the reduced second window, the display position and/or area of the second window and the third window are restored together.
An electronic device, characterized by including:

processor, memory, and, one or more programs;

Wherein, the one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the steps of claim 1- The method steps described in any one of 20.
A computer-readable storage medium, characterized in that the computer-readable storage medium is used to store a computer program. When the computer program is run on a computer, it causes the computer to execute any one of claims 1 to 20. method described in the item.
A computer program product, characterized in that it includes a computer program, which when the computer program is run on a computer, causes the computer to execute the method described in any one of claims 1-20.