CN113552986A

CN113552986A - Multi-window screen capturing method and device and terminal equipment

Info

Publication number: CN113552986A
Application number: CN202010268738.1A
Authority: CN
Inventors: 徐杰; 华文
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-04-07
Filing date: 2020-04-07
Publication date: 2021-10-26

Abstract

The application is applicable to the technical field of terminals, and provides a multi-window screen capturing method, a device and a terminal device, under the condition of multiple windows, when a user triggers screen capturing operation, the terminal device can perform screen capturing processing on a display interface to obtain a first preview image which is displayed on the display interface, meanwhile, a window splitting button can be displayed in the display interface, the first preview image can be split into a plurality of second preview images corresponding to the windows according to the triggering of the window splitting button by the user, the user can select the second preview images according to needs, the terminal device can obtain a final screen capturing image according to the second preview images selected by the user, the operation process of performing partial window screen capturing in the multiple windows can be simplified, the flexibility and the efficiency of multi-window screen capturing are improved, and screen capturing of blocked windows in the multiple windows can be realized, and the user experience is improved.

Description

Multi-window screen capturing method and device and terminal equipment

Technical Field

The application belongs to the technical field of terminals, and particularly relates to a multi-window screen capturing method and device, terminal equipment and a computer readable storage medium.

Background

The screen capture function and the multi-window display function are functions used at high frequency in the terminal device. In a multi-window scene, the existing screen capture mostly captures the full-screen content of the terminal device. When the user only needs to intercept the content of one or a plurality of windows, the full-screen content needs to be intercepted first, and then the intercepted full-screen content is manually cut through image editing software and the like to obtain the finally-desired screenshot image of the user, so that the operation process is complicated, and the screenshot efficiency is low.

Disclosure of Invention

The embodiment of the application provides a multi-window screen capturing method and device, terminal equipment and a computer readable storage medium, and can solve the problems of complicated operation process and low screen capturing efficiency in the conventional multi-window screen capturing.

In a first aspect, an embodiment of the present application provides a multi-window screen capture method, which may include:

when screen capture operation is detected, screen capture processing is carried out on a display interface, a first preview image corresponding to the display interface is obtained, and a plurality of windows are displayed in the display interface;

displaying the first preview image and a window split button in the display interface;

responding to the triggering operation of the window splitting button, splitting the first preview image into a plurality of second preview images, and displaying the second preview images on the display interface, wherein each second preview image is a picture thumbnail of a window picture corresponding to each window;

and responding to the selection operation of the second preview image, acquiring a third preview image, and saving the third preview image as a screen capture image, wherein the third preview image is at least one preview image in the second preview image.

It should be understood that the multiple windows displayed in the display interface may be multiple windows in which there is no overlap between any two windows, or may also be multiple windows in which there is overlap between two or more windows. The window may be the display interface itself, or may be a floating window floating on the display interface.

The screen capturing operation refers to a triggering operation of triggering the terminal device to capture a screen of the display interface, where the screen capturing operation may be a click or touch operation on the display interface, for example, a click or touch operation on a specific button or a specific icon in the display interface, or an operation of tapping the display interface through a finger joint, or an operation of performing multi-finger sliding in the display interface, and the like; the screen capture operation may also be a pressing operation on a physical key in the terminal device, for example, the screen capture operation may be a simultaneous pressing operation on a "volume +" key and a "volume-" key in the terminal device; the screen capture operation may also be a voice operation, a shaking operation, an air gesture operation, or the like, for example, the screen capture operation may be a voice input operation including a preset keyword such as "screen capture", or may be an operation of shaking the terminal device, or may be an operation of executing a preset gesture such as "C" in an air, and the screen capture operation is not specifically limited in the embodiment of the present application.

It should be understood that the window splitting button may be used to trigger the terminal device to split the first preview image according to each window. Here, the window split button may be displayed at any position in the display interface. Optionally, the position of the window split button in the display interface may be associated with the position of the first preview image in the display interface, e.g., the position of the window split button in the display interface may be above the first preview image.

For example, after the terminal device acquires the first preview image corresponding to the display interface, the first preview image may be displayed at any position in the display interface. In order to reduce the occlusion of the first preview image to the content currently viewed by the user and affect the user experience, the first preview image is optionally displayed in a corner of the display interface in the embodiment of the present application, for example, the first preview image may be displayed in the lower left of the display interface.

When the terminal device splits the first preview image into a plurality of second preview images corresponding to the respective windows and displays the second preview images on the display interface, the terminal device may display the plurality of second preview images on the display interface in a horizontally arranged manner or may display the plurality of second preview images on the display interface in a vertically arranged manner.

It should be understood that, when the terminal device splits the first preview image into a plurality of second preview images and displays the second preview images on the display interface, a corresponding delete button may also be set for each second preview image, and the user may click or touch the delete button to select the second preview image, so as to obtain a third preview image (i.e., the second preview image whose delete button is not clicked or touched), and may respectively save the third preview image, so as to obtain a screenshot image corresponding to each window selected by the user.

For example, overlapping at least two of the windows, and performing screen capture processing on the display interface to obtain a first preview image corresponding to the display interface may include:

acquiring window positions and window levels corresponding to the windows in the display interface and window pictures corresponding to the windows in the display interface;

and carrying out image synthesis on each window picture according to the window position and the window hierarchy to obtain the first preview image corresponding to the display interface.

The window position refers to a position of a window in a display interface, the window level refers to a layer level of a layer corresponding to the window, and the window picture refers to a picture in the whole window, that is, the window picture includes a part displayed in the display interface and also includes a part which is blocked by other windows and is not displayed in the display interface. The window level may be used to determine a top-bottom position relationship between window frames corresponding to the windows, where a window frame corresponding to a window with a high window level may be located above a window frame corresponding to a window with a low window level, so that a part of the window frames in the window with the low window level may not be displayed in the display interface.

It should be understood that the window picture corresponding to the window is determined by the layer, and the drawing data of the layer may be used to generate the layer, that is, the terminal device may obtain the drawing data of the layer corresponding to each window, and may draw the layer corresponding to each window according to the drawing data of each layer, so as to obtain the window picture corresponding to each window.

Specifically, after acquiring the window position, the window level and the window picture corresponding to each window, the terminal device may perform image splicing on the window pictures according to the window position, and may determine the vertical position relationship between the window pictures corresponding to the overlapping windows according to the window level in the splicing process, so as to splice the window pictures corresponding to the overlapping windows according to the vertical position relationship, thereby obtaining the first preview image corresponding to the display picture.

For example, in a scene where there is no window overlap, the terminal device may only obtain a window position corresponding to each window and a window picture corresponding to each window in the display interface, and then may perform image stitching on the window pictures according to the window positions to obtain a first preview image corresponding to the display picture.

In a possible implementation manner of the first aspect, the displaying the second preview image on the display interface may include:

acquiring a first boundary position of each window and a second boundary position of the display interface, and determining a distance between each first boundary position and each second boundary position;

and determining the display sequence of the second preview images according to the distance, and displaying the second preview images on the display interface according to the display sequence.

Optionally, after determining the distance between each first boundary position and the second boundary position, the method may further include:

if multiple identical target distances exist in the distance, a third boundary position of a target window corresponding to each target distance and a fourth boundary position of the display interface are obtained, wherein the target window is any one of the windows, the third boundary position is a position different from the first boundary position in the target window, and the fourth boundary position is a position different from the second boundary position in the display interface;

and determining the display sequence between the second preview images corresponding to the target window according to the third boundary position and the fourth boundary position.

It should be noted that, after splitting the first preview image into a plurality of second preview images, the terminal device may display each of the second preview images in the display interface according to a preset display order. The display order is an order in which the second preview images are arranged when displayed on the display interface.

In a possible implementation manner, the preset display order may be determined according to the boundary position of the window and the boundary position of the display interface. Specifically, the terminal device may first obtain a first boundary position of each window and a second boundary position of the display interface, and may determine a distance between each first boundary position and each second boundary position; the display order of the second preview images may then be determined according to the distances. For example, the display order of the second preview images corresponding to the windows with smaller distances is earlier, and the display order of the second preview images corresponding to the windows with larger distances is later. The display sequence is determined according to the distance between the boundary position of the window and the boundary position of the display interface, so that the moving amount of the second preview image in the splitting process can be effectively reduced, the splitting speed is improved, and the fluency and the display effect of the first preview image when the first preview image is unfolded into a plurality of second preview images are improved.

It should be noted that, when a plurality of identical target distances exist in the distances, the terminal device may obtain a third boundary position of the target window and a fourth boundary position of the display interface corresponding to each target distance, and may determine a display order between the second preview images corresponding to the target windows according to the distance between each third boundary position and each fourth boundary position. That is, when there are two or more windows whose first boundary positions are equal to the second boundary positions of the display interface, the terminal device may further determine the display order between the second preview images corresponding to the windows according to the third boundary positions of the windows and the fourth boundary positions of the display interface. And the display sequence of the second preview images corresponding to the target window with the closer distance between the third boundary position and the fourth boundary position is earlier than the display sequence of the second preview images corresponding to the target window with the farther distance between the third boundary position and the fourth boundary position. It should be understood that the third boundary position is a position in the target window that is different from the first boundary position, and the fourth boundary position is a position in the display interface that is different from the second boundary position.

For example, in a scene in which the display order is from left to right and the first preview image is displayed at the lower left of the display interface, the first boundary position may be a position at which the left edge of the window is located, the second boundary position may be a position at which the left edge of the display interface is located, the third boundary position may be a position at which the lower edge of the window is located, and the fourth boundary position may be a position at which the lower edge of the display interface is located.

For example, in a scene in which the display order is from left to right and the first preview image is displayed on the upper left of the display interface, the first boundary position may be a position where a left edge of the window is located, the second boundary position may be a position where a left edge of the display interface is located, the third boundary position may be a position where an upper edge of the window is located, and the fourth boundary position may be a position where an upper edge of the display interface is located.

For example, in a scene in which the display order is from right to left and the first preview image is displayed on the lower right of the display interface, the first boundary position may be a position where a right edge of the window is located, the second boundary position may be a position where the right edge of the display interface is located, the third boundary position may be a position where a lower edge of the window is located, and the fourth boundary position may be a position where the lower edge of the display interface is located.

For example, in a scene in which the display order is from right to left and the first preview image is displayed on the upper right of the display interface, the first boundary position may be a position where a right edge of the window is located, the second boundary position may be a position where a right edge of the display interface is located, the third boundary position may be a position where an upper edge of the window is located, and the fourth boundary position may be a position where an upper edge of the display interface is located.

and determining a display sequence corresponding to each second preview image according to the window level corresponding to each window in the display interface, and displaying each second preview image on the display interface according to the display sequence.

Illustratively, the method may further comprise:

if multiple identical target window levels exist in the window levels, determining the window positions of target windows corresponding to the target window levels in the display interface, wherein the target windows are any one of the windows;

and determining the display sequence of the second preview images corresponding to the target window according to the window position of the target window in the display interface.

In a possible implementation manner, the preset display order may also be determined according to a window level corresponding to the window. For example, the display order of the second preview images corresponding to windows with higher window levels is more advanced, or the display order of the second preview images corresponding to windows with lower window levels is more advanced, and the display order of the second preview images corresponding to windows with lower window levels is more advanced, which may be determined according to actual situations, and the embodiment of the present application does not limit this.

It should be understood that, when multiple identical target window levels exist in the window levels, the terminal device may determine the display order between the second preview images corresponding to the target windows according to the window positions of the target windows corresponding to the target window levels in the display interface. Wherein the target window is any one of a plurality of windows. For example, the display order between the second preview images corresponding to the target window may be determined according to the boundary position of the target window and the boundary position of the display interface. It should be noted that the determination of the display order between the second preview images corresponding to the target window according to the boundary position of the target window and the boundary position of the display interface is similar to the determination of the display order according to the boundary position of the window and the boundary position of the display interface, and the basic principle is the same.

In a possible implementation manner, the preset display sequence may also be determined according to the starting time of the windows. For example, the display order of the second preview images corresponding to the windows with the newer activation times is earlier, and the display order of the second preview images corresponding to the windows with the older activation times is later. Wherein, the new or old starting time can be measured by the distance between the starting time and the current time for displaying the second preview image.

In another possible implementation manner, the preset display order may also be determined according to the window name of the window. For example, the display order may be determined according to the sort of the first letter of the window name from a to z.

Optionally, the method may further include:

and after the window splitting button is triggered, displaying a window synthesis button in the display interface.

For example, the saving the third preview image as the screen capture image may include:

and responding to the triggering operation of the window synthesis button, carrying out image synthesis on the third preview image according to the window position and the window hierarchy corresponding to the third preview image to obtain a fourth preview image, and storing the fourth preview image as a screen capture image.

It should be noted that the image that the user wants to capture may be a composite image of some of the windows, and in this embodiment, a window composite button may be displayed in the display interface, where the window composite button may be displayed when the first preview image is split into the second preview images. For example, when the window splitting button is triggered and the plurality of second preview images are displayed in the display interface, the window splitting button in the display interface may be changed into a window composition button. When the window synthesis button is triggered, the terminal device can perform image synthesis on the preview image currently displayed in the display interface. Specifically, the terminal device may perform image synthesis on the preview image according to the window position and the window hierarchy of the window corresponding to the currently displayed preview image in the display interface, so as to obtain a synthesized preview image.

Optionally, the saving the third preview image as a screenshot image may include:

and when no operation is detected within the preset time, saving the third preview image as a screen capture image, and deleting the third preview image in the display interface.

In the embodiment of the application, the terminal device can automatically store the preview image displayed in the display interface as the screen capture image. Specifically, the terminal device may automatically save the preview image displayed in the display interface as the screenshot image in a form (such as a composite form or a separate form) of the preview image in the display interface when no operation of the user is detected within a preset time. For example, when the user clicks the window splitting button and does not perform any other operation within a preset time, the terminal device may respectively store each split preview image as a screenshot image, so as to obtain a plurality of screenshot images corresponding to each window. For example, when the user clicks the window splitting button and directly clicks the window combining button, and no other operation is performed within a preset time, the terminal device may save the preview image including all the windows as the screen capture image, so as to obtain the full-screen image including all the windows. For example, when the user clicks a window splitting button and clicks a delete button in a preview image corresponding to some windows, and no other operation is performed within a preset time, the terminal device may respectively store each preview image retained by the user in the display interface as a screenshot image, and obtain one or more screenshot images corresponding to the window selected by the user.

It should be noted that the terminal device may also set a save button corresponding to the preview image in the display interface, and in the process of the user operating the preview image in the display interface, the user may click or touch the save button to save the preview image and the like in real time to obtain different types of screenshot images, so as to meet the diversified screenshot demands of the user.

In a second aspect, an embodiment of the present application provides a multi-window screen capture device, which may include:

the screen capture processing module is used for carrying out screen capture processing on a display interface when screen capture operation is detected, and acquiring a first preview image corresponding to the display interface, wherein a plurality of windows are displayed in the display interface;

the image display module is used for displaying the first preview image and the window splitting button in the display interface;

the image splitting module is used for splitting the first preview image into a plurality of second preview images in response to the triggering operation of the window splitting button, and displaying the second preview images on the display interface, wherein each second preview image is a picture thumbnail of a window picture corresponding to each window;

and the image saving module is used for responding to the selection operation of the second preview image, acquiring a third preview image and saving the third preview image as a screen capture image, wherein the third preview image is at least one preview image in the second preview image.

In a possible implementation manner of the second aspect, there is an overlap between at least two of the windows, and the screen capture processing module may include:

a window picture acquiring unit, configured to acquire a window position and a window level corresponding to each window in the display interface, and a window picture corresponding to each window in the display interface;

and the window picture synthesizing unit is used for carrying out image synthesis on each window picture according to the window position and the window hierarchy to obtain the first preview image corresponding to the display interface.

Illustratively, the image splitting module may include:

the distance determining unit is used for acquiring a first boundary position of each window and a second boundary position of the display interface and determining a distance between each first boundary position and each second boundary position;

and the first display unit is used for determining the display sequence of the second preview images according to the distance and displaying the second preview images on the display interface according to the display sequence.

Optionally, the image splitting module may further include:

a boundary determining unit, configured to, if multiple identical target distances exist in the distances, obtain a third boundary position of a target window and a fourth boundary position of the display interface, where the target window is any one of the windows, the third boundary position is a position in the target window different from the first boundary position, and the fourth boundary position is a position in the display interface different from the second boundary position;

and the first display order determining unit is used for determining the display order between the second preview images corresponding to the target window according to the third boundary position and the fourth boundary position.

Illustratively, the image splitting module may further include:

and the second display unit is used for determining a display sequence corresponding to each second preview image according to the window level corresponding to each window in the display interface and displaying each second preview image on the display interface according to the display sequence.

Optionally, the image splitting module may further include:

the position determining unit is used for determining the window position of a target window corresponding to the target window hierarchy in the display interface if the same multiple target window hierarchies exist in the window hierarchies, wherein the target window is any one of the windows;

and the second display sequence determining unit is used for determining the display sequence between the second preview images corresponding to the target window according to the window position of the target window in the display interface.

In a possible implementation manner of the second aspect, the apparatus may further include:

and the synthesized button display module is used for displaying the window synthesized button in the display interface after the window split button is triggered.

Optionally, the image saving module may be further configured to perform image synthesis on the third preview image according to a window position and a window level corresponding to the third preview image in response to a trigger operation of the window synthesis button, to obtain a fourth preview image, and save the fourth preview image as a screenshot image.

For example, the image saving module may be further configured to, when no operation is detected within a preset time, save the third preview image as a screenshot image, and delete the third preview image in the display interface.

In a third aspect, an embodiment of the present application provides a terminal device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor, when executing the computer program, implements the multi-window screenshot method described in any one of the above first aspects.

In a fourth aspect, the present application provides a computer-readable storage medium, where a computer program is stored, and the computer program, when executed by a processor, implements the multi-window screenshot method of any one of the above first aspects.

In a fifth aspect, the present application provides a computer program product, which when run on a terminal device, causes the terminal device to execute the multi-window screenshot method of any one of the above first aspects.

It is understood that the beneficial effects of the second aspect to the fifth aspect can be referred to the related description of the first aspect, and are not described herein again.

Compared with the prior art, the embodiment of the application has the advantages that:

in the embodiment of the application, under the condition of multiple windows, when a user triggers a screen capture operation, the terminal device can perform screen capture processing on a display interface to obtain a first preview image and display the first preview image on the display interface, and simultaneously can display a window splitting button in the display interface, and can split the first preview image into a plurality of second preview images corresponding to the windows according to the triggering operation of the window splitting button by the user, the user can select the second preview images as required, the terminal device can obtain final screen capture images according to the second preview images selected by the user, so that the operation process of performing partial window screen capture in the multiple windows can be simplified, the flexibility and the efficiency of multi-window screen capture are improved, screen capture of a blocked window in the multiple windows can be realized, and the user experience is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

FIG. 1a, FIG. 1b, FIG. 2a, FIG. 2b and FIG. 3 are exemplary diagrams of a multi-window display in an embodiment of the present application;

FIG. 4 is a flowchart illustrating a multi-window screenshot method according to an embodiment of the present disclosure;

fig. 5a to 5d are schematic diagrams of application scenarios for acquiring a first preview image according to an embodiment of the present application;

FIG. 6a is a schematic diagram of an application scenario displaying a first preview image and a window split button according to an embodiment of the present application;

fig. 6b and fig. 6c are schematic diagrams of an application scene displaying a second preview image according to an embodiment of the present application;

fig. 7a and 7b are schematic diagrams of an application scene for displaying a second preview image according to a display order according to an embodiment of the present application;

fig. 8a and 8b are schematic diagrams of an application scene displaying a second preview image according to a display order according to another embodiment of the present application;

fig. 9a and 9b are schematic diagrams of application scenes for displaying a second preview image according to a display order according to another embodiment of the present application;

FIG. 10 is a diagram illustrating an application scenario in which a delete button is displayed according to another embodiment of the present application;

FIG. 11 is a schematic diagram of an application scenario for displaying a third preview image according to another embodiment of the present application;

12a to 12c are schematic diagrams of application scenarios for preview image synthesis based on a window synthesis button according to another embodiment of the present application;

FIG. 13 is a schematic structural diagram of a multi-window screenshot device provided in an embodiment of the present application;

fig. 14 is a schematic structural diagram of a terminal device provided in an embodiment of the present application;

fig. 15 is a schematic structural diagram of a mobile phone to which a multi-window screen capture method according to an embodiment of the present application is applied;

fig. 16 is a schematic diagram of a software architecture to which a multi-window screenshot method according to an embodiment of the present application is applied.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to" determining "or" in response to detecting ". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".

Furthermore, in the description of the present application and the appended claims, the terms "first," "second," "third," and the like are used for distinguishing between descriptions and not necessarily for describing or implying relative importance.

Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.

The multi-window screen capturing method provided by the embodiment of the application can be applied to a mobile phone, a tablet personal computer, a wearable device, a vehicle-mounted device, an Augmented Reality (AR)/Virtual Reality (VR) device, a notebook computer, a desktop computer, a super-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA) and other terminal devices with a display screen, and the embodiment of the application does not limit the specific type of the terminal device at all.

With the intelligent development of terminal equipment, the functions of the terminal equipment are more and more, and the screen capture function and the multi-window display function become the functions used at high frequency in the terminal equipment. The screen capture refers to a process of capturing and storing the content displayed in the display interface of the terminal device as an image, so that the user can conveniently view and share the content subsequently. The multi-window display refers to displaying a plurality of application interfaces in a display interface of the terminal device at the same time, so that a user can conveniently interact among applications. The multi-window display may be in one or more floating windows as shown in fig. 1a and 1b, in a split-screen display manner as shown in fig. 2a and 2b, or in a combined display manner of split screen and floating window as shown in fig. 3. In a multi-window scene, when a user needs to intercept the content of one or several windows, the existing screen capture needs to intercept the full-screen content containing all windows first, and then manually cut the intercepted full-screen content through image editing software and the like to obtain the screen capture image of one or several windows finally desired by the user, so that the operation process is complicated, and the screen capture efficiency is low. For example, in the multi-window scenario shown in fig. 3, when a user wants to capture the contents of the window 301 (the window where the application a corresponding to the chat interface is located) and the window 303 (the window where the floating window corresponding to the notification interface is located), the existing screen capture can only capture the full-screen contents including the window 301, the window 302 (the window where the application B corresponding to the two-dimensional code interface is located) and the window 303, and the user needs to manually clip the screen capture image corresponding to the full-screen contents by using image editing software and the like to obtain the finally desired contents of the window 301 and the window 303.

In order to solve the above problem, embodiments of the present application provide a multi-window screenshot method, apparatus, terminal device, and computer-readable storage medium. Under the condition of multiple windows, when a user triggers a screen capture operation, the terminal device can perform screen capture processing on a display interface to obtain a first preview image corresponding to the display interface and display the first preview image on the display interface, meanwhile, a window splitting button can be displayed in the display interface, the first preview image can be split into a plurality of second preview images according to the triggering operation of the user on the window splitting button, the user can select the second preview images according to needs, and the terminal device can obtain a final screen capture image according to the second preview image selected by the user. When the screen capture is performed under the multi-window condition, the first preview image can be split into the plurality of second preview images corresponding to the windows according to the needs of the user, the final screen capture image can be obtained according to the selection of the user on the second preview images, the operation process of performing partial window screen capture in the multi-window can be simplified, the flexibility and the screen capture efficiency of the multi-window screen capture are improved, the screen capture of the blocked window in the multi-window can be realized, and the user experience is improved.

Referring to fig. 4, fig. 4 is a schematic flowchart illustrating a multi-window screen capture method according to an embodiment of the present application. As shown in fig. 4, the method may include:

s401, when screen capturing operation is detected, screen capturing processing is carried out on a display interface, a first preview image corresponding to the display interface is obtained, and a plurality of windows are displayed in the display interface.

Here, one or more windows may be displayed in the display interface of the terminal device, and a window is a visual interface between the user and the application program that generates the window, and may be responsible for displaying or processing a certain type of information. It should be understood that the multiple windows displayed in the display interface may be multiple windows in which there is no overlap between any two windows, for example, multiple windows displayed in a split screen manner as shown in fig. 2a and fig. 2 b; there may also be a plurality of windows in which there is an overlap between two or more windows, for example, there may be a plurality of windows displayed by a floating window as shown in fig. 1a and 1b, or there may be a plurality of windows displayed by a combination of split screen and floating window as shown in fig. 3.

The window may be the display interface itself, or may be a floating window floating on the display interface. For example, in the scenario shown in fig. 1a, the windows displayed in display interface 101 may include both display interface 101 and floating window 102 floating in display interface 101. It should be understood that in a split-screen scenario of the display interface, each display area in the display interface is a window. For example, in the scenario shown in fig. 2B, the window displayed in the display interface may include three of a first display area 201 displaying application a, a second display area 202 displaying application B, and a third display area 203 displaying application C.

When a user wants to perform screen capturing on a display interface of the terminal device in the process of using the terminal device by the user, the user can input screen capturing operation, and after the terminal device detects the screen capturing operation input by the user, screen capturing can be performed on all windows in the display interface to obtain a first preview image corresponding to the display interface, namely the first preview image is a full-screen image containing window pictures of all windows in the display interface.

For example, in a scene where windows overlap, the terminal device may obtain a window position and a window level corresponding to each window in the display interface and a window picture corresponding to each window in the display interface, and may perform image synthesis on each window picture according to the window position and the window level to obtain a first preview image corresponding to the display interface.

It should be noted that a specific obtaining manner of the window screen corresponding to each window is similar to that of the application screenshot in the existing multitask management interface, and the basic principle is the same.

It should be understood that after the terminal device obtains the window position, the window hierarchy and the window picture corresponding to each window, the window pictures may be image-spliced according to the window position, and in the splicing process, the up-down position relationship between the window pictures corresponding to the overlapping windows may be determined according to the window hierarchy, so that the window pictures corresponding to the overlapping windows are spliced according to the up-down position relationship, thereby obtaining the first preview image corresponding to the display picture. For example, in the scenario shown in fig. 3, when the terminal device obtains a window picture a shown in fig. 5a according to the drawing data of the layer corresponding to the window 301, obtains a window picture B shown in fig. 5B according to the drawing data of the layer corresponding to the window 302, and obtains a window picture C shown in fig. 5C according to the drawing data of the layer corresponding to the window 303, and the window position corresponding to the window 301 is obtained as the left side of the display interface, the window position corresponding to the window 302 is obtained as the right side of the display interface, the window position corresponding to the window 303 is obtained as the central position in the display interface, when the window level corresponding to the window 301 and the window 302 is 1 and the window level corresponding to the window 303 is 2, the terminal device may perform image stitching on the window frame a, the window frame B, and the window frame C according to the window position and the window level, so as to obtain a first preview image shown in fig. 5 d.

The first preview image may be an image having an image size equal to the interface size of the display interface, or may be a thumbnail image after being reduced. When the first preview image is a thumbnail image, for example, the terminal device may first reduce the window screen at a preset scale to obtain a screen thumbnail, and then may perform image synthesis on the screen thumbnail to obtain the first preview image; for example, the terminal device may perform image synthesis on the window frame according to the original frame size of the window, and then reduce the synthesized image according to a preset scale to obtain the first preview image. Here, in order to reduce the occlusion of the first preview image on the display interface and affect the user experience, the first preview image in the embodiment of the present application is preferably a thumbnail image, and the embodiment of the present application will be further exemplarily described with the first preview image as a thumbnail image.

S402, displaying the first preview image and the window splitting button in the display interface.

The window splitting button can be used for triggering the terminal device to split the first preview image according to each window. Here, the window split button may be displayed at any position in the display interface. Alternatively, the position of the window split button in the display interface may be associated with the position of the first preview image in the display interface, for example, as shown in fig. 6a, the position of the window split button 601 in the display interface may be above the first preview image 602.

For example, after the terminal device acquires the first preview image corresponding to the display interface, the first preview image may be displayed at any position in the display interface. Here, in order to reduce the occlusion of the first preview image to the content currently viewed by the user and affect the user experience, the first preview image is optionally displayed in a corner of the display interface in the embodiment of the present application, for example, the first preview image 602 may be displayed in the lower left of the display interface as shown in fig. 6 a.

And S403, responding to the triggering operation of the window splitting button, splitting the first preview image into a plurality of second preview images, and displaying the second preview images on the display interface, wherein each second preview image is a picture thumbnail of a window picture corresponding to each window.

It should be understood that, when the first preview image and the window splitting button are displayed on the display interface, when a user wants to view a window picture corresponding to each window or obtain a screenshot image of one or some windows, the user may trigger the window splitting button in the display interface through a triggering operation, where the triggering operation may be an operation in which the user clicks or touches the window splitting button. After the terminal device detects that the user triggers the window splitting button, the terminal device can split the first preview image into a plurality of second preview images corresponding to the windows and display the second preview images on the display interface, that is, any one of the split second preview images is a picture thumbnail of a window picture corresponding to one window. The terminal device may display the plurality of second preview images on the display interface in a horizontally arranged manner or display the plurality of second preview images on the display interface in a vertically arranged manner. For example, the terminal device may split the first preview image 602 shown in fig. 6a into a plurality of second preview images 603, and may display the second preview images 603 on the display interface in a horizontally-arranged manner as shown in fig. 6b, or may display the second preview images 603 on the display interface in a vertically-arranged manner as shown in fig. 6 c.

The above-mentioned displaying the second preview images in the display interface in the horizontal arrangement manner or the vertical arrangement manner is only schematically explained, and should not be construed as a limitation to the embodiment of the present application, and in the embodiment of the present application, the second preview images may be displayed in other arrangement manners, for example, the second preview images may be displayed in an arrangement manner along a diagonal direction of the display interface, which is not limited by the embodiment of the present application. Here, in order to reduce the amount of movement of the second preview image and increase the display speed of the second preview image, in the embodiment of the present application, the second preview image may be displayed in a horizontal arrangement, and the embodiment of the present application will be described as an example of displaying the second preview image in a horizontal arrangement.

It should be noted that, after splitting the first preview image into a plurality of second preview images, the terminal device may display each of the second preview images in the display interface according to a preset display order. The display order is an order in which the second preview images are arranged when displayed on the display interface. Here, the display order may be measured based on a certain edge of the display interface.

For example, in a scene in which the first preview image is displayed at the lower left or upper left of the display interface, the second preview image may be displayed in the display interface in a display order from left to right. When the display sequence of the second preview image is closer to the left edge of the display interface, the position of the second preview image in the display interface is closer to the left edge of the display interface, and when the display sequence of the second preview image is closer to the rear, the position of the second preview image in the display interface is farther away from the left edge of the display interface.

For example, in a scene in which the first preview image is displayed at the upper right or lower right of the display interface, the second preview images may be arranged in the display interface in a display order from right to left. When the display sequence of the second preview image is closer to the right edge of the display interface, the position of the second preview image in the display interface is closer to the right edge of the display interface, and when the display sequence of the second preview image is closer to the rear, the position of the second preview image in the display interface is farther away from the right edge of the display interface.

For example, when the terminal device determines that the distance between the first boundary position of the window a and the second boundary position of the display interface is 1 cm, the distance between the first boundary position of the window B and the second boundary position of the display interface is 2 cm, and the distance between the first boundary position of the window C and the second boundary position of the display interface is 2.5 cm, the terminal device may determine that the display order of the second preview images a corresponding to the window a is earlier than the display order of the second preview images B corresponding to the window B, and the display order of the second preview images B corresponding to the window B is earlier than the display order of the second preview images C corresponding to the window C, that is, in the display interface, the second preview images a are displayed before the second preview images B, and the second preview images B are displayed before the second preview images C.

For example, in a scene in which the display order is from left to right and the first preview image is displayed at the lower left of the display interface, the first boundary position may be a position at which the left edge of the window is located, the second boundary position may be a position at which the left edge of the display interface is located, the third boundary position may be a position at which the lower edge of the window is located, and the fourth boundary position may be a position at which the lower edge of the display interface is located. As shown in fig. 1a, the first boundary position of the window 102 is a left edge 103, the third boundary position of the window 102 is a lower edge 104, the second boundary position of the display interface 101 (or the window 101) is a left edge 105, and the fourth boundary position of the display interface 101 (or the window 101) is a lower edge 106.

For example, in the scenario shown in fig. 7a, according to the window 701 (the window where the application a corresponding to the chat interface is located), the window 702 (the window where the application B corresponding to the login interface is located), the window 703 (the window where the application C corresponding to the two-dimensional code interface is located), the left edge of the window 704 (the window where the floating window corresponding to the notification interface is located) and the left edge of the display interface, the terminal device may determine that the distance between the left edge of the window 701 and the left edge of the display interface is equal to the distance between the left edge of the window 702 and the left edge of the display interface, and both are smaller than the distance between the left edge of the window 704 and the left edge of the display interface, and the distance between the left edge of the window 704 and the left edge of the display interface is smaller than the distance between the left edge of the window 703 and the left edge of the display interface. At this time, the terminal device may first determine that the display order of the second preview image 701 ' corresponding to the window 701 and the display order of the second preview image 702 ' corresponding to the window 702 are both before the display order of the second preview image 704 ' corresponding to the window 704, and may determine that the display order of the second preview image 704 ' corresponding to the window 704 is before the display order of the second preview image 703 ' corresponding to the window 703. Then, the terminal device may further determine, according to the window 701 and the lower edge of the window 702 and the lower edge of the display interface, that the distance between the lower edge of the window 702 and the lower edge of the display interface is smaller than the distance between the lower edge of the window 701 and the lower edge of the display interface, so that it may be determined that the display order of the second preview image 702 'is before the display order of the second preview image 701', and the finally obtained display order may be: the second preview image 702 'precedes the second preview image 701', the second preview image 701 'precedes the second preview image 704', and the second preview image 704 'precedes the second preview image 703'. Finally, the second preview image is displayed according to the display sequence, so that the display image shown in fig. 7b can be obtained.

For example, in the scenario shown in fig. 8a, the terminal device may determine, according to the right edges of the window 801 (the window where the application a corresponding to the chat interface is located), the window 802 (the window where the application B corresponding to the login interface is located), the window 803 (the window where the floating window corresponding to the notification interface is located), and the display interface, that the distance between the right edge of the window 801 and the right edge of the display interface is equal to the distance between the right edge of the window 802 and the right edge of the display interface, and both of the distances are smaller than the distance between the right edge of the window 803 and the right edge of the display interface. At this time, the terminal device may first determine that the display order of the second preview image 801 ' corresponding to the window 801 and the display order of the second preview image 802 ' corresponding to the window 802 are both earlier than the display order of the second preview image 803 ' corresponding to the window 803. Then, the terminal device may further determine, according to the window 801 and the lower edge of the window 802 and the lower edge of the display interface, that the distance between the lower edge of the window 802 and the lower edge of the display interface is smaller than the distance between the lower edge of the window 801 and the lower edge of the display interface, so that it may be determined that the display order of the second preview image 802 'is before the display order of the second preview image 801', and the resulting display order may be: the second preview image 802 'precedes the second preview image 801' and the second preview image 801 'precedes the second preview image 803'. The second preview image is displayed according to the display order, and the display image shown in fig. 8b can be obtained.

In another possible implementation manner, the preset display order may be determined according to a window level corresponding to the window. For example, the display order of the second preview images corresponding to windows with higher window levels is more advanced, or the display order of the second preview images corresponding to windows with lower window levels is more advanced, and the display order of the second preview images corresponding to windows with lower window levels is more advanced, which may be determined according to actual situations, and the embodiment of the present application does not limit this. The following describes an exemplary embodiment of the present application, taking an example in which the display order of the second preview images corresponding to windows with lower window levels is earlier as the display order of the second preview images corresponding to windows with higher window levels is later.

It should be understood that, when multiple identical target window levels exist in the window levels, the terminal device may determine the display order between the second preview images corresponding to the target windows according to the window positions of the target windows corresponding to the target window levels in the display interface. Wherein the target window is any one of a plurality of windows. For example, the display order between the second preview images corresponding to the target window may be determined according to the boundary position of the target window and the boundary position of the display interface. It should be noted that, determining the display order between the second preview images corresponding to the target window according to the boundary position of the target window and the boundary position of the display interface may refer to the description of determining the display order according to the boundary position of the window and the boundary position of the display interface, and is not described herein again.

For example, in the scenario shown in fig. 3, when the terminal device determines that the window level corresponding to the window 303 is higher than the window level corresponding to the window 301 and higher than the window level corresponding to the window 302, and the window level corresponding to the window 301 and the window level corresponding to the window 302 are equal, the terminal device may determine that the display order of the second preview image 301 ' corresponding to the window 301 and the second preview image 302 ' corresponding to the window 302 is earlier than the display order of the second preview image 303 ' corresponding to the window 303. Subsequently, the terminal device may determine the display order between the second preview image 301 'corresponding to the window 301 and the second preview image 302' corresponding to the window 302 according to the window positions of the window 301 and the window 302 in the display interface, for example, when the display order of the second preview images is from left to right, the terminal device may determine that the display order of the second preview image 301 'corresponding to the window 301 is before the display order of the second preview image 302' corresponding to the window 302, and the final display order may be: the second preview image 301 'corresponding to the window 301 is preceded by the second preview image 302' corresponding to the window 302, and the second preview image 302 'corresponding to the window 302 is preceded by the second preview image 303' corresponding to the window 303, and the second preview image is displayed according to the display sequence, so that the display image shown in fig. 9a can be obtained. If the display order of the second preview images is from right to left, the terminal device may determine that the display order of the second preview image 302 'corresponding to the window 302 is earlier than the display order of the second preview image 301' corresponding to the window 301, and the resulting display order may be: the second preview image 302 'corresponding to the window 302 is preceded by the second preview image 301' corresponding to the window 301, and the second preview image 301 'corresponding to the window 301 is preceded by the second preview image 303' corresponding to the window 303, and the second preview image is displayed according to the display order, so that the display image shown in fig. 9b can be obtained.

In another possible implementation, the preset display sequence may be determined according to a starting time of the windows. For example, the display order of the second preview images corresponding to the windows with the newer activation times is earlier, and the display order of the second preview images corresponding to the windows with the older activation times is later. Wherein, the new or old starting time can be measured by the distance between the starting time and the current time for displaying the second preview image.

It should be understood that the determination of the display order of the second preview images according to the boundary position of the window and the boundary position of the display interface, the window hierarchy, the start time of the window, and the window name of the window is only schematically illustrated and should not be construed as a limitation to the embodiment of the present application, and in the embodiment of the present application, the display order of the second preview images may be determined by other determination manners, for example, the display order of the second preview images may be determined by a random arrangement manner, which is not limited in this embodiment of the present application.

It should be noted that the terminal device may automatically save the preview image displayed in the display interface as the screenshot image. Specifically, the terminal device may automatically save the preview image displayed in the display interface as the screenshot image in a form (such as a composite form or a separate form) of the preview image in the display interface when no operation of the user is detected within a preset time. For example, after the terminal device displays the first preview image and the window splitting button, if the user does not trigger the window splitting button within the first preset time, the user may consider that the full-screen image including all windows is to be intercepted, at this time, the terminal device may directly store the first preview image as the screen capture image, and may delete the first preview image displayed in the display interface. The first preset time may be set according to an actual situation, for example, the first preset time may be set to any time such as 3 seconds, 5 seconds, 6 seconds, and the like, which is not limited in this embodiment of the present application.

S404, responding to the selection operation of the second preview image, acquiring a third preview image, and saving the third preview image as a screen capture image, wherein the third preview image is at least one preview image in the second preview image.

Here, when the terminal device splits the first preview image into a plurality of second preview images and displays the second preview images on the display interface, as shown in fig. 10, a corresponding delete button 100 may be provided for each second preview image, and the user may click or touch the delete button 100 to select the second preview image, thereby obtaining a third preview image (i.e., the second preview image in which the delete button 100 is not clicked or touched). For example, in the scene shown in fig. 3, when the user needs to capture the image corresponding to the window 301 and the image corresponding to the window 303, after obtaining the second preview image shown in fig. 10, the user may click the delete button 100 corresponding to the second preview image corresponding to the window 302 to delete the second preview image corresponding to the window 302, so as to obtain the third preview image shown in fig. 11, and may store the third preview image, respectively, so as to obtain the screenshot image corresponding to the window 301 and the screenshot image corresponding to the window 303.

For example, after the user performs the selection operation, when the user does not perform any other operation within a second preset time, the terminal device may automatically store each third preview image as the screenshot image, and delete each third preview image displayed in the display interface. The second preset time is similar to the first preset time and can be set according to actual conditions, for example, the second preset time can be set to any time such as 3 seconds, 5 seconds, 6 seconds, and the like, which is not limited in this embodiment of the present application.

It should be understood that the above-mentioned deletion of the second preview image by the delete button is only schematically illustrated, and should not be construed as a limitation to the embodiment of the present application, and the deletion of the second preview image may also be performed in other manners, for example, the deletion of the second preview image may be performed by sliding the second preview image upwards or downwards or sliding the second preview image leftwards or rightwards, which is not specifically limited by the embodiment of the present application.

It should be noted that, after the terminal device splits the first preview image into the plurality of second preview images and displays the second preview images on the display interface, if the user does not perform the selection operation within the third preset time, the terminal device may consider that the user wants to capture the screenshot images corresponding to the respective windows, at this time, the terminal device may directly store the second preview images as the screenshot images respectively and delete the second preview images displayed in the display interface. The third preset time is similar to the first preset time and the second preset time, and may also be set according to an actual situation, for example, the third preset time may be set to any time such as 3 seconds and 5 seconds, which is not limited in this embodiment of the present application.

In some embodiments, the image that the user wants to capture may be a composite image of some of the windows, and the present application may further display a window composite button in the display interface, where the window composite button may be displayed when the first preview image is split into the plurality of second preview images. For example, when the window splitting button is triggered and the plurality of second preview images are displayed in the display interface, the window splitting button in the display interface may be changed into a window composition button. When the window synthesis button is triggered, the terminal device can perform image synthesis on the preview image currently displayed in the display interface. Specifically, the terminal device may perform image synthesis on the preview image according to the window position and the window hierarchy of the window corresponding to the currently displayed preview image in the display interface, so as to obtain a synthesized preview image.

It should be understood that, within the fourth preset time after the image composition, if the user does not perform any other operation, the terminal device may save the composited preview image as the screenshot image and delete the composited preview image displayed on the display interface. The fourth preset time is similar to the first preset time, the second preset time, and the third preset time, and may also be set according to an actual situation, for example, the fourth preset time may be set to any time such as 3 seconds, 5 seconds, and 6 seconds, which is not limited in this embodiment of the application.

For example, in the scenario shown in fig. 3, when the user wants to cut out the composite image corresponding to the window 302 and the window 303, as shown in fig. 12a, when the first preview image is split into a plurality of second preview images and displayed on the display interface, the window composite button 200 may be further displayed on the display interface. The user may first click or touch the delete button 100 corresponding to the second preview image corresponding to the window 301 to delete the second preview image corresponding to the window 301, so as to obtain the third preview image shown in fig. 12b (i.e., the second preview image corresponding to the window 302 and the second preview image corresponding to the window 303), and may then click or touch the window composition button 200 to perform image composition on the third preview image, so as to obtain the fourth preview image 1201 shown in fig. 12c, and may save the fourth preview image.

For example, in the scenario shown in fig. 3, when the user wants to include both a full-screen image of the window 301, the window 302, and the window 303, and a single image of the window 302, and also wants to include only a composite image of the window 301 and the window 303, after the user triggers a screen capture operation, the terminal device may perform screen capture processing on the display interface to obtain a first preview image, and may display the first preview image, a window splitting button, and a saving button in the display interface, at this time, the user may first click the saving button to save the first preview image to obtain a full-screen image including the window 301, the window 302, and the window 303; then, the user can click or touch the window splitting button, the terminal device can split the first preview image into a plurality of second preview images and display the second preview images on the display interface, the window splitting button can be converted into a window synthesizing button and displayed on the display interface, and meanwhile, a saving button and a deleting button corresponding to each second preview image can be displayed on the display interface; a user can click a save button corresponding to a second preview image corresponding to the window 302 to save the second preview image corresponding to the window 302 to obtain an individual image corresponding to the window 302, and can click a delete button corresponding to the second preview image corresponding to the window 302 to delete the second preview image corresponding to the window 302, so that only the second preview image corresponding to the window 301 and the second preview image corresponding to the window 303 are displayed in a display interface; subsequently, the user can click a window composition button, and at this time, the terminal device can perform image composition on the second preview image corresponding to the window 301 and the second preview image corresponding to the window 303 to obtain a composite image of the window 301 and the window 303, so as to meet diversified screen capture requirements of the user.

In the embodiment of the application, under the condition of multiple windows, when a user triggers a screen capture operation, the terminal device can perform screen capture processing on a display interface of the terminal device to obtain a first preview image displayed on the display interface, and simultaneously can display a window splitting button in the display interface, and can split the first preview image into a plurality of second preview images corresponding to the windows according to the triggering operation of the window splitting button by the user, the user can select the second preview images as required, the terminal device can obtain final screen capture images according to the second preview images selected by the user, so that the operation process of performing partial window screen capture in the multiple windows can be simplified, the flexibility and efficiency of the multiple window screen capture are improved, the screen capture of a blocked window in the multiple windows can be realized, and the user experience is improved.

It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

Fig. 13 shows a structural block diagram of a multi-window screen capture device provided in the embodiment of the present application, corresponding to the multi-window screen capture method described in the above embodiment, and only shows parts related to the embodiment of the present application for convenience of description.

Referring to fig. 13, the apparatus may include:

the screen capture processing module 1301 is configured to perform screen capture processing on a display interface when a screen capture operation is detected, and obtain a first preview image corresponding to the display interface, where multiple windows are displayed in the display interface;

an image display module 1302, configured to display the first preview image and a window splitting button in the display interface;

the image splitting module 1303 is configured to split the first preview image into a plurality of second preview images in response to a triggering operation of the window splitting button, and display the second preview images on the display interface, where each second preview image is a thumbnail of a window image corresponding to each window;

an image saving module 1304, configured to, in response to a selection operation on the second preview image, obtain a third preview image, and save the third preview image as a screen capture image, where the third preview image is at least one preview image in the second preview image.

In a possible implementation manner, there is an overlap between at least two windows in the multiple windows, and the screen capture processing module 1301 may include:

For example, the image splitting module 1303 may include:

Optionally, the image splitting module 1303 may further include:

For example, the image splitting module 1303 may further include:

Optionally, the image splitting module 1303 may further include:

In one possible implementation, the apparatus may further include:

Optionally, the image saving module 1304 may be further configured to, in response to a triggering operation of the window combination button, perform image combination on the third preview image according to a window position and a window hierarchy corresponding to the third preview image to obtain a fourth preview image, and save the fourth preview image as a screenshot image.

For example, the image saving module 1304 may be further configured to save the third preview image as a screenshot image and delete the third preview image in the display interface when no operation is detected within a preset time.

It should be noted that, for the information interaction, execution process, and other contents between the above-mentioned devices/units, the specific functions and technical effects thereof are based on the same concept as those of the embodiment of the method of the present application, and specific reference may be made to the part of the embodiment of the method, which is not described herein again.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

Fig. 14 is a schematic structural diagram of a terminal device according to an embodiment of the present application. As shown in fig. 14, the terminal device 14 of this embodiment includes: at least one processor 1400 (only one shown in fig. 14), a memory 1401, and a computer program 1402 stored in the memory 1401 and executable on the at least one processor 1400, wherein the processor 1400, when executing the computer program 1402, implements the steps of any of the various multi-window screenshot method embodiments described above.

The terminal device may include, but is not limited to, a processor 1400, a memory 1401. Those skilled in the art will appreciate that fig. 14 is merely an example of the terminal device 14, and does not constitute a limitation of the terminal device 14, and may include more or less components than those shown, or combine some of the components, or different components, such as an input-output device, a network access device, etc.

The Processor 1400 may be a Central Processing Unit (CPU), and the Processor 1400 may also be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), off-the-shelf Programmable Gate arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The storage 1401 may in some embodiments be an internal storage unit of the terminal device 14, such as a hard disk or a memory of the terminal device 14. The memory 1401 may also be an external storage device of the terminal device 14 in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the terminal device 14. Further, the memory 1401 may also include both an internal storage unit and an external storage device of the terminal device 14. The memory 1401 is used for storing an operating system, an application program, a BootLoader (BootLoader), data, and other programs, such as program codes of the computer program. The memory 1401 may also be used to temporarily store data that has been output or is to be output.

As can be seen from the foregoing, the terminal device 14 may be a mobile phone, a tablet computer, a wearable device, an in-vehicle device, an AR/VR device, a notebook computer, a desktop computer, a UMPC, a netbook, a PDA, or other terminal devices with a display screen. Take the terminal device as a mobile phone as an example. Fig. 15 is a block diagram illustrating a partial structure of a mobile phone according to an embodiment of the present application. Referring to fig. 15, the handset may include: radio Frequency (RF) circuitry 1510, memory 1520, input unit 1530, display unit 1540, sensor 1550, audio circuitry 1560, wireless fidelity (WiFi) module 1570, processor 1580, and power supply 1590. Those skilled in the art will appreciate that the handset configuration shown in fig. 15 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The following describes each component of the mobile phone in detail with reference to fig. 15:

the RF circuit 1510 may be configured to receive and transmit signals during information transmission and reception or during a call, and in particular, receive downlink information of a base station and then process the received downlink information to the processor 1580; in addition, the data for designing uplink is transmitted to the base station. In general, RF circuit 1510 includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, RF circuit 1510 may also communicate with networks and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE)), e-mail, Short Messaging Service (SMS), and the like.

The memory 1520 may be used to store software programs and modules, and the processor 1580 performs various functional applications and data processing of the cellular phone by operating the software programs and modules stored in the memory 1520. The memory 1520 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 1520 may include high-speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.

The input unit 1530 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone. Specifically, the input unit 1530 may include a touch panel 1531 and other input devices 1532. The touch panel 1531, also referred to as a touch screen, can collect touch operations of a user (e.g., operations of the user on or near the touch panel 1531 using any suitable object or accessory such as a finger or a stylus) and drive corresponding connection devices according to a preset program. Alternatively, the touch panel 1531 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, and sends the touch point coordinates to the processor 1580, and can receive and execute commands sent by the processor 1580. In addition, the touch panel 1531 may be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The input unit 1530 may include other input devices 1532 in addition to the touch panel 1531. In particular, other input devices 1532 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 1540 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The Display unit 1540 may include a Display panel 1541, and optionally, the Display panel 1541 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch panel 1531 may cover the display panel 1541, and when the touch panel 1531 detects a touch operation on or near the touch panel 1531, the touch operation is transmitted to the processor 1580 to determine the type of the touch event, and then the processor 1580 provides a corresponding visual output on the display panel 1541 according to the type of the touch event. Although in fig. 15, the touch panel 1531 and the display panel 1541 are two separate components to implement the input and output functions of the mobile phone, in some embodiments, the touch panel 1531 and the display panel 1541 may be integrated to implement the input and output functions of the mobile phone.

The handset can also include at least one sensor 1550, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display panel 1541 according to the brightness of ambient light and a proximity sensor that turns off the display panel 1541 and/or the backlight when the mobile phone is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.

Audio circuitry 1560, speaker 1561, and microphone 1562 may provide an audio interface between a user and a cell phone. The audio circuit 1560 may transmit the electrical signal converted from the received audio data to the speaker 1561, and convert the electrical signal into an audio signal by the speaker 1561 and output the audio signal; on the other hand, the microphone 1562 converts collected sound signals into electrical signals, which are received by the audio circuit 1560 and converted into audio data, which are processed by the audio data output processor 1580 and then passed through the RF circuit 1510 for transmission to, for example, another cellular phone, or for output to the memory 1520 for further processing.

WiFi belongs to short-distance wireless transmission technology, and the mobile phone can help a user to receive and send e-mails, browse webpages, access streaming media and the like through a WiFi module 1570, and provides wireless broadband internet access for the user. Although fig. 15 shows WiFi module 1570, it is understood that it does not belong to the essential constitution of the handset and can be omitted entirely as needed within the scope not changing the essence of the invention.

The processor 1580 is a control center of the mobile phone, connects various parts of the entire mobile phone by using various interfaces and lines, and performs various functions of the mobile phone and processes data by operating or executing software programs and/or modules stored in the memory 1520 and calling data stored in the memory 1520, thereby integrally monitoring the mobile phone. Optionally, the processor 1580 may include one or more processing units; preferably, the processor 1580 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, and the like, and a modem processor, which mainly handles wireless communications. It is to be appreciated that the modem processor may not be integrated into the processor 1580.

The handset also includes a power supply 1590 (e.g., a battery) for powering the various components, which may preferably be logically coupled to the processor 1580 via a power management system to manage charging, discharging, and power consumption management functions via the power management system.

Although not shown, the handset may also include a camera. Optionally, the position of the camera on the mobile phone may be front-located or rear-located, which is not limited in this embodiment of the present application.

Optionally, the mobile phone may include a single camera, a dual camera, or a triple camera, which is not limited in this embodiment.

For example, a cell phone may include three cameras, one being a main camera, one being a wide camera, and one being a tele camera.

Optionally, when the mobile phone includes a plurality of cameras, all the cameras may be arranged in front of the mobile phone, or all the cameras may be arranged in back of the mobile phone, or a part of the cameras may be arranged in front of the mobile phone, and another part of the cameras may be arranged in back of the mobile phone, which is not limited in this embodiment of the present application.

In addition, although not shown, the mobile phone may further include a bluetooth module, etc., which will not be described herein.

Fig. 16 is a software structure diagram of a mobile phone according to an embodiment of the present application. Taking a mobile phone operating system as an Android system as an example, in some embodiments, the Android system is divided into four layers, which are an application layer, an application Framework (FWK) layer, a system layer and a hardware abstraction layer, and the layers communicate with each other through a software interface.

As shown in fig. 16, the application layer may be a series of application packages, which may include short message, calendar, camera, video, navigation, gallery, call, and other applications.

The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer may include some predefined functions, such as functions for receiving events sent by the application framework layer.

As shown in fig. 16, the application framework layer may include a window manager, a resource manager, and a notification manager, among others.

The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like. The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.

The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, sounding a prompt tone, vibrating the electronic device, flashing an indicator light, etc.

The application framework layer may further include:

a viewing system that includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

The telephone manager is used for providing the communication function of the mobile phone. Such as management of call status (including on, off, etc.).

The system layer may include a plurality of functional modules. For example: a sensor service module, a physical state identification module, a three-dimensional graphics processing library (such as OpenGL ES), and the like.

The sensor service module is used for monitoring sensor data uploaded by various sensors in a hardware layer and determining the physical state of the mobile phone;

the physical state recognition module is used for analyzing and recognizing user gestures, human faces and the like;

the three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The system layer may further include:

the surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The hardware abstraction layer is a layer between hardware and software. The hardware abstraction layer may include a display driver, a camera driver, a sensor driver, etc. for driving the relevant hardware of the hardware layer, such as a display screen, a camera, a sensor, etc.

The embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments may be implemented.

The embodiments of the present application provide a computer program product, which when running on a terminal device, enables the terminal device to implement the steps in the above method embodiments when executed.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the processes in the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium and can implement the steps of the embodiments of the methods described above when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable storage medium may include at least: any entity or device capable of carrying computer program code to the apparatus/device, recording medium, computer Memory, Read-Only Memory (ROM), Random-Access Memory (RAM), electrical carrier signals, telecommunications signals, and software distribution medium. Such as a usb-disk, a removable hard disk, a magnetic or optical disk, etc. In certain jurisdictions, computer-readable storage media may not be an electrical carrier signal or a telecommunications signal in accordance with legislative and proprietary practices.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

The above-mentioned embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.

Claims

1. A multi-window screen capture method, comprising:

2. The method according to claim 1, wherein at least two of the windows overlap with each other, and the performing the screen capture process on the display interface to obtain the first preview image corresponding to the display interface comprises:

3. The method of claim 1 or 2, wherein the displaying the second preview image on the display interface comprises:

4. The method of claim 3, further comprising, after determining the distance between each of the first boundary locations and the second boundary location:

5. The method of claim 1 or 2, wherein the displaying the second preview image on the display interface comprises:

6. The method of claim 5, further comprising:

7. The method according to any one of claims 1-6, further comprising:

8. The method of claim 7, wherein saving the third preview image as a screenshot image comprises:

9. The method of any of claims 1-8, wherein saving the third preview image as a screenshot image comprises:

10. A multi-window screen capture device, comprising:

11. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the multi-window screenshot method of any one of claims 1 to 9 when executing the computer program.

12. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, implements the multi-window screen capture method according to any one of claims 1 to 9.