CN115373558A

CN115373558A - Screen projection method, device, equipment and storage medium

Info

Publication number: CN115373558A
Application number: CN202110540798.9A
Authority: CN
Inventors: 欧阳宇基; 黄升
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Priority date: 2021-05-18
Filing date: 2021-05-18
Publication date: 2022-11-22
Also published as: WO2022242628A1

Abstract

The embodiment of the application discloses a screen projection method, a screen projection device, screen projection equipment and a storage medium, and belongs to the technical field of communication. The method is applied to a screen-casting sending end, the method comprises the following steps that a screen projection sending end and a screen projection receiving end establish communication connection, and the method comprises the following steps: in response to the operation by the user, displaying selection information including a plurality of application windows that are running; obtaining user selection from multiple application windows at least two application windows to be projected, acquiring display contents of at least two application windows; and sending the display contents of the at least two application windows to a screen projection receiving end so that the screen projection receiving end displays the display contents of the at least two application windows. According to the method and the device, the multiple applications or application windows on one screen projection sending end can be targeted in one screen projection process, and the user operation is simple.

Description

Screen projection method, device, equipment and storage medium

Technical Field

The present application relates to the field of communications, and in particular, to a screen projection method, apparatus, device, and storage medium.

Background

The screen projection refers to projecting a screen picture on a small-screen device such as a mobile phone or a computer onto a large screen (as shown in fig. 1A), so that the screen picture is viewed on the large screen.

In the screen projection process, users often have a need to project multiple applications or multiple application windows. Currently, a plurality of applications are projected, wherein a user manually projects the currently projected application on a small-screen device after finishing projecting the screen, and then manually selects other applications to project the screen. In addition, if a user needs to screen a plurality of application windows of the same application, the user still needs to manually finish screen projection of the application window currently screened on the small-screen device, and then manually select other application windows to screen. In this way, the projection of multiple applications or application windows is achieved.

However, the operation process of the screen projection of the plurality of applications or application windows is complex, and one screen projection process is still aimed at one application or application window on one screen projection sending end.

Disclosure of Invention

The embodiment of the application provides a screen projection method, a screen projection device, screen projection equipment and a storage medium, and can solve the problems that the operation process of screen projection of a plurality of applications is complex, and one screen projection process still aims at one application or application window on one screen projection sending end. The technical scheme is as follows:

in a first aspect, an embodiment of the present application provides a screen projection method, which is applied to a screen projection transmitting end, where the screen projection transmitting end establishes a communication connection with a screen projection receiving end, and the method includes: displaying selection information in response to an operation of a user, wherein the selection information comprises a plurality of application windows which are running; acquiring at least two application windows to be screened selected by the user from the plurality of application windows, acquiring display contents of at least two application windows to be projected; and sending the display contents of the at least two application windows to be projected to the screen projection receiving end so that the screen projection receiving end displays the display contents of the at least two application windows to be projected.

In a second aspect, an embodiment of the present application provides a screen projection method, which is applied to a screen projection receiving terminal, where the screen projection receiving terminal establishes a communication connection with a screen projection sending terminal, and a display interface of the screen projection receiving terminal includes at least two display windows, and the method includes: receiving display contents of at least two application windows to be subjected to screen projection, which are sent by the screen projection sending end; displaying the object in the at least two display windows displaying contents of at least two application windows projected on the screen; the display content of one application window to be projected corresponds to one display window.

In a third aspect, an embodiment of the present application provides a screen projection sending apparatus, where the screen projection sending apparatus establishes a communication connection with a screen projection receiving apparatus, and the screen projection sending apparatus includes: the device comprises a first display module, a second display module and a display module, wherein the first display module is used for responding to the operation of a user and displaying selection information, and the selection information comprises a plurality of application windows which are running; the first acquisition module is used for acquiring at least two application windows to be screened selected from the multiple application windows by the user and acquiring display contents of the at least two application windows to be screened; the first sending module is used for sending the display contents of the at least two application windows to be subjected to screen projection to the screen projection receiving device, so that the screen projection receiving device displays the display contents of the at least two application windows to be subjected to screen projection.

In a fourth aspect, an embodiment of the present application provides a screen projection receiving apparatus, where the screen projection receiving apparatus establishes a communication connection with a screen projection sending apparatus, a display interface of the screen projection receiving apparatus includes at least two display windows, and the screen projection receiving apparatus includes: the second receiving module is used for receiving the display contents of the at least two application windows to be subjected to screen projection, which are sent by the screen projection sending device; a second display module for displaying a second image, the display content of the at least two application windows to be projected is displayed in the at least two display windows; the display content of one application window to be projected corresponds to one display window.

In a fifth aspect, embodiments of the present application provide a computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the method steps of the first aspect.

In a sixth aspect, embodiments of the present application provide a computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the method steps of the second aspect.

In a seventh aspect, an embodiment of the present application provides an electronic device, including: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of the first aspect.

In an eighth aspect, an embodiment of the present application provides an intelligent interactive tablet, which may include: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of the second aspect described above.

In the embodiment of the application, the selection information is displayed by responding to the operation of a user, and the selection information comprises a plurality of application windows which are running; acquiring at least two application windows to be screened selected from a plurality of application windows by a user, and acquiring display contents of the at least two application windows to be screened; the display contents of at least two application windows to be projected are sent to a projection receiving end, so that the projection receiving end displays the display contents of at least two application windows to be projected in the at least two display windows; the display content of one application window to be projected corresponds to one display window. Because the selection information comprising the running application windows is provided for the user, the user can select the application windows for screen projection at one time, the repeated operation process that the user needs to project the screen for many times and stop projecting the screen is avoided, the screen projection of multiple applications on one screen projection sending end is realized, and the effect of simple operation is achieved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.

FIG. 1A is a schematic view of a screen projection provided by an embodiment of the present application;

fig. 1B is a scene schematic diagram of a screen projection method provided in the embodiment of the present application;

fig. 2 is a first interaction diagram of a screen projection method according to an embodiment of the present disclosure;

FIG. 3 is an exemplary diagram of one manner of presenting selection information provided by an embodiment of the present application;

FIG. 4 is an exemplary diagram of another manner of presenting selection information provided by an embodiment of the present application;

fig. 5 is an interaction diagram ii of a screen projection method provided in the embodiment of the present application;

FIG. 6 is an exemplary diagram of a selection sequence of application windows provided in an embodiment of the present application;

FIG. 7 is an exemplary diagram of a display order of application windows provided by an embodiment of the present application;

fig. 8 is a third interaction diagram of a screen projection method according to an embodiment of the present application;

FIG. 9 is a diagram illustrating a target application window in a touch activated state according to an embodiment of the present application;

FIG. 10 is a schematic diagram illustrating an effect of a superposition display of multiple application windows according to an embodiment of the present application;

fig. 11 is a schematic diagram of application switching according to an embodiment of the present application;

fig. 12 is a fourth interaction diagram of a screen projection method provided in the embodiment of the present application;

FIG. 13A provides a continuation of the examples provided herein a display effect schematic diagram in a screen projection mode;

fig. 13B is a schematic view of a display effect in the continuous screen projection mode according to the embodiment of the present application;

fig. 14 is a flowchart of a screen projection method provided in an embodiment of the present application;

fig. 15A is a schematic view of a display interface provided in an embodiment of the present application;

fig. 15B is a schematic partitioning diagram of another display interface provided in the embodiment of the present application;

fig. 15C is a schematic diagram illustrating a division of another display interface provided in the embodiment of the present application;

fig. 16 is a schematic structural diagram of a screen projection sending apparatus according to an embodiment of the present application;

fig. 17 is a schematic structural diagram of a projection screen receiving apparatus according to an embodiment of the present application;

fig. 18 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

fig. 19 is a schematic structural diagram of an intelligent interactive tablet according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

It should be understood that the embodiments described are only a few embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given in the present application without making any inventive step, are within the scope of the present application.

The following description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the application, as detailed in the appended claims.

In the description of the present application, it is to be understood that the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not necessarily used to describe a particular order or sequence, nor are they to be construed as indicating or implying relative importance. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as the case may be. In addition, in the description of the present application, "a plurality" means two or more unless otherwise specified. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

Fig. 1B is a scene schematic diagram of the screen projection method provided in the embodiment of the present application, and as shown in fig. 1B, the scene of the embodiment includes a screen projection transmitting end 11 and a screen projection receiving end 12. The screen projection sending end 11 and the screen projection receiving end 12 are in communication connection. The screen projection sending end 11 can be a mobile device such as a mobile phone, a computer, a tablet computer and the like. The screen projection receiving end 12 may be a large screen device such as a television, an intelligent interactive panel, and the like. It should be understood that a large screen device is relative to a small screen device.

The screen-casting transmitting terminal 11 may obtain the display content of the application window currently running on the screen-casting transmitting terminal 11, and transmit the display content to the screen-casting receiving terminal 12, so as to perform synchronous display on the screen-casting receiving terminal 12. The user can enjoy the watching experience of a large screen, and therefore the watching experience is improved.

After a user casts an application window on a screen casting sending end to a screen casting receiving end, the display content of the application window can be synchronously displayed on a large screen of the screen casting receiving end. The application windows of the screen projection can be different application windows of the same application (for example, different word documents) or application windows of different applications (for example, chat software and video software). Then, for different applications, even if the screen-casting sending end switches to other applications, the switched applications are not displayed on a large screen. If a user needs to show multiple applications on a large screen, it is necessary to switch back and forth between multiple different applications. For example, if a user needs to project the display contents of multiple applications, the application a needs to be projected first, then the projection of the application a needs to be stopped, then the application B needs to be selected, then the projection of the application B needs to be stopped, and then the application C needs to be selected. In addition, in the screen projection mode, for one screen projection sending end, one application is still projected each time the screen is projected.

In addition, for different application windows of the same application, if a user needs to show different application windows of the same application on a large screen, the user also needs to switch back and forth between the different application windows. For example, if a user needs to screen different word display contents, the user needs to screen the application window of word1 first, then stop the screen of the application window of word1, then select the application window of word2, then stop the screen of the application window of word2, and then select the application window of word 3. In addition, in the screen projection mode, for one screen projection sending end, each screen projection is still performed on one application window of one application.

In order to solve the technical problems, the application provides the following technical concepts: and splitting a large screen at the screen projection receiving end into a plurality of display windows, wherein each display window is used for displaying the display content of one application window. A user can select a plurality of application windows which are currently running at a screen projection sending end, wherein the application windows can be different application windows of the same application or application windows of different applications; the screen-casting sending terminal acquires the display contents of a plurality of application windows currently running according to the selection of a user and sends the display contents to the screen-casting receiving terminal; the screen-casting receiving end receives the display contents of a plurality of currently running application windows selected by a user, and displays the display contents of one application window in one display window of the screen-casting receiving end. Therefore, the multiple application windows on one screen projection sending end are synchronously displayed on the large screen of the screen projection receiving end, and the operation is simple.

The screen projection method provided by the application is described in detail in specific embodiments by combining the drawings. The following specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.

The screen projection method provided by the embodiment of the present application is described in detail below based on the scenario shown in fig. 1B. In order to facilitate understanding, in the following embodiments, a screen projection method is described with an intelligent interactive tablet as a screen projection receiving end and a mobile device integrated with a wireless screen transmission function as a screen projection sending end.

The hardware part of the intelligent interactive panel is composed of a touch display module, an intelligent processing system (including a controller) and the like, the touch display module is combined together by an integral structural member and is supported by a special software system, the touch display module comprises a display screen, a touch assembly and a backlight assembly, the backlight assembly is used for providing backlight light source for the display screen, the display screen generally adopts a liquid crystal display device and is used for displaying pictures, and the touch assembly is arranged on the display screen or at the front end of the display screen and is used for collecting touch operation data of a user and sending the collected touch operation data to the intelligent processing system for processing.

In actual use, the screen data is displayed on the display screen of the intelligent interactive panel, when a user clicks the content displayed on the display screen through a touch object such as a finger or a touch pen, for example, a graphical button displayed on the display screen is clicked, the touch component of the intelligent interactive panel acquires touch data, the touch component converts the touch data into coordinate data of a touch point and then sends the coordinate data to the intelligent processing system, or the coordinate data is sent to the intelligent processing system and converted into coordinate data of the touch point by the intelligent processing system, after the intelligent processing system obtains the coordinate data of the touch point, corresponding control operation is realized according to a preset program, the display content of the display screen is driven to change, and diversified display and operation effects are realized.

Touch components are distinguished from technical principles and can be divided into five basic categories; a vector pressure sensing technology touch component, a resistance technology touch component, a capacitance technology touch component, an electromagnetic technology touch screen, an infrared technology touch component, and a surface acoustic wave technology touch component. According to the working principle of the touch assembly and the medium for transmitting information, the touch assembly can be divided into four categories: resistive, capacitive, electromagnetic, infrared, and surface acoustic wave.

When a user touches the display screen by a finger or a pen, the touch assembly can acquire data of touch points and send the data to the intelligent processing system, and then different functional applications are realized along with software built in the intelligent processing system, so that touch control of the intelligent processing system is realized.

Fig. 2 is a first interaction diagram of a screen projection method provided in the embodiment of the present application, and as shown in fig. 2, the screen projection method of the embodiment includes the following steps:

in step S201, the removable device displays selection information including a plurality of application windows that are running in response to an operation by a user.

In this embodiment, the operation of the user is an operation for triggering the screen projection function. Optionally, the operation may be a click operation of a button displayed on a display interface of the mobile device and used for waking up the screen projection function, or a voice operation, that is: and the user awakens the screen projection function through voice. Gesture operations are also possible, namely: and the user wakes up the screen projection function through gesture operation. The gesture operation may be a touch gesture operation or an air gesture operation. The present embodiment is not limited herein.

The method and the device for displaying the screen are used for providing selection information of a plurality of application windows currently running on the mobile device for a user, so that the user can select the application window to be screened from the plurality of application windows. The multiple application windows may be different application windows of the same application, or may be application windows of different applications.

In some scenes, a user can screen application windows of different applications such as video software and music software; different application windows of the same application, such as a word application, can also be projected, for example, a word1 currently running on a mobile device, and a plurality of application windows are opened at the same time, because the content of the word1 is more and long, the plurality of application windows can also respectively display the content of different parts of the word1, for example, the plurality of application windows include an application window 1 and an application window 2, the application window 1 is used for displaying the content of part a of the word1, the application window 2 is used for displaying the content of part B of the word1, the content of part a and the content of part B are respectively different contents in the word1, and the application window of the content of part a of the word1 and the application window of the content of part B can be projected at the same time in the embodiment of the application.

In some scenarios, the user may select one application window or may select multiple application windows. And if the user selects one application window for screen projection, the display content of the application window is paved on the display interface of the intelligent interactive panel. The embodiment aims to screen a plurality of application windows selected by a user on the intelligent interaction tablet.

The applications include Application programs (APP) and Application software. An application is a computer program that performs one or more specific tasks, operates in a user mode, can interact with a user, and has a visual user interface. Such as chat software, video class APP, audio class APP, etc. The application software refers to a single executable file or a single program, such as Word, photoshop, photo album, browser.

It should be understood that the application in the embodiment is not limited to the above examples, and any content that can be displayed on the screen-projection sending end can be projected by the method in the embodiment of the present application.

Step S202, the movable device obtains at least two application windows to be screened selected by the user from the multiple application windows, and obtains display contents of the at least two application windows to be screened.

Specifically, the acquiring at least two application windows to be screened selected by a user from the plurality of application windows and the acquiring display contents of the at least two application windows to be screened includes: detecting a trigger event of selecting at least two application windows to be screened from a plurality of application windows by a user; acquiring identifiers of at least two application windows to be screened, which are selected by a user from a plurality of application windows, according to a trigger event; and acquiring the display contents of the at least two application windows to be screened according to the identifications of the at least two application windows to be screened.

In this embodiment, the user may select at least two application windows to be screened from the plurality of application windows through any one of the above-described clicking operation, voice operation, and gesture operation. Furthermore, when the screen projection sending end detects a trigger event that the user selects at least two application windows to be projected, the identifiers of the at least two application windows to be projected can be obtained, and the display contents of the at least two application windows can be obtained according to the identifiers of the at least two application windows to be projected.

In some optional embodiments, the screen-casting sending end stores the display content of the currently displayed application window, and the screen-casting sending end may directly obtain the display content of the currently displayed application window from the local storage and send the display content to the screen-casting receiving end.

In other alternative embodiments, in order to reduce the storage pressure of the mobile device, the display content of the application window currently displayed on the screen-casting sending terminal may also be stored in the server, and then the screen-casting sending terminal may obtain the display content of the currently displayed application window from the server and send the display content to the screen-casting receiving terminal.

Wherein the identification of the application window is information for uniquely characterizing the application window. For different applications, the identification of the application window may be the name of the application; for different windows of the same application, the identifier of the application window may be the name of the application window, for example, for word1 and word2, the identifier may be the names of word1 and word 2; the identifier of the application window may be the name of the application window in case of different windows of the same application, for example, for word1 and word2, the identifier may be the names of word1 and word 2. For another example, for different application windows of word1, different application windows of word1 may be generally named as word1, word1 copy 1, and word1 copy 2 … … in a computer, and if the mobile device opens the three application windows of word1, word1 copy 1, and word1 copy 2, the screen projection sending end obtains display contents of the application windows identified as word1, word1 copy 1, and word1 copy 2, and sends the display contents to the intelligent interactive tablet.

And S203, the mobile device sends the display contents of at least two application windows to be projected to the intelligent interactive tablet.

In some alternative embodiments, the display contents of at least two application windows to be projected can be sequentially sent to the smart interactive tablet. For example, the at least two application windows to be screened include an application window a and an application window B, in this embodiment, the display content of the application window a may be first sent to the intelligent interaction tablet, and then the display content of the application window B may be sent to the intelligent interaction tablet, so that the intelligent interaction tablet displays the display contents of the application window a and the application window B.

In other alternative embodiments, the display contents of at least two application windows to be screened can be simultaneously sent to the smart interactive tablet. For example, the display contents of at least two application windows to be screened may be packaged into one data packet, and the data packet is sent to the intelligent interactive tablet, so that the screen-projecting receiving end displays the display contents of at least two application windows to be screened according to the data packet.

And S204, the intelligent interactive tablet receives the display contents of at least two application windows to be projected, which are sent by the movable equipment.

Corresponding to step S203, this step may be to sequentially receive display contents of at least two application windows to be screened. It is also possible to simultaneously receive the display contents of at least two application windows to be screened.

S205, the intelligent interactive tablet displays the display contents of at least two application windows to be projected in at least two display windows; the display content of one application window to be projected corresponds to one display window.

In this embodiment, the display interface of the intelligent interactive tablet needs to be divided into a plurality of display windows.

Corresponding to step S203, this step may be to sequentially display the display contents of at least two application windows to be screened. For example, at least two application windows to be projected are an application window a and an application window B, respectively, and the projection receiving end may display the display content of the application window a first and then the display content of the application window B. From the user perspective, application window a is seen first, and application window B is seen second.

Corresponding to step S203, the step may also be to display the display contents of at least two application windows to be screened at the same time. For example, at least two application windows to be projected are an application window a and an application window B, respectively, and the projection receiving end displays the display contents of the application window a and the application window B at the same time. From the user's perspective, application window A and application window B appear in the user's field of view simultaneously.

In this embodiment, selection information is displayed by responding to an operation of a user, and the selection information includes a plurality of application windows that are running; acquiring at least two application windows to be screened selected by a user from the plurality of application windows, and acquiring display contents of the at least two application windows to be screened; the display contents of at least two application windows to be projected are sent to a projection receiving end, and the display contents of at least two application windows to be projected are displayed in the at least two display windows; the display content of one application window to be projected corresponds to one display window. Because the selection information comprising the running application windows is provided for the user, the user can select the application windows for screen projection at one time, the repeated operation process that the user needs to project the screen for many times and stop projecting the screen is avoided, the technical effect of projecting the application windows on one screen projection sending end is achieved, and the operation is simple.

On the basis of the above embodiment, in order to facilitate a user to quickly select an application window to be screened from a plurality of running application windows, the embodiment of the application may further present the plurality of running application windows to the user in the form of small windows.

In some scenarios, if a user needs to screen multiple windows of the same application currently running, the user needs to move a cursor to each widget one by one to confirm the display content of the widget and finally determine an application window to be screened. For example, the application currently running is word, which includes word1 and word2, and word1 and word2 are different contents, respectively. The user wants to screen word 1. And limited by the size of the screen of the mobile device, the word1 and the word2 can be displayed below the display interface of the mobile device in the form of a word icon, and when the cursor moves to the word icon, the display contents of the word1 and the word2 can be seen.

Therefore, the present application also proposes the following embodiments: the plurality of application windows currently running are presented to the user in the form of an application list, which includes an identification of the plurality of application windows. In this way, the user can see all currently running application windows without any operation, and can directly make a selection. Of course, to achieve better results, multiple application windows can also be presented simultaneously in the form of a small window and an application list.

In some optional embodiments, the width and height of the application window, as well as the status information, may also be obtained. The state information may include a state of whether to minimize, a state of whether to obtain a focus, and a thumbnail.

For the convenience of the reader's understanding, the following application list is presented in detail by the following table:

for example, a screen-projection button may be disposed on the display interface of the mobile device. The user can select one or more applications in table 1, and then click the screen projection button, so that a plurality of application windows can be projected on the intelligent interactive tablet. Specifically, the application list may be traversed, and for each application selected by the user, the current application window may be found through the handle, and the display content of the current application window may be obtained.

Specifically, the displaying of the selection information includes: displaying a plurality of application windows which are running in a small window form; and/or displaying a list of applications.

Fig. 3 is an exemplary diagram of a presentation manner of selection information provided in an embodiment of the present application. As shown in fig. 3, it can be seen that a plurality of widgets are displayed on the display interface of the movable device, and the user can click on the widgets to select an application window to be screened. In fig. 3, 6 application windows are shown, including application window 1 through application window 6. It should be understood that the present embodiment is not limited to 6 application windows of small windows, and the number of the small windows of the actual application window may be determined according to the size of the large screen and the size of the small window. The present embodiment is not particularly limited herein.

Fig. 4 is an exemplary diagram of another presentation manner of selection information provided in the embodiment of the present application. As shown in fig. 4, it can be seen that an application list is displayed on the display interface of the removable device, and the application list includes identifiers of multiple application windows, such as the names of the application windows, an application name a, an application name B, and an application name C, and an identifier of each application window corresponds to a control. The user may click on the control to select the application window to be screened.

According to the content described in the above embodiments, a user may select multiple application windows to screen, and the display interface of the smart interactive tablet includes multiple display windows, where one display window is used to display the display content of one application window. On this basis, for the smart interactive tablet, it is also necessary to determine a display window for displaying the display content of each application window, that is, to determine a corresponding relationship between the display content of each application window and the display window. How to determine the correspondence between the display content of each application window and the display window is described in detail below based on the scenario shown in fig. 1:

fig. 5 is an interaction diagram of a screen projection method provided in the embodiment of the present application, and as shown in fig. 5, the screen projection method of the embodiment may further include the following steps:

step S501, the mobile device obtains the selection sequence of at least two application windows to be projected by the user.

In this embodiment, the selection sequence of the at least two application windows to be screened by the user may be a click sequence of the at least two application windows to be screened by the user.

Specifically, the mobile device may detect a click event of an identifier of an application window in a small window or an application list of at least two application windows to be screened by a user, acquire time of the click event, and then determine a selection order of the application windows corresponding to the click event according to the time of each click event.

The earlier the time of the click event is, the smaller the selection sequence of the application window corresponding to the click event is, and conversely, the later the time of the click event is, the larger the selection sequence of the application window corresponding to the click event is. It can be understood that the time of the click event is positively correlated with the selection sequence of the application windows corresponding to the click event.

Fig. 6 is an exemplary diagram of a selection sequence of application windows according to an embodiment of the present application. As shown in fig. 6, the user clicks on the application window 1 first and then clicks on the application window 5, the selection order of the application windows 1 may be marked as 1 (indicated by the number 1 in the circle in the figure), and the selection order of the application windows 5 may be marked as 2 (indicated by the number 2 in the circle in the figure).

Step S502, the mobile device sends the selection sequence of the at least two application windows to be projected to the intelligent interactive tablet.

Step S503, the intelligent interactive tablet receives the selection sequence of the at least two application windows to be projected by the user, wherein the selection sequence is sent by the mobile equipment.

Step S504, the intelligent interactive flat panel displays the application windows to be projected corresponding to the selection sequence in the display windows corresponding to the display sequence which is the same as the selection sequence according to the selection sequence of at least two application windows to be projected.

Fig. 7 is an exemplary diagram of a display sequence of application windows according to an embodiment of the present application. As shown in fig. 7, the display interface of the smart interactive tablet includes a display window 1, a display window 2, a display window 3 and a display window 4, where the display window 1 is used to display the display content of the application window with the selection order of 1 (reference numeral 1 shown in a circle), the display window 2 is used to display the display content of the application window with the selection order of 2 (reference numeral 2 shown in a circle), the display window 3 is used to display the display content of the application window with the selection order of 3 (reference numeral 3 shown in a circle), and the display window 4 is used to display the display content of the application window with the selection order of 4 (reference numeral 4 shown in a circle).

After the screen-casting action is completed, the user usually performs interaction on the currently-cast application window on the intelligent interaction panel, and the interaction is currently realized at the intelligent interaction panel end, and synchronous interaction is not realized at the mobile device side. Therefore, in order to synchronize the interaction on the intelligent interaction panel side to the mobile device, the following embodiments may be further proposed in the present application:

fig. 8 is a third interaction diagram of a screen projection method provided in the embodiment of the present application, and as shown in fig. 8, the screen projection method of the embodiment may further include the following steps:

and step S801, the intelligent interactive panel acquires the operation information of the target application window.

The target application window is an application window selected from at least two application windows displayed on the display interface by a user; the operation information includes an identification of the target application window and an operation on the target application window.

In this embodiment, if the user performs a touch operation on a certain application window on the large screen, the state flag of the application window is a touch activation state.

Fig. 9 is a schematic diagram of a target application window in a touch activated state according to an embodiment of the present application. As shown in fig. 9, the display interface includes a display window 1, a display window 2, a display window 3, and a display window 4, and when the user operates the display content on the display window 3, the display window 3 shows a selected state (shown by a thick-line frame in fig. 9).

And S802, the intelligent interactive panel sends the operation information of the target application window to the movable equipment.

In this embodiment, in order not to affect transmission of display content required for screen projection, in this embodiment, the intelligent interactive tablet and the mobile device may establish wireless communication, for example, wifi connection, and send operation information of the target application window to the mobile device through the wireless communication, that is, a transmission channel for screen projection and a wireless communication channel for interaction use different transmission channels, so as to avoid interference.

And S803, the mobile device receives the operation information of the target application window sent by the intelligent interactive tablet.

And step S804, the movable equipment executes corresponding operation on the application window on the screen-casting sending end corresponding to the identifier according to the operation information of the target application window.

Illustratively, the size h1, w1 of the large screen of the smart interaction tablet (e.g., h1=3840, w1= 2160), and the current touch coordinates (x 1, y 1) may be transmitted back to the removable device side.

And the movable device converts the coordinates of the application window corresponding to the movable device end according to the current application window size happ3 and wap 3 (such as happ3=1920, wap 3= 1080):

xapp3＝x1/w1*wapp3；yapp3＝y1/h1*happ3；

and then, simulating a touch event to act on the application window corresponding to the movable equipment end according to the converted coordinates under the application window corresponding to the movable equipment end, thereby realizing the touch feedback function.

In some optional embodiments, at least two application windows on the screen-projecting sending end are displayed in an overlapping manner, and the effect of the overlapping display is shown in fig. 10, where fig. 10 shows an effect schematic diagram of the overlapping display of N currently running application windows. The operation in the present embodiment may include a touch operation.

Specifically, according to the operation information of the target application window, corresponding operations are performed on the application window on the screen projection sending end corresponding to the identifier, and the corresponding operations include: and switching the application window on the screen-casting sending end corresponding to the identifier to the top layer for displaying according to the identifier and the operation of the target application window.

Fig. 11 is a schematic diagram of application switching according to an embodiment of the present application. As shown in the left side of the arrow in fig. 11, the display sequence of the plurality of application windows at the mobile device end is as follows from the top layer to the bottom layer: the application window 1, the application window 2, the application window 3 and the application window 4 are displayed in an overlapping mode. After the user performs a touch operation on the application window 3 at the smart interaction tablet, as shown by the right arrow in fig. 11, the display sequence of the plurality of application windows at the mobile device end sequentially includes from the top layer to the bottom layer: application window 3, application window 1, application window 2 and application window 4, wherein the 4 application windows are still displayed in an overlapped mode, but the display sequence is changed.

On the basis of the above embodiments, the present embodiment may display a screen projection button on the display interface of the mobile device, where the screen projection button is used to provide a screen projection function. After the user selects at least two application windows according to the displayed selection information, the screen projection button can be operated, so that at least two application windows are projected. Specifically, the screen projection button corresponds to a normal screen projection mode, the normal screen projection mode is used for providing a screen projection function for at least two application windows, and if the operation of the user on the normal screen projection button is detected, the display contents of the at least two application windows and the normal screen projection mode are sent to a screen projection receiving end, so that the screen projection receiving end displays the display contents of the at least two application windows to be projected according to the normal screen projection mode. After the screen projection of at least two application windows is realized based on the screen projection button, a user may further need to continue to project other application windows, and the specific implementation manner for this case is as follows:

fig. 12 is a fourth interaction diagram of a screen projection method according to an embodiment of the present application.

In this embodiment, when the user needs to continue to add another application window to be screened after the application program is currently screened, as shown in fig. 12, the screen-screening method further includes:

and step S1201, displaying a screen continuous projection button.

The continuous screen projection mode is used for providing a function of continuously projecting other application windows under the condition that at least two application windows are already projected.

Step S1202, if it is detected that the user continues to select the operation of the at least one application window to be added from the multiple application windows in operation and operates the continuous screen-casting button, sending the display content of the at least one application window and the continuous screen-casting mode to the screen-casting receiving end, so that the screen-casting receiving end displays the display content of the at least one application window to be added according to the continuous screen-casting mode.

Step S1203, receiving display contents of at least one application window to be added and a continuous screen projection mode, wherein the display contents are sent by the intelligent interactive tablet;

step S1204, according to the display content of at least two application windows to be projected and the continuous projection mode, the display content of at least two application windows to be projected and the display content of at least one application window to be added are displayed in the at least two display windows.

In this embodiment, a continuous screen-casting mode is provided for a situation where a user wants to continue to add an application window to be cast after the user casts an application program.

And the continuous screen projection mode is used for enabling a user to continuously select the application window to be projected on the basis of the application window which is projected at present, and simultaneously displaying the continuously selected application window to be projected on the display interface of the intelligent interaction panel and the application window which is projected at present. For example, after the user selects an application window to be projected for screen projection, there may be a need to project other application windows, and the user may implement the need by continuing the screen projection mode. The following description of the continuous projection mode is made by way of example with reference to the accompanying drawings:

fig. 13A is a schematic view of a display effect in a continuous screen projection mode according to an embodiment of the present application. As shown in fig. 13A, the display window may be divided into a display window 1, a display window 2, a display window 3, and a display window 4, where a user first selects the application window 1, the application window 2, and the application window 3 for screen projection, and in a meeting process, the user needs to screen project the application window 4, and the user wants to display the application window 4 together with the application window 1, the application window 2, and the application window 3. Therefore, the user can continue to select the application window 4 in the continuous screen projection mode, and the display contents of the application windows 1 to 4 are simultaneously displayed on the display interface.

In some embodiments, the above-described screen-projection button may also provide a re-screen-projection function. The method specifically comprises the following steps: if the operation of the user on the screen projection button is detected, the mobile equipment sends the display contents of at least two application windows and the normal screen projection mode to a screen projection receiving end; the method comprises the steps that an intelligent interactive panel receives a normal screen projection mode of at least two application windows to be projected, wherein the normal screen projection mode is sent by a mobile device and used for providing a function of projecting at least two application windows; the intelligent interactive panel displays the display contents of the at least two application windows to be projected in the at least two display windows according to the display contents of the at least two application windows to be projected and the normal screen projection mode. The function of the re-projection screen is described below by way of example with reference to the accompanying drawings:

fig. 13B is a schematic view of a display effect of implementing a re-screen projection based on a normal screen projection mode according to an embodiment of the present application. As shown in fig. 13B, in the normal screen projection mode, the user may discard the application window that has been previously projected and perform screen projection again. Still taking the above example as an example, the user first selects the application window 1, the application window 2, the application window 3, and the application window 4 to perform screen projection, and in the process of a meeting, the user needs to perform screen projection on the application window 5 and the application window 6, while the application window 1, the application window 2, the application window 3, and the application window 4 need to stop screen projection. Therefore, the user can select the application window 5 and the application window 6 and click the screen projection button, and the display contents of the application window 5 and the application window 6 are displayed on the display interface.

It will be appreciated that the re-projection mode is essentially a normal projection mode. The implementation process of the re-screen mode can be understood as a repeated execution process of the embodiment shown in fig. 2. Thus, a re-screen button may not be separately provided, and the re-screen function may be implemented based on the screen button.

Fig. 14 is a flowchart of a screen projection method provided in the embodiment of the present application, and as shown in fig. 14, the screen projection method of the embodiment may further include the following steps:

step S1401, the number of application windows for screen projection is determined.

In this embodiment, the application windows for screen projection include at least two application windows to be screen projected, or include at least two application windows to be screen projected and at least one application window to be added.

The number of the application windows for screen projection can be determined according to the received identification of the application windows for screen projection. For example, if the identification of the application window for screen projection includes the identification of two application windows, the number of application windows for screen projection is determined to be 2.

Step S1402, determining the number of display windows according to the number of application windows for screen projection; wherein the number of display windows is greater than or equal to the number of application windows for screen projection.

For the case where the application window for projection includes at least two application windows to be projected, there may be two different embodiments as follows:

in an alternative embodiment, the number of display windows is equal to the number of application windows used for screen projection. On the basis of the embodiment, for the continuous screen projection mode, the number of the display windows can be determined again according to the application window which is currently projected and at least one application window to be added. And the sum of the number of the application windows which are currently projected to the screen and the number of at least one application window to be added is equal to the number of the display windows.

In another optional embodiment, on the basis of ensuring that the display content of each display window is clear, if the number of application windows for screen projection is small and the sum of the sizes of the application windows for screen projection is smaller than the size of the display interface, the number of the display windows may also be larger than the number of the application windows for screen projection. That is, the sum of the number of application windows currently being screened and the number of at least one application window to be added is greater than the number of display windows. On the basis of the implementation mode, for the continuous screen projection mode, at least one application window to be added can be directly displayed in the blank display window until the at least one application window to be added is projected on the screen, or the number of the blank display windows is 0, and then the number of the at least one application window to be added is smaller than or equal to the number of the blank display windows in the display windows.

And step S1403, dividing the display interface into a corresponding number of display windows according to the determined number of display windows.

In this embodiment, the display interface may be further divided according to the number of the display windows and the display type of the application window. The display types of the application window comprise a horizontal screen display and a vertical screen display.

Fig. 15A is a schematic diagram illustrating a display interface according to an embodiment of the present disclosure. As shown in fig. 15A, if all 4 application windows in the drawing are displayed on a horizontal screen, the display interface may be divided sequentially from top to bottom. Of course, the display interface may be divided as shown in fig. 7.

Fig. 15B is a schematic diagram illustrating division of another display interface according to an embodiment of the present application. As shown in fig. 15A, if all 4 application windows in the drawing are displayed in a vertical screen, the display interface may be sequentially divided from left to right in the drawing.

Fig. 15C is a schematic diagram illustrating division of another display interface provided in the embodiment of the present application. As shown in fig. 15C, the 5 application windows in the drawing may adopt a mixed display mode, where the mixed display means that the display interface may be divided into a horizontal screen display window and a vertical screen display window, where the horizontal screen display window is used to display the application window of the horizontal screen, and the vertical screen display window is used to display the application window of the vertical screen.

Of course, the three dividing manners are exemplary illustrations and do not limit the present application, and those skilled in the art can reasonably divide the display interface according to actual requirements.

In other optional scenes, a preset number of display windows can be set according to the definition requirement of the display content of each display window and the size of the display interface of the intelligent interactive tablet, and the number of the application windows to be screened selected by the user is smaller than or equal to the preset number of the display windows. The preset number is the maximum number of the display windows which can be obtained by dividing on the basis that the definition of each display window meets the preset definition according to the size of the display interface of the intelligent interactive panel. Optionally, a prompt message may be generated according to a preset number of display windows to prompt a user of the maximum number of application windows to be screened, so as to avoid a problem that the screen cannot be screened completely due to an excessive number of application windows to be screened selected by the user.

On the basis of the foregoing screen projection method embodiment, fig. 16 is a schematic structural diagram of a screen projection transmitting device provided in an embodiment of the present application, and as shown in fig. 16, in the screen projection transmitting device of the present embodiment, the screen projection transmitting device establishes a communication connection with a screen projection receiving device, and the screen projection transmitting device includes: a first display module 1601, a first obtaining module 1602, and a first sending module 1603; a first display module 1601 for displaying selection information in response to a user operation, the selection information including a plurality of application windows being run; a first obtaining module 1602, configured to obtain at least two application windows to be screened, which are selected by a user from multiple application windows, and obtain display contents of the at least two application windows to be screened; the first sending module 1603 is configured to send the display contents of the at least two application windows to be screened to the screen-casting receiving device, so that the screen-casting receiving device displays the display contents of the at least two application windows to be screened.

Optionally, the selection information includes: a widget of the plurality of application windows that are running, and/or an application list, the application list including an identification of the plurality of application windows; the display selection information includes: displaying a plurality of application windows which are running in a small window form; and/or displaying a list of applications.

Optionally, the first obtaining module 1602 is further configured to obtain a selection order of at least two application windows to be screened by the user; the first sending module 1603 is further configured to send the selection sequence of the at least two application windows to be screened to the screen projection receiving device.

Optionally, the apparatus further comprises: the first receiving module 1604 is configured to receive operation information of a target application window, where the operation information includes an identifier and an operation of the target application window, and the target application window is an application window selected by a user from at least two application windows displayed on a display interface of the screen-casting receiving apparatus; an executing module 1605, configured to execute a corresponding operation on the application window on the screen projection sending device corresponding to the identifier according to the operation information of the target application window.

Optionally, at least two application windows on the screen-casting sending end are displayed in a superposition manner; the operation comprises a touch operation; the execution module 1605 specifically includes: and switching the application window on the screen projection sending device corresponding to the identifier to the top layer for displaying according to the identifier and the operation of the target application window.

Optionally, the first obtaining module 1602 is further configured to obtain at least one application window to be added, selected by a user from the multiple application windows, and obtain display content and a selection mode of the at least one application window, where the selection mode includes a continuous screen-casting mode and a screen-re-casting mode; the first sending module 1603 is further configured to send the display content and the selection mode of the at least one application window to the screen projection receiving end.

Optionally, at least two application windows to be subjected to screen projection correspond to a screen projection mode, and the screen projection mode comprises a normal screen projection mode; the first display module 1601 is further configured to display a normal screen projection button, where the normal screen projection button corresponds to a normal screen projection mode, and the normal screen projection mode is used for providing a function of projecting at least two application windows to be projected; the first sending module 1603 is further configured to send the display contents of the at least two application windows to be projected and the normal screen projection mode to a screen projection receiving end under the condition that the operation of the user on the normal screen projection button is detected, so that the screen projection receiving end displays the display contents of the at least two application windows to be projected according to the normal screen projection mode.

Optionally, the screen projection mode further includes a continuous screen projection mode; the first display module 1601 is further configured to display a continuous screen-casting button, where the continuous screen-casting button corresponds to a continuous screen-casting mode, and the continuous screen-casting mode is used to provide a function of continuously casting other application windows when at least two application windows to be cast are cast; the first sending module 1603 is further configured to, if it is detected that the user continues to select the at least one application window to be added from the multiple application windows in operation and operates the continuous screen-casting button, send the display content of the at least one application window to be added and the continuous screen-casting mode to the screen-casting receiving end, so that the screen-casting receiving end displays the display content of the at least one application window to be added according to the continuous screen-casting mode.

On the basis of the foregoing screen projection method embodiment, fig. 17 is a schematic structural diagram of a screen projection receiving device provided in this embodiment, where the screen projection receiving device establishes a communication connection with a screen projection sending device, and a display interface of the screen projection receiving device includes at least two display windows, as shown in fig. 17, the screen projection receiving device of this embodiment includes: a second receiving module 1701, configured to receive display contents of at least two application windows to be screened, which are sent by the screen-casting sending device; a second display module 1702, configured to display, in at least two display windows, display contents of at least two application windows to be screened; the display content of one application window to be projected corresponds to one display window.

Optionally, at least two display windows correspond to a display order; a second receiving module 1701 for receiving a selection sequence of at least two application windows to be projected by a user; the second display module 1702 is further configured to display, according to the selection sequence of the at least two application windows to be screened, the application windows to be screened corresponding to the selection sequence in the display windows corresponding to the display sequence that is the same as the selection sequence.

Optionally, the apparatus further comprises: a second obtaining module 1703 and a second sending module 1704; a second obtaining module 1703, configured to obtain operation information of the target application window; the target application window is an application window selected by at least two application windows displayed on the display interface by the user; the operation information comprises the identification of the target application window and the operation on the target application window; a second sending module 1704, configured to send the operation information of the target application window to the screen-projection sending device.

Optionally, the second receiving module 1701 is further configured to receive display content of at least one application window to be added and a selection mode, where the selection mode includes a continuous screen projection mode and a re-screen projection mode; the second display module 1702 is further configured to display, in the at least two display windows, the at least two application windows to be screened and the display content of the at least one application window to be added according to the display content and the selection mode of the at least one application window.

Optionally, the second receiving module 1701 is further configured to receive display contents of at least two application windows to be screened and a normal screen projecting mode, where the display contents and the normal screen projecting mode are sent by the screen projecting sending end, and the normal screen projecting mode is used to provide a function of projecting the at least two application windows; the second display module 1702 is further configured to display the display contents of the at least two application windows to be screened in the at least two display windows according to the display contents of the at least two application windows to be screened and the normal screen-casting mode.

Optionally, the second receiving module 1701 is further configured to receive display content of at least one application window to be added and a continuous screen projecting mode sent by the screen projecting sending end, where the continuous screen projecting mode is used to provide a function of continuing to project other application windows when at least two application windows to be projected are already projected; the second display module 1702 is further configured to display, in the at least two display windows, the display contents of the at least two application windows to be subjected to screen projection and the display contents of the at least one application window to be added according to the display contents of the at least one application window to be added and the continuous screen projection mode.

Optionally, the screen projection receiving apparatus further includes: a determining module 1705 and a dividing module 1706; a determining module 1705, configured to determine the number of application windows for screen projection; the determining module 1705 is further configured to determine the number of display windows according to the number of application windows used for screen projection; the number of the display windows is larger than or equal to the number of application windows used for screen projection; a dividing module 1706, configured to divide the display interface into a corresponding number of display windows according to the determined number of display windows.

It should be noted that, when the screen projecting transmitting apparatus and the screen projecting receiving apparatus provided in the foregoing embodiments execute the screen projecting method, only the division of the above functional modules is taken as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules, so as to complete all or part of the functions described above. In addition, the embodiments of the screen projection sending device, the screen projection receiving device and the screen projection method provided in the above embodiments belong to the same concept, and details of implementation processes thereof are found in the method embodiments, and are not described herein again.

The above-mentioned serial numbers of the embodiments of the present application are merely for description, and do not represent the advantages and disadvantages of the embodiments.

In this embodiment, selection information is displayed by responding to an operation of a user, and the selection information includes a plurality of application windows that are running; acquiring at least two application windows to be screened selected from a plurality of application windows by a user, and acquiring display contents of the at least two application windows; the display contents of at least two application windows are sent to a screen projection receiving end, and the display contents of at least two application windows to be projected are displayed in the at least two display windows; the display content of one application window to be projected corresponds to one display window. Because the selection information comprising the running application windows is provided for the user, the user can select the application windows for screen projection at one time, the repeated operation process that the user needs to project the screen for many times and stop projecting the screen is avoided, the technical effect of projecting the application windows on one screen projection sending end is achieved, and the operation is simple.

The embodiment of the present application further provides a computer storage medium, where multiple instructions may be stored in the computer storage medium, where the instructions are suitable for being loaded by a processor and being used to execute the method steps executed by the screen projection sending end in the embodiment of the screen projection method, and specific execution processes may refer to specific descriptions of the embodiment of the screen projection method, which are not described herein again. The device in which the storage medium is located may be a removable device.

The embodiment of the present application further provides a computer storage medium, where the computer storage medium may store a plurality of instructions, where the instructions are suitable for being loaded by a processor and executing the method steps executed by the screen projection receiving end in the embodiment of the screen projection method, and a specific execution process may refer to specific descriptions of the embodiment of the screen projection method, which are not described herein again. The device on which the storage medium is located may be a smart interactive tablet.

Fig. 18 is a schematic structural diagram of an electronic device according to an embodiment of the present application. As shown in fig. 18, the electronic device may include: a processor 1801, a memory 1802, and a transceiver 1803.

The processor 1801 executes computer-executable instructions stored in the memory, so that the processor 1801 executes the scheme in the above-described embodiments. The processor 1801 may be a general-purpose processor including a central processing unit CPU, a Network Processor (NP), and the like; but also a digital signal processor DSP, an application specific integrated circuit ASIC, a field programmable gate array FPGA or other programmable logic device, discrete gate or transistor logic, discrete hardware components.

A memory 1802 is coupled to the processor 1801 via the system bus and is configured to communicate with the processor, the memory 1802 being configured to store computer program instructions.

The transceiver 1803 may be used to send messages to the smart interactive tablet or receive messages from the smart interactive tablet.

The system bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The system bus may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus. The transceiver is used to enable communication between the database access device and other computers (e.g., clients, read-write libraries, and read-only libraries). The memory may include Random Access Memory (RAM) and may also include non-volatile memory (non-volatile memory).

Please refer to fig. 19, which provides a schematic structural diagram of an intelligent interactive tablet according to an embodiment of the present application. As shown in fig. 19, the smart interactive tablet may include: at least one processor 1901, at least one network interface 1904, a user interface 1903, a memory 1905, and at least one communication bus 1902.

The communication bus 1902 is used for implementing connection communication among these components.

The user interface 1903 may include a Display screen (Display) and a Camera (Camera), and the optional user interface 1903 may also include a standard wired interface and a wireless interface.

The network interface 1904 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface), among others.

The processor 1901 may include one or more processing cores, among others. The processor 1901 connects various parts throughout the intelligent interaction panel 1900 using various interfaces and lines, and performs various functions of the intelligent interaction panel 1900 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 1905, and calling data stored in the memory 1905. Alternatively, the processor 1901 may be implemented in at least one hardware form of Digital Signal Processing (DSP), field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 1001 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the display screen; the modem is used to handle wireless communications. It is to be understood that the modem may not be integrated into the processor 1901, but may be implemented by a single chip.

The Memory 1905 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 1905 includes a non-transitory computer-readable medium. The memory 1905 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 1905 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described above, and the like; the storage data area may store data and the like referred to in the above respective method embodiments. The memory 1905 may alternatively be at least one memory device located remotely from the processor 1901. As shown in fig. 19, the memory 1905, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and an operating application of the smart interactive tablet.

In the smart interaction tablet 1900 shown in fig. 19, the user interface 1903 is mainly used as an interface for providing input for a user, and acquiring data input by the user; and the processor 1901 may be configured to call the operating application of the smart interactive tablet stored in the memory 1905 and to perform the method steps of the above screen-casting method in particular.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.

Computer-readable media, including both permanent and non-permanent, removable and non-removable media, may implement the information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.

The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art to which the present application pertains. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A screen projection method is characterized by being applied to a screen projection sending end, wherein the screen projection sending end and a screen projection receiving end establish communication connection, and the method comprises the following steps:

displaying selection information in response to a user's operation, the selection information including a plurality of application windows that are running;

acquiring at least two application windows to be screened selected from the multiple application windows by the user, and acquiring display contents of the at least two application windows to be screened;

and sending the display contents of the at least two application windows to be projected to the screen projection receiving end so that the screen projection receiving end displays the display contents of the at least two application windows to be projected.

2. The method of claim 1, wherein the selection information comprises: a widget of the running plurality of application windows, and/or an application list, the application list including an identification of the plurality of application windows;

the display selection information includes:

displaying the running plurality of application windows in the form of small windows;

and/or the presence of a gas in the gas,

and displaying the application list.

3. The method of claim 1, further comprising:

acquiring the selection sequence of the user on at least two application windows to be projected;

and sending the selection sequence of the at least two application windows to be projected to the screen projection receiving end.

4. The method according to any one of claims 1-3, further comprising:

receiving operation information of a target application window, wherein the operation information comprises an identifier and an operation of the target application window, and the target application window is an application window selected from at least two application windows displayed on a display interface of the screen projection receiving end by the user;

and executing corresponding operation on the application window on the screen projection sending end corresponding to the identifier according to the operation information of the target application window.

5. The method of claim 4, wherein at least two application windows on the screen-casting sending end are displayed in an overlapping manner; the operation comprises a touch operation;

the executing corresponding operation on the application window on the screen projection sending end corresponding to the identifier according to the operation information of the target application window comprises the following steps:

and switching the application window on the screen projection sending end corresponding to the identifier to the top layer for displaying according to the identifier and the operation of the target application window.

6. The method according to any one of claims 1-3, wherein the at least two application windows to be projected correspond to a projection mode, the projection mode comprising a normal projection mode, the method further comprising:

displaying a screen projection button, wherein the screen projection button corresponds to the normal screen projection mode, and the normal screen projection mode is used for providing a function of projecting at least two application windows to be projected;

the sending the display contents of the at least two application windows to be projected to the screen projection receiving terminal so that the screen projection receiving terminal displays the display contents of the at least two application windows to be projected includes:

and if the operation of the user on the screen projection button is detected, the display contents of the at least two application windows to be subjected to screen projection and the normal screen projection mode are sent to the screen projection receiving end, so that the screen projection receiving end displays the display contents of the at least two application windows to be subjected to screen projection according to the normal screen projection mode.

7. The method of claim 6, wherein the screen-casting mode further comprises a continued screen-casting mode, the method further comprising:

displaying a continuous screen projection button, wherein the continuous screen projection button corresponds to the continuous screen projection mode, and the continuous screen projection mode is used for providing a function of continuously projecting other application windows under the condition that at least two application windows to be projected are projected;

after the display contents and the normal screen projection modes of the at least two application windows to be projected are sent to the screen projection receiving end, the method further comprises the following steps:

if the operation that the user continues to select at least one application window to be added from the multiple application windows running at present and the operation of the continuous screen projection button are detected, the display content of the at least one application window to be added and the continuous screen projection mode are sent to the screen projection receiving end, so that the screen projection receiving end displays the display content of the at least one application window to be added according to the continuous screen projection mode.

8. A screen projection method is characterized by being applied to a screen projection receiving end, the screen projection receiving end is in communication connection with a screen projection sending end, a display interface of the screen projection receiving end comprises at least two display windows, and the method comprises the following steps:

receiving display contents of at least two application windows to be subjected to screen projection, which are sent by the screen projection sending end;

displaying the display contents of the at least two application windows to be screened in the at least two display windows; the display content of one application window to be projected corresponds to one display window.

9. The method of claim 8, wherein the at least two display windows correspond to a display order, the method further comprising:

receiving a selection sequence of the user for the at least two application windows to be projected;

the displaying contents of the at least two application windows to be projected in the at least two display windows comprises:

and displaying the application windows to be projected corresponding to the selection sequence in the display windows corresponding to the display sequence which is the same as the selection sequence according to the selection sequence of the at least two application windows to be projected.

10. The method according to claim 8 or 9, characterized in that the method further comprises:

acquiring operation information of a target application window; the target application window is an application window selected by a user from at least two application windows displayed on the display interface; the operation information comprises the identification of the target application window and the operation on the target application window;

and sending the operation information of the target application window to the screen projection sending end.

11. The method according to claim 8 or 9, characterized in that the method further comprises:

receiving a normal screen projection mode of the at least two application windows to be projected, which is sent by the screen projection sending end, wherein the normal screen projection mode is used for providing a function of projecting the at least two application windows;

the displaying the display contents of the at least two application windows to be screened in the at least two display windows comprises:

and displaying the display contents of the at least two application windows to be projected in the at least two display windows according to the display contents of the at least two application windows to be projected and a normal screen projection mode.

12. The method of claim 11, wherein after displaying the display contents of the at least two application windows to be screened in the at least two display windows according to the display contents of the at least two application windows to be screened and a normal screen-casting mode, the method further comprises:

receiving display content of at least one application window to be added and a continuous screen projection mode sent by the screen projection sending end, wherein the continuous screen projection mode is used for providing a function of continuously projecting the at least one application window to be added;

and displaying the display contents of the at least two application windows to be subjected to screen projection and the display contents of the at least one application window to be added in the at least two display windows according to the display contents of the at least one application window to be added and a continuous screen projection mode.

13. The method according to any one of claims 8-9, 12, further comprising:

determining the number of application windows for screen projection;

determining the number of the display windows according to the number of the application windows for screen projection; wherein the number of display windows is greater than or equal to the number of application windows for screen projection;

and dividing the display interface into a corresponding number of display windows according to the determined number of the display windows.

14. A screen projection sending device is characterized in that the screen projection sending device is in communication connection with a screen projection receiving device, and the screen projection sending device comprises:

the device comprises a first display module, a second display module and a display module, wherein the first display module is used for responding to the operation of a user and displaying selection information, and the selection information comprises a plurality of application windows which are running;

the first acquisition module is used for acquiring at least two application windows to be screened selected from the multiple application windows by the user and acquiring display contents of the at least two application windows to be screened;

the first sending module is used for sending the display contents of the at least two application windows to be projected to the screen projection receiving device so that the screen projection receiving device can display the display contents of the at least two application windows to be projected.

15. The apparatus of claim 14, wherein the selection information comprises: a widget of the running plurality of application windows, and/or an application list, the application list including an identification of the plurality of application windows;

the first display module specifically includes:

displaying the running application windows in the form of small windows;

and/or the presence of a gas in the atmosphere,

and displaying the application list.

16. The apparatus of claim 14,

the first obtaining module is further configured to obtain a selection order of the user for the at least two application windows to be screened;

the first sending module is further configured to send the selection sequence of the at least two application windows to be screened to the screen-projecting receiving device.

17. The apparatus according to any one of claims 14-16, further comprising:

the first receiving module is used for receiving operation information of a target application window, wherein the operation information comprises identification and operation of the target application window, and the target application window is an application window selected from at least two application windows displayed on a display interface of the screen projection receiving device by the user;

and the execution module is used for executing corresponding operation on the application window on the screen projection sending device corresponding to the identifier according to the operation information of the target application window.

18. The apparatus of claim 17, wherein at least two application windows on the screen-casting transmitting end are displayed in an overlapping manner; the operation comprises a touch operation;

the execution module specifically includes:

and switching the application window on the screen projection sending device corresponding to the identifier to a top layer for displaying according to the identifier and the operation of the target application window.

19. The apparatus according to any one of claims 14-16, wherein at least two application windows to be projected correspond to a projection mode, and the projection mode comprises a normal projection mode;

the first display module is also used for displaying a normal screen projection button, the normal screen projection button corresponds to the normal screen projection mode, and the normal screen projection mode is used for providing a screen projection function for at least two application windows to be projected;

the first sending module is further configured to send the display contents of the at least two application windows to be subjected to screen projection and the normal screen projection mode to the screen projection receiving end under the condition that the user is detected to operate the normal screen projection button, so that the screen projection receiving end displays the display contents of the at least two application windows to be subjected to screen projection according to the normal screen projection mode.

20. The apparatus of claim 19, wherein the screen-projecting mode further comprises a continued screen-projecting mode;

the first display module is further configured to display a continuous screen projection button, the continuous screen projection button corresponds to the continuous screen projection mode, and the continuous screen projection mode is used for providing a function of continuously projecting the screens of other application windows under the condition that at least two application windows to be projected are projected;

the first sending module is further configured to send, if it is detected that the user continues to select the operation of the at least one application window to be added from the multiple application windows that are currently running and operates the continuous screen-casting button, the display content of the at least one application window to be added and the continuous screen-casting mode to the screen-casting receiving end, so that the screen-casting receiving end displays the display content of the at least one application window to be added according to the continuous screen-casting mode.

21. The utility model provides a throw screen receiving arrangement which characterized in that, throw screen receiving arrangement and throw screen sending device and establish communication connection, the display interface that throws screen receiving arrangement includes two at least display windows, throw screen receiving arrangement includes:

the second receiving module is used for receiving the display contents of at least two application windows to be projected, which are sent by the screen projection sending device;

the second display module is used for displaying the display contents of the at least two application windows to be screened in the at least two display windows; the display content of one application window to be projected corresponds to one display window.

22. The apparatus of claim 21, wherein the at least two display windows correspond to a display order;

the second receiving module is used for receiving the selection sequence of the user on the at least two application windows to be projected;

the second display module is further configured to display the application windows to be screened corresponding to the selection sequence in the display windows corresponding to the display sequence that is the same as the selection sequence according to the selection sequence of the at least two application windows to be screened.

23. The apparatus of claim 21 or 22, further comprising:

the second acquisition module is used for acquiring the operation information of the target application window; the target application window is an application window selected from at least two application windows displayed on the display interface by a user; the operation information comprises the identification of the target application window and the operation on the target application window;

and the second sending module is used for sending the operation information of the target application window to the screen projection sending device.

24. The apparatus of claim 21 or 22,

the second receiving module is further configured to receive display contents of the at least two application windows to be subjected to screen projection and a normal screen projection mode, which are sent by the screen projection sending end, where the normal screen projection mode is used to provide a function of projecting the at least two application windows;

the second display module is further configured to display the display contents of the at least two application windows to be subjected to screen projection in the at least two display windows according to the display contents of the at least two application windows to be subjected to screen projection and a normal screen projection mode.

25. The apparatus of claim 24,

the second receiving module is further configured to receive display content of at least one application window to be added and a continuous screen projecting mode, where the display content and the continuous screen projecting mode are sent by the screen projecting sending end, and the continuous screen projecting mode is used to provide a function of continuing to project other application windows on the condition that at least two application windows to be projected are already projected;

the second display module is further configured to display the display contents of the at least two application windows to be subjected to screen projection and the display contents of the at least one application window to be added in the at least two display windows according to the display contents of the at least one application window to be added and a continuous screen projection mode.

26. The apparatus of claim 25, wherein the screen-casting receiving device further comprises: a determining module and a dividing module;

the determining module is used for determining the number of application windows for screen projection;

the determining module is further used for determining the number of the display windows according to the number of the application windows for screen projection; wherein the number of display windows is greater than or equal to the number of application windows for screen projection;

and the dividing module is used for dividing the display interface into a corresponding number of display windows according to the determined number of the display windows.

27. A computer storage medium, characterized in that it stores a plurality of instructions adapted to be loaded by a processor and to perform the method steps according to any of claims 1-7.

28. A computer storage medium, characterized in that it stores a plurality of instructions adapted to be loaded by a processor and to perform the method steps according to any of claims 8-13.

29. An electronic device, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of any of claims 1-7.

30. An intelligent interactive tablet, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of any of claims 8-13.