WO2022242628A1

WO2022242628A1 - Screen casting method, apparatus, and device, and storage medium

Info

Publication number: WO2022242628A1
Application number: PCT/CN2022/093253
Authority: WO
Inventors: 欧阳宇基; 黄升
Original assignee: 广州视源电子科技股份有限公司; 广州视睿电子科技有限公司
Priority date: 2021-05-18
Filing date: 2022-05-17
Publication date: 2022-11-24
Also published as: CN115373558A

Abstract

Embodiments of the present application provide a screen projection method, apparatus, and device, and a storage medium, relating to the technical field of communications. The method is applied to a screen casting sending end, the screen casting sending end establishing a communication connection with a screen casting receiving end. The method comprises: in response to a user operation, displaying selection information comprising multiple currently running application windows; acquiring at least two application windows to be screen cast that are selected by the user from among the multiple application windows, and acquiring display content of the at least two application windows; sending the display content of the at least two application windows to the screen casting receiving end, so that the screen casting receiving end displays the display content of the at least two application windows. The embodiments of the present application can achieve the screen casting of multiple applications or application windows of a screen casting sending end in a single process, and user operation is simple.

Description

Screen projection method, device, equipment and storage medium

This application claims the priority of the Chinese patent application with the application number 202110540798.9 and the title of the invention "screen projection method, device, equipment and storage medium" submitted to the State Intellectual Property Office on May 18, 2021, the entire contents of which are incorporated by reference in this application.

technical field

The present application relates to the communication field, for example, to a screen projection method, device, equipment and storage medium.

Background technique

Screen projection refers to projecting a screen image on a small screen device such as a mobile phone or a computer onto a large screen (as shown in FIG. 1A ), so as to watch the screen image on the large screen.

During the screen mirroring process, users often have the need to mirror multiple applications or multiple application windows to the screen. In related technologies, to screen multiple applications, the user manually finishes the screen projection of the current application on a small-screen device, and then manually selects other applications for screen projection. In addition, if the user needs to mirror multiple application windows of the same application, he still needs to manually end the current mirroring application window on the small screen device, and then manually select other application windows to mirror the screen. In this way, screen projection of multiple applications or application windows is realized.

However, the above-mentioned operation process of multiple applications or application windows is complicated, and one screen projection process is still aimed at one application or application window on one screen projection sending end.

Contents of the invention

The embodiment of the present application provides a screen projection method, device, equipment, and storage medium, which can solve the complex operation process of multiple application screen projection, and one screen projection process is still aimed at one application or application on one screen projection sending end Windows problem. Described technical scheme is as follows:

In the first aspect, the embodiment of the present application provides a screen projection method, which is applied to the screen projection sender, and the screen projection sender establishes a communication connection with the screen projection receiver. The method includes: responding to the user's operation, displaying the selected Information, the selection information includes a plurality of running application windows; obtain at least two application windows to be projected selected by the user from the plurality of application windows, and obtain at least two application windows to be projected The display content of the application window: sending the display content of the at least two application windows to be projected to the screen projection receiving end, so that the screen projection receiving end displays the at least two application windows to be projected on the screen display content.

In the second aspect, the embodiment of the present application provides a method for screen projection, which is applied to the screen projection receiving end. The screen projection receiving end establishes a communication connection with the screen projection sending end, and the display interface of the screen projection receiving end includes at least two Displaying a window, the method includes: receiving the display content of at least two application windows to be projected sent by the screen projection sending end; displaying the at least two application windows to be projected in the at least two display windows display content; wherein, the display content of an application window to be mirrored corresponds to a display window.

In a third aspect, an embodiment of the present application provides a screen projection sending device, which establishes a communication connection with a screen projection receiving device, and the screen projection sending device includes: a first display module, configured to respond to user operation, displaying selection information, the selection information including a plurality of running application windows; a first acquiring module, configured to acquire at least two application windows to be projected selected by the user from the plurality of application windows , and acquire the display content of the at least two application windows to be projected; the first sending module is configured to send the display content of the at least two application windows to be projected to the screen projection receiving device, to making the screen projection receiving device display the display content of the at least two application windows to be screen projection.

In a fourth aspect, an embodiment of the present application provides a screen projection receiving device, the screen projection receiving device establishes a communication connection with the screen projection sending device, the display interface of the screen projection receiving device includes at least two display windows, the The screen projection receiving device includes: a second receiving module, configured to receive the display content of at least two application windows to be screen-projected sent by the screen projection sending device; The display content of at least two application windows to be projected is displayed in ; wherein, the display content of one application window to be projected corresponds to one display window.

In a fifth aspect, an embodiment of the present application provides a computer storage medium, where a plurality of instructions are stored in the computer storage medium, and the instructions are adapted to be loaded by a processor and execute the method steps in the first aspect.

In a sixth aspect, an embodiment of the present application provides a computer storage medium, where a plurality of instructions are stored in the computer storage medium, and the instructions are adapted to be loaded by a processor and execute the method steps in the second aspect.

In a seventh aspect, an embodiment of the present application provides an electronic device, including: a processor and a memory; wherein, the memory stores a computer program, and the computer program is adapted to be loaded and executed by the processor according to the first aspect. Method steps.

In the eighth aspect, the embodiment of the present application provides an intelligent interactive tablet, which may include: a processor and a memory; wherein, the memory stores a computer program, and the computer program is adapted to be loaded by the processor and execute the above-mentioned second Aspect method steps.

In the embodiment of the present application, by responding to the user's operation, the selection information is displayed, and the selection information includes a plurality of running application windows; at least two application windows to be projected selected by the user from the plurality of application windows are acquired, and Acquiring the display content of at least two application windows to be screen casted; sending the display content of at least two application windows to be screen casted to the screen projection receiving end, so that the screen projection receiving end displays the screen to be cast in at least two display windows The display content of at least two application windows on the screen; wherein, the display content of an application window to be mirrored corresponds to a display window. Since the user is provided with selection information including multiple running application windows, the user can select multiple application windows for screencasting at one time, avoiding the repeated operation process of multiple screencasting and stopping screencasting for the user, It realizes the effect of casting multiple applications on a screen projection sender with simple operation.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or related technologies. Obviously, the accompanying drawings in the following description are the For some embodiments of the present invention, those of ordinary skill in the art can also obtain other drawings based on these drawings on the premise of not paying creative efforts.

FIG. 1A is a schematic diagram of a projection screen provided by an embodiment of the present application;

FIG. 1B is a schematic diagram of a scenario of a screen projection method provided in an embodiment of the present application;

FIG. 2 is an interactive diagram 1 of a screen projection method provided by an embodiment of the present application;

FIG. 3 is an example diagram of a presentation manner of selection information provided by an embodiment of the present application;

FIG. 4 is an example diagram of another presentation manner of selection information provided by the embodiment of the present application;

FIG. 5 is an interactive diagram 2 of a screen projection method provided in an embodiment of the present application;

FIG. 6 is an example diagram of the selection sequence of application windows provided by the embodiment of the present application;

FIG. 7 is an example diagram of the display sequence of the application windows provided by the embodiment of the present application;

FIG. 8 is an interactive diagram 3 of a screen projection method provided by an embodiment of the present application;

FIG. 9 is a schematic diagram of a target application window in a touch-activated state provided by an embodiment of the present application;

FIG. 10 is a schematic diagram of the effect of superimposed display of multiple application windows provided by the embodiment of the present application;

FIG. 11 is a schematic diagram of application switching provided by an embodiment of the present application;

FIG. 12 is an interactive diagram 4 of a screen projection method provided by an embodiment of the present application;

FIG. 13A is a schematic diagram of the display effect in the continuous projection mode provided by the embodiment of the present application;

FIG. 13B is a schematic diagram of the display effect in the continuous projection mode provided by the embodiment of the present application;

FIG. 14 is a flow chart of a screen projection method provided by an embodiment of the present application;

FIG. 15A is a schematic diagram of division of a display interface provided by an embodiment of the present application;

FIG. 15B is a schematic division diagram of another display interface provided by the embodiment of the present application;

FIG. 15C is a schematic division diagram of another display interface provided by the embodiment of the present application;

FIG. 16 is a schematic structural diagram of a screen projection sending device provided in an embodiment of the present application;

FIG. 17 is a schematic structural diagram of a screen projection receiving device provided in an embodiment of the present application;

FIG. 18 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

FIG. 19 is a schematic structural diagram of an intelligent interactive tablet provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings.

It should be clear that the described embodiments are some of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence, nor can it be understood that To indicate or imply relative importance. Those of ordinary skill in the art can understand the specific meanings of the above terms in this application according to specific situations. In addition, in the description of the present application, unless otherwise specified, "plurality" means two or more. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character "/" generally indicates that the contextual objects are an "or" relationship.

FIG. 1B is a schematic diagram of a scenario of a screen projection method provided by an embodiment of the present application. As shown in FIG. 1B , the scenario of this embodiment includes a screen projection sender 11 and a screen projection receiver 12 . Wherein, the screen projection sending end 11 and the screen projection receiving end 12 are connected in communication. The screen projection sending end 11 may be a mobile device such as a mobile phone, a computer, or a tablet computer. The screen projection receiver 12 may be a large-screen device such as a TV, an intelligent interactive tablet, or the like. It should be understood that a device with a large screen is relative to a device with a small screen.

The screen projection sender 11 can acquire the display content of the currently running application window on the screen projection sender 11 , and send the display content to the screen projection receiver 12 for synchronous display on the screen projection receiver 12 . Allow users to enjoy the viewing experience of the large screen, thereby enhancing the viewing experience.

After the user casts an application window on the screen-casting sender to the screen-casting receiver, the display content of the application window will be displayed on the large screen of the screen-casting receiver synchronously. Wherein, the application windows for screen projection may be different application windows of the same application (for example, for different word documents), or application windows of different applications (for example, chat software and video software). Afterwards, for different applications, even if the screen projection sender switches to another application, the switched application will not be displayed on the large screen. If the user needs to display multiple applications on a large screen, he needs to switch back and forth between multiple different applications. For example, if the user needs to cast the display content of multiple applications, he needs to cast the screen of application A first, then stop the projection of application A, select application B to cast the screen, stop the projection of application B, and then Select C Application Screencasting..., and repeat the above process multiple times to display multiple applications on the large screen. In this way, the screencasting operation is relatively cumbersome. In addition, for this screen projection method, for a screen projection sender, each screen projection is still an application.

In addition, for different application windows of the same application, if the user needs to display different application windows of the same application on a large screen, he also needs to switch back and forth between multiple different application windows. For example, if the user needs to cast the display content of different words, it is necessary to cast the application window of word1 first, then stop the projection of the application window of word1, then select the application window of word2 to cast the screen, and then stop the application window of word2 Screen projection, and then select word3 application window projection..., the above process is repeated several times, and different application windows of the same application can be displayed on the large screen, which makes the screen projection operation more cumbersome. In addition, in this screen projection method, for a screen projection sender, each screen projection is still an application window of an application.

In view of the above technical problems, the present application proposes the following technical idea: divide the large screen of the screen projection receiver into multiple display windows, and each display window is used to display the display content of an application window. The user can select multiple currently running application windows on the screen projection sending end. The application windows can be different application windows of the same application, or application windows of different applications; the screen projection sending end obtains multiple application windows according to the user's selection. The display content of the currently running application window is sent to the screen projection receiver; the screen projection receiver receives the display content of multiple currently running application windows selected by the user, and receives the display content of an application window on the screen projection displayed in a display window on the terminal. In this way, multiple application windows on a screen projection sender can be displayed synchronously on the large screen of the screen projection receiver, and the operation is simple.

The screen projection method provided by the present application will be described in detail below with several embodiments in conjunction with the accompanying drawings. The following embodiments may be combined with each other, and the same or similar concepts or processes will not be repeated in some embodiments.

Based on the scenario shown in FIG. 1B , the screen projection method provided by the embodiment of the present application will be described in detail below. For ease of understanding, in the following embodiments, the screen projection method is described by using the smart interactive tablet as the screen projection receiver and the mobile device integrated with the wireless screen transfer function as the screen projection sender.

Among them, the hardware part of the intelligent interactive tablet is composed of touch display module, intelligent processing system (including controller), etc. The module includes a display screen, a touch component and a backlight component. The backlight component is used to provide a backlight source for the display screen. The display screen generally uses a liquid crystal display device for displaying images. The touch component is set on the display screen or set At the front end of the display screen, it is used to collect user's touch operation data, and send the collected touch operation data to an intelligent processing system for processing.

In actual use, the display screen of the intelligent interactive tablet displays picture data. When the user clicks the content displayed on the display screen with a touch object such as a finger or a stylus, for example, when clicking a graphic button displayed on the display screen, the intelligent interactive tablet The touch component will collect the touch data, so that the touch component converts the touch data into the coordinate data of the touch point and sends it to the intelligent processing system, or sends it to the intelligent processing system, and the intelligent processing system converts it into a touch point The coordinate data of the point, after the intelligent processing system obtains the coordinate data of the touch point, realizes the corresponding control operation according to the preset program, drives the display content to change, and realizes a variety of display and operation effects.

Touch components can be divided into five basic types based on technical principles: vector pressure sensing technology touch components, resistive technology touch components, capacitive technology touch components, electromagnetic technology touch screens, infrared technology touch components, and surface acoustic wave technology touch components. According to the working principle of the touch component and the medium for transmitting information, the touch component can be divided into four types: resistive, capacitive induction, electromagnetic induction, infrared and surface acoustic wave.

When the user touches the display screen with a finger or a pen, the touch component can collect the data of the touch point and send it to the intelligent processing system, and then implement different functional applications with the built-in software of the intelligent processing system, thereby realizing the control of the intelligent processing system Touch controls.

Fig. 2 is an interactive diagram 1 of a screen projection method provided by the embodiment of the present application. As shown in Fig. 2, the screen projection method of this embodiment includes the following steps:

In step S201, the mobile device displays selection information in response to a user's operation, and the selection information includes a plurality of running application windows.

In this embodiment, the user's operation is an operation for triggering the screen projection function. Optionally, the operation may be a click operation on a button displayed on the display interface of the mobile device for waking up the screen projection function, or a voice operation, that is, the user wakes up the screen projection function by voice. It can also be a gesture operation, that is, the user wakes up the screen mirroring function through a gesture operation. The gesture operation may be a touch gesture operation, or an air gesture operation. This embodiment is not limited here.

Wherein, this embodiment provides the user with selection information of multiple application windows currently running on the mobile device, so that the user can select the application window to be projected from among the multiple application windows. The multiple application windows may be different application windows of the same application, or application windows of different applications.

In some scenarios, users can cast application windows of different applications such as video software and music software; they can also cast different application windows of the same application such as the word application, for example, word1 currently running on a mobile device, Multiple application windows are opened at the same time. Since the content of word1 is relatively large and the length of the text is long, the multiple application windows can also display the contents of different parts of word1 respectively. For example, the multiple application windows include application window 1 And the application window 2, the application window 1 is used to display the content of part A of word1, the application window 2 is used to display the content of part B of word1, the content of part A and the content of part B are different contents in word1 respectively, and the embodiment of the present application can Simultaneously cast the application window of part A content and the application window of part B content of word1.

In some scenarios, the user can select one application window or multiple application windows. If the user selects an application window for screen projection, the display content of the application window will cover the display interface of the smart interactive tablet. This embodiment aims at projecting multiple application windows selected by the user onto the smart interactive tablet.

It should be noted that an application includes an application program (Application, APP) and application software. An application program refers to a computer program that completes one or more specific tasks, runs in user mode, can interact with users, and has a visual user interface. For example, chat software, video apps, audio apps, etc. Application software refers to a single executable file or a single program, such as Word, Photoshop, photo album, browser.

It should be understood that the application in this embodiment is not limited to the above examples, and any content that can be displayed on the screen projection sending end can be projected through the method of the embodiment of the present application.

Step S202, the mobile device acquires at least two application windows to be projected selected by the user from a plurality of application windows, and acquires display content of the at least two application windows to be projected.

In an embodiment, acquiring at least two application windows to be projected selected by the user from a plurality of application windows, and acquiring the display content of the at least two application windows to be projected includes: detecting that the user chooses from multiple application windows Select the trigger event of at least two application windows to be casted; according to the trigger event, obtain the identifiers of at least two application windows to be cast selected by the user from multiple application windows; according to the at least two application windows to be cast The identifier of the window is used to obtain the display content of at least two application windows to be mirrored.

In this embodiment, the user can select at least two application windows to be projected from multiple application windows through any one of the above-mentioned click operation, voice operation, and gesture operation. Furthermore, when the screen projection sending end detects the trigger event that the user selects at least two application windows to be screen-casted, it will obtain the identifiers of the at least two application windows to be screen-casted, and according to the at least two application windows to be screen-casted identify, and acquire the display content of the at least two application windows.

In some optional implementation manners, the display content of the currently displayed application window is stored in the screen projection sending end, then the screen projection sending end can directly obtain the display content of the currently displayed application window from the local storage, and send it to the projection screen. screen receiver.

In some other optional implementations, in order to reduce the storage pressure of the mobile device, the display content of the currently displayed application window on the screen projection sending end can also be stored in the server, and then the screen projection sending end can obtain the currently displayed application window from the server. The displayed content of the application window and send it to the receiving end of the screen projection.

Wherein, the identifier of the application window is information used to uniquely characterize the application window. For different applications, the identifier of the application window can be the name of the application; for different windows of the same application, the identifier of the application window can be the name of the application window, for example, for word1 and word2, the identifiers can be word1 and Name of word2; for different windows of the same application, the identifier of the application window may be the name of the application window, for example, for word1 and word2, the identifier may be the naming of word1 and word2. For another example, for different application windows of word1, the different application windows of word1 can usually be named word1, word1 copy 1, word1 copy 2... in the computer, then if the mobile device opens word1, word1 copy 1, word1 For the three application windows of copy 2, the screen projection sender obtains the display content of the application windows identified as word1, word1 copy 1, and word1 copy 2, and sends them to the smart interactive tablet.

Step S203, the mobile device sends the display content of at least two application windows to be projected to the smart interactive tablet.

In some optional implementation manners, the display contents of at least two application windows to be projected may be sequentially sent to the smart interactive tablet. For example, if at least two application windows to be projected include application window A and application window B, then in this embodiment, the display content of application window A may be sent to the smart interactive tablet first, and then the display content of application window B may be sent to The smart interactive tablet, so that the smart interactive tablet displays the display content of the application window A and the application window B.

In some other optional implementation manners, it is also possible to simultaneously send the display contents of at least two application windows to be projected to the smart interactive tablet. For example, the display contents of at least two application windows to be projected can be packaged into a data packet, and the data packet is sent to the smart interactive panel, so that the receiving end of the screen projection can display at least two application windows to be projected according to the data packet. The display content of each application window.

Step S204, the smart interactive tablet receives the display content of at least two application windows to be projected from the mobile device.

Corresponding to step S203, this step may be to sequentially receive display contents of at least two application windows to be mirrored. It is also possible to simultaneously receive display contents of at least two application windows to be projected.

Step S205 , the smart interactive tablet displays the display content of at least two application windows to be projected in at least two display windows; wherein, the display content of one application window to be projected corresponds to one display window.

In this embodiment, the display interface of the intelligent interactive tablet needs to be divided into multiple display windows.

Corresponding to step S203, this step may be to sequentially display the display contents of at least two application windows to be mirrored. For example, at least two application windows to be projected are application window A and application window B respectively, then the screen projection receiving end can display the display content of application window A first, and then display the display content of application window B. From the user's point of view, the application window A is seen first, and then the application window B is seen.

Corresponding to step S203, this step may also display the display contents of at least two application windows to be projected at the same time. For example, the at least two application windows to be projected are application window A and application window B respectively, then the screen projection receiving end displays the display content of application window A and application window B at the same time. From the perspective of the user, the application window A and the application window B appear in the user's field of view at the same time.

In this embodiment, the selection information is displayed in response to the user's operation, and the selection information includes a plurality of running application windows; at least two application windows to be projected selected by the user from the plurality of application windows are obtained, and the information to be projected is acquired. The display content of at least two application windows for screen projection; sending the display content of at least two application windows to be screen projection to the screen projection receiver, and displaying the at least two application windows for screen projection in at least two display windows Display content; wherein, the display content of an application window to be mirrored corresponds to a display window. Since the user is provided with selection information including multiple running application windows, the user can select multiple application windows for screencasting at one time, avoiding the repeated operation process of multiple screencasting and stopping screencasting for the user, The technical effect of projecting screens of multiple applications on one screen projection sending end is realized, and the effect of simple operation is achieved.

On the basis of the above-mentioned embodiments, in order to facilitate the user to quickly select the application window to be projected from the multiple running application windows, the embodiment of the present application can also present multiple running application windows in the form of a small window to the user.

In some scenarios, if the user needs to cast multiple windows of the same application that is currently running, the user needs to move the cursor to each small window one by one to confirm the display content of the small window and finally determine the screen to be projected. application window. For example, the currently running application is word, word includes word1 and word2, and word1 and word2 have different contents respectively. The user wants to cast word1 to the screen. However, limited by the screen size of the mobile device, word1 and word2 will be displayed in the form of a word icon at the bottom of the display interface of the mobile device. When the cursor moves to the word icon, the displayed content of word1 and word2 can be seen.

Therefore, the present application also proposes the following implementation manner: multiple currently running application windows are presented to the user in the form of an application list, and the application list includes identifications of the multiple application windows. In this way, the user can see all currently running application windows without any operation, and thus can directly select them. Of course, in order to achieve a better effect, multiple application windows may also be presented simultaneously in the form of small windows and application lists.

In some optional implementation manners, the width and height of the application window and status information may also be acquired. Wherein, the status information may include whether it is minimized, whether it is focused, and a thumbnail.

For the convenience of readers, the following table introduces the application list in detail:

Exemplarily, a screen projection button may be set on the display interface of the mobile device. The user can select one or more applications in Table 1, and then click the projection button to project multiple application windows to the smart interactive tablet. In an embodiment, the application list can be traversed, and for each application selected by the user, the current application window can be found through the handle, and the display content of the current application window can be obtained.

In an embodiment, displaying the selection information includes: displaying multiple running application windows in the form of small windows; and/or displaying an application list.

FIG. 3 is an example diagram of a presentation manner of selection information provided by the embodiment of the present application. As shown in FIG. 3 , it can be seen that multiple small windows are displayed on the display interface of the mobile device, and the user can click on the small windows to select an application window to be projected. FIG. 3 shows six application windows, including application window 1 to application window 6 . It should be understood that this embodiment is not limited to 6 small windows of application windows, and the actual number of small windows of application windows may be determined according to the size of the large screen and the size of the small windows. This embodiment is not specifically limited here.

FIG. 4 is an example diagram of another presentation manner of selection information provided by the embodiment of the present application. As shown in FIG. 4, it can be seen that an application list is displayed on the display interface of the mobile device, and the application list includes identifications of multiple application windows, such as the names of each application window, application name A, application name B and application name C, each application window ID corresponds to a control. The user can click this control to select the application window to be mirrored.

According to the contents introduced in the above embodiments, it can be known that the user can select multiple application windows for screen projection, and the display interface of the smart interactive tablet includes multiple display windows, and one display window is used to display the display content of one application window. On this basis, for the intelligent interactive tablet, it is also necessary to determine the display window for displaying the display content of each application window, that is, to determine the correspondence between the display content of each application window and the display window. Based on the scenario shown in Figure 1, how to determine the corresponding relationship between the display content of each application window and the display window is described in detail below:

Fig. 5 is an interactive diagram 2 of a screen projection method provided by the embodiment of the present application. As shown in Fig. 5, the screen projection method of this embodiment may also include the following steps:

In step S501, the mobile device obtains the user's selection order of at least two application windows to be mirrored.

In this embodiment, the order in which the user selects the at least two application windows to be projected may be the order in which the user clicks on the at least two application windows to be projected.

In an embodiment, the mobile device can detect a click event of the user's identification of the at least two application windows to be projected on the small windows of the application windows or the application windows in the application list, and obtain the time of the click event, and then, according to each click The time of the event determines the selection order of the application windows corresponding to the click event.

Wherein, the earlier the time of the click event is, the smaller the selection order of the application windows corresponding to the click event is, conversely, the later the time of the click event is, the greater the selection order of the application windows corresponding to the click event is. It can be understood that the time of the click event is positively related to the selection order of the application windows corresponding to the click event.

FIG. 6 is an example diagram of the selection order of application windows provided by the embodiment of the present application. As shown in Figure 6, the user first clicks the application window 1, and then clicks the application window 5, then the selection order of the application window 1 can be marked as 1 (shown by the number 1 in the circle in the figure), and the selection order of the application window 5 Can be marked as 2 (shown by the number 2 circled in the figure).

Step S502, the mobile device sends the selection order of at least two application windows to be projected to the smart interactive tablet.

Step S503 , the smart interactive tablet receives the user's selection sequence of at least two application windows to be projected from the mobile device.

Step S504 , the smart interactive tablet displays the application windows to be projected corresponding to the selection sequence in the display window corresponding to the same display sequence as the selection sequence according to the selection sequence of at least two application windows to be projected.

FIG. 7 is an example diagram of a display sequence of application windows provided by an embodiment of the present application. As shown in Figure 7, the display interface of the intelligent interactive flat panel includes a display window 1, a display window 2, a display window 3, and a display window 4, and then the display window 1 is used to display the selection order of 1 (label 1 shown in the circle). The display content of the application window, the display window 2 is used to display the display content of the application window whose selection order is 2 (label 2 shown in the circle), and the display window 3 is used to display the display content of the application window whose selection order is 3 (label 3 shown in the circle). ), the display window 4 is used to display the display content of the application window whose selection order is 4 (label 4 shown in the circle).

After the screen-casting action is completed, the user usually interacts with the current screen-casting application window on the smart interactive tablet. In related technologies, this interaction is realized on the smart interactive tablet side, but not on the mobile device side. Synchronized interactions. Therefore, in order to enable the interaction on the side of the smart interactive tablet to be synchronized to the mobile device, this application can also propose the following embodiments:

Fig. 8 is an interactive diagram 3 of a screen projection method provided by the embodiment of the present application. As shown in Fig. 8, the screen projection method of this embodiment may also include the following steps:

Step S801, the smart interactive tablet acquires the operation information of the target application window.

Wherein, the target application window is an application window selected by the user from at least two application windows displayed on the display interface; the operation information includes the identification of the target application window and the operation on the target application window.

In this embodiment, if the user performs a touch operation on a certain application window on the large screen, the state of the application window is marked as a touch-activated state.

FIG. 9 is a schematic diagram of a target application window in a touch-activated state provided by an embodiment of the present application. As shown in Figure 9, the display interface includes a display window 1, a display window 2, a display window 3 and a display window 4, if the user operates the display content on the display window 3, then the display window 3 displays the selected state (Fig. 9 shown in bold outline).

Step S802, the smart interactive tablet sends the operation information of the target application window to the mobile device.

In this embodiment, in order not to affect the transmission of the display content required for screen projection, in this embodiment, the smart interactive tablet and the mobile device can establish wireless communication, such as a wifi connection, and send the operation information of the target application window through wireless communication To the mobile device, that is, the transmission channel for screen projection and the wireless communication channel for interaction use different transmission channels to avoid interference.

Step S803, the mobile device receives the operation information of the target application window sent by the smart interactive tablet.

Step S804, the mobile device performs corresponding operations on the application window on the screen projection sending end corresponding to the identifier according to the operation information of the target application window.

Exemplarily, the dimensions h1 and w1 (such as h1=3840, w1=2160) of the large screen of the smart interactive tablet and the current touch coordinates (x1, y1) may be sent back to the mobile device.

The mobile device converts the coordinates under the corresponding application window of the mobile device according to the current application window size happ3 and wapp3 (such as happ3=1920, wapp3=1080):

xapp3=x1/w1*wapp3; yapp3=y1/h1*happ3;

Afterwards, according to the converted coordinates under the application window corresponding to the mobile device, it is simulated that a touch event acts on the application window corresponding to the mobile device, thereby realizing the touch return function.

In some optional implementation manners, at least two application windows on the screen projection sending end are superimposed and displayed, and the superimposed display effect is shown in FIG. 10 , which shows the superimposed display of currently running N application windows. Effect diagram. The operations in this embodiment may include touch operations.

In an embodiment, according to the operation information of the target application window, performing a corresponding operation on the application window on the screen projection sending end corresponding to the identification, including: according to the identification and operation of the target application window, performing the corresponding operation on the screen projection corresponding to the identification The application window on the sender is switched to the top layer for display.

FIG. 11 is a schematic diagram of application switching provided by the embodiment of the present application. As shown on the left side of the arrow in Figure 11, the display order of multiple application windows on the mobile device is from the top layer to the bottom layer: application window 1, application window 2, application window 3, and application window 4, and the four application windows are superimposed show. After the user touches the application window 3 on the smart interactive tablet, as shown on the right side of the arrow in Figure 11, the display order of multiple application windows on the mobile device is from top to bottom: application window 3, application window 1 , application window 2, and application window 4, the four application windows are still superimposed and displayed, but the display order has changed.

Based on the foregoing embodiments, in this embodiment, a screen projection button may be displayed on the display interface of the mobile device, and the screen projection button is used to provide a screen projection function. After the user selects at least two application windows according to the displayed selection information, the user may operate the screen projection button, so as to perform screen projection of the at least two application windows. In an embodiment, the screen projection button corresponds to a normal screen projection mode, and the normal screen projection mode is used to provide the function of projecting at least two application windows, and if the user's operation on the normal screen projection button is detected, then The display content of at least two application windows and the normal screen projection mode are sent to the screen projection receiving end, so that the screen projection receiving end displays the display content of at least two application windows to be screen projection according to the normal screen projection mode. After the projection of at least two application windows is realized based on the projection button, the user may still need to continue projection of other application windows. In an embodiment, the implementation of this situation is as follows:

FIG. 12 is an interactive diagram 4 of a screen projection method provided by an embodiment of the present application.

In one embodiment, when the user needs to continue to add other application windows to be screened after the user has currently screencasted the application, as shown in FIG. 12 , the screencasting method includes:

Step S1201, displaying a screen projection continue button.

Wherein, the continue projection button corresponds to the continue projection mode, and the continue projection mode is used to provide a function of continuing to project other application windows when at least two application windows have been projected.

Step S1202, if it is detected that the user continues to select at least one application window to be added from among the multiple running application windows, and the user operates the continue projection screen button, the display content of at least one application window and the continuous projection screen The mode is sent to the screen projection receiving end, so that the screen projection receiving end displays the display content of at least one application window to be added according to the continuous screen projection mode.

Step S1203, receiving the display content of at least one application window to be added and the continuation of screen projection mode sent by the smart interactive tablet;

Step S1204, according to the display content of the at least two application windows to be projected and the continuous screen projection mode, display the display contents of the at least two application windows to be projected in at least two display windows, and at least one application to be added The display content of the window.

In this embodiment, aiming at the situation where the user wants to continue to add application windows to be screen-casted after the application program has been screen-casted, a continuous screen-casting mode is proposed.

Among them, the continuous projection mode is used to enable the user to continue to select the application window to be projected on the basis of the currently projected application window, and to combine the continuously selected application window to be projected with the currently projected application window Simultaneously displayed on the display interface of the intelligent interactive tablet. For example, after the user selects the application window to be projected, there may be a need to project other application windows, and the user can realize this requirement by continuing the screen projection mode. The following is an introduction to the continuous screen projection mode through examples combined with the attached drawings:

FIG. 13A is a schematic diagram of a display effect in the continuous screen projection mode provided by the embodiment of the present application. As shown in Figure 13A, the display window can be divided into display window 1, display window 2, display window 3, and display window 4. The user first selects application window 1, application window 2, and application window 3 for screen projection. , the user needs to mirror the application window 4, and the user wants to display the application window 4, application window 1, application window 2, and application window 3 at the same time. Therefore, the user can continue to select the application window 4 in the continuous screen projection mode, and the display contents of the application window 1 to the application window 4 are simultaneously displayed on the display interface.

In some embodiments, the screen projection button described above may also provide a screen re-projection function. In one embodiment, it includes: if the operation of the screen projection button by the user is detected, the mobile device sends the display content of at least two application windows and the normal screen projection mode to the screen projection receiving end; The normal screen projection mode of at least two application windows to be screencast sent by the device. The normal screen projection mode is used to provide the function of screen projection of at least two application windows; The display content of the window and the normal screen projection mode, display the display content of at least two application windows to be screen projection in at least two display windows. Let’s introduce the function of re-projecting the screen through examples combined with the accompanying drawings:

FIG. 13B is a schematic diagram of a display effect of re-casting a screen based on a normal screen-casting mode provided by an embodiment of the present application. As shown in FIG. 13B , in the normal screen projection mode, the user can discard the application window that has been screen projection before, and perform screen projection again. Still taking the above example as an example, the user first selects application window 1, application window 2, application window 3, and application window 4 for screen projection. During the conference, the user needs to screen application window 5 and application window 6. , while application window 1, application window 2, application window 3 and application window 4 need to stop screen projection. Therefore, the user can select the application window 5 and the application window 6, and click the screen projection button, and the display content of the application window 5 and the application window 6 will be displayed on the display interface.

It can be understood that the screen re-projection mode is essentially a normal screen projection mode. The implementation process of the screen re-projection mode may be understood as a repeated execution process of the embodiment shown in FIG. 2 . Therefore, a screen re-projection button may not be provided separately, and the screen re-projection function may be realized based on the screen projection button.

Fig. 14 is a flow chart of a screen projection method provided by the embodiment of the present application. As shown in Fig. 14, the screen projection method of this embodiment may also include the following steps:

Step S1401. Determine the number of application windows used for screen projection.

In this embodiment, the application windows for screen projection include at least two application windows to be screen projection, or include at least two application windows to be screen projection and at least one application window to be added.

Wherein, the number of application windows used for screen projection may be determined according to the received identifiers of application windows used for screen projection. For example, if the identifiers of the application windows used for screen projection include identifiers of two application windows, it is determined that the number of application windows used for screen projection is two.

Step S1402. Determine the number of display windows according to the number of application windows used for screen projection; wherein, the number of display windows is greater than or equal to the number of application windows used for screen projection.

For the case where the application window for screen projection includes at least two application windows to be screen projection, the following two different implementation manners are possible:

In an optional implementation manner, the number of display windows is equal to the number of application windows used for screen projection. On the basis of this embodiment, for the continuous screen projection mode, the number of display windows may be determined again according to the current application window for screen projection and at least one application window to be added. Wherein, the sum of the number of application windows that are currently mirroring the screen and the number of at least one application window to be added is equal to the number of display windows.

In another optional implementation manner, on the basis of ensuring that the display content of each display window is clear, if the number of application windows used for screen projection is small, and the sum of the sizes of the application windows used for screen projection smaller than the size of the display interface, the number of display windows may also be greater than the number of application windows used for screen projection. That is, the sum of the number of application windows currently projected to the screen and the number of at least one application window to be added is greater than the number of display windows. On the basis of this embodiment, for the continuous screen projection mode, at least one application window to be added can be directly displayed in a blank display window until at least one application window to be added is all screen projection, or the blank display window If the number is 0, the number of at least one application window to be added is less than or equal to the number of blank display windows in the display window.

Step S1403, according to the determined number of display windows, divide the display interface into a corresponding number of display windows.

In this embodiment, the display interface may also be divided according to the number of display windows and the display types of the application windows. Wherein, the display types of the application window include horizontal screen display and vertical screen display.

FIG. 15A is a schematic division diagram of a display interface provided by an embodiment of the present application. As shown in FIG. 15A , the four application windows in the figure are all displayed in a horizontal screen, so the display interface can be divided sequentially from top to bottom. Of course, the display interface may also be divided according to the manner shown in FIG. 7 above.

FIG. 15B is a schematic division diagram of another display interface provided by the embodiment of the present application. As shown in FIG. 15A , the four application windows in the figure are all displayed on a vertical screen, and the display interface can be divided in order from left to right in the figure.

FIG. 15C is a schematic division diagram of another display interface provided by the embodiment of the present application. As shown in Figure 15C, the five application windows in the figure can be displayed in a mixed display mode. The mixed display means that the display interface can be divided into a horizontal screen display window and a vertical screen display window, wherein the horizontal screen display window is used for horizontal screen display. The vertical screen display window is used to display the vertical screen application window.

Certainly, the above three division methods are illustrative descriptions, and do not limit the present application. Those skilled in the art can reasonably divide the display interface according to actual needs.

In some other optional scenarios, it is also possible to set a preset number of display windows according to the clarity requirements of the display content of each display window and the size of the display interface of the smart interactive tablet, and the application to be screened selected by the user The number of windows is less than or equal to a preset number of display windows. Wherein, the preset number is the maximum number of display windows that can be divided based on the size of the display interface of the intelligent interactive panel and the definition of each display window meeting the preset definition. Optionally, a prompt message may also be generated according to a preset number of display windows to prompt the user to select the maximum number of application windows to be screen-casted, so as to prevent the user from selecting too many application windows to be screen-casted, resulting in The problem of not being able to cast all screens.

On the basis of the above embodiment of the screen projection method, FIG. 16 is a schematic structural diagram of a screen projection sending device provided in the embodiment of the present application. As shown in FIG. 16, the screen projection sending device of this embodiment, the screen projection sending device and The screen projection receiving device establishes a communication connection, and the screen projection sending device includes: a first display module 1601, a first acquisition module 1602, and a first sending module 1603; the first display module 1601 is used to display selection information in response to user operations, The selection information includes a plurality of running application windows; the first obtaining module 1602 is configured to obtain at least two application windows to be projected selected by the user from the plurality of application windows, and obtain at least two applications to be projected The display content of the window; the first sending module 1603, configured to send the display content of at least two application windows to be projected to the screen projection receiving device, so that the screen projection receiving device displays the at least two application windows to be projected Display content.

Optionally, the selection information includes: small windows of multiple running application windows, and/or, an application list, and the application list includes identifications of multiple application windows; displaying the selection information includes: combining multiple running application windows with display in the form of a small window; and/or, display an application list.

Optionally, the first obtaining module 1602 is also used to obtain the user's selection sequence of at least two application windows to be projected; the first sending module 1603 is also used to obtain the selection sequence of at least two application windows to be projected Send it to the screen projection receiving device.

Optionally, the device further includes: a first receiving module 1604, configured to receive the operation information of the target application window, the operation information includes the identification and operation of the target application window, and the target application window is the display interface of the user's screen projection receiving device The selected application window among the at least two displayed application windows; the execution module 1605, configured to perform corresponding operations on the application window on the screen projection sending device corresponding to the identification according to the operation information of the target application window.

Optionally, at least two application windows on the screen projection sending end are superimposed and displayed; the operation includes a touch operation; the execution module 1605 includes: according to the identification and operation of the target application window, the application on the screen projection transmission device corresponding to the identification The window switches to the top level for display.

Optionally, the first acquiring module 1602 is also configured to acquire at least one application window to be added selected by the user from a plurality of application windows, and acquire the display content and selection mode of at least one application window, the selection mode includes continuing screen projection mode and screen re-projection mode; the first sending module 1603 is also configured to send the display content and selection mode of at least one application window to the screen projection receiving end.

Optionally, at least two application windows to be projected correspond to a projection mode, and the projection mode includes a normal projection mode; the first display module 1601 is also used to display a normal projection button, and the normal projection button corresponds to a normal projection Screen mode, the normal screen projection mode is used to provide the function of projecting at least two application windows to be projected; the first sending module 1603 is also used to detect the user’s operation on the normal screen projection button, Sending the display content of the at least two application windows to be cast and the normal screen projection mode to the screen projection receiver, so that the screen projection receiver can display the display content of the at least two application windows to be cast according to the normal screen projection mode.

Optionally, the screen projection mode also includes a screen projection mode; the first display module 1601 is also used to display a screen projection button, and the screen projection button corresponds to the screen projection mode, and the screen projection mode is used to provide In the case of at least two application windows for screen projection, the function of continuing to perform screen projection for other application windows; the first sending module 1603 is also used to continue to select from multiple running application windows if it is detected The operation of at least one application window to be added, and the operation of the screen projection button, will send the display content of the at least one application window to be added and the screen projection mode to the screen projection receiving end, so that the screen projection receiving end according to Continue to display the display content of at least one application window to be added in the screen projection mode.

On the basis of the above embodiment of the screen projection method, FIG. 17 is a schematic structural diagram of a screen projection receiving device provided in the embodiment of the present application. The screen projection receiving device establishes a communication connection with the screen projection sending device. The display of the screen projection receiving device The interface includes at least two display windows. As shown in FIG. 17 , the receiving device for screen projection in this embodiment includes: a second receiving module 1701, configured to receive the display of at least two application windows to be screen-casted sent by the screen-casting sending device Content; the second display module 1702 is configured to display the display content of at least two application windows to be projected in at least two display windows; wherein, the display content of one application window to be projected corresponds to one display window.

Optionally, the at least two display windows correspond to a display order; the second receiving module 1701 is used to receive the user's selection order of at least two application windows to be projected; the second display module 1702 is also used to The selection order of the at least two application windows, and the application windows to be projected corresponding to the selection order are displayed in the display window corresponding to the same display order as the selection order.

Optionally, the device further includes: a second acquiring module 1703 and a second sending module 1704; the second acquiring module 1703 is configured to acquire the operation information of the target application window; the target application window is at least two displayed by the user on the display interface. The application window selected by each application window; the operation information includes the identification of the target application window and the operation on the target application window; the second sending module 1704 is used to send the operation information of the target application window to the screen projection sending device.

Optionally, the second receiving module 1701 is also configured to receive the display content and selection mode of at least one application window to be added, and the selection mode includes the continuous screen projection mode and the screen re-projection mode; the second display module 1702 is also used to According to the display content and the selection mode of the at least one application window, the at least two application windows to be projected and the display content of the at least one application window to be added are displayed in at least two display windows.

Optionally, the second receiving module 1701 is also configured to receive the display content of at least two application windows to be screened and the normal screen projection mode sent by the screen projection sending end, and the normal screen projection mode is used to provide at least two application windows. The function of window projection; the second display module 1702 is also used to display at least two application windows to be projected in at least two display windows according to the display content of at least two application windows to be projected and the normal screen projection mode. The display content of the application window.

Optionally, the second receiving module 1701 is also used to receive the display content of at least one application window to be added and the continuation screen projection mode sent by the screen projection sending end, and the continuation screen projection mode is used to provide In the case of at least two application windows being cast, the function of continuing to cast other application windows; the second display module 1702 is also used to, according to the display content of at least one application window to be added and continue the screen projection mode, in The display content of at least two application windows to be projected and the display content of at least one application window to be added are displayed in the at least two display windows.

Optionally, the screen projection receiving device further includes: a determination module 1705 and a division module 1706; a determination module 1705, configured to determine the number of application windows used for screen projection; a determination module 1705, also configured to The number of windows is to determine the number of display windows; wherein, the number of display windows is greater than or equal to the number of application windows used for screen projection; the dividing module 1706 is used to divide the display interface into corresponding numbers according to the determined number of display windows display window.

It should be noted that when the screen projection sending device and the screen projection receiving device provided in the above-mentioned embodiments execute the screen projection method, only the division of the above-mentioned functional modules is used as an example for illustration. In practical applications, the above-mentioned functions can be allocated according to needs It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the screen projection sending device and screen projection receiving device provided in the above embodiments belong to the same concept as the screen projection method embodiment, and the implementation process thereof is detailed in the method embodiment, and will not be repeated here.

The serial numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

In this embodiment, the selection information is displayed in response to the user's operation, and the selection information includes a plurality of running application windows; at least two application windows to be projected selected by the user from the plurality of application windows are obtained, and at least The display content of two application windows; the display content of at least two application windows is sent to the screen projection receiving end, and the display content of at least two application windows to be projected is displayed in at least two display windows; one of them is to be projected The display content of the application window of the screen corresponds to a display window. Since the user is provided with selection information including multiple running application windows, the user can select multiple application windows for screencasting at one time, avoiding the repeated operation process of multiple screencasting and stopping screencasting for the user, The technical effect of projecting screens of multiple applications on one screen projection sending end is realized, and the effect of simple operation is realized.

The embodiment of the present application also provides a computer storage medium, and the computer storage medium can store a plurality of instructions, and the instructions are suitable for being loaded and executed by a processor. For the method steps and execution process, refer to the description of the embodiment shown in the screen projection method, and details are not described here. The device where the storage medium is located may be a removable device.

The embodiment of the present application also provides a computer storage medium, and the computer storage medium can store a plurality of instructions, and the instructions are suitable for being loaded and executed by a processor. For the method steps and execution process, refer to the description of the embodiment shown in the screen projection method, and details are not described here. The device where the storage medium is located may be an intelligent interactive tablet.

FIG. 18 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. As shown in FIG. 18 , the electronic device may include: a processor 1801 , a memory 1802 and a transceiver 1803 .

The processor 1801 executes the computer-executable instructions stored in the memory, so that the processor 1801 executes the solutions in the foregoing embodiments. The processor 1801 can be a general-purpose processor, including a central processing unit CPU, a network processor (network processor, NP), etc.; it can also be a digital signal processor DSP, an application-specific integrated circuit ASIC, a field programmable gate array FPGA or other programmable Logic devices, discrete gate or transistor logic devices, discrete hardware components.

The memory 1802 is connected to the processor 1801 through the system bus and communicates with each other, and the memory 1802 is used for storing computer program instructions.

The transceiver 1803 can be used to send messages to the smart interactive tablet, or receive messages from the smart interactive tablet.

The system bus may be a peripheral component interconnect standard (peripheral component interconnect, PCI) bus or an extended industry standard architecture (extended industry standard architecture, EISA) bus or the like. The system bus can be divided into address bus, data bus, control bus and so on. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus. Transceivers are used to enable communication between database access devices and other computers such as clients, read-write libraries, and read-only libraries. Memory may include random access memory (RAM) and may also include non-volatile memory.

Please refer to FIG. 19 , which provides a schematic structural diagram of an intelligent interactive tablet according to the embodiment of the present application. As shown in FIG. 19 , the intelligent interactive tablet may include: at least one processor 1901 , at least one network interface 1904 , user interface 1903 , memory 1905 , and at least one communication bus 1902 .

Among them, the communication bus 1902 is used to realize connection and communication between these components.

Wherein, the user interface 1903 may include a display screen (Display) and a camera (Camera), and the optional user interface 1903 may also include a standard wired interface and a wireless interface.

Wherein, the network interface 1904 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).

Wherein, the processor 1901 may include one or more processing cores. The processor 1901 uses various interfaces and lines to connect various parts in the entire intelligent interactive panel 1900, and by running or executing instructions, programs, code sets or instruction sets stored in the memory 1905, and calling data stored in the memory 1905, Execute various functions of the intelligent interactive panel 1900 and process data. Optionally, the processor 1901 may adopt at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). implemented in the form of hardware. The processor 1001 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used to render and draw the content that needs to be displayed on the display screen; the modem is used to handle wireless communication. It can be understood that, the above-mentioned modem may not be integrated into the processor 1901, but implemented by a single chip.

Wherein, the memory 1905 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory). Optionally, the memory 1905 includes a non-transitory computer-readable storage medium (non-transitory computer-readable storage medium). The memory 1905 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 1905 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions and the like for implementing the above method embodiments; the storage data area can store the data and the like involved in the above method embodiments. Optionally, the memory 1905 may also be at least one storage device located away from the aforementioned processor 1901 . As shown in FIG. 19 , the memory 1905 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an operating application program of an intelligent interactive tablet.

In the intelligent interactive tablet 1900 shown in FIG. 19 , the user interface 1903 is mainly used to provide the user with an input interface and obtain the data input by the user; and the processor 1901 can be used to call the operation application of the intelligent interactive tablet stored in the memory 1905 program, and execute the method steps of the above screen projection method.

Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present application is described with reference to flowcharts and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in the flow chart or blocks of the flowchart and/or the block or blocks of the block diagrams.

In one configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

Memory may include non-permanent storage in computer readable media, in the form of random access memory (RAM) and/or nonvolatile memory such as read only memory (ROM) or flash RAM. The memory is an example of a computer readable medium.

Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridge, tape magnetic disk storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media excludes transitory computer-readable media, such as modulated data signals and carrier waves.

It should also be noted that the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes Other elements not expressly listed, or elements inherent in the process, method, commodity, or apparatus are also included. Without further limitations, an element qualified by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising the element.

The above are only examples of the present application, and are not intended to limit the present application. For those skilled in the art, various modifications and changes may occur in this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the scope of the claims of the present application.

Claims

A screen projection method, which is applied to a screen projection sending end, and the screen projection sending end establishes a communication connection with a screen projection receiving end, and the method includes:

In response to a user's operation, display selection information, where the selection information includes a plurality of running application windows;

Acquiring at least two application windows to be projected selected by the user from the plurality of application windows, and obtaining display contents of the at least two application windows to be projected;

Sending the display content of the at least two application windows to be projected to the screen projection receiving end, so that the screen projection receiving end displays the display content of the at least two application windows to be projected.
The method according to claim 1, wherein the selection information includes: small windows of the running multiple application windows, and/or an application list, the application list including the identifications of the multiple application windows ;

The display selection information includes:

displaying the running multiple application windows in the form of small windows;

and / or,

A list of said applications is displayed.
The method according to claim 1, wherein the method further comprises:

Obtaining the user's selection order of the at least two application windows to be projected;

Sending the selection sequence of the at least two application windows to be projected to the screen projecting receiving end.
The method according to any one of claims 1-3, wherein the method further comprises:

receiving operation information of the target application window, the operation information including the identification and operation of the target application window, the target application window being at least two application windows displayed by the user on the display interface of the screen projection receiving terminal The selected application window;

According to the operation information of the target application window, perform a corresponding operation on the application window on the screen projection sending end corresponding to the identifier.
The method according to claim 4, wherein at least two application windows on the screen projection sending end are superimposed and displayed; the operation includes a touch operation;

According to the operation information of the target application window, performing corresponding operations on the application window on the screen projection sending end corresponding to the identification includes:

According to the identification and operation of the target application window, the application window corresponding to the identification on the screen projection sending end is switched to the top layer for display.
The method according to any one of claims 1-3, wherein the at least two application windows to be screen-casted correspond to a screen-casting mode, and the screen-casting mode includes a normal screen-casting mode, and the method further comprises:

Displaying a screen projection button, the screen projection button corresponds to the normal screen projection mode, and the normal screen projection mode is used to provide a function of projecting the at least two application windows to be projected;

The sending the display content of the at least two application windows to be projected to the screen projection receiving end, so that the screen projection receiving end displays the display content of the at least two application windows to be projected, include:

If it is detected that the user operates the screen projection button, the display content of the at least two application windows to be screen projection and the normal screen projection mode are sent to the screen projection receiving end, so that the projection The screen receiving end displays display contents of the at least two application windows to be screen-casted according to the normal screen-casting mode.
The method according to claim 6, wherein the screen projection mode further includes a continuation screen projection mode, and the method further comprises:

Displaying a continue screen projection button, the continue screen projection button corresponds to the continuation screen projection mode, and the continuation screen projection mode is used to provide that when the at least two application windows to be screen projection have been screen projection, The function of continuing to cast other application windows;

After sending the display content of the at least two application windows to be screen-casted and the normal screen-casting mode to the screen-casting receiving end, the method further includes:

If it is detected that the user continues to select at least one application window to be added from the multiple running application windows, and the operation of the continue screen projection button, the at least one application window to be added The display content of the window and the continuous screen projection mode are sent to the screen projection receiving end, so that the screen projection receiving end displays the display content of the at least one application window to be added according to the continuous screen projection mode.
A screen projection method, which is applied to a screen projection receiving end, the screen projection receiving end establishes a communication connection with the screen projection sending end, and the display interface of the screen projection receiving end includes at least two display windows, and the method includes:

receiving the display content of at least two application windows to be screen-cast sent by the screen-casting sending end;

Displaying the display content of the at least two application windows to be projected in the at least two display windows; where the display content of one application window to be projected corresponds to one display window.
The method according to claim 8, wherein the at least two display windows correspond to a display order, the method further comprising:

receiving a user's selection order of the at least two application windows to be projected;

The displaying the display content of the at least two application windows to be projected in the at least two display windows includes:

According to the selection sequence of the at least two application windows to be projected, the application windows to be projected corresponding to the selection sequence are displayed in a display window corresponding to the same display sequence as the selection sequence.
The method according to claim 8 or 9, wherein the method further comprises:

Obtaining operation information of a target application window; the target application window is an application window selected by the user from at least two application windows displayed on the display interface; the operation information includes the identification of the target application window and the The operation of the target application window;

Sending the operation information of the target application window to the screen projection sending end.
The method according to claim 8 or 9, wherein the method further comprises:

Receiving the normal screen projection mode of the at least two application windows to be screen projection sent by the screen projection sending end, the normal screen projection mode is used to provide the function of projecting the at least two application windows;

The displaying the display content of the at least two application windows to be projected in the at least two display windows includes:

According to the display content of the at least two application windows to be projected and the normal screen projection mode, display the display contents of the at least two application windows to be projected in the at least two display windows.
The method according to claim 11, wherein, according to the display content of the at least two application windows to be screen-casted and the normal screen-casting mode, displaying the screen-to-be-cast screen in the at least two display windows After displaying content of at least two application windows, the method further includes:

receiving the display content of the at least one application window to be added and the continuation screen projection mode sent by the screen projection sending end, and the continuation screen projection mode is used to provide the function of continuing to perform screen projection for the at least one application window to be added ;

According to the display content of the at least one application window to be added and the continuous screen projection mode, display the display content of the at least two application windows to be screen projection in the at least two display windows, and the display content of the at least one application window to be added Display content of at least one application window.
The method according to any one of claims 8-9, 12, wherein the method further comprises:

Determine the number of application windows used for screen mirroring;

Determine the number of display windows according to the number of application windows used for screen projection; wherein, the number of display windows is greater than or equal to the number of application windows used for screen projection;

According to the determined number of display windows, the display interface is divided into a corresponding number of display windows.
A screen projection sending device, wherein the screen projection sending device establishes a communication connection with a screen projection receiving device, and the screen projection sending device includes:

A first display module, configured to display selection information in response to user operations, where the selection information includes a plurality of running application windows;

A first obtaining module, configured to obtain at least two application windows to be projected selected by the user from the plurality of application windows, and obtain display contents of the at least two application windows to be projected;

A first sending module, configured to send the display content of the at least two application windows to be projected to the screen projection receiving device, so that the screen projection receiving device displays the at least two applications to be projected. The display content of the window.
The device according to claim 14, wherein the selection information includes: small windows of the running multiple application windows, and/or an application list, the application list including the identifications of the multiple application windows ;

The first display module includes:

displaying the running multiple application windows in the form of small windows;

and / or,

A list of said applications is displayed.
The apparatus of claim 14, wherein,

The first acquiring module is further configured to acquire the user's selection order of the at least two application windows to be projected;

The first sending module is further configured to send the selection order of the at least two application windows to be projected to the screen projecting receiving device.
The device according to any one of claims 14-16, wherein the device further comprises:

The first receiving module is configured to receive the operation information of the target application window, the operation information includes the identification and operation of the target application window, and the target application window is displayed by the user on the display interface of the screen projection receiving device a selected application window among at least two displayed application windows;

An execution module, configured to perform corresponding operations on the application window on the screen projection sending device corresponding to the identifier according to the operation information of the target application window.
The device according to claim 17, wherein at least two application windows on the screen projection sending end are superimposed and displayed; the operation includes a touch operation;

The execution module includes:

According to the identification and operation of the target application window, the application window on the screen projection sending device corresponding to the identification is switched to the top layer for display.
The device according to any one of claims 14-16, wherein the at least two application windows to be screen-casted correspond to screen-casting modes, and the screen-casting mode includes a normal screen-casting mode;

The first display module is also used to display a normal screen projection button, the normal screen projection button corresponds to the normal screen projection mode, and the normal screen projection mode is used to provide the at least two applications to be screen projection The function of mirroring the screen through the window;

The first sending module is further configured to send the display content of the at least two application windows to be screen-casted and the normal screen-casting mode when the user's operation on the normal screen-casting button is detected to the screen projection receiving end, so that the screen projection receiving end displays the display content of at least two application windows to be screen projection according to the normal screen projection mode.
The device according to claim 19, wherein the screen projection mode further includes a continuous screen projection mode;

The first display module is also used to display a button for continuing screen projection, the button for continuing screen projection corresponds to the mode for continuing screen projection, and the mode for continuing screen projection is used to provide the When one application window is mirrored, the function of continuing to mirror other application windows;

The first sending module is further configured to detect that the user continues to select at least one application window to be added from among the multiple running application windows, and the operation of the continue screen projection button, Then, the display content of the at least one application window to be added and the continuous screen projection mode are sent to the screen projection receiving end, so that the screen projection receiving end displays the screen projection to be added according to the continuous screen projection mode. Display content of at least one application window of .
A screen projection receiving device, wherein the screen projection receiving device establishes a communication connection with the screen projection sending device, the display interface of the screen projection receiving device includes at least two display windows, and the screen projection receiving device includes:

The second receiving module is configured to receive the display content of at least two application windows to be projected sent by the screen projecting sending device;

The second display module is configured to display the display content of the at least two application windows to be projected in the at least two display windows; wherein, the display content of one application window to be projected corresponds to one display window.
The device according to claim 21, wherein the at least two display windows correspond to a display order;

The second receiving module is configured to receive a user's selection order of the at least two application windows to be projected;

The second display module is further configured to, according to the selection sequence of at least two application windows to be projected, display the screen to be projected corresponding to the selection sequence in a display window corresponding to the same display sequence as the selection sequence application window.
The device according to claim 21 or 22, wherein the device further comprises:

The second obtaining module is used to obtain the operation information of the target application window; the target application window is an application window selected by the user from at least two application windows displayed on the display interface; the operation information includes the target application Identification of the window and operations on the target application window;

The second sending module is configured to send the operation information of the target application window to the screen projection sending device.
Apparatus according to claim 21 or 22, wherein,

The second receiving module is further configured to receive the display content of the at least two application windows to be projected and the normal screen projection mode sent by the screen projection sending end, and the normal screen projection mode is used to provide the The function of casting screens of at least two application windows;

The second display module is further configured to display at least two of the at least two application windows to be projected in the at least two display windows according to the display content of the at least two application windows to be projected and the normal screen projection mode. The display content of the application window.
The apparatus of claim 24, wherein,

The second receiving module is further configured to receive the display content of at least one application window to be added and the screen-continuing mode sent by the screen-casting sending end, and the screen-continuing mode is used to provide When at least two application windows are being cast, the function of continuing to cast other application windows;

The second display module is further configured to display the at least two application windows to be screen-projected in the at least two display windows according to the display content of the at least one application window to be added and the continuous screen projection mode and the display content of the at least one application window to be added.
The device according to claim 25, wherein the screen projection receiving device further comprises: a determining module and a dividing module;

The determining module is configured to determine the number of application windows used for screen projection;

The determining module is further configured to determine the number of display windows according to the number of application windows used for screen projection; wherein, the number of display windows is greater than or equal to the number of application windows used for screen projection quantity;

The division module is configured to divide the display interface into a corresponding number of display windows according to the determined number of display windows.
A computer storage medium, wherein the computer storage medium stores a plurality of instructions, and the instructions are adapted to be loaded by a processor and execute the method steps according to any one of claims 1-7.
A computer storage medium, wherein the computer storage medium stores a plurality of instructions, and the instructions are adapted to be loaded by a processor and execute the method steps according to any one of claims 8-13.
An electronic device, including: a processor and a memory; wherein the memory stores a computer program, the computer program is adapted to be loaded by the processor and execute the method steps according to any one of claims 1-7 .
An intelligent interactive tablet, which includes: a processor and a memory; wherein, the memory stores a computer program, and the computer program is suitable for being loaded by the processor and executing the method according to any one of claims 8-13 step.