CN117724669A - Screen-throwing display method and electronic equipment - Google Patents

Abstract

The application provides a screen display method and electronic equipment, relates to the technical field of screen display, and can realize that connection between first electronic equipment and second electronic equipment is not required to be disconnected in the process of screen display of the first electronic equipment to the second electronic equipment, and screen display is switched into homologous screen display by heterologous screen display, so that user operation is simplified, and man-machine interaction efficiency is improved. The specific scheme comprises the following steps: the first electronic equipment displays a first screen projection interface, wherein the first screen projection interface comprises a preset functional control and first screen projection content projected by the second electronic equipment, and the first screen projection content is different from the content displayed on the display screen of the second electronic equipment; responding to triggering operation of a preset function control, and sending a switching request and a reverse control instruction to second electronic equipment by first electronic equipment; the first electronic equipment displays a second screen projection interface, the second screen projection interface comprises second screen projection contents projected by the second electronic equipment, and the second screen projection contents are identical to the contents of the second interface.

Description

Screen-throwing display method and electronic equipment

Technical Field

The embodiment of the application relates to the technical field of screen projection, in particular to a screen projection display method and electronic equipment.

Background

With the development of electronic technology and mobile internet, a user may simultaneously have more electronic devices such as a mobile phone, a tablet computer, a personal computer (personal computer, PC), an intelligent home device (such as a television), and the like. The electronic devices of the users can be interconnected for use. For example, a user's mobile phone may be connected to a PC, and the screen content of the mobile phone may be projected for display on the PC to demonstrate the benefits of a large screen.

In the above example, the mobile phone is used to screen the PC. The mobile phone can support two screen throwing modes of heterogeneous screen throwing and homologous screen throwing, in the process that a user uses the mobile phone to throw the heterogeneous screen, if the user wants to switch from the heterogeneous screen throwing to the homologous screen throwing, the user needs to manually disconnect the heterogeneous screen throwing, then uses the mobile phone to establish the connection of the homologous screen throwing with the PC, the operation is complex, and the man-machine interaction efficiency is low.

Disclosure of Invention

The embodiment of the application provides a screen-throwing display method and electronic equipment, wherein in the screen-throwing process of first electronic equipment to second electronic equipment, the connection between the first electronic equipment and the second electronic equipment can be avoided, the screen throwing is quickly switched from a heterologous screen throwing mode to a homologous screen throwing mode, the user operation is simplified, and the man-machine interaction efficiency is improved.

In a first aspect, a method for displaying a projection screen is provided, which is applied to a first electronic device, and includes: the first electronic equipment displays a first screen-throwing interface, wherein the first screen-throwing interface comprises a preset functional control and first screen-throwing content projected by the second electronic equipment, the first screen-throwing content is different from the content displayed on the display screen of the second electronic equipment, namely, the screen-throwing modes of the first electronic equipment and the second electronic equipment are different from each other and the same screen.

The method comprises the steps that first electronic equipment receives triggering operation of a user on a preset function control; responding to the triggering operation, the first electronic equipment sends a switching request to the second electronic equipment and sends a reverse control instruction; the reverse control instruction corresponds to a preset functional control and is used for triggering the second electronic equipment to display a second interface on a display screen of the second electronic equipment.

The first electronic equipment displays a second screen projection interface, the second screen projection interface comprises second screen projection contents projected by the second electronic equipment, and the second screen projection contents are identical to the contents of the second interface, namely the screen projection modes of the first electronic equipment and the second electronic equipment are homologous screen projection.

In summary, by adopting the scheme of the application, since the first screen-throwing interface of the first electronic device is provided with the preset function control, when the triggering operation of the user acts on the preset function control, the screen throwing process of the first electronic device and the second electronic device can be quickly switched from the heterogeneous screen throwing to the homologous screen throwing, so that the user operation is simplified, and the man-machine interaction efficiency is improved.

Optionally, the preset functionality control may be a control at a fixed position in the first screen-drop interface of the first electronic device.

Optionally, the preset function control may be a hover window, hover button, or hover icon displayed on the first screen interface of the first electronic device.

In a possible implementation manner of the first aspect, the first screen projection content is the same as the content drawn on the virtual display of the second electronic device. That is, the second electronic device projects the content drawn on the virtual display onto the first electronic device, so that the first electronic device displays the first screen content on the first screen interface.

In a possible implementation manner of the first aspect, the first screen-projection interface includes a navigation bar, and the navigation bar includes a Home key and a percent key; when the preset function control is a Home key, the reverse control instruction corresponds to the Home key. Thus, after the second electronic device receives the reverse control instruction, the main interface is displayed on the display screen of the second electronic device.

Or when the preset function control is a license key, the reverse control instruction corresponds to the license key. Thus, after the second electronic device receives the reverse control instruction, the main interface is displayed on the display screen of the second electronic device.

Optionally, the navigation bar further includes a Back key; when the preset function control is a Back key, the reverse control instruction corresponds to the Back key. And the first electronic equipment returns to the previous display screen-throwing interface from the current screen-throwing interface.

Optionally, after the triggering operation of the user acts on the preset functional control, the first electronic device may send a switching request to the second electronic device without sending the reverse control instruction. In this way, after the second electronic device receives the switching request, the content of the current interface is drawn on the virtual display, and the content drawn on the virtual display is projected to the first electronic device.

In a possible implementation manner of the first aspect, before the first electronic device sends the reverse control instruction to the second electronic device, the method further includes: the first electronic device receives a notification message from the second electronic device, wherein the notification message is used for indicating the second electronic device to switch from heterogeneous screen projection to homologous screen projection.

In a second aspect, a method for displaying a projection screen is provided, which is applied to a second electronic device, and the method includes: the second electronic equipment sends first screen throwing content to the first electronic equipment, wherein the first screen throwing content is different from the content of the first interface displayed on the display screen of the second electronic equipment, namely, the screen throwing mode of the second electronic equipment and the first electronic equipment is heterogeneous screen throwing.

The second electronic equipment receives a switching request from the first electronic equipment and receives a reverse control instruction from the first electronic equipment; and responding to the reverse control instruction, and displaying a second interface on the display screen by the second electronic equipment.

And responding to the switching request, the second electronic equipment sends second screen-throwing content to the first electronic equipment, wherein the second screen-throwing content is the same as the content of the second interface, namely the screen-throwing mode of the second electronic equipment and the first electronic equipment is homologous screen-throwing.

In summary, by adopting the scheme of the application, after the second electronic device receives the switching request from the first electronic device and receives the reverse control instruction from the first electronic device, the second electronic device firstly displays the second interface on the display screen, and then projects the content of the second interface (i.e. the second screen projection content) to the first electronic device; therefore, in the screen-throwing process of the first electronic equipment and the second electronic equipment, the screen-throwing process can be quickly switched from the heterogeneous screen-throwing process to the homologous screen-throwing process, so that the user operation is simplified, and the man-machine interaction efficiency is improved.

In a possible implementation manner of the second aspect, the sending, by the second electronic device, the first screen content to the first electronic device includes: the second electronic device receives a screen projection request from the first electronic device, wherein the screen projection request is used for requesting the second electronic device to project a screen to the first electronic device.

Responding to a screen throwing request, the second electronic equipment creates a virtual display, and stacks the interface of the target application onto the virtual display for drawing; the configuration information of the virtual display comprises: the screen projection mode corresponding to the virtual display is heterogeneous screen projection, and homologous screen projection is allowed.

And the second electronic equipment sends the first screen projection content to the first electronic equipment based on the content drawn on the virtual display.

In the implementation manner, when the second electronic device creates the virtual display, the corresponding configuration information is set, that is, the screen projection mode of the virtual display is set to be the heterogeneous screen projection mode, and the homologous screen projection is allowed, so that the second electronic device can be switched from the heterogeneous screen projection mode to the homologous screen projection mode.

In a possible implementation manner of the second aspect, after the creating the virtual display by the second electronic device, the method further includes: the second electronic equipment sets a first zone bit, and the first zone bit is used for indicating that the screen-throwing mode of the second electronic equipment and the first electronic equipment is heterogeneous screen throwing.

In a possible implementation manner of the second aspect, after the second electronic device receives the handover request from the first electronic device, the method further includes: the second electronic device moves the content of the interface of the target application drawn on the virtual display to a display screen of the second electronic device; the second electronic equipment modifies the first zone bit into a second zone bit, and the second zone bit is used for indicating that the screen-throwing mode of the second electronic equipment and the first electronic equipment is homologous screen throwing.

In a possible implementation manner of the second aspect, the method further includes: the second electronic device performs a first operation after creating the virtual display; wherein the first operation comprises: the second electronic equipment judges that the virtual display is the display corresponding to the heterogeneous screen according to the identifier of the virtual display; and when the display screen of the second electronic device is locked, the virtual display is not locked, and is used for prohibiting the screen-throwing interface of the first electronic device from being in a screen locking state.

In a possible implementation manner of the second aspect, before the second electronic device receives the reverse control instruction from the first electronic device, the method further includes: the second electronic device sends a notification message to the first electronic device, wherein the notification message is used for indicating the second electronic device to switch from the heterogeneous screen projection to the homologous screen projection.

In a third aspect, a method for displaying a projection screen is provided, which is applied to a system including a first electronic device and a second electronic device, and includes: the first electronic equipment receives first screen throwing content from the second electronic equipment, a first screen throwing interface is displayed, the first screen throwing interface comprises a preset functional control and first screen throwing content, and the first screen throwing content is different from the content of the first interface displayed on the display screen of the second electronic equipment.

The method comprises the steps that first electronic equipment receives triggering operation of a user on a preset function control; and responding to the triggering operation, the first electronic equipment sends a switching request to the second electronic equipment and sends a reverse control instruction, and the reverse control instruction corresponds to the preset functional control.

Responding to the reverse control instruction, and displaying a second interface on the display screen by the second electronic equipment; responding to the switching request, and sending second screen throwing content to the first electronic equipment by the second electronic equipment; the second electronic equipment displays a second screen-throwing interface, wherein the second screen-throwing interface comprises second screen-throwing content, and the second screen-throwing content is identical to the content of the second interface.

In a possible implementation manner of the third aspect, the first screen-cast content is the same as the content drawn by the second electronic device on the virtual display.

In a possible implementation manner of the third aspect, the first screen-projection interface includes a navigation bar, and the navigation bar includes a Home key and a percent key; the preset function control is a Home key, and the second interface is a main interface; or, the preset function control is a percent key, and the second interface is a multi-task interface.

In a possible implementation manner of the third aspect, the sending, by the first electronic device, a reverse control instruction to the second electronic device includes: the second electronic equipment sends a notification message to the first electronic equipment, wherein the notification message is used for indicating that the second electronic equipment is switched from heterogeneous screen projection to homologous screen projection; in response to the notification message, the first electronic device sends a reverse control instruction to the second electronic device.

In a fourth aspect, an electronic device is provided, where the electronic device has a function of implementing the method of any one of the first aspects, and the function may be implemented by hardware, or may be implemented by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above.

In a fifth aspect, there is provided an electronic device comprising: a memory for storing computer-executable instructions that when executed by the electronic device cause the electronic device to perform the method of any one of the first aspects; alternatively, the method of any of the second aspects above is performed.

In a sixth aspect, a projection display system is provided, which includes: a first electronic device for performing the method of any of the first aspects above, and a second electronic device for performing the method of any of the second aspects above.

In a seventh aspect, a chip system is provided, which is applied to the electronic device in the fourth aspect or the fifth aspect. The chip system comprises a processor and an interface, wherein the interface is used for receiving instructions and transmitting the instructions to at least one processor; execution of the instructions by at least one processor causes the electronic device to perform the method of any one of the first aspects above; alternatively, the method of any of the second aspects above is performed.

In an eighth aspect, there is provided a computer readable storage medium having instructions stored therein which, when run on a computer, cause the computer to perform the method of any of the first aspects above; alternatively, the method of any of the second aspects above is performed.

In a ninth aspect, there is provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of any one of the first aspects above; alternatively, the method of any of the second aspects above is performed.

The technical effects caused by any implementation manner of the third aspect to the ninth aspect may refer to the technical effects caused by different implementation manners of the first aspect or the second aspect, which are not described herein.

Drawings

Fig. 1A is an interface schematic diagram in a heterogeneous screen projection scenario provided in an embodiment of the present application;

fig. 1B is an interface schematic diagram in another heterogeneous screen projection scenario provided in an embodiment of the present application;

fig. 1C is an interface schematic diagram in another heterogeneous screen projection scenario provided in an embodiment of the present application;

fig. 1D is an interface schematic diagram in a homologous screen projection scenario provided in an embodiment of the present application;

Fig. 2A is a schematic diagram of an interface for establishing a heterogeneous screen according to an embodiment of the present application;

FIG. 2B is a schematic diagram of another interface for creating a heterogeneous screen according to an embodiment of the present disclosure;

fig. 2C is a schematic diagram of an interface for switching from heterologous screen projection to homologous screen projection according to an embodiment of the present application;

FIG. 2D is a schematic diagram of another interface for switching from heterologous screen projection to homologous screen projection according to an embodiment of the present disclosure;

fig. 3 is a schematic hardware structure of an electronic device according to an embodiment of the present application;

fig. 4 is a schematic diagram of a software framework of an electronic device according to an embodiment of the present application;

fig. 5A is a schematic flow chart of a screen projection display method according to an embodiment of the present application;

fig. 5B is a schematic flow chart of establishing a heterogeneous screen according to an embodiment of the present application;

fig. 6 is a schematic flow chart of another method for establishing a heterogeneous screen according to an embodiment of the present application;

fig. 7 is a schematic flow chart of another method for establishing a heterogeneous screen according to an embodiment of the present application;

fig. 8 is a schematic flow chart of switching from heterogeneous screen projection to homologous screen projection according to an embodiment of the present application;

fig. 9 is a schematic flow chart of another switching from heterologous screen projection to homologous screen projection according to an embodiment of the present application;

Fig. 10 is a schematic structural diagram of a chip system according to an embodiment of the present application.

Detailed Description

In the description of the embodiments of the present application, unless otherwise indicated, "/" means or, for example, a/B may represent a or B; "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: three cases of A alone, A and B together, and B alone exist.

The following terms "first", "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the embodiments of the present application, unless otherwise indicated, the meaning of "a plurality" is two or more.

In the embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as examples, illustrations, or descriptions. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

Embodiments of the present application provide a screen projection system, as shown in fig. 1A or fig. 1B, where the screen projection system 100 may include a remote device 101 and a local device 102. The remote device 101 may be a second electronic device and the local device 102 may be a first electronic device.

Wherein the remote device 101 and the local device 102 may establish a connection through a wired or wireless manner. Based on the established connection, the remote device 101 and the local device 102 may be used in conjunction. Specifically, the remote device 101 may be a screen-throwing device, and the local device 102 is a screen-throwing device; the remote device 101 may project the screen content of the remote device 101 to the local device 102 for display through a projection application.

In particular implementations, the remote device 101 may be implemented as a mobile phone, a tablet computer, a handheld computer, a PC, a cellular phone, a personal digital assistant (personal digital assistant, PDA), a wearable device (e.g., a smart watch), a smart home device (e.g., a television), a car-mounted computer, a game console, an augmented reality (augmented reality, AR)/Virtual Reality (VR) device, or the like, including a display screen. The local device 202 may be a mobile phone, a tablet computer, a notebook computer, a PC, a smart tv, a projector, or other devices including a display screen. The remote device 101 and the local device 102 may have the same device configuration or may have different device configurations. For example, as shown in fig. 1A, the remote device 101 may be a mobile phone, and the local device 102 may be a notebook computer. As another example, as shown in fig. 1B, the remote device 101 may be a mobile phone, and the local device 102 may be a tablet computer. As another example, the remote device 101 and the local device 102 are both mobile phones.

In general, the local device 102 is a large screen device, while the remote device 101 has a smaller screen size. For example, the screen size of the local device 102 (e.g., a notebook computer) shown in fig. 1A is larger than the screen size of the remote device 101 (e.g., a cell phone). As another example, the screen size of the local device 102 (e.g., tablet computer) shown in fig. 1B is larger than the screen size of the remote device 101 (e.g., cell phone). In this way, the remote device 101 projects the screen content to the local device 102 for display, which not only can reduce the influence on the visual experience of the user due to the limitation of the screen size of the remote device 101, but also can embody the advantage of a large screen.

In this embodiment of the present application, when the remote device 101 and the local device 202 establish connection in a wireless manner, the wireless communication protocol used may be Wi-Fi protocol, bluetooth (Bluetooth) protocol, zigBee protocol, short-range wireless communication (near field communication, NFC) protocol, various cellular network protocols, or the like, which is not limited herein. The wired connection of the remote device 201 and the local device 102 may include: a universal serial bus (universal serial bus, USB) connection and a high definition multimedia interface (high definition multimedia interface, HDMI). In the following embodiments, the method of the embodiments of the present application will be described by taking an example that the remote device 101 and the local device 102 establish a connection in a wireless manner.

The remote device 101 and the local device 102 may be touch screen devices or non-touch screen devices. In this embodiment, the remote device 101 and the local device 102 are terminals that can run an operating system, install applications, and have a display (or display screen). The operating systems of the remote device 101 and the local device 102 may be an Android system, an ios system, a windows system, a mac system, a Linux system, etc., which are not limited herein. The operating systems of the remote device and the local device may be the same or different.

The embodiment of the application provides a screen projection display method which can be applied to the screen projection system. By the method, in the process of screen-throwing from the remote equipment 101 to the local equipment 102, the connection established between the remote equipment 101 and the local equipment 102 can be quickly switched from heterogeneous screen-throwing to homologous screen-throwing without disconnecting, so that the user operation is simplified, and the man-machine interaction efficiency is improved.

The following examples describe in detail the homologous and heterologous projection screens.

And (I) homologous screen projection.

Homologous screening refers to mirror copying of the remote device 101 to the local device 102. In the homologous screen-projection scenario, the display content of the screen-projection window displayed by the home terminal apparatus 102 is the same as the content of the display interface of the remote terminal apparatus 101. In some embodiments, the homologous screen may also be referred to as a mirror screen, a full-sharing screen, a wireless display, or the like.

For example, as shown in fig. 1A, the display content of the screen window 110 displayed by the notebook computer (i.e., the local device 102) is the same as the display interface content of the mobile phone (i.e., the remote device 101). As another example, as shown in fig. 1B, the display content of the screen window 120 displayed by the tablet computer (i.e., the local device 102) is the same as the content of the display interface of the mobile phone (i.e., the remote device 101). As another example, as shown in fig. 1C, the display content of the screen window 130 displayed by the tablet computer (i.e., the local device 102) is the same as the content of the display interface of the mobile phone (i.e., the remote device 101).

The embodiment of the present application may specifically include the following three cases, where in each case, the display content of the screen projection window displayed by the local device 102 is the same as the content of the display interface of the remote device 101.

Case (1):

the remote device 101 projects a screen to the local device 102 in a landscape screen state, and the local device 102 displays a projection window of the remote device 101 in a small window.

For example, as shown in fig. 1A, the mobile phone is in a horizontal screen state, and the mobile phone throws a screen to a notebook computer. In fig. 1A, the notebook computer displays a screen window 110 of the mobile phone in a small window, and the display content of the screen window 110 is the same as the display interface content of the mobile phone.

Note that the home terminal apparatus 102 displays the screen-drop window of the remote terminal apparatus 101 in a small window, specifically: the drop screen window occupies a portion of the screen of the home device 102, and another portion of the screen displays the UI interface of the home device 102. For example, as shown in fig. 1A, a part of the screen of the notebook computer is used to display the screen-throwing window 110, and another part of the screen is used to display the desktop of the notebook computer.

It should be noted that the screen size of the home terminal device 102 may be different from the screen size of the remote terminal device 101, resulting in that the aspect ratio of the screen of the home terminal device 102 is also different from the aspect ratio of the screen of the remote terminal device 101. Accordingly, the home terminal device 102 displays the screen contents of the remote terminal device 101 full screen according to the aspect ratio of the screen of the remote terminal device 101, and there may be a problem in that the screen contents are distorted. In the homologous screen-throwing scene, the local terminal device 102 displays the screen-throwing window of the remote terminal device 101 in a small window, so that the problem of distortion of screen-throwing content in the screen-throwing window displayed by the local terminal device 102 can be avoided, and the visual experience of a user in the screen-throwing process can be ensured.

Case (2):

the remote device 101 projects a screen to the local device 102 in a horizontal screen state, and the local device 102 displays a projection window of the remote device 101 in a full window.

For example, as shown in fig. 1B, the mobile phone is in a horizontal screen state, and the mobile phone throws a screen to the tablet computer. In fig. 1B, the tablet computer displays the screen window 120 of the mobile phone with a full window, and the display content of the screen window 120 is the same as the display interface of the mobile phone.

Note that the home terminal apparatus 102 displays the screen-drop window of the remote terminal apparatus 101 in a full window, specifically: the screen-drop window occupies the entire screen of the home device 102. For example, as shown in fig. 1B, the entire screen of the tablet computer is used to display the screen-drop window 120.

It should be noted that, although the screen size of the home terminal apparatus 102 may be different from the screen size of the remote terminal apparatus 101; however, the aspect ratio of the screen of the home device 102 may be similar to the aspect ratio of the screen of the remote device 101. For example, the aspect ratio of the screen of a tablet computer is similar to the aspect ratio of the screen of a cell phone. Therefore, even if the home terminal apparatus 102 displays the screen contents of the remote terminal apparatus 101 full-screen in accordance with the aspect ratio of the screen of the remote terminal apparatus 101, the problem of distortion of the screen contents does not occur. Therefore, in the homologous screen projection scene, the local terminal device 102 can display the screen projection window of the remote terminal device 101 in a full window or can ensure the visual experience of the user in the screen projection process.

Case (3):

the remote device 101 projects a screen to the local device 102 in a vertical screen state, and the local device 102 displays a screen projection window of the remote device 101 in a small window.

For example, as shown in fig. 1C, the mobile phone is in a vertical screen state, and the mobile phone throws a screen to the tablet computer. In fig. 1C, the tablet computer displays the screen-throwing window 130 of the mobile phone in a small window, and the display content of the screen-throwing window 130 is the same as the display interface of the mobile phone.

It should be noted that, in the homologous screen-throwing scene, when the remote device 101 is in the vertical screen state, the local device 102 displays the screen-throwing window of the remote device 101 with a small window, so that the problem of distortion of the screen-throwing content in the screen-throwing window displayed by the local device 102 can be avoided, and the visual experience of the user in the screen-throwing process can be ensured.

And (II) heterologous screen projection.

Heterologous screen casting refers to that the remote device 101 generates a virtual display, generates (e.g., renders) new screen casting data based on the virtual display, and transmits the screen casting data to the local device 102. In other words, the screen-drop window of the home terminal apparatus 102 displays only the screen-drop content of the virtual display, and does not mirror the content of the main display screen of the remote terminal apparatus 101. In the heterogeneous screen-projection scenario, the display content of the screen-projection window displayed by the local terminal device 102 is different from the content of the display interface on the main display screen of the remote terminal device 101.

In some embodiments, the heterologous screen may also be referred to as an application screen, a network screen, an online screen, a digital living network alliance (digital living network alliance, DLAN) screen, a non-mirrored screen, etc.

For example, as shown in fig. 1D, the mobile phone is in a vertical screen state, and the mobile phone throws a screen to the tablet computer. In fig. 1D, the tablet computer displays the screen window 140 of the mobile phone with a full window, and the mobile phone displays the main interface. The display content of the screen-drop window 140 is different from the content of the display interface of the mobile phone.

The mobile phone generates a virtual display after receiving the screen-throwing instruction, and draws the content needing to be thrown on the virtual display. Then, the mobile phone projects the content drawn on the virtual display onto the tablet computer. After receiving the content projected by the mobile phone, the tablet computer can display the screen projection window 140 shown in fig. 1D.

The screen throwing instruction received by the mobile phone can be sent by the tablet personal computer or generated by the mobile phone. For example, in the scenario shown in fig. 2A, in response to the clicking operation of the user on the "notification message 1", the tablet computer sends a screen-throwing instruction to the mobile phone, so as to trigger the mobile phone to throw a screen to the tablet computer in a heterogeneous screen-throwing manner.

For another example, in the scenario shown in fig. 2B, in response to the multi-finger up-sliding operation of the user, the mobile phone generates a screen-throwing instruction, where the screen-throwing instruction is used to instruct the mobile phone to throw a screen to the tablet computer in a heterogeneous screen-throwing manner.

In the heterogeneous screen projection scene, the interface content displayed by the mobile phone is different from the content displayed by the screen projection window 140. For example, the handset may display a main interface, or the handset may display any of the one or more applications that have recently run and have not been closed. For example, as shown in FIG. 1D, the handset may display a main interface.

When a user uses the electronic device, the electronic device may be in a landscape screen state or a portrait screen state. The embodiment of the application describes a horizontal screen state and a vertical screen state of the electronic equipment. The display screen of the electronic device (including the folding screen in the unfolded state) may include four sides including two longer sides that are parallel and equal to each other, which may be referred to as the long sides of the display screen; the four sides also comprise two short sides which are parallel and equal to each other and can be called short sides of the display screen.

In the horizontal screen state, the long side of the display screen of the electronic device is parallel to the horizontal plane (namely, the included angle between the long side of the display screen and the horizontal plane is 0), or the included angle between the long side of the display screen and the horizontal plane is smaller than or equal to a preset value. In the vertical screen state, the long side of the display screen of the electronic equipment is basically vertical to the horizontal plane, or the included angle between the long side of the display screen and the horizontal plane is larger than a preset value. The preset value is smaller than or equal to 45 degrees, and the specific value of the preset value can be set according to an actual application scene. For example, the preset value may be 20 °.

In the horizontal screen state, the display screen of the electronic equipment is basically in a horizontal bar shape; the height of the display screen of the electronic device is smaller than the width, and the aspect ratio (i.e., the ratio of the height to the width) of the display screen is smaller than 1. In a vertical screen state, a display screen of the electronic equipment is basically in a vertical bar shape; the electronic device has a display screen with a height greater than a width and a height to width ratio (i.e., a ratio of height to width) greater than 1.

The display screen is high to be the length of the side with the larger included angle between the display screen and the horizontal plane, and the display screen is wide to be the length of the side with the smaller included angle between the display screen and the horizontal plane. The height of the display screen may be understood as the longitudinal length of the display screen, the width of the display screen may be understood as the lateral length of the display screen, and the aspect ratio of the display screen may be understood as the aspect ratio (i.e., the ratio of the longitudinal length to the lateral length) of the display screen.

The following examples detail the scenario of a fast switch from a heterologous to a homologous screen.

It can be understood that, in the heterogeneous screen-projection scenario, the screen-projection window of the local device 102 only displays the screen-projection content of the virtual display, and does not mirror the content of the main display screen of the remote device 101. Alternatively, the screen window of the local device 102 only displays the screen interface (e.g., news interface, video interface, etc.) of the remote device 101 for a certain application. In this case, in the related art, if the user wants to view UI interfaces of other applications of the remote device 101 on the local device 102, the user is required to disconnect the heterogeneous screen connection established between the remote device 101 and the local device 102 first, and then reestablish the homogeneous screen connection between the remote device 101 and the local device 102.

For example, the drop screen window of the home device 102 displays a UI interface for "instant messaging application" on which the user chat with the contact. After the chat is finished, the user wants to use the local end device 102 to open the browser application of the remote end device 101, and when inquiring the related information, the user needs to disconnect the heterogeneous screen connection established by the remote end device 101 and the local end device 102, and then reestablish the homologous screen connection. In the homologous screen-projection scenario, the user may open the browser application of the remote device 101 through the screen-projection window displayed by the local device 102, and query the relevant message.

For another example, the screen drop window of the home device 102 displays a UI interface of "news application", and when a user browses a certain news message, the user wants to share the news message to a contact through the "instant messaging application" of the remote device 101. In this case, the user is required to disconnect the remote device 101 from the local device 102, and then reestablish the connection of the homologous screen. In the homologous screen-throwing scene, the user can open the 'instant messaging application' of the remote device 101 through the screen-throwing window displayed by the local device 102, and share the news message to the corresponding contact person.

In the above scenario, in order to meet the needs of the user and improve the experience of the user in using the screen-throwing function, in the process that the remote device 101 throws the screen to the local device 102, a scheme capable of switching from heterogeneous screen throwing to homologous screen throwing is needed.

It should be noted that, based on the scenario according to the present embodiment, the remote device 101 and the local device 102 first perform screen projection in a screen projection manner of heterogeneous screen projection. Illustratively, the remote device 101 may implement the heterogeneous screen-casting with the local device 102 in a variety of manners including Wi-Fi connection, bluetooth connection, NFC communication, USB connection, and HDMI connection. The following lists two specific implementation procedures for heterogeneous screen-casting between the remote device 101 and the local device 102.

The remote device 101 and the local device 102 may implement heterogeneous screen projection in the following two manners.

Mode (1), adopt Wi-Fi to connect or bluetooth to connect the mode and carry out the heterologous screen of throwing:

the remote device 101 logs in the same device account number with the local device 102, and then a function switch corresponding to notification sharing is turned on in the remote device 101, so that Wi-Fi, bluetooth and the like of the remote device 101 are ensured to be turned on, and meanwhile, a switch of an application needing to share notification is turned on. In this way, the notification message received by the remote device 101 is shared to the local device 102, and in response to the clicking operation of the notification message on the local device 102 by the user, the remote device 101 establishes a connection with the local device 102, and pulls up the heterogeneous screen. I.e. the remote device 101 projects the screen to the local device 102 in a heterogeneous screen projection manner.

For example, as shown in fig. 2A, after the mobile phone (i.e., the remote device 101) establishes a connection "notification sharing" with the notebook computer (i.e., the local device 102), the notebook computer may receive the notification message of the mobile phone. As shown in fig. 2A, after the notebook computer receives the notification message 1 of the mobile phone, the notebook computer displays a screen window 210 in response to the clicking operation of the notification message 1 by the user. The screen-projection window 210 includes a UI interface of an instant messaging application projected by the mobile phone. The user can chat with the contact Sam in the UI interface.

It will be appreciated that in a heterogeneous screen-drop scenario, the handset may not display the display of the screen-drop window 210. In this case, the handset may display a main interface, or the handset may display any of the one or more applications that have recently run and have not been closed. For example, as shown in FIG. 2A, the handset may display a main interface.

Mode (2), adopt the mode of NFC connection to carry out the heterologous screen of throwing:

when the remote device 101 approaches the local device 101, in response to a user operation for triggering the establishment of a heterologous screen connection, such as a multi-finger up-sliding operation, the remote device 101 establishes a connection with the local device 102 and pulls up the heterologous screen. I.e. the remote device 101 projects the screen to the local device 102 in a heterogeneous screen projection manner.

For example, as shown in fig. 2B, the cell phone (i.e., the remote device 101) displays a UI interface of "real-time news application". When the mobile phone approaches the notebook computer (i.e. the local terminal device 102), the mobile phone projects a UI interface of 'real-time news application' onto a screen projection window 310 of the notebook computer after drawing on a virtual display in response to multi-finger up-sliding operation of a user on a screen of the mobile phone. Because the screen-throwing mode of the mobile phone and the notebook computer is heterogeneous screen-throwing mode. In this case, the handset may exit the UI interface of the "real-time news application", for example, as shown in fig. 2B, the handset may display the main interface.

The specific implementation manner of switching from the heterologous screen to the homologous screen will be described in detail below with reference to the heterologous screen scenario in the above-mentioned modes (1) and (2).

For example, a preset functionality control may be set in a drop window displayed on the home device 102. The preset functional control is used for triggering the screen-throwing mode of the mobile phone and the notebook computer to be switched from the heterogeneous screen-throwing mode to the homologous screen-throwing mode. The preset functionality control may be a control displayed in a fixed position in the drop window of the home device 102. Alternatively, the preset functionality control may be a hover window, hover button, or hover icon displayed on the drop screen window of the home device 102.

The preset function control displayed on the screen throwing window of the local terminal device 102 may be semitransparent in a manner of a floating window, a floating button or a floating icon. Thus, the visual interference of the preset function control on the user can be reduced, and the use experience of the user can be improved.

In some embodiments, the drop window also displays a navigation bar. Alternatively, in other embodiments, the drop window also displays a title bar. For example, as shown in fig. 2A and 2B, a navigation bar 212 and a title bar 213 are displayed in the screen-in window 210 and the screen-in window 310.

It should be noted that, the navigation bar generally represents a shortcut button bar at the bottom of the mobile phone screen, and generally appears at the bottom of the mobile phone screen in the form of virtual keys. The navigation bar contains three buttons Back key, home key, and Recent (percent) key by default. The Back key is used for returning to the previous interface, the Home key is used for returning to the desktop, and the percent key is used for displaying the application program which is used recently.

In this embodiment, as shown in fig. 2A and 2B, the navigation bar is not displayed at the bottom of the mobile phone screen, and the navigation bar 212 is displayed in the screen-throwing window 210 and the screen-throwing window 310 displayed by the notebook computer. Or, in other words, the navigation bar 212 is not drawn in the virtual display of the handset. The Back key displayed in the navigation bar 212 may be a triangle virtual key as shown in fig. 2A and 2B, the Home key may be a circle virtual key as shown in fig. 2A and 2B, and the count key may be a rectangle key as shown in fig. 2A and 2B.

In some embodiments, as shown in fig. 2A and 2B, a title bar 213 is used to display the application name of the application being screened. In fig. 2A and 2B, the title bar 213 displays the application name of the target application (e.g., fig. 2A shows "instant messaging application", and fig. 2B shows "real-time news application"). For example, the title bar 213 also includes a "hide button", "zoom in button", and "close button". Wherein the "hide button" is used to hide the screen-drop window 210 within the taskbar at the bottom of the notebook screen. The "zoom in button" is used to trigger the notebook computer to display the drop screen window 210 in full window. The "close button" is used to trigger the notebook computer to close the screen window 210. It will be appreciated that in response to a user operating the "close button" the handset stops projecting the screen to the notebook computer.

Illustratively, the preset functionality control may be any one of the Back key, the Home key, and the percent key in the navigation bar 212 shown in fig. 2A and 2B. Of course, the navigation bar 212 may include only one or two controls, and the preset function control is one of the controls included in the navigation bar 212. For example, the navigation bar 212 includes a control, which is a Home key, and the preset function control may be the Home key.

Taking the example that the preset function control is the Home key in the navigation bar 212 shown in fig. 2A and fig. 2B as an example, for example, in response to the operation of the Home key by the user, such as the clicking operation, as shown in fig. 2C, the screen-throwing mode of the mobile phone and the notebook computer is switched from the heterogeneous screen-throwing mode to the homologous screen-throwing mode. For example, in fig. 2C, the notebook computer displays a screen window 220 of the mobile phone, and the display content of the screen window 220 is the same as the display interface of the mobile phone. For example, the display content of the screen window 220 and the display interface content of the mobile phone are both the main interface of the mobile phone.

Taking the above-mentioned preset function control as an example, the remote key in the navigation bar 212 shown in fig. 2A and fig. 2B is taken as an example, and in response to the click operation of the remote key by the user, as shown in fig. 2D, the screen-throwing mode of the mobile phone and the notebook computer is switched from the heterogeneous screen-throwing mode to the homologous screen-throwing mode. For example, in fig. 2D, the notebook computer displays a screen window 230 of the mobile phone, and the display content of the screen window 230 is the same as the display interface of the mobile phone. For example, the display content of the screen window 230 and the display interface content of the mobile phone are both the multitasking interfaces of the mobile phone.

That is, as a response of the user to the operation of the preset function control, the mobile phone may not project the content drawn on the virtual display onto the notebook computer, but project the content displayed on the main display screen of the mobile phone onto the notebook computer, i.e., switch from the heterogeneous screen projection to the homogeneous screen projection.

It should be noted that the preset function control may be another control, so long as the function of switching the screen-throwing mode of the mobile phone and the notebook computer from the heterogeneous screen-throwing mode to the homologous screen-throwing mode can be realized. The foregoing embodiments of the present application are only illustrated by taking the preset function control as the Home key or the accept key, and are not limited to the present application.

The implementation of the examples of the present application will be described in detail below with reference to the accompanying drawings. Taking the example that the remote device is a mobile phone, the hardware structure of the remote device (such as the electronic device 400) is described. The hardware structure of the local device may refer to a detailed description of the electronic device 400 in this embodiment, which is not described herein.

As shown in fig. 3, the electronic device 400 may include: processor 410, external memory interface 420, internal memory 421, universal serial bus (universal serial bus, USB) interface 430, charge management module 440, power management module 441, battery 142, antenna 1, antenna 2, mobile communication module 450, wireless communication module 460, audio module 470, speaker 470A, receiver 470B, microphone 470C, headset interface 170D, sensor module 480, positioning module 481, keys 490, motor 491, indicator 492, camera 493, display screen 494, and subscriber identity module (subscriber identification module, SIM) card interface, etc.

It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 400. In other embodiments, electronic device 400 may include more or fewer components than shown, or may combine certain components, or split certain components, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 410 may include one or more processing units, such as: the processor 410 may include an application processor (application processor, AP), a Modem processor (Modem), a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), an ADSP, a baseband processor, and/or a neural-network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller may be a neural hub and command center of the electronic device 400. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 410 for storing instructions and data. In some embodiments, the memory in the processor 410 is a cache memory. The memory may hold instructions or data that the processor 410 has just used or recycled. If the processor 410 needs to reuse the instruction or data, it may be called directly from the memory. Repeated accesses are avoided, reducing the latency of the processor 410 and thus improving the efficiency of the system.

In some embodiments, processor 410 may include one or more interfaces. It should be understood that the connection relationship between the modules illustrated in this embodiment is merely illustrative, and does not limit the structure of the electronic device 400. In other embodiments, the electronic device 400 may also employ different interfaces in the above embodiments, or a combination of interfaces.

The charge management module 440 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. The battery 442 may be charged by the charge management module 440, and the electronic device may be powered by the power management module 441.

The power management module 441 is configured to connect the battery 442, the charge management module 440 and the processor 410. The power management module 441 receives input from the battery 442 and/or the charge management module 440 to power the processor 410, the internal memory 421, the external memory, the display screen 494, the camera 493, the wireless communication module 460, and the like.

The wireless communication function of the electronic device 400 may be implemented by the antenna 1, the antenna 2, the mobile communication module 450, the wireless communication module 460, the modem processor, the baseband processor, and the like.

The electronic device 400 implements display functions via a GPU, a display screen 494, and an application processor, etc. The GPU is a microprocessor for image processing, and is connected to the display screen 494 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 410 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 494 is used to display images, videos, and the like. The display screen 494 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini-LED, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like.

The electronic device 400 may implement audio functions through an audio module 470 (such as the audio conversion module described above), a speaker 470A, a receiver 470B, a microphone 470C, an ear-headphone interface 470D, an application processor, and the like. Such as music playing, recording, etc.

The audio module 470 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 470 may also be used to encode and decode audio signals. Speaker 470A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. A receiver 470B, also referred to as a "earpiece," is used to convert the audio electrical signal into a sound signal. Microphone 470C, also referred to as a "microphone" or "microphone," is used to convert sound signals into electrical signals. The headphone interface 470D is for connecting a wired headphone.

The external memory interface 420 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device. The external memory card communicates with the processor 410 through an external memory interface 420 to implement data storage functions. For example, audio, video, etc. files are stored in an external memory card.

The internal memory 421 may be used to store computer-executable program code that includes instructions. The processor 410 executes various functional applications of the electronic device and data processing by executing instructions stored in the internal memory 421. For example, in the present embodiment, the processor 410 may include a storage program area and a storage data area by executing instructions stored in the internal memory 421.

The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device (e.g., audio data, phonebook, etc.), and so forth. In addition, the internal memory 421 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.

The keys 490 include a power-on key, a volume key, etc. The motor 491 may be used for incoming call vibration alerting as well as for touch vibration feedback. The indicator 492 may be an indicator light, which may be used to indicate a state of charge, a change in charge, an indication message, a missed call, a notification, or the like.

The SIM card interface 495 is used to connect to a SIM card. The SIM card may be inserted into the SIM card interface 495 or removed from the SIM card interface 495 to enable contact and separation with the electronic device. The electronic device may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 195 may support Nano SIM cards, micro SIM cards, and the like. The same SIM card interface 495 may be used to insert multiple cards simultaneously. The types of the plurality of cards may be the same or different. The SIM card interface 495 may also be compatible with different types of SIM cards. The SIM card interface 495 may also be compatible with external memory cards. The electronic device 400 interacts with the network through the SIM card to realize functions such as communication and data communication. In some embodiments, the electronic device 400 employs an eSIM card, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 400 and cannot be separated from the electronic device 400.

The methods in the following embodiments may be implemented in the electronic device 400 having the above-described hardware structure.

The software system of the electronic device 400 (such as the remote device 101 and the local device 102) may use a layered architecture, an event driven architecture, a micro-core architecture, or a cloud architecture. Taking an Android system with a layered architecture as an example, the embodiment of the application illustrates a software structure of the remote device 101 or the local device 102.

Fig. 4 is a software architecture block diagram of the remote device 101 and the local device 102 provided in the embodiment of the present application. The layered architecture may divide the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into three layers, from top to bottom, an Application layer (Application layer), an Application Framework layer (Framework layer), and a Kernel layer (Kernel, also referred to as a driver layer). For example, as shown in fig. 4, the remote device 101 may include an application layer 500, a framework layer 501, and a driver layer 502; the home device 202 may include an application layer 510, a framework layer 511, and a driver layer 512.

The application layer may include a series of application packages. For example, the application layer 500 and the application layer 510 shown in fig. 4 may include: common applications, screen-drop management applications and applications of a System (System) UI.

Common applications may be cameras, gallery, calendar, conversation, map, navigation, WLAN, bluetooth, music, video, short message, and desktop applications (Launcher). Applications of the System UI may include status bars, navigation bars, and the like. The screen-shot management application may include a screen-shot connection application and a screen-shot display application. Wherein the screen-cast connection application is used to manage wired or wireless connections between cross-devices (e.g., remote device 101 and local device 202) for implementing a screen cast. The screen display application is used to display screen content or screen interfaces projected by the remote device 101 to the local device 102.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. As shown in fig. 4, the framework layer may include a device virtual framework, a screen casting service, and a display management module. The device virtual framework is used for realizing the virtualization of each hardware of devices (such as the remote device 101 and the local device 202) in the screen projection scene, so as to realize the data transceiving of the remote device 101 and the local device 202. The screen-casting service is used for managing data communication from the remote device 101 to the local device 102 in the screen-casting scene. For example, as shown in FIG. 4, a screen-casting service may be used to manage screen-casting data transmitted by the remote device 101 to the local device 102. The screen-cast data may include screen-cast audio-video data and layer data, which may also be referred to as screen image data. The display management module of the remote device 101 is used to create a virtual display of the cast screen display.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver, a sensor driver and the like. The embodiments of the present application do not impose any limitation on this.

In actual implementation, the remote device 101 may be used as a screen terminal, or may be used as a screen terminal. Accordingly, the home terminal device 101 may be used as a screen-throwing terminal, and may also be used as a screen-throwing terminal. In this case, the remote device 101 may include all of the software modules shown in the above examples; the local device 102 may also include all of the software modules shown in the examples above.

In the following embodiments, the process of switching the remote device 101 and the local device 102 from the heterogeneous screen to the homogeneous screen is described in conjunction with the heterogeneous screen scenario. For example, as shown in fig. 5A, the process of switching from heterologous to homologous screen may include the following steps.

Step i: the remote device 101 receives a screen-throwing request (or may also be referred to as a screen-throwing instruction) from the local device 102, and is used for instructing the local device 102 to throw a screen to the remote device 101 in a heterogeneous screen-throwing manner.

Step ii: the remote device 101 sends the first screen shot content to the local device 102.

Illustratively, after receiving the screen-casting request, the remote device 101 responds to the screen-casting request, and the remote device 101 creates a virtual display and draws the content that needs to be screened on the virtual display. The remote device 101 then projects the content on the virtual display (i.e., the first screen shot content) onto the local device 102.

Step iii: the home terminal device 102 displays a first screen-drop interface, where the first screen-drop interface includes first screen-drop content and a preset functionality control.

The preset functionality control home terminal device 102 is obtained after the first screen projection interface is drawn. For example, after receiving the first screen content, the home device 102 displays the first screen content on the first screen interface and draws the first screen content on the first screen interface.

Illustratively, the first screen content is different from the content of the interface displayed on the display screen of the remote device 101. For example, the first screen content is the content displayed by the tablet computer in fig. 1D in the screen window 140. Alternatively, the first screen content is displayed on the screen window 210 of the notebook computer in fig. 2A. Alternatively, the first screen content is displayed on the screen window 310 by the notebook computer in fig. 2B.

And the content of the interface displayed on the display screen of the remote device 101 is the content of the main interface displayed on the display screen by the mobile phone in fig. 1D, 2A and 2B.

That is, in steps i through iii, the remote device 101 projects the first screen content to the local device 102 using the heterologous screen.

Step iv: in response to a triggering operation of a user on a preset function control, the local end device 102 sends a switching request to the remote end device 101 and sends a reverse control instruction.

The switching request is used for requesting the remote device 101 to switch from heterogeneous screen-casting to homologous screen-casting to the local device 102. The reverse control instruction corresponds to a preset function control, and the reverse control instruction is used for triggering the remote device 101 to display a first interface on the display screen.

For example, when the preset function control is a Home key, the reverse control instruction is used to trigger the remote device 101 to display a main interface on the display screen; or when the preset function control is a percent key, the reverse control instruction is used for triggering the remote equipment 101 to display the multi-task interface on the display screen.

Step v: in response to the reverse control instruction, the remote device 101 displays a first interface on the display screen.

Step vi: in response to the switching request, the remote device 101 sends second screen-casting content to the local device 102, where the second screen-casting content is the same as the content of the first interface.

Illustratively, when the remote device 101 displays the first interface as the main interface on the display screen, the remote device 101 sends the content of the main interface (i.e., the second screen content) to the local device 102, so that the local device 102 displays the second screen content on the screen window. For example, as shown in fig. 2C, the content of the first interface displayed on the display screen by the remote device 101 (i.e., the mobile phone) is the same as the content displayed on the screen window 210 by the local device 102 (i.e., the notebook computer), and is the content of the main interface.

Also exemplary, when the first interface displayed by the remote device 101 on the display screen is a multi-tasking interface, the remote device 101 sends the content of the multi-tasking interface (i.e., the second screen-casting content) to the local device 102, such that the local device 102 displays the second screen-casting content on the screen-casting window. For example, as shown in fig. 2D, the content of the first interface displayed on the display screen by the remote device 101 (i.e., the mobile phone) is the same as the content displayed on the screen window 310 by the local device 102 (i.e., the notebook computer), which is the content of the multi-tasking interface.

The following describes a specific implementation of the remote device 101 and the local device 102 to establish a heterogeneous screen. Illustratively, as shown in fig. 5B, the procedure of establishing a heterogeneous screen with the local device 102 by the remote device 101 is as follows.

For example, referring to fig. 5B, the heterologous screen-casting process may include the following three steps: (1) a process of 'remote end-local end set up screen connection'; (2) "the remote device creates a virtual display" flow; (3) A process of 'remote-local screen projection data transmission'.

The remote device 101 and the local device 102 may execute the above-described (1) "remote-local set up screen connection" procedure through the screen connection application in the application layer. The remote device 101 may support the remote device 101 to execute the above-mentioned (2) "remote device creates virtual display" process. The remote device 101 and the local device 102 may perform the above-described (3) "remote-local screen data transmission" flow through the screen display application in the application layer.

In this embodiment, the three flows shown in fig. 5B are illustrated herein in conjunction with the software architecture shown in fig. 4. Illustratively, as shown in FIG. 6, the process generally includes the steps of: (1) the screen-cast connection application in the application layer 500 of the remote device 101 performs signaling interaction with the screen-cast connection application in the application layer 510 of the local device 102 to establish a screen-cast connection.

(2) The screen connect application in the application layer 500 of the remote device 101 initializes the device virtual framework in the framework layer 501 and creates the capability parameters of the remote device 101. Accordingly, (2) -1, the drop connection application in the application layer 510 of the home device 102 initializes the device virtual framework in the framework layer 511.

(3) The device virtual framework in the framework layer 501 of the remote device 101 initiates a screen-casting service in the framework layer 501 for obtaining screen-casting data of the remote device 101. (4) The drop service in the framework layer 501 of the remote device 101 notifies the display management module in the framework layer 501 to create a virtual display. The display management module in the framework layer 501 performs creation of a virtual display. (5) The Display management module in the framework layer 501 of the remote device 101 notifies the drop Display application in the application layer 500 that the virtual Display creation was successful.

(6) The drop display application in the application layer 500 of the remote device 101 stacks the target application (e.g., the "instant messaging application" projected by the handset to the laptop) into the virtual display created by the framework layer 501. (7) The screen service in the framework layer 501 of the remote device 101 obtains screen projection data (such as the screen image data of the "instant messaging application" interface projected onto the notebook computer) from the virtual display created by the display management module of the framework layer 501. (8) The screen-casting service in the frame layer 501 of the remote device 101 encodes the screen-casting data and transmits the encoded screen-casting data to the screen-casting service in the frame layer 511 of the local device 102. Accordingly, (8) -1, the screen-casting service in the framework layer 501 of the remote device 101, notifies the device virtual framework in the framework layer 501 that the screen-casting is successful.

(9) The device virtual frames in the frame layer 501 of the remote device 101 send the capability parameters of the remote device 101 to the device virtual frames in the frame layer 511 of the local device 102.

The capability parameters described in the above embodiments may be used to reflect one or more of the display capability, audio capability, and shooting capability of the remote device 101. The device virtual framework may be, for example, a distributed mobile sensor development platform (distributed mobile sensing development platform, DMSDP).

For example, the capability parameter is used to reflect the audio capabilities of the remote device 101. In this case, the remote device 101 may create a virtual microphone and send the capability parameters corresponding to the virtual microphone to the local device 101. Thus, after the voice message is received by the "instant messaging application" of the remote device 101, the voice message may be projected onto the local device 102 in a "notification sharing" manner, and the local device 102 may play the voice message based on the capability parameters of the virtual microphone.

The screen-casting service in the framework layer 511 of the local device 102 decodes the screen-casting data and sends the screen-casting data to the screen-casting display application in the application layer 510, so that the screen-casting display application in the application layer 510 displays the screen-casting content or the screen-casting interface.

The following examples describe the above process in detail. For example, as shown in fig. 7, the remote device 101 and the local device 102 may perform the following steps to implement the flows of (1) - (3) described above.

Step a: the screen-connection application of the remote device 101 establishes a screen-connection with the screen-connection application of the local device 102.

By way of example, step a may include steps a-1 through a-7.

Step a-1: the screen-throwing connection application of the remote device 101 initiates a connection creation message to the screen-throwing connection application of the local device 102, for notifying the screen-throwing connection application of the local device 102 to create the screen-throwing connection.

The message of step a-1 may be expressed, for example, as: open Session. For example, the message is used to notify the drop connection application of the home device 102, open a notification message (or may be understood as an open session), and create a drop connection.

Step a-2: the screen connection application of the local end device 102 replies a connection message to the screen connection application of the remote end device 101, which is used to inform the screen connection application of the remote end device 102 that the screen connection can be created.

The message of step a-2 may be expressed, for example, as: on Session Opened. For example, the message may be used to inform the remote 101 of the drop connection application that the message (or session) has been opened, and a drop connection may be created.

Step a-3: the screen-on connection application of the remote device 101 and the screen-on connection application of the local device 102 send device information to each other.

Illustratively, the screen-connect application of the remote device 101 sends the device information of the remote device 101 to the screen-connect application of the local device 102. Accordingly, the screen-throwing connection application of the local end device 102 sends the screen-throwing connection application of the local end device 102 to the screen-throwing connection application of the remote end device 101. The message of step a-3 may be expressed, for example, as: pair Notify.

Wherein the device information includes, but is not limited to: device account number, device name, device ID, etc.

Step a-4: the screen connection application of the local end device 102 sends a version negotiation request message to the screen connection application of the remote end device 101, and the version data packet of the screen management application of the local end device 102 is carried.

By way of example, step a-4 may be expressed as: version Query Request.

Step a-5: the screen-throwing connection application of the remote device 101 replies a version negotiation response message to the screen-throwing connection application of the local device 102, which is used for indicating that the version negotiation is successful, and screen throwing can be performed.

By way of example, step a-5 may be expressed as: version Query Response.

Step a-6: the screen-throwing connection application of the local end device 102 sends a screen-throwing request to the screen-throwing connection application of the remote end device 101, so as to request the remote end device 101 to throw a screen.

By way of example, step a-6 may be expressed as: hi Cast Start Request.

Step a-7: the screen connect application of the remote device 101 begins the screen and sets a heterologous flag bit (alternatively referred to as a first flag bit).

For example, the heterologous flag bit may be used to indicate that the screen-casting manner of the remote device 101 and the local device 102 is a heterologous screen-casting. For example, the screen connect application of the remote device 101 sets the heterologous flag bit to "true".

Wherein step a-7 may be expressed, for example, as: handle Share Screen Start set Async Cast Mode true.

It should be noted that, the remote device 101 and the local device 102 establish the screen connection through the steps a-1 to a-7, that is, the process of (1) "the remote-local end establishes the screen connection" is implemented through the steps a-1 to a-7.

Step b: the screen connect application of the remote device 101 initiates a device virtual framework and invokes the screen service of the remote device 101 to create a virtual Display.

Wherein step b may be expressed, for example, as: start DMSDP.

Step c: the screen-casting service of the remote device 101 notifies the Display management module to create a virtual Display, which carries attribute information required for creating the virtual Display, and a heterologous flag bit.

The attribute information is used to indicate that the screen projection mode of the remote device 101 and the local device 102 is a heterogeneous screen projection mode, and allows for a homologous screen projection.

Step c may be expressed, for example, as: create Virtual Display.

Step d: the display management module of the remote device 101 creates a virtual display.

Wherein, the display management module of the remote device 101 creates a virtual display, and may further perform the following operations: 1. the display management module judges that the screen-throwing mode of the remote device 101 and the local device 102 is the heterogeneous screen-throwing mode according to the identifier (such as ID) of the virtual display. 2. The Display management module sets the virtual Display to lock the screen without following the screen locking of the main Display screen. That is, when the main display screen is locked, the virtual display will not be locked. Therefore, in the scene of heterogeneous screen projection, the problem that after the screen of the main display screen is locked, the virtual display screen is locked can be solved.

Step d may be expressed, for example, as: on Display Added set Killed Flag set Async PC Display ID set Wall paper Blur.

It should be noted that, in the embodiment of the present application, because the remote device 101 modifies the attribute information of the virtual display to "the screen-throwing mode of the remote device 101 and the local device 102 is a heterogeneous screen-throwing mode and allows for a homologous screen-throwing" when creating the virtual display, and the above operation 1 and operation 2 are also performed, it is possible to implement that the screen-throwing mode of the remote device 101 and the local device 101 is quickly switched from the heterogeneous screen-throwing mode to the homologous screen-throwing mode.

In addition, the remote device 101 and the local device 102 create a virtual display through the above steps b to d, that is, the above (2) "remote device creates a virtual display" flow is implemented through the steps b to d.

Step e: the display management module of the remote device 101 notifies the cast display application that virtual display creation was successful.

Step f: the drop display application of the remote device 101 stacks the target application into a virtual display.

The target application refers to an application corresponding to the screen content that needs to be projected onto the local device 102 by the remote device 101. For example, in fig. 2A, the application corresponding to the notification message 1 displayed on the notebook computer (i.e., the home terminal apparatus 102) is the target application. For another example, in fig. 2B, an application corresponding to an interface currently displayed on the display screen of the mobile phone (i.e., the remote device 101) is a target application.

Step f may be expressed, for example, as move Stack To Async Display.

Step g: the screen projection service of the remote device 101 acquires screen projection data from the virtual display created by the display management module, and performs encoding processing on the screen projection data.

Step h: the screen-casting service of the remote device 101 sends the encoded screen-casting data to the screen-casting service of the local device 101.

Step j: the screen-throwing service of the local terminal equipment 101 decodes the screen-throwing data, and sends the decoded screen-throwing data to the screen-throwing display application of the local terminal equipment 101, so that the screen-throwing display application displays the screen-throwing content or the screen-throwing interface corresponding to the screen-throwing data.

It should be noted that, the remote device 101 and the local device 102 transmit the screen-casting data through the steps e to j, that is, the process of (3) "remote-local screen-casting data transmission" is implemented through the steps e to j.

In this embodiment of the present application, the home terminal device 102 may not only display the content projected by the remote terminal device 101 in the screen projection window, but also display the preset function control in the screen projection window by the home terminal device 102. Taking the example that the preset function control is included in the navigation bar, in some embodiments, the navigation bar may also be displayed in the screen-throwing window. As shown in fig. 2A and 2B, the screen window 210 and the screen window 310 of the home terminal apparatus 102 (i.e., notebook computer) display the navigation bar 212. The navigation bar 212 may include preset functionality controls, such as a Back key, a Home key, a count key, etc.

In the following embodiments, a preset function control is taken as a Home key for example, and a method for rapidly switching from heterogeneous screen projection to homologous screen projection is illustrated.

For example, as shown in fig. 8, switching the screen-casting mode of the remote device 101 and the local device 102 from the heterologous screen-casting mode to the homologous screen-casting mode may include the following procedures: (I) "local device 102 indicates the procedure of switching the remote device 101 from heterogeneous screen projection to homologous screen projection"; (II) a procedure in which the remote device 101 switches from heterogeneous screen projection to homogeneous screen projection; (III) "the remote device 101 and the local device 102 transmit the screen-shot data" in the homologous screen-shot scene.

The remote device 101 and the local device 102 may perform the above-described (I) "the local device 102 instructs the remote device 101 to switch from the heterogeneous screen to the homogeneous screen" through the screen-throwing connection application in the application layer. The screen-throwing connection application of the application layer and the display management module of the framework layer in the remote device 101 can support the remote device 101 to execute the process of (II) switching the remote device 101 from the heterogeneous screen throwing to the homologous screen throwing. The remote device 101 and the local device 102 may execute the above-described (III) "the process of transmitting the screen-casting data" by the remote device 101 and the local device 102 in the homologous screen-casting scene through the screen-casting display application in the application layer and the screen-casting service in the framework layer.

The embodiment of the present application herein illustrates three flows shown in fig. 8 in conjunction with the software architecture shown in fig. 4. Illustratively, as shown in FIG. 9, the process generally includes the following steps.

Step 1: the screen connection application of the local end device 102 sends a switching request to the screen connection application of the remote end device 101, where the switching request is used to request the remote end device 101 to switch from heterogeneous screen to homogeneous screen.

Illustratively, the screen window 210 and the screen window 310 include the Home key in combination with the screen window 201 described above with respect to fig. 2A and the screen window 310 shown in fig. 2B. In response to the user's operation on the Home key, the screen-drop connection application of the Home device 102 sends a switching request to the screen-drop connection application of the remote device 101.

For example, step 1 may be expressed as: switch To Sync Cast Request.

Step 2: the drop Display application of the remote device 101 moves the target application from the virtual Display to the main Display.

Step 2 may be expressed, for example, as: move Stack To Default Display. The remote device 101 moving the target application to the main display screen may be understood as displaying an interface of the target application on the main display screen. As shown in fig. 2C, the remote device 101 (i.e., a cell phone) displays an interface of the desktop application on the main display. Alternatively, as shown in FIG. 2D, the remote device 101 (i.e., a cell phone) displays an interface for the multitasking application on the main display.

Step 3: the screen-cast connection application of the remote device 101 is switched from the heterologous screen-cast to the homologous screen-cast, and the heterologous flag bit is modified (the modified heterologous flag bit may be referred to as a second flag bit).

Illustratively, the screen-connection application of the remote device 101 sets the heterologous flag bit to "false" to indicate that the screen-casting manner of the remote device 101 and the local device 102 is a homologous screen-casting.

For example, step 3 may be expressed as: set Async Cast mode false.

Step 4: the screen-throwing connection application of the remote equipment 101 notifies the display management module, the screen-throwing mode of the remote equipment 101 and the local equipment 102 is switched to the homologous screen throwing mode, and the heterologous marker bit is sent.

Illustratively, step 4 may be represented as: set Async Cast mode false.

Step 5: the display management module of the remote device 101 deletes the ID corresponding to the virtual display and clears the heterologous flag bit.

Step 5 may be expressed, for example, as: set Killed Flag set Async PC Display ID.

Step 6: the screen connection application of the remote device 101 returns to the screen connection application of the local device 102, and the screen switching mode of the remote device 101 and the local device 102 is changed into the homologous screen switching mode.

Step 6 may be expressed, for example, as: switch To Sync Cast Response.

Step 7: the screen display application of the local end device 102 sends a reverse control instruction (or called reverse control instruction) of the Home key to the screen service of the remote end device 101, so as to instruct the remote end device 101 to display the desktop application.

After the remote device 101 receives the countercontrol instruction of the Home key, the remote device 101 may display a main interface, that is, an interface for displaying a desktop application, on the main display screen in response to the countercontrol instruction.

Step 7 may be expressed, for example, as: HW_VIRTUAL_KEY_CMD_HOME/HW_VIRTUAL_KEY_CMD_RECENTs.

Step 8: the screen service of the remote device 101 re-detects the set heterologous flag bit.

For example, if the screen-throwing service of the remote device 101 does not detect the set heterologous flag bit, it indicates that the screen-throwing manner of the remote device 101 and the local device 102 is a homologous screen-throwing manner.

For example, step 8 may be expressed as: check And set Async Cast Mode.

Step 9: the screen display application of the remote device 101 projects the content displayed on the main display screen to the screen display application of the local device 102, so that the screen display application of the local device 102 displays the screen content.

For example, since the screen projection modes of the remote device 101 and the local device 102 are switched from the heterogeneous screen projection mode to the homogeneous screen projection mode, the screen projection display application of the remote device 101 may project the content displayed on the main display screen to the screen projection display application of the local device through the screen projection mode of the homogeneous screen projection. It will be appreciated that the content projected onto the home device 102 at this point is the interface of the desktop application.

It can be understood that, after the screen-casting modes of the remote device 101 and the local device 102 are switched from the heterogeneous screen-casting mode to the homogeneous screen-casting mode, the content displayed by the remote device 101 and the content displayed by the screen-casting window of the local device 102 become mirror images (which can be understood as the same content).

It should be noted that, in the above embodiment, the preset function control is illustrated by taking the Home key as an example, and when the preset function control is other controls, the instruction corresponding to the reverse control instruction is sent. For example, when the preset function control is an icon of "instant messaging application", the reverse control instruction sent by the home device 101 to the remote device 102 is an instruction corresponding to the icon, that is, instructs the remote device 102 to display an interface (i.e., a first interface) of "instant messaging application".

In some embodiments, after the local device 102 receives the triggering operation of the preset function control by the user, the local device 102 needs to send a switching request and a reverse control instruction to the remote device 101.

In other embodiments, after the local device 102 receives the triggering operation of the preset function control by the user, the local device 102 only needs to send the switching request to the remote device 101. In this case, the remote device 101 may directly project the content of the current interface display onto the local device 101. For example, in a heterogeneous screen-cast scenario, the remote device 101 displays an interface of a video application on a display screen, and the local device 102 displays an interface of "instant messaging application" on a screen-cast window. In this way, after the local device 102 receives the triggering operation of the user on the preset function control, the local device 102 sends a switching request to the remote device 101. In response to the switching request, the remote device 101 switches from heterogeneous screen projection to homologous screen projection, and projects the content of the interface of the video application currently displayed onto the local device 102, so that the screen projection window of the local device 102 displays the content of the video application.

In summary, by adopting the scheme of the application, through setting up the preset function control at the screen throwing window, the connection between the remote equipment and the local equipment can be realized without disconnection, the screen throwing mode of the remote equipment and the local equipment is quickly switched from the heterogeneous screen throwing mode to the homologous screen throwing mode, the user operation is simplified, and the human-computer interaction efficiency is improved.

It should be noted that, what is described in the embodiments of the present application may explain and the technical solutions in other embodiments of the present application, and the technical features described in the embodiments may also be applied in other embodiments, and form a new solution in combination with the technical features in other embodiments, where the present application is only to exemplify several embodiments and not to represent the limitation of the present application.

The embodiment of the present application provides an electronic device, which may be the above-mentioned remote device 101 or local device 102; the electronic device may include: a memory and one or more processors; the memory has stored therein computer program code comprising computer instructions which, when executed by the processor, cause the electronic device to perform the various functions or steps described above as being performed in the remote device 101 or the local device 102. The structure of the electronic device may refer to the structure of the electronic device 400 shown in fig. 3 described above.

The embodiment of the application also provides a chip system which is applied to the remote device 101 or the local device 102. As shown in fig. 10, the chip system 1100 includes at least one processor 1101 and at least one interface circuit 1102, wherein the processor 1101 may be the processor 410 shown in fig. 3 in the above-described embodiments. The interface circuit 1102 may be, for example, an interface circuit between the processor 410 and an external memory; or as an interface circuit between the processor and the internal memory 421.

The processor 1101 and interface circuit 1102 may be interconnected by wires. For example, interface circuit 1102 may be used to receive signals from other devices (e.g., a memory of electronic device 400). For another example, the interface circuit 1102 may be used to send signals to other devices (e.g., the processor 1101). The interface circuit 1102 may, for example, read instructions stored in a memory and send the instructions to the processor 1101. The instructions, when executed by the processor 1101, may cause the electronic device to perform the various functions or steps performed in the remote device 101 or the local device 102 in the embodiments described above. Of course, the chip system may also include other discrete devices, which are not specifically limited in this embodiment of the present application.

Embodiments of the present application also provide a computer-readable storage medium including computer instructions that, when executed on an electronic device, cause the electronic device to perform the functions or steps performed in the remote device 101 or the local device 102 in the above-described method embodiments.

Embodiments of the present application also provide a computer program product which, when run on a computer, causes the computer to perform the functions or steps described above as being performed in the remote device 101 or the local device 102 in the method embodiments.

It will be apparent to those skilled in the art from this description that the above-described functional modules are merely illustrated in terms of division for convenience and brevity, and in practical applications, the above-described functional modules may be allocated to different functional modules according to the system, that is, the internal structure of the apparatus may be divided into different functional modules to perform all or part of the functions described above.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another apparatus, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and the parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a readable storage medium. Based on such understanding, the technical solution of the embodiments of the present application may be essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions for causing a device (may be a single-chip microcomputer, a chip or the like) or a processor (processor) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read Only Memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

The foregoing is merely a specific embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered in the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (18)

1. A method of on-screen display, characterized in that it is applied to a first electronic device, the method comprising:

the first electronic equipment displays a first screen projection interface, wherein the first screen projection interface comprises a preset functional control and first screen projection content projected by second electronic equipment, and the first screen projection content is different from the content of the first interface displayed on the display screen of the second electronic equipment;

the first electronic equipment receives triggering operation of a user on the preset function control;

responding to the triggering operation, the first electronic equipment sends a switching request to the second electronic equipment and sends a reverse control instruction; the reverse control instruction corresponds to the preset functional control and is used for triggering the second electronic equipment to display a second interface on a display screen of the second electronic equipment;

the first electronic equipment displays a second screen projection interface, the second screen projection interface comprises second screen projection content projected by the second electronic equipment, and the second screen projection content is identical to the content of the second interface.

2. The method of claim 1, wherein the step of determining the position of the substrate comprises,

the first screen projection content is the same as the content drawn on the virtual display by the second electronic device.

3. The method of claim 1 or 2, wherein the first drop interface comprises a navigation bar comprising a Home key and a return key;

the preset function control is the Home key, and the second interface is a main interface; or,

the preset function control is the accept key, and the second interface is a multi-task interface.

4. A method according to any of claims 1-3, wherein before the first electronic device sends a reverse control instruction to the second electronic device, the method further comprises:

the first electronic device receives a notification message from the second electronic device, wherein the notification message is used for indicating that the second electronic device is switched from heterogeneous screen projection to homologous screen projection.

5. A method of on-screen display, characterized in that it is applied to a second electronic device, the method comprising:

the second electronic equipment sends first screen throwing content to the first electronic equipment, wherein the first screen throwing content is different from the content of a first interface displayed on a display screen of the second electronic equipment;

The second electronic equipment receives a switching request from the first electronic equipment and receives a reverse control instruction from the first electronic equipment;

responding to the reverse control instruction, and displaying a second interface on a display screen by the second electronic equipment;

and responding to the switching request, and sending second screen throwing content to the first electronic equipment by the second electronic equipment, wherein the second screen throwing content is the same as the content of the second interface.

6. The method of claim 5, wherein the second electronic device sending the first screen content to the first electronic device comprises:

the second electronic equipment receives a screen projection request from the first electronic equipment, wherein the screen projection request is used for requesting the second electronic equipment to project a screen to the first electronic equipment;

responding to the screen throwing request, the second electronic equipment creates a virtual display, and stacks the interface of the target application onto the virtual display for drawing; the configuration information of the virtual display includes: the screen projection mode corresponding to the virtual display is a heterogeneous screen projection mode, and homologous screen projection is allowed;

and the second electronic equipment sends the first screen projection content to the first electronic equipment based on the content drawn on the virtual display.

7. The method of claim 6, wherein after the second electronic device creates the virtual display, the method further comprises:

the second electronic equipment is provided with a first zone bit, and the first zone bit is used for indicating that the screen-throwing mode of the second electronic equipment and the first electronic equipment is heterogeneous screen throwing.

8. The method of claim 7, wherein after the second electronic device receives the handoff request from the first electronic device, the method further comprises:

the second electronic device stacks the content of the interface of the target application drawn on the virtual display to a display screen of the second electronic device;

the second electronic equipment modifies the first zone bit into a second zone bit, wherein the second zone bit is used for indicating that the screen-throwing mode of the second electronic equipment and the first electronic equipment is homologous screen throwing.

9. The method according to any one of claims 6-8, further comprising:

the second electronic device performs a first operation after creating the virtual display;

wherein the first operation comprises: the second electronic equipment judges that the virtual display is a display corresponding to the heterogeneous screen projection according to the identifier of the virtual display; and when the display screen of the second electronic device is locked, the virtual display is not locked, and is used for prohibiting the screen-throwing interface of the first electronic device from being in a screen locking state.

10. The method of any of claims 4-9, wherein prior to the second electronic device receiving a reverse control instruction from the first electronic device, the method further comprises:

the second electronic device sends a notification message to the first electronic device, wherein the notification message is used for indicating that the second electronic device is switched from heterogeneous screen projection to homologous screen projection.

11. A method of projection display, characterized in that it is applied to a system comprising a first electronic device and a second electronic device, said method comprising:

the first electronic equipment receives first screen throwing content from the second electronic equipment, and displays a first screen throwing interface, wherein the first screen throwing interface comprises a preset functional control and the first screen throwing content, and the first screen throwing content is different from the content of the first interface displayed on a display screen of the second electronic equipment;

the first electronic equipment receives triggering operation of a user on the preset function control;

responding to the triggering operation, the first electronic equipment sends a switching request to the second electronic equipment and sends a reverse control instruction; the reverse control instruction corresponds to the preset functional control;

Responding to the reverse control instruction, and displaying a second interface on a display screen by the second electronic equipment;

responding to the switching request, and sending second screen throwing content to the first electronic equipment by the second electronic equipment;

the second electronic equipment displays a second screen-throwing interface, wherein the second screen-throwing interface comprises second screen-throwing content, and the second screen-throwing content is the same as the content of the second interface.

12. The method of claim 11, wherein the first screen shot content is the same as content drawn by the second electronic device on a virtual display.

13. The method of claim 11 or 12, wherein the first drop interface comprises a navigation bar comprising a Home key and a return key;

the preset function control is the Home key, and the second interface is a main interface; or,

the preset function control is the accept key, and the second interface is a multi-task interface.

14. The method of any of claims 11-13, wherein the first electronic device sending a reverse control instruction to the second electronic device comprises:

the second electronic equipment sends a notification message to the first electronic equipment, wherein the notification message is used for indicating that the second electronic equipment is switched from heterogeneous screen projection to homologous screen projection;

And responding to the notification message, and sending a reverse control instruction to the second electronic device by the first electronic device.

15. An electronic device, the electronic device comprising:

a memory and one or more processors;

the memory has stored therein computer program code comprising computer instructions; when executed by the processor, cause the electronic device to perform the method of any of claims 1-4; alternatively, the method of any of claims 5-10 is performed.

16. A projection display system, comprising: a first electronic device for performing the method of any of claims 1-4, and a second electronic device for performing the method of any of claims 5-10.

17. A chip system for use in an electronic device, the chip system comprising:

at least one processor and an interface;

the interface is used for receiving the instruction and transmitting the instruction to the at least one processor; execution of the instructions by the at least one processor causes the electronic device to perform the method of any one of claims 1-4; alternatively, the method of any of claims 5-10 is performed.

18. A computer readable storage medium comprising computer instructions which, when run on an electronic device, cause the electronic device to perform the method of any of claims 1-4; alternatively, the method of any of claims 5-10 is performed.