CN117492672A

CN117492672A - Screen projection method and electronic equipment

Info

Publication number: CN117492672A
Application number: CN202210887873.3A
Authority: CN
Inventors: 李自然; 刁月磊; 李建钊
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2022-07-26
Filing date: 2022-07-26
Publication date: 2024-02-02
Also published as: WO2024022307A1

Abstract

The application provides a screen projection method and electronic equipment. In one aspect, when the multimedia content in the application supports screen-casting display on the large-screen device after drawing on the virtual screen, the electronic device can draw the screen-casting content on the virtual screen through the application based on the multimedia content in the application and the device information of the large-screen device, and display the screen-casting content on the large-screen device. The method and the device realize that the screen throwing content is obtained by drawing the device information based on the large screen device, so that the size of the screen throwing content is matched with the large screen size of the large screen device. On the other hand, the electronic equipment allows the high screen-throwing authority application to preempt the screen-throwing channel of the low screen-throwing authority application, does not allow the low screen-throwing authority application to preempt the screen-throwing channel of the high screen-throwing authority, so that the electronic equipment can control the screen-throwing behavior of the application based on the screen-throwing authority priority of the application, and the occurrence of screen-throwing confusion is avoided.

Description

Screen projection method and electronic equipment

Technical Field

The application relates to the technical field of screen projection, in particular to a screen projection method and electronic equipment.

Background

Wireless screen-casting enables electronic devices such as mobile phones, tablets and the like to cast local or network multimedia content on large screens such as PCs, smart screens and the like with audio, video and the like playing capability, and play the multimedia data on the large screens. Typical wireless screens include mirrored screens (e.g., miracast), online screens (e.g., digital living network alliance (digital living network alliance, DLNA)), and the like.

In the mirror image screen-throwing process, if a user frequently switches multimedia content on the mobile phone side, the content displayed on the large screen can also be frequently switched, so that the screen throwing is disordered. In some cases, however, the user need only switch the display of multimedia content on the user, and not the large screen, as opposed to the user's intent. In the online screen-throwing process, protocols supporting online screen-throwing by different applications are different at present, unified standards are not available, and universality is poor.

Disclosure of Invention

The application provides a screen projection method and electronic equipment, which realize that the electronic equipment can control the screen projection behavior of an application based on the screen projection authority priority of the application, and avoid the occurrence of the condition of screen projection confusion.

In a first aspect, the present application provides a screen projection system, the system including an electronic device and a large screen device, where the electronic device is configured to establish a screen projection connection with the large screen device; the electronic equipment is also used for displaying a first interface of the first application; the electronic equipment is further used for receiving a first operation aiming at the first interface, wherein the first operation is used for selecting first screen projection content; the electronic equipment is also used for responding to the first operation and sending the first screen throwing data to the large screen equipment through screen throwing connection; the large screen device is used for displaying a second interface after receiving the first screen throwing data, and the second interface comprises first screen throwing content; the electronic device is also used for receiving a second operation; the electronic equipment is also used for responding to the second operation and displaying a third interface of the second application; and the large screen device is also used for continuously displaying the second interface under the condition that the screen-throwing authority of the second application is lower than or equal to the screen-throwing authority of the first application.

The first interface may be a video interface or a picture interface, and the second interface may be a video interface or a picture interface.

When the first interface of the first application supports the screen-throwing display after virtual screen drawing on the large screen device, the first application displays the screen-throwing display after virtual screen drawing on the large screen device. The interface layout of the first screen content displayed on the large screen device may be different from the interface layout of the first interface. The display content of the first screen-cast content displayed on the large screen device may also be different from the display content of the first interface.

Through the screen projection system provided by the first aspect, the electronic equipment can control the screen projection behavior of the application based on the screen projection authority priority of the application. And the condition of screen throwing confusion is avoided. For example, the electronic device 100 may display the multimedia content in the application with the highest priority of the screen-throwing authority on the large-screen device, and whether the electronic device side switches to display the content in other applications, the multimedia content in the application with the highest priority of the screen-throwing authority is displayed on the large-screen or on the large-screen.

With reference to the first aspect, in one possible implementation manner, the electronic device is further configured to obtain the second screen content and send the second screen data to the large screen device through the screen connection when the screen access right of the second application is higher than the screen access right of the first application; and the large screen device is also used for displaying a fourth interface after receiving the second screen throwing data, wherein the fourth interface comprises second screen throwing content.

In this way, when the high screen-throwing authority priority application is switched to the low screen-throwing authority priority application, under the condition that the third interface of the second application supports the screen-throwing display on the large screen device after drawing on the virtual screen, the electronic device can display the multimedia content in the high screen-throwing authority priority application on the large screen device after drawing on the virtual screen.

With reference to the first aspect, in one possible implementation manner, the electronic device is further configured to obtain the second screen content and send the second screen data to the large screen device through the screen connection when the screen access right of the second application is higher than the screen access right of the first application; and the large screen device is also used for displaying a third interface after receiving the second screen throwing data.

When the high screen throwing authority priority application is switched to the low screen throwing authority priority application, the electronic equipment can acquire the second screen throwing data in a screen recording and/or recording mode under the condition that the third interface of the second application does not support the screen throwing display on the large screen equipment after being drawn on the virtual screen, so that the large screen equipment displays the third interface.

With reference to the first aspect, in one possible implementation manner, the electronic device is further configured to receive a third operation after the large-screen device continues to display the second interface, where the third operation is used for stopping the electronic device from displaying the first interface; the electronic equipment is also used for responding to the third operation and displaying a fourth interface; the electronic equipment is further used for responding to the fourth operation and displaying a fifth interface of the second application; the electronic equipment is also used for sending the third screen throwing data to the large screen equipment through screen throwing connection; the large screen device is also used for displaying a fifth interface after receiving the third screen throwing data;

Or the electronic equipment is also used for sending third screen projection data to the large screen equipment through screen projection connection to third screen projection content; and the large screen device is also used for displaying a sixth interface after receiving the third screen projection data, wherein the sixth interface comprises third screen projection content.

The fourth interface may be a user interface in the first application, or may be a user interface in another application (such as a desktop application), for example, a main interface of the electronic device.

The fifth interface may be the same as the third interface or may be different from the third interface.

In this way, after the electronic device stops displaying the first interface and the fourth interface does not support the screen projection display under the large screen device after drawing on the virtual screen, the electronic device can display the fourth interface screen projection on the large screen device based on the mirror image screen projection mode.

After the electronic device displays the fifth interface of the second application, if the fifth interface does not support the screen projection display on the large screen device after drawing on the virtual screen, the electronic device can display the fifth interface on the large screen device based on the mode of 'mirror image screen projection', and the large screen device displays the fifth interface.

Or,

after the electronic device displays the fifth interface of the second application, if the fifth interface supports drawing on the virtual screen and then screen-casting displaying on the large-screen device, the electronic device can draw the fifth interface on the virtual screen and then screen-casting displaying on the large-screen device.

In this way, the electronic device 100 may switch the screen-casting display of the multimedia content in the application with the lower screen-casting authority priority after the electronic device receives the user operation to cause the electronic device to stop displaying the user interface supported to be drawn on the virtual screen.

With reference to the first aspect, in one possible implementation manner, the large screen device is specifically configured to: the second interface is displayed full screen.

With reference to the first aspect, in one possible implementation manner, the large screen device is specifically configured to: the fourth interface is displayed full screen. Therefore, the user interface is drawn on the virtual screen and then displayed on the large-screen equipment, so that the size of the screen throwing content is matched with the screen size of the large-screen equipment, and the screen utilization rate of the large-screen equipment is improved.

With reference to the first aspect, in one possible implementation manner, the large screen device is specifically configured to: the third interface is not displayed full screen. Therefore, the user interface does not support to be displayed on the large-screen device after being drawn on the virtual screen, the electronic device can only record the screen-throwing content in a screen recording and/or recording mode, and the size of the screen-throwing content cannot be matched with the screen size of the large-screen device.

With reference to the first aspect, in one possible implementation manner, the electronic device is further configured to: acquiring equipment information of large-screen equipment, wherein the equipment information of the large-screen equipment comprises one or more of the following items: the screen size of the large screen device, the color format of the screen of the large screen device and the pixel density of the screen of the large screen device; the electronic equipment is also used for acquiring the first screen throwing content through the first application before the first screen throwing content is sent to the large screen equipment through the screen throwing connection; and the electronic equipment generates first screen throwing data through the first application based on the first screen throwing content and equipment information of the large-screen equipment. Therefore, for the screen throwing content which is supported to be displayed on the large screen equipment on the screen throwing after being drawn on the virtual screen, the screen throwing content can be displayed on the large screen equipment on the screen throwing after being drawn on the virtual screen, the size of the screen throwing content is matched with the screen size of the large screen equipment, and the screen utilization rate of the large screen equipment is improved.

With reference to the first aspect, in one possible implementation manner, the first screen content includes all display content or part of display content in the first interface.

With reference to the first aspect, in one possible implementation manner, the first interface includes a plurality of layers; the first screen shot content includes display content of one or more layers in the first interface.

With reference to the first aspect, in one possible implementation manner, the first screen content includes display content of a sub-interface of the first interface.

With reference to the first aspect, in one possible implementation manner, the electronic device is further configured to obtain, based on an application type of the first application, a screen capturing permission of the first application; the electronic device is further configured to obtain, based on an application type of the second application, a screen-throwing authority of the second application. In this way, the electronic device can acquire the screen-throwing authority priority of the application based on the type of the application, so as to control the screen-throwing behavior of the application.

With reference to the first aspect, in one possible implementation manner, the electronic device is further configured to send, when the first interface is displayed, third screen-projection data to the large-screen device through a screen-projection connection; and the large screen device is also used for displaying the first interface after receiving the third screen projection data.

In a second aspect, the present application provides a screen projection method, including: the electronic equipment establishes screen-throwing connection with the large screen equipment; the electronic equipment displays a first interface; the electronic equipment receives a first operation aiming at a first interface, wherein the first operation is used for selecting first screen projection content; responding to a first operation, and sending first screen throwing data to the large screen equipment by the electronic equipment through screen throwing connection, wherein the first screen throwing data are used for displaying a second interface by the large screen equipment, and the second interface comprises first screen throwing content; the electronic device receives a second operation; in response to the second operation, the electronic device displays a third interface of the second application; and under the condition that the screen-throwing authority of the second application is lower than or equal to the screen-throwing authority of the first application, the electronic equipment instructs the large-screen equipment to continuously display the second interface.

With reference to the second aspect, in one possible implementation manner, the method further includes: and under the condition that the screen-throwing authority of the second application is higher than the screen-throwing authority of the first application, the electronic equipment acquires second screen-throwing content and sends second screen-throwing data to the large-screen equipment through screen-throwing connection, wherein the second screen-throwing data are used for displaying a fourth interface of the large-screen equipment, and the fourth interface comprises the second screen-throwing content.

With reference to the second aspect, in one possible implementation manner, the method further includes: and under the condition that the screen-throwing authority of the second application is higher than the screen-throwing authority of the first application, the electronic equipment acquires second screen-throwing content and sends second screen-throwing data to the large-screen equipment through screen-throwing connection, and the second screen-throwing data are used for displaying a third interface by the large-screen equipment.

With reference to the second aspect, in one possible implementation manner, after the electronic device instructs the large screen device to continue displaying the second interface, the method further includes: the electronic equipment receives a third operation, wherein the third operation is used for stopping displaying the first interface by the electronic equipment; in response to the third operation, the electronic device displays a fourth interface; the electronic device receives a fourth operation; in response to the fourth operation, the electronic device displays a fifth interface of the second application; the electronic equipment sends third screen throwing data to the large screen equipment through screen throwing connection, wherein the third screen throwing data are used for displaying a fifth interface of the large screen equipment; or the electronic equipment acquires third screen projection content, and sends third screen projection data to the large screen equipment through screen projection connection, wherein the third screen projection data are used for displaying a sixth interface of the large screen equipment, and the sixth interface comprises the third screen projection content.

With reference to the second aspect, in one possible implementation manner, the first screen throwing data is used for displaying the second interface on the large screen device in a full screen mode.

With reference to the second aspect, in one possible implementation manner, the second screen throwing data is used for displaying the fourth interface on the large screen device in a full screen mode.

With reference to the second aspect, in one possible implementation manner, the second projection data is used for displaying the third interface on the large screen device in a non-full screen manner.

With reference to the second aspect, in one possible implementation manner, after the electronic device establishes a screen-casting connection with the large-screen device, the method further includes: the electronic equipment acquires equipment information of the large-screen equipment, wherein the equipment information of the large-screen equipment comprises one or more of the following items: the screen size of the large screen device, the color format of the screen of the large screen device and the pixel density of the screen of the large screen device; before the electronic device sends the first screen-projection data to the large-screen device through the screen-projection connection, the method further comprises: the electronic equipment acquires first screen throwing content through a first application; the electronic device generates first screen throwing data based on the first screen throwing content and device information of the large screen device through the first application.

With reference to the second aspect, in one possible implementation manner, the first screen-cast content includes all display content or part of display content in the first interface.

With reference to the second aspect, in one possible implementation manner, the first interface includes a plurality of layers; the first screen shot content includes display content of one or more layers in the first interface.

With reference to the second aspect, in one possible implementation manner, the first screen-dropping content includes display content of a sub-interface of the first interface.

With reference to the second aspect, in one possible implementation manner, the method further includes: the first electronic equipment acquires screen-throwing permission of a first application based on the application type of the first application; the first electronic equipment acquires the screen throwing authority of the second application based on the application type of the second application.

With reference to the second aspect, in one possible implementation manner, when the electronic device displays the first interface, the method further includes: and the electronic equipment sends third screen throwing data to the large screen equipment through screen throwing connection, and the third screen throwing data are used for displaying the first interface by the large screen equipment.

In a third aspect, the present application provides a screen projection method, including: the method comprises the steps that screen throwing connection is established between large-screen equipment and electronic equipment, wherein the electronic equipment displays a first interface of a first application; after the electronic equipment receives a first operation aiming at a first interface, the large-screen equipment receives first screen projection data sent by the electronic equipment through screen projection connection, wherein the first operation is used for selecting first screen projection content; after receiving the first screen throwing data, the large screen equipment displays a second interface, wherein the second interface comprises first screen throwing content; after the electronic equipment displays the third interface of the second application, the large-screen equipment continues to display the second interface under the condition that the screen-throwing authority of the second application is lower than or equal to the screen-throwing authority of the first application.

With reference to the third aspect, in one possible implementation manner, the method includes: under the condition that the screen-throwing authority of the second application is higher than that of the first application, the large-screen equipment receives second screen-throwing data sent by the electronic equipment through screen-throwing connection; and after receiving the second screen throwing data, the large screen equipment displays a fourth interface, wherein the fourth interface comprises second screen throwing content.

With reference to the third aspect, in one possible implementation manner, the method includes: under the condition that the screen-throwing authority of the second application is higher than that of the first application, the large-screen equipment receives second screen-throwing data sent by the electronic equipment through screen-throwing connection; and after receiving the second screen throwing data, the large screen device displays a third interface.

With reference to the third aspect, in one possible implementation manner, after the large screen device continues to display the second interface, the method further includes: the large screen device receives third screen throwing data sent by the electronic device after the electronic device stops displaying the first interface and displays a fifth interface of the second application; after the large screen device receives the third screen throwing data, a fifth interface is displayed; or after receiving the third screen projection data, the large screen device displays a sixth interface, wherein the sixth interface comprises third screen projection content.

With reference to the third aspect, in one possible implementation manner, the large screen device displays a second interface, specifically includes: the large screen device displays the second interface full screen.

With reference to the third aspect, in one possible implementation manner, the large screen device displays a fourth interface, specifically includes: the large screen device displays the fourth interface full screen.

With reference to the third aspect, in one possible implementation manner, the large screen device displays the third interface, and specifically includes that the large screen device displays the third interface in a non-full screen manner.

With reference to the third aspect, in one possible implementation manner, the first screen content includes all display content or part of display content in the first interface.

With reference to the third aspect, in one possible implementation manner, the first interface includes a plurality of layers; the first screen shot content includes display content of one or more layers in the first interface.

With reference to the third aspect, in one possible implementation manner, the first screen-dropping content includes display content of a sub-interface of the first interface.

With reference to the third aspect, in one possible implementation manner, after the large-screen device establishes the screen-throwing connection with the electronic device, before the large-screen device receives the first screen-throwing data sent by the electronic device through the screen-throwing connection, the method further includes: the large screen device receives third screen throwing data sent by the electronic device through screen throwing connection; and after receiving the third screen projection data, the large screen device displays a first interface.

In a fourth aspect, the present application provides a screen projection system, the system comprising an electronic device and a large screen device, wherein,

the electronic equipment is used for establishing screen throwing connection with the large screen equipment; the electronic equipment is also used for displaying a first interface of a first application, wherein the first application is a shopping application, and the first interface is a main interface of the first application or a commodity list interface of the first application; the electronic equipment is further used for receiving a first operation aiming at the first interface, wherein the first operation is an operation of clicking a link of a first commodity; the electronic equipment is also used for responding to the first operation, acquiring first screen projection content and sending first screen projection data to the large-screen equipment through screen projection connection; the large screen device is used for displaying a second interface after receiving the first screen throwing data, and the second interface comprises first screen throwing content; the second interface is a picture of the first commodity or a detail page of the first commodity.

With reference to the fourth aspect, in one possible implementation manner, the large screen device is specifically configured to: the second interface is displayed full screen.

With reference to the fourth aspect, in one possible implementation manner, the electronic device is further configured to: acquiring equipment information of large-screen equipment, wherein the equipment information of the large-screen equipment comprises one or more of the following items: the screen size of the large screen device, the color format of the screen of the large screen device and the pixel density of the screen of the large screen device; the electronic equipment is further used for acquiring the first screen throwing content through a first application before the first screen throwing content is sent to the large screen equipment through screen throwing connection; and the electronic equipment generates first screen throwing data through the first application based on the first screen throwing content and equipment information of the large-screen equipment.

With reference to the fourth aspect, in a possible implementation manner, the electronic device is further configured to obtain, before receiving the first operation for the first interface, second screen content, and send second screen data to the large screen device through a screen connection; and the large screen device is also used for displaying the first interface after receiving the second screen throwing data.

In other possible implementations, after the electronic device obtains the first screen content through the first application, the first screen content may be sent to the large screen device, and the large screen device generates first screen data based on the first screen content and device information of the large screen device, and displays the first screen content.

Optionally, when the electronic device obtains the address of the first screen content through the first application, the electronic device sends the address of the first screen content to the large screen device, and the large screen device may obtain the first screen content based on the address of the first screen content. And generating first screen throwing data based on the first screen throwing content and the equipment information of the large-screen equipment, and displaying the first screen throwing content.

In a fifth aspect, the present application provides an electronic device, including: one or more processors, one or more memories; the one or more memories are coupled to the one or more processors, the one or more memories are configured to store computer program code comprising computer instructions that the one or more processors invoke to cause the electronic device to perform a method of screening provided in any of the possible implementations of the above.

In a sixth aspect, the present application provides a large screen apparatus, the large screen apparatus comprising: one or more processors, one or more memories; the one or more memories are coupled to the one or more processors, the one or more memories are configured to store computer program code comprising computer instructions that the one or more processors invoke to cause the large screen device to perform a method of screen casting provided in any of the possible implementations of the above.

In a seventh aspect, the present application provides a computer readable storage medium for storing computer instructions that, when executed on an electronic device, cause the electronic device to perform a method of screening provided in any one of the possible implementations of the above.

In an eighth aspect, the present application provides a computer readable storage medium for storing computer instructions that, when run on a large screen device, cause the large screen device to perform a screen projection method provided in any one of the possible implementations of the above aspect.

In a ninth aspect, the present application provides a computer program product which, when run on an electronic device, causes the electronic device to perform a method of screening provided in any one of the possible implementations of the above.

In a tenth aspect, the present application provides a computer program product which, when run on a large screen device, causes the large screen device to perform a method of screening provided in any one of the possible implementations of the above.

For the description of the beneficial effects of the second aspect to the tenth aspect, reference may be made to the description of the beneficial effects of the first aspect, and embodiments of the present application are not described herein again.

Drawings

Fig. 1A is a scene of sharing network video by an electronic device and a large screen based on mirror image projection according to an embodiment of the present application;

fig. 1B is a schematic diagram of size of a screen content and size mismatch of a large screen according to an embodiment of the present application;

fig. 1C is a schematic diagram illustrating a scenario in which an electronic device and a large screen share a network video based on online screen casting according to an embodiment of the present application;

FIG. 2 is a system architecture diagram provided in an embodiment of the present application;

fig. 3 is a schematic structural diagram of an electronic device 100 according to an embodiment of the present application;

fig. 4 is a software block diagram of an electronic device 100 according to an embodiment of the present application;

fig. 5 is a schematic hardware structure of a large screen 200 according to an embodiment of the present application;

Fig. 6A-6E schematically illustrate a schematic diagram of an electronic device 100 establishing a screen-casting connection with a large screen 200;

7A-7H illustrate schematic diagrams of electronic device 100 receiving a user operation to change a screen-cast permission level of an application;

8A-8D illustrate schematic diagrams of the electronic device 100 displaying video drops in a Hua video application on a large screen 200;

9A-9D illustrate schematic diagrams of a sub-interface of electronic device 100 displaying interface one on large screen 200;

10A-10D illustrate schematic diagrams of a sub-interface of electronic device 100 displaying interface one on large screen 200;

11A-11D illustrate schematic diagrams of a partial area of the electronic device 100 displaying interface one on the large screen 200;

FIG. 12 is a UI diagram provided in an embodiment of the present application;

13A-13D illustrate schematic diagrams of a large screen 200 switching display of cast screen content;

FIG. 14 is another UI diagram provided by an embodiment of the present application;

fig. 15 is a schematic flowchart of a method of screen projection according to an embodiment of the present application;

fig. 16 is a schematic flow chart of another method for screen projection according to an embodiment of the present application;

fig. 17 is a schematic flow chart of a method of still another screen projection method according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and thoroughly described below with reference to the accompanying drawings. Wherein, in the description of the embodiments of the present application, "/" means or is meant unless otherwise indicated, for example, a/B may represent a or B; the text "and/or" is merely an association relation describing the associated object, and indicates that three relations may exist, for example, a and/or B may indicate: the three cases where a exists alone, a and B exist together, and B exists alone, and in addition, in the description of the embodiments of the present application, "plural" means two or more than two.

The terms "first," "second," and the like, are used below for descriptive purposes only and are not to be construed as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature, and in the description of embodiments of the present application, unless otherwise indicated, the meaning of "a plurality" is two or more.

The term "User Interface (UI)" in the following embodiments of the present application is a media interface for interaction and information exchange between an application program or an operating system and a user, which enables conversion between an internal form of information and an acceptable form of the user. A commonly used presentation form of the user interface is a graphical user interface (graphic user interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be a visual interface element of text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc., displayed in a display of the electronic device.

The electronic device may display content (such as the played multimedia content) displayed by the electronic device on a large screen (such as the played multimedia content) through wireless screen projection, and then the electronic device may continue to display the content or may not display the content any more. Other words can be adopted for replacing the wireless screen, such as multi-screen interaction and the like; the embodiments of the present application are not limited. The electronic device may also be referred to as an output terminal or a source terminal (source terminal), and the large screen may also be referred to as an input terminal or a sink terminal (sink terminal).

After the wireless screen is dropped, the multimedia content displayed or played by the electronic device may include any one or more of the following: video, text, pictures, photographs, audio, or forms, etc. For example, the multimedia content may be a movie, a television show, a short video, a musical show, etc.

The multimedia content may be network multimedia content, local multimedia content, or a combination of network multimedia content and local multimedia content. The network multimedia content refers to multimedia content obtained by the electronic equipment from a network. Such as video acquired from a server providing audio-video services while the electronic device is running a video application. The local multimedia content is multimedia content stored or generated locally by the electronic device. For example, pictures or tables, etc., stored locally on the electronic device.

Two wireless screen throwing modes are introduced: mirror screen (mirroring technology) and on-line screen.

1. Mirror image screen projection: the electronic equipment (such as a smart phone, a tablet personal computer and the like) establishes communication connection with a large screen (such as a smart television, a smart screen and the like), acquires multimedia content from a network side or a local side, and then transmits the multimedia content to the large screen in a wireless transmission mode such as point-to-point transmission after encoding; the large screen is decoded and then output (such as display, playing, etc.).

Wherein the multimedia content may be network multimedia content, local multimedia content, or a combination of both. The point-to-point transmission mode between the electronic device and the large screen may include, but is not limited to: wireless fidelity direct (wireless fidelity direct), also known as Wi-Fi point-to-point (Wi-Fi P2P), communication connection, bluetooth communication connection, near field communication (near field communication, NFC) connection, and the like.

The mirror projection may include miracast, established by Wi-Fi alliance, private mirror projection solutions established by companies such as cast from chinese, airPlay from apple, etc. Wherein miracast builds on the basic technical standards developed by the Wi-Fi alliance of wireless fidelity and on the real-time streaming protocol (real time streaming protocol, RTSP). Wi-Fi base technology standards can include wireless transmission technologies 802.11n, 802.11ac, wi-Fi direct/Wi-Fi P2P, channel direct Link setup (tunneled direct link setup, TDLS), WPA2 (Wi-Fiprotected access 2) encryption to manage security, WMM (Wi-Fimultimedia) technology to provide quality of service and traffic management, and so forth.

The mirror projection is further described below in conjunction with FIG. 1A. Fig. 1A illustrates a scenario in which an electronic device and a large screen share network video based on mirrored screen casting. As shown in fig. 1A, the electronic device establishes a communication connection (e.g., a Wi-FiP2P connection) with the large screen. Meanwhile, the electronic equipment is connected with the routing equipment, and the streaming media is acquired from the server through the routing equipment. The electronic device accesses the routing device, and may specifically be an Access Point (AP) provided by the electronic device access routing device. Then, the electronic equipment acquires the screen recording content and the recording content in the modes of screen recording, recording and the like in the process of playing the streaming media, and then respectively codes the screen recording content and the recording content in real time and then sends the coded contents to a large screen through Wi-Fi P2P connection; and after the large screen receives the information, playing and displaying the information in real time.

The mirror projection has the following problems: after the electronic equipment and the large screen are connected in a mirror image mode, when a user frequently switches the multimedia content on the mobile phone side, the screen throwing content displayed on the large screen is frequently switched. In some cases, however, the user need only switch the display of multimedia content on the electronic device, and not the large screen, as opposed to the user's intent.

Problem 2, as shown in fig. 1B, when the electronic device displays a picture 201 in a gallery application on a vertical screen, the display size of the picture 201 on the electronic device is a and B is wide. The electronic device drops the picture to a large screen, the picture 202 is displayed on the large screen, and the display size of the picture 202 on the electronic device is c and d. Wherein a: c=b: d. That is, the electronic device enlarges or reduces the length and width of the picture 201 in equal proportion and then displays the enlarged or reduced length and width on the large screen, and displays a black area in an area where the picture is not displayed, resulting in insufficient screen utilization of the large screen.

2. On-line screen throwing: the electronic equipment and the large screen are connected to the Internet or a local area network, and the electronic equipment only sends the network address, such as a uniform resource locator (uniform resource locator, URL), corresponding to the multimedia resource to be screened to the large screen; and the large screen acquires corresponding multimedia content from the Internet side or the local area network side according to the network address, so as to output (e.g. play and display).

Wherein the multimedia content may be network multimedia content, local multimedia content, or a combination of both. Here, the electronic device and the large screen access to a local area network formed by the same wireless Wi-Fi access point AP, and the electronic device and the large screen are connected to different networks, for example, access to different local area networks formed by different APs, and the different local area networks are interconnected through the internet.

The online screen may include a DLNA, a proprietary online screen solution formulated by each company. Such as Google cast from Google corporation, airPlay from apple corporation, etc. Among them, DLNA builds on top of the universal plug and play (universal plug and play, UPnP) protocol.

The on-line projection is further described below in conjunction with FIG. 1C. FIG. 1C illustrates a scenario in which an electronic device and a large screen share network video based on online screen casting. As shown in fig. 1C, the electronic device and the large screen are commonly connected to a local area network formed by Wi-Fi APs, the electronic device sends the website of the played network video to the large screen through the AP, and then the large screen obtains the multimedia content according to the website. The web address is the address of the server providing the network audio and video service.

The following problems exist in online screen projection: the problem 1 is that different protocols supporting online screen projection are different from each other in different current applications, and the method has no unified standard and relatively poor universality.

Based on the analysis, the embodiment of the application provides a screen projection method. The method comprises the following steps:

step one: the electronic device 100 establishes a screen-casting connection with the large screen 200.

Step two: the electronic device 100 acquires device information of the large screen 200.

Among them, the device information of the large screen 200 includes, but is not limited to: the address of the large screen 200, the name of the large screen 200, the screen size of the large screen 200, the color format of the screen on the large screen 200, the pixel density of the screen on the large screen 200, etc.

The electronic device 100 obtains a first virtual display screen based on the device information of the large screen 200.

Step three: the electronic device 100 displays the first multimedia content of application one. In the case where the first multimedia content supports redrawing, a screen-cast content is drawn based on the device information of the large screen 200 and the first multimedia content. Wherein, the size of the screen contents is the same as the screen size of the large screen 200.

Step four: the electronic device 100 transmits the screen contents to the large screen 200, and the large screen 200 displays the screen contents in full screen.

In the case that the first multimedia content does not support redrawing, the electronic device 100 may acquire the screen-casting content based on the manner of recording and/or recording, and send the screen-casting content to the large screen 200, where the large screen 200 displays the first multimedia content. In the case where the screen size of the electronic device 100 is different from the screen size of the large screen 200, the large screen 200 displays the first multimedia content in a non-full screen manner.

According to the screen projection method, on one hand, the fact that the large screen 200 can display part of interfaces in the application in a full screen mode is achieved, namely, the screen utilization rate of the large screen 200 is 100%, and the problem that the screen utilization rate of the large screen 200 is insufficient is solved.

On the other hand, the application one rendered on-screen content may be the same as or different from the multimedia content of which the electronic device 100 displays application one. In the case where the application one rendered screen content is different from the multimedia content of the electronic device 100 display application one, it is achieved that different applications may personalize the rendered screen content.

It should be noted that, based on different service scenarios, the application may set some user interfaces in the application to be displayed on the large screen 200 in a mirror image screen-throwing manner, or may set some user interfaces in the application to be displayed on the large screen 200 after redrawing based on the device information of the large screen 200. Different applications may be customized, which is not limited by the embodiments of the present application. For example, in the gallery application, when a certain picture in the gallery application is displayed or when a certain video in the gallery application is displayed, the gallery application redraws the picture interface or the video interface based on the device information of the large screen 200 and then drops the screen to display on the large screen 200. For example, in a video application, when a certain video in the video application is displayed, the video application may redraw the video interface based on the device information of the large screen 200 and then display the redrawn video interface on the large screen 200. For example, in the shopping application, when the detail page of a certain commodity in the shopping application is displayed, the shopping application redraws the detail page of the commodity based on the device information of the large screen 200 and then drops the screen to display on the large screen 200. For other interfaces within the application, the electronic device 100 may be displayed on the large screen 200 in a mirrored screen-casting manner.

Alternatively, in some embodiments, the user interface within the application may also all support a redrawn post-screen display on the large screen 200. The embodiments of the present application are not limited in this regard.

Fig. 2 illustrates a system architecture diagram provided in an embodiment of the present application.

As shown in fig. 2, the system includes an electronic device 100 and a large screen 200.

The electronic device 100 establishes a screen-casting connection with the large screen 200, i.e., the electronic device 100 may screen-cast the screen content on the large screen 200.

Not limited to the electronic device 100 establishing a screen-cast connection with the large screen 200, in other embodiments, the electronic device 100 may establish a screen-cast connection with multiple (two and more) devices simultaneously. For example, the electronic device 100 establishes a screen-casting connection with the large screen 200 and the large screen 300 at the same time, and the electronic device 100 may respectively screen-cast and display the same screen-casting content on the large screen 200 and the large screen 300. Alternatively, the electronic device 100 may also display different screen contents on the large screen 200 and the large screen 300. The embodiments of the present application are not limited in this regard.

The electronic device 100 may be a cell phone, tablet, desktop, laptop, handheld, notebook, ultra-mobile personal computer (ultra-mobile personal computer, UMPC), netbook, as well as a cellular telephone, personal digital assistant (personal digital assistant, PDA), augmented reality (augmented reality, AR) device, virtual Reality (VR) device, artificial intelligence (artificial intelligence, AI) device, wearable device, vehicle-mounted device, smart home device, and/or smart city device, with the specific types of such electronic devices not being particularly limited in the embodiments of the present application. Software systems of electronic device 100 include, but are not limited to Linux, or other operating systems. />Is a hong Mongolian system.

The large screen 200 may be a tablet computer, desktop computer, portable electronic device (e.g., laptop computer, laptop), smart television (e.g., smart screen), vehicle computer, smart speaker, augmented reality (augmented reality, AR) device, virtual Reality (VR) device, electronic billboard with display, stand-alone (e.g., projection)On a wall) or in combination with a display device such as a curtain, other smart devices with a display screen, other smart devices with speakers, etc. Exemplary embodiments of large screen 200 include, but are not limited to, piggybacking Linux, or other operating system devices. In some embodiments, the large screen 200 may be a television configured with a television box for receiving multimedia content from the electronic device 100 and providing a screen-casting function, the television providing only a display function. The following embodiments of the present application will be described with respect to a large screen 200 as an example of a television.

After the electronic device 100 establishes a screen-throwing connection with the large screen 200, the electronic device 100 may acquire device information of the large screen 200, where the device information of the large screen 200 includes, but is not limited to: the address of the large screen 200, the name of the large screen 200, the screen size of the large screen 200, the color format of the screen on the large screen 200, the pixel density of the screen on the large screen 200, etc.

The electronic device 100 receives the multimedia content in the application one for user operation and displays, in the case that the large screen 200 does not display the screen-casting content, and the currently displayed multimedia content in the application one supports redrawing and then the screen-casting is displayed on the large screen 200, so that the application redraws the screen-casting content based on the multimedia content in the application one and the device information of the large screen 200 to obtain the first screen-casting content. The electronic device 100 sends the first screen content to the large screen 200 based on the screen-cast connection such that the large screen 200 displays the first screen content full screen.

If the multimedia content in the application one currently displayed does not support the redrawing and then the screen is displayed on the large screen 200, the electronic device 100 acquires the screen content in a screen recording and/or recording mode, and the electronic device 100 sends the screen content to the large screen 200, so that the large screen 200 displays the multimedia content in the application one in a non-full screen mode.

Then, the electronic device 100 receives the user operation to display the multimedia content in the application two, and if the screen-throwing priority of the application one is higher than or equal to the screen-throwing priority of the application two, the large screen 200 displays the first screen-throwing content.

Under the condition that the screen projection priority of the first application is lower than that of the second application, the second application redraws the screen projection content based on the multimedia content in the second application and the equipment information of the large screen 200, and the second screen projection content is obtained. The electronic device 100 sends the second screen content to the large screen 200 based on the screen-cast connection such that the large screen 200 displays the second screen content.

Thus, on one hand, the large screen 200 can display the screen throwing content in a full screen mode, namely, the screen utilization rate of the large screen 200 is 100%, and the problem of insufficient screen utilization rate of the large screen 200 is solved. On the other hand, the different applications each draw the screen-cast content, which may be the same as or different from the multimedia content within the application displayed by the electronic device 100. In the case that the screen contents drawn by the application are different from the multimedia contents of the application displayed by the electronic device 100, the screen contents drawn by different applications can be personalized.

The following embodiments of the present application will be described with reference to the electronic device 100 as a mobile phone.

Fig. 3 shows a schematic structural diagram of the electronic device 100.

The electronic device 100 may be a cell phone, tablet, desktop, laptop, handheld, notebook, ultra-mobile personal computer (ultra-mobile personal computer, UMPC), netbook, as well as a cellular telephone, personal digital assistant (personal digital assistant, PDA), augmented reality (augmented reality, AR) device, virtual Reality (VR) device, artificial intelligence (artificial intelligence, AI) device, wearable device, vehicle-mounted device, smart home device, and/or smart city device, with the specific types of such electronic devices not being particularly limited in the embodiments of the present application.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

It should be understood that the illustrated structure of the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.

The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.

It should be understood that the interfacing relationship between the modules illustrated in the embodiments of the present invention is only illustrative, and is not meant to limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also use different interfacing manners, or a combination of multiple interfacing manners in the foregoing embodiments.

The charge management module 140 is configured to receive a charge input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charge management module 140 may receive a charging input of a wired charger through the USB interface 130. In some wireless charging embodiments, the charge management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.

The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 to power the processor 110, the internal memory 121, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be configured to monitor battery capacity, battery cycle number, battery health (leakage, impedance) and other parameters. In other embodiments, the power management module 141 may also be provided in the processor 110. In other embodiments, the power management module 141 and the charge management module 140 may be disposed in the same device.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional module, independent of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless localarea networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., as applied to the electronic device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 150 of electronic device 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that electronic device 100 may communicate with a network and other devices through wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (longterm evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (globalnavigation satellite system, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).

The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (flex), a Mini led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

The electronic device 100 may implement photographing functions through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the electronic device 100 may be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.

The internal memory 121 may include one or more random access memories (random access memory, RAM) and one or more non-volatile memories (NVM).

The external memory interface 120 may be used to connect external non-volatile memory to enable expansion of the memory capabilities of the electronic device 100. The external nonvolatile memory communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and video are stored in an external nonvolatile memory.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The electronic device 100 may listen to music, or to hands-free conversations, through the speaker 170A.

A receiver 170B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When electronic device 100 is answering a telephone call or voice message, voice may be received by placing receiver 170B in close proximity to the human ear.

Microphone 170C, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 170C through the mouth, inputting a sound signal to the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may also be provided with three, four, or more microphones 170C to enable collection of sound signals, noise reduction, identification of sound sources, directional recording functions, etc.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be a USB interface 130 or a 3.5mm open mobile electronic device platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. The capacitance between the electrodes changes when a force is applied to the pressure sensor 180A. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 may also calculate the location of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example: when a touch operation with the touch operation intensity lower than the first pressure threshold value is applied to the short message application icon, an instruction for checking the short message is executed. And executing an instruction for newly creating the short message when the touch operation with the touch operation intensity higher than or equal to the first pressure threshold acts on the short message application icon.

The gyro sensor 180B may be used to determine a motion gesture of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., x, y, and z axes) may be determined by gyro sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects the shake angle of the electronic device 100, calculates the distance to be compensated by the lens module according to the angle, and makes the lens counteract the shake of the electronic device 100 through the reverse motion, so as to realize anti-shake. The gyro sensor 180B may also be used for navigating, somatosensory game scenes.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, electronic device 100 calculates altitude from barometric pressure values measured by barometric pressure sensor 180C, aiding in positioning and navigation.

The magnetic sensor 180D includes a hall sensor. The electronic device 100 may detect the opening and closing of the flip cover using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip machine, the electronic device 100 may detect the opening and closing of the flip according to the magnetic sensor 180D. And then according to the detected opening and closing state of the leather sheath or the opening and closing state of the flip, the characteristics of automatic unlocking of the flip and the like are set.

The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the electronic device 100 is stationary. The electronic equipment gesture recognition method can also be used for recognizing the gesture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, the electronic device 100 may range using the distance sensor 180F to achieve quick focus.

The proximity light sensor 180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it may be determined that there is an object in the vicinity of the electronic device 100. When insufficient reflected light is detected, the electronic device 100 may determine that there is no object in the vicinity of the electronic device 100. The electronic device 100 can detect that the user holds the electronic device 100 close to the ear by using the proximity light sensor 180G, so as to automatically extinguish the screen for the purpose of saving power. The proximity light sensor 180G may also be used in holster mode, pocket mode to automatically unlock and lock the screen.

The ambient light sensor 180L is used to sense ambient light level. The electronic device 100 may adaptively adjust the brightness of the display 194 based on the perceived ambient light level. The ambient light sensor 180L may also be used to automatically adjust white balance when taking a photograph. Ambient light sensor 180L may also cooperate with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent false touches.

The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 may utilize the collected fingerprint feature to unlock the fingerprint, access the application lock, photograph the fingerprint, answer the incoming call, etc.

The temperature sensor 180J is for detecting temperature. In some embodiments, the electronic device 100 performs a temperature processing strategy using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs a reduction in the performance of a processor located in the vicinity of temperature sensor 180J in order to reduce power consumption to implement thermal protection. In other embodiments, when the temperature is below another threshold, the electronic device 100 heats the battery 142 to avoid the low temperature causing the electronic device 100 to be abnormally shut down. In other embodiments, when the temperature is below a further threshold, the electronic device 100 performs boosting of the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperatures.

The touch sensor 180K, also referred to as a "touch device". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a different location than the display 194.

The bone conduction sensor 180M may acquire a vibration signal. In some embodiments, bone conduction sensor 180M may acquire a vibration signal of a human vocal tract vibrating bone pieces. The bone conduction sensor 180M may also contact the pulse of the human body to receive the blood pressure pulsation signal. In some embodiments, bone conduction sensor 180M may also be provided in a headset, in combination with an osteoinductive headset. The audio module 170 may analyze the voice signal based on the vibration signal of the sound portion vibration bone block obtained by the bone conduction sensor 180M, so as to implement a voice function. The application processor may analyze the heart rate information based on the blood pressure beat signal acquired by the bone conduction sensor 180M, so as to implement a heart rate detection function.

The keys 190 include a power-on key, a volume key, etc. The keys 190 may be mechanical keys. Or may be a touch key. The electronic device 100 may receive key inputs, generating key signal inputs related to user settings and function controls of the electronic device 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration alerting as well as for touch vibration feedback. For example, touch operations acting on different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also correspond to different vibration feedback effects by touching different areas of the display screen 194. Different application scenarios (such as time reminding, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc.

The SIM card interface 195 is used to connect a SIM card.

The software system of the electronic device 100 may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the invention, taking an Android system with a layered architecture as an example, a software structure of the electronic device 100 is illustrated.

Fig. 4 is a software configuration block diagram of the electronic device 100 according to the embodiment of the present invention.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun rows (Android run) and system libraries, and a kernel layer (kernel). The embodiment of the application does not limit the layering of the software structure of the electronic equipment.

It should be understood that the modules included in the respective layers shown in fig. 4 are modules referred to in the embodiments of the present application, and the modules included in the respective layers below do not constitute limitations on the structure of the electronic device and the hierarchy (illustration) of the module arrangement. For example, the rendering module may be deployed at an application layer or at an application framework layer. In one embodiment, the modules shown in FIG. 4 may be deployed alone, or several modules may be deployed together, with the division of modules in FIG. 4 being an example. In one embodiment, the names of the modules shown in FIG. 4 are exemplary.

The application layer may include a series of application packages. Such as camera, gallery, calendar, talk, map, navigation, WLAN, bluetooth, music, video, short message, etc.

The application framework layer may provide an application programming interface (application programming interface, API) and programming framework for applications of the application layer. The application framework layer may include some predefined functions. Referring to fig. 4, the application framework layer may include: a system service module, a virtual screen, a window management service (window manager service, WMS), a rendering module, and a Surface layer compositing (SF).

The system service module can inform each application program whether the screen throwing authority exists or not, and control the screen throwing behavior of the application program and the like.

The virtual screen, the device information of which is the same as the device information of the device (e.g., large screen 200) of which the electronic device 100 establishes the screen-casting connection, may be used by the application to draw the screen-casting content on the virtual screen. For example, the virtual screen is the same size as the device (e.g., large screen 200) that the electronic device 100 establishes the screen-casting connection.

WMS for managing user interfaces. And the drawing module is used for drawing each element on the screen projection interface displayed on the screen projection equipment by application. And the rendering module is used for rendering the elements drawn by the drawing module. SF, which is used to make layer synthesis for each element after rendering, so as to obtain the screen projection interface to be displayed on the screen projection equipment.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

Fig. 5 shows a hardware structure of the large screen 200 provided in the embodiment of the present application.

As shown in fig. 5, the large screen 200 may include: video codec 221, processor 222, memory 223, wireless communication processing module 224, power switch 225, wired LAN communication processing module 226, high definition multimedia interface (high definition multimedia interface, HDMI) communication processing module 227, USB communication processing module 228, display screen 229, audio module 230. The modules may be connected by a bus. Wherein:

Processor 222 may be used to read and execute computer readable instructions. In particular implementations, processor 222 may include primarily controllers, operators, and registers. The controller is mainly responsible for instruction decoding and sending out control signals for operations corresponding to the instructions. The arithmetic unit is mainly responsible for performing fixed-point or floating-point arithmetic operations, shift operations, logic operations, and the like, and may also perform address operations and conversions. The register is mainly responsible for storing register operands, intermediate operation results and the like temporarily stored in the instruction execution process. In a specific implementation, the hardware architecture of the processor 222 may be an Application Specific Integrated Circuit (ASIC) architecture, a MIPS architecture, an ARM architecture, an NP architecture, or the like.

The wireless communication processing module 224 may include a WLAN communication processing module 224A, and may also include a Bluetooth (BT) communication processing module 224B, NFC processing module 224C, a cellular mobile communication processing module (not shown), and the like.

In some embodiments, the wireless communication processing module 224 may be configured to establish a communication connection with the electronic device 100 and receive encoded data transmitted by the electronic device 100 based on the communication connection. For example, the WLAN communication processing module 224A may be used to establish a Wi-Fi direct communication connection with the electronic device 100, the Bluetooth (BT) communication processing module 224B may be used to establish a bluetooth communication connection with the electronic device 100, the NFC processing module 224C may be used to establish an NFC connection with the electronic device 100, and so on. That is, the wireless communication processing module 224 may support sharing of multimedia content between the electronic device 100 and the electronic device 100 through a drop-in screen connection.

In one embodiment, the wireless communication processing module 224 may monitor signals transmitted by the electronic device 100, such as probe requests, scanning signals, discover the electronic device 100, and establish a communication connection with the electronic device 100. In another embodiment, the wireless communication processing module 224 may also transmit signals, such as probe requests, scanning signals, so that the large screen 200 may discover the electronic device 100 and establish a communication connection (e.g., wi-FiP2P connection) with the electronic device 100.

The video codec 221 is used to compress or decompress digital video. In the present embodiment, the video codec 221 may decompress multimedia content from the electronic device 100 or a server. The large screen 200 may support one or more video codecs that may play video in one or more encoding formats. For example: MPEG1, MPEG2, MPEG3, MPEG4, etc.

The processor 222 may be used to parse signals received by the wireless communication processing module 224, such as broadcast probe requests from the large screen 200, and the like. The processor 222 may be configured to perform corresponding processing operations, such as generating probe responses, etc., based on the parsing results. The processor 222 may be used to drive the display screen 229 to perform display according to the decompression result of the video codec 221.

A memory 223 is coupled to the processor 222 for storing various software programs and/or sets of instructions. In particular implementations, memory 223 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 223 may store an operating system, such as an embedded operating system, for example uCOS, vxWorks, RTLinux, harmony, android. Memory 223 may also store communication programs that may be used to communicate with large screen 200, one or more servers, or additional devices.

The power switch 225 may be used to control the power supplied by the power source to the large screen 200.

The wired LAN communication processing module 226 may be used to communicate with other devices in the same LAN through a wired LAN, and may also be used to connect to the WAN through a wired LAN, and may communicate with devices in the WAN.

The HDMI communication processing module 227 can be used to communicate with other devices through an HDMI interface (not shown).

The USB communication processing module 228 may be used to communicate with other devices via a USB interface (not shown).

The display screen 229 may be used to display images, video, and the like. The display 229 may be a display LCD, OLED, AMOLED, FLED, QLED or the like. The content displayed on the display 229 may be referred to in connection with the description of the method embodiments that follow.

The audio module 230 may be configured to output audio signals via an audio output interface, which may enable the large screen 200 to support audio playback. The audio module 230 may also be used to receive audio data through an audio input interface. The audio module 230 may include, but is not limited to: microphones, speakers, receivers, etc.

In some embodiments, the large screen 200 may also include a serial interface such as an RS-232 interface. The serial interface can be connected to other devices, such as audio playback devices, such as speakers, so that the display and the audio playback devices cooperate to play audio and video.

It will be appreciated that the configuration illustrated in fig. 5 does not constitute a particular limitation of the large screen 200. In other embodiments of the present application, large screen 200 may include more or fewer components than shown, or certain components may be combined, certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

First, a manner of establishing a screen-throwing connection between the electronic device 100 and the large screen 200 will be described.

The electronic device 100 receives an operation of a user to open a screen connection function in a setup application, and selects a device that establishes a screen connection.

Fig. 6A-6E schematically illustrate a schematic diagram of the electronic device 100 establishing a screen-cast connection with a large screen 200.

Fig. 6A shows a schematic diagram of the electronic device 100 displaying a main interface of a setup application. The main interface of the setup application includes a plurality of setup options, such as a flight mode setup option, wi-Fi setup option, bluetooth setup option, personal hotspot setup option, mobile network setup option, do not disturb mode setup option, display and brightness setup option, home account setup option, more connection setup option, and so forth.

As shown in fig. 6A, the electronic device 100 receives an input operation (e.g., a click) by the user for more connection setting options, and in response to the input operation by the user, the electronic device 100 displays a user interface 610 as shown in fig. 6B. The user interface 610 shows a number of connection options, such as a Hua Ding option, an NFC option, a cell phone drop option, a print option, a VPN option, an encryption DNS option, and so forth. Wherein, the mobile phone screen throwing function is closed.

As shown in fig. 6B, the electronic device 100 receives an input operation (e.g., a click) of the user for a cell phone screen option, and in response to the input operation of the user, the electronic device 100 displays a user interface 620 as shown in fig. 6C. The user interface 620 shows an option 6201 to turn on/off the handset cast function and an option 6202 to set application cast rights management. Wherein, the mobile phone screen throwing function is closed.

As shown in fig. 6C, the electronic device 100 receives an input operation (e.g., a click) of the user for turning on/off the option 6201 of the mobile phone screen-casting function, and in response to the input operation of the user, the electronic device 100 displays the user interface 630 as shown in fig. 6D. As shown in fig. 6D, the display mode of the option 6201 for turning on/off the screen function of the mobile phone is switched from the off state to the on state.

After the mobile phone screen-throwing function on the electronic device 100 is started, the electronic device 100 scans other surrounding devices which also start the screen-throwing function. As shown in fig. 6D, other devices in the vicinity where electronic device 100 scans to turn on the screen-casting function include large screen 200, large screen 300, and large screen 400.

As shown in fig. 6D, the electronic device 100 receives an input operation (e.g., a click) of an option of the large screen 200 by the user, and in response to the input operation by the user, the electronic device 100 will establish a screen-casting connection with the large screen 200.

After the electronic device 100 will establish a screen connection with the large screen 200, the electronic device 100 will display a prompt 6203 as shown in fig. 6E, where the prompt 6203 is used to prompt that the electronic device 100 has established a screen connection with the large screen 200.

Optionally, in some embodiments, after the electronic device 100 establishes a screen connection with the large screen 200, the electronic device 100 may also establish a screen connection with another device (for example, the large screen 300) based on the manner shown in fig. 6A-6E, so as to implement that the electronic device 100 establishes a screen connection with a plurality of different devices at the same time.

It should be noted that fig. 6A-6E are only exemplary manners of establishing a screen connection between the electronic device 100 and the large screen 200, and in other embodiments, the electronic device 100 may also establish a screen connection with the large screen 200 in other manners, which is not limited in the embodiments of the present application.

In the screen projection method provided by the embodiment of the present application, after the electronic device 100 establishes the screen projection connection with the large screen 200, the electronic device 100 receives the multimedia content of the application one by the operation of the user, and the electronic device 100 can screen-project the multimedia content in the application one on the large screen. If the electronic device 100 receives the operation of the user to display the multimedia content of the application two, the electronic device 100 may display the multimedia content in the application two on the large screen when the screen-throwing authority of the application two is higher than the screen-throwing authority of the application one. If the screen-throwing authority of the application two is lower than or equal to the screen-throwing authority of the application one, the electronic device 100 will also display the multimedia content in the application one on the large screen without switching the multimedia content of the display screen. In this way, the situation that the screen contents are frequently switched on the electronic device 100 and the screen is chaotic due to the frequent switching of the multimedia contents in different applications can be avoided.

Therefore, the electronic device 100 may divide only applications installed on the electronic device 100 into different levels of screen-throwing permissions, and the applications with high level of screen-throwing permissions may preempt the screen-throwing channels of the applications with high and low level of screen-throwing permissions. The application of the low-level screen-throwing authority can not preempt the screen-throwing channel of the application of the high-level screen-throwing authority. The application of the same-level screen-throwing authority can not preempt the screen-throwing channel of the application of the same-level screen-throwing authority. It is achieved that the electronic device 100 can manage the screen-throwing behavior of the application.

For example, the electronic device 100 may divide the screen of the application on the electronic device 100 into three levels, namely, a first level screen-throwing authority, a second level screen-throwing authority, and a third level screen-throwing authority. The first-level screen-throwing authority is higher than the second-level screen-throwing authority, and the second-level screen-throwing authority is higher than the third-level screen-throwing authority. Not only three levels, the electronic device 100 may also divide more applications on the electronic device 100 into more or fewer levels of screen-throwing authority, which is not limited in the embodiment of the present application.

Wherein, the application of the first-level screen-throwing authority can include but is not limited to: system applications including, but not limited to: such as desktop applications. For example, desktop applications may be described as productivity desktops, computer modes, and so forth.

Applications of the second level of screen-cast rights may include, but are not limited to: video class applications, instant messaging class applications, music class applications, god view game class applications, and the like. The god view game application can be understood as a sightseeing mode or a third view game application.

Applications of third level of screen-cast permissions may include, but are not limited to: gallery applications, office class applications, first view game class applications, and the like.

Optionally, in the application of the first-level screen-throwing authority and the application of the second-level screen-throwing authority, when the electronic device 100 exits to display the multimedia content in the first-level screen-throwing authority application or the second-level screen-throwing authority application, the large screen 200 may still display the screen-throwing content in the first-level screen-throwing authority application or the second-level screen-throwing authority application.

Optionally, in the third-level screen-projection authority application, when the electronic device 100 exits displaying the multimedia content in the third-level screen-projection authority application, the display is stopped on the large screen 200 along with the stopping of the display of the electronic device 100.

Alternatively, when there is a newly downloaded application on the electronic device 100, the electronic device 100 may set the screen-casting authority level of the newly downloaded application based on the newly downloaded application type.

Optionally, when the application type of the preset screen capturing permission does not include the newly downloaded application type, the electronic device 100 may set the screen capturing permission level of the newly downloaded application to the lowest level. Alternatively, the electronic device 100 may set the newly downloaded application to not support screen casting. The embodiments of the present application are not limited to specific implementations.

It should be noted that, the application types included in each level of screen-throwing authority may be changed according to the needs of the developer in practical application, and may be different from those listed in the foregoing embodiments, and the embodiments of the present application are merely exemplary and not limiting.

In some embodiments, the electronic device 100 divides the applications on the electronic device 100 into different screen-throwing authority levels, and the electronic device 100 can also receive the operations of the user to change the screen-throwing authority levels of the applications, so as to realize personalized customization and improve the experience of the user.

Fig. 7A-7H illustrate schematic diagrams of electronic device 100 receiving a user operation to change a screen-cast permission level of an application.

As shown in fig. 7A, the electronic device 100 receives an input operation (e.g., a single click) by a user for setting an option 6202 for applying screen-casting rights management in the user interface 620, and in response to the input operation by the user, the electronic device 100 may display a user interface 710 as shown in fig. 7B.

Different drop right level options are shown in the user interface 710. Such as a first level of screen shot rights option, a second level of screen shot rights option 7101, and a third level of screen shot rights option. Wherein the electronic device 100 may receive an input operation (e.g., a single click) of the user for the screen-throwing authority level option, and in response to the input operation of the user, the electronic device 100 may display one or more applications divided under the corresponding screen-throwing authority level.

As shown in fig. 7B, the electronic device 100 receives an input operation (e.g., a single click) of the user for the second-level screen-throwing authority option 7101, and in response to the input operation of the user, the electronic device 100 may display an icon and a name of an application under the second-level screen-throwing authority as shown in fig. 7C. For example, applications under the second level of projection rights include Hua as a video application, an instant messaging application, a music application, and the like.

Alternatively, the electronic device 100 may receive an operation of the user to delete the application from each level of the screen-casting authority. For example, the electronic device 100 may receive an input operation (e.g., a single click) by a user for a delete control as shown in fig. 7C, and in response to the input operation by the user, the electronic device 100 may remove the corresponding application from under the second level of screen-cast permissions. For example, the electronic device 100 receives an input operation (e.g., a single click) by the user for the delete control 7102 as shown in fig. 7D, and in response to the input operation by the user, the electronic device 100 may remove the video from the second-level screen-cast authority. After the electronic device 100 removes the video from the second level of screen-casting authority, the electronic device 100 may display a user interface 720 as shown in fig. 7E. User interface 720 differs from user interface 710 in that in user interface 720, the second level of screen-casting rights do not include the Hua as a video application.

Optionally, after the electronic device 100 removes the bloom video from the second level of screen-throwing authority, the electronic device 100 may divide the bloom video to the lowest level of screen-throwing authority (i.e., the third level of screen-throwing authority). Optionally, after the electronic device 100 removes the video with the bloom number from the second-level screen projection authority, the electronic device 100 may also divide the bloom number into the video without the bloom number to any one level of screen projection authority, and default the bloom number is that the video does not support the screen projection function.

Alternatively, the electronic device 100 may receive an operation of the user to add other applications under each level of screen-casting authority. For example, the electronic device 100 may receive an input operation (e.g., a single click) by the user for the add application control 7103, and in response to the input operation by the user, the electronic device 100 may add other applications under the second level of screen-drop rights. For example, as shown in fig. 7F, the electronic device 100 receives an input operation (e.g., a click) by the user for adding the application control 7103, and in response to the input operation by the user, the electronic device 100 may display a prompt bar 7110 as shown in fig. 7G. The electronic device 100 may receive a slide up and down operation by the user on the prompt 7110 so that the electronic device 100 may display additional applications in the prompt 7110.

As shown in fig. 7G, the electronic device 100 receives an input operation by the user for the shopping application option in the prompt field 7110, and selects the shopping application. Thereafter, the electronic device 100 receives an input operation (e.g., a click) of the user for the determination option in the prompt field 7110, and in response to the input operation of the user, the electronic device 100 may add the shopping application under the second-level screen-throwing authority, that is, set the screen-throwing authority of the shopping application as the second-level screen-throwing authority. Thereafter, the electronic device 100 may display a user interface 730 as shown in fig. 7H, the user interface 730 differing from the user interface 710 in that applications included under the second level of screen-casting authority, and shopping applications, are included.

It should be noted that fig. 7A to fig. 7H are only schematic diagrams illustrating the screen-throwing authority of the changing application, and in practical applications, the implementation of the screen-throwing authority of the changing application may be different from that shown in fig. 7A to fig. 7H, which is not limited in this embodiment of the present application.

After the electronic device 100 establishes a screen-cast connection with the large screen 200, the electronic device 100 may receive multimedia content of the user-operated display application one. The application one can redraw the screen throwing content based on the device information of the large screen 200 and the multimedia content of the application one, so that the size of the image frame or the image frame in the screen throwing content is the same as the size of the display screen of the large screen 200, and the screen utilization rate of the large screen 200 can be improved.

It should be noted that, an application may set some user interfaces to be displayed on the large screen 200 in a mirror image screen-projection manner, and an application may also set some user interfaces to be displayed on the large screen 200 after redrawing based on the device information of the large screen 200. Different applications may be customized, which is not limited by the embodiments of the present application. For example, in the gallery application, when a certain picture in the gallery application is displayed or when a certain video in the gallery application is displayed, the gallery application redraws the picture interface or the video interface based on the device information of the large screen 200 and then drops the screen to display on the large screen 200. For example, in a video application, when a certain video in the video application is displayed, the video application may redraw the video interface based on the device information of the large screen 200 and then display the redrawn video interface on the large screen 200. For example, in the shopping application, when the detail page of a certain commodity in the shopping application is displayed, the shopping application redraws the detail page of the commodity based on the device information of the large screen 200 and then drops the screen to display on the large screen 200.

For example, the application one may be a video application, and the multimedia content of the electronic device 100 displaying the application one may be a video playing interface in the video application displayed by the electronic device 100.

Fig. 8A-8D schematically illustrate a schematic diagram of the electronic device 100 displaying video drops in a video application on a large screen 200.

As shown in fig. 8A (a), the electronic device 100 displays a main interface 801. As shown in (b) of fig. 8A, the electronic device 100 may display the main interface 801 on the large screen 200 in a mirror-image screen-projection manner.

The main interface 801 of the electronic device 100 includes icons of a plurality of application programs, such as an icon of a weather application, an icon of a Hua shop application, an icon of a shopping application, an icon of a Hua video application, an icon of a calendar application, an icon of a gallery application, an icon of a camera application, an icon of an address book application, and an icon of a telephone application. The main interface 801 of the electronic device 100 also includes calendar indicators, weather indicators, page indicators, power indicators, and the like.

As shown in (a) of fig. 8A, the electronic device 100 receives an input operation (e.g., a click) of an icon for a video by a user, and in response to the input operation by the user, the electronic device 100 may display an interface for the video application as shown in (a) of fig. 8B. A plurality of video thumbnail images are shown in the interface of the video application. As shown in (B) of fig. 8B, the electronic device 100 may display an interface of the video application on the large screen 200 in a mirror-image screen-casting manner.

As shown in (a) of fig. 8B, the electronic device 100 receives an input operation (e.g., a click) of a video thumbnail of "brave stride" by the user, and in response to the input operation by the user, the electronic device 100 may display a video interface 802 as shown in (a) of fig. 8C. The video interface 802 includes video frames and profile information of the video, and the profile information of the video may be, for example, a name of the video, a total number of sets of the video, a number of sets of the video being played, a play amount of the video, a type of the video, a play progress of the video, and the like.

In one possible implementation, the Hua video application may draw a screen-drop interface based on the video frames shown in video interface 802, the device information of large screen 200, and send the screen-drop interface to large screen 200 through a screen-drop connection between electronic device 100 and large screen 200 so that large screen 200 may display the screen-drop interface, e.g., large screen 200 may display screen-drop interface 803 as shown in (b) of fig. 8C.

In other possible implementations, the Hua-Cheng video application may draw a screen-drop interface based on the video frames shown in the video interface 802, the profile information of the video, the device information of the large screen 200, and send the screen-drop interface to the large screen 200 through a screen-drop connection between the electronic device 100 and the large screen 200, so that the large screen 200 may display the screen-drop interface, e.g., the large screen 200 may display the screen-drop interface 804 shown in (b) of fig. 8D. The screen projection interface 804 is different from the screen projection interface 803 in that the screen projection interface 804 includes, in addition to the video frame, the name of the video and the play progress of the video.

Optionally, after the electronic device 100 establishes a screen-casting connection with the large screen 200, the electronic device 100 may receive a user operation to display the interface one of the application one. The electronic device 100 receives the first operation of the user on the first interface, and in response to the first operation, the electronic device 100 may screen a sub-interface (or a next-level interface called the first interface) of the first internal interface on the large screen 200. In one possible implementation, after the large screen 200 displays the sub-interface of interface one, the electronic device 100 may display the sub-interface of interface one. In other possible implementations, after the large screen 200 displays the sub-interface of the interface one, the electronic device 100 may also display the interface one, which is not limited in the embodiment of the present application.

By way of example, the application one may be a shopping application. Interface one may be the main interface of the shopping application.

Fig. 9A-9D schematically illustrate a sub-interface of the electronic device 100 displaying interface one on the large screen 200.

As shown in (a) of fig. 9A, the electronic device 100 displays a main interface 801. As shown in (b) of fig. 9A, the electronic device 100 may display the main interface 801 on the large screen 200 in a mirror-image screen-projection manner.

As shown in (a) of fig. 9A, the electronic device 100 receives an input operation (e.g., a click) of an icon of the shopping application in the main interface 801 by a user, and in response to the input operation by the user, the electronic device 100 may display a user interface 901 of the shopping application as shown in (a) of fig. 9B. As shown in (B) of fig. 9B, the electronic device 100 may screen-display the user interface 901 on the large screen 200 in a mirror-image screen-casting manner.

The user interface 901 may be a merchandise recommendation page of a shopping application. The user interface 901 may include a merchandise display area. The commodity display area can display a plurality of recommended commodity icons, and the recommended commodity icons can be used for triggering and displaying commodity detail pages corresponding to the recommended commodity icons. Optionally, the user interface 901 may also include a personal center control, a swipe control, a merchandise search bar, and the like.

As shown in fig. 9B, the electronic device 100 receives an input operation (e.g., a click) from a user on the basketball shoe commodity icon, and in response to the input operation from the user, as shown in fig. 9C (a), the electronic device 100 also displays a user interface 901. As shown in fig. 9C (b), in response to an input operation (e.g., clicking) of the basketball shoe commodity icon by the user, the shopping application acquires a sub-interface of the user interface 901 (or referred to as a next-level interface of the user interface 901), draws a screen-throwing interface based on the sub-interface of the user interface 901 and device information of the large screen 200, and transmits the screen-throwing interface to the large screen 200 through a screen-throwing connection between the electronic device 100 and the large screen 200, so that the large screen 200 may display the screen-throwing interface, for example, the large screen 200 may display the screen-throwing interface 902 as shown in fig. 9C (b). The screen interface 902 includes a picture of basketball shoes, a merchandise profile of basketball shoes, store links, purchase options, collection options, etc., and the screen interface 902 is a sub-interface of the user interface 901. In this way, electronic device 100 may screen a sub-interface of user interface 901 on large screen 200 so that a user may view a detailed page of an item on large screen 200.

In other possible implementations, in response to a user input operation (e.g., a single click) on a basketball shoe merchandise icon, as shown in fig. 9D (a), the electronic device 100 may display a user interface 903, the user interface 903 being a sub-interface of the user interface 901. As shown in fig. 9D (b), the large screen 200 displays a user interface 903. In this way, the electronic device 100 can display a detailed page of the article on the electronic device 100 and on a large screen at the same time.

Optionally, after the electronic device 100 establishes a screen-casting connection with the large screen 200, the electronic device 100 may receive a user operation to display the interface one of the application one. The electronic device 100 receives operation two of the user for interface one. And the second operation is the operation of selecting the picture. In response to operation two, the electronic device 100 may screen the picture selected by the user on the large screen 200. In one possible implementation, after the large screen 200 displays the user-selected picture, the electronic device 100 may also display interface one. In other possible implementations, after the large screen 200 displays the picture selected by the user, the electronic device 100 may also display the picture selected by the user, which is not limited in this embodiment of the present application.

Fig. 10A-10D schematically illustrate a sub-interface of the electronic device 100 displaying interface one on the large screen 200.

Referring to the embodiment of fig. 9A-9B, the electronic device 100 may display a user interface 901 of a shopping application.

As shown in fig. 10A (a), the electronic device 100 receives an input operation of a user for a basketball shoe commodity picture (for example, a selection operation of a display area where a basketball shoe commodity icon is located), and the large screen 200 displays a user interface 901 as shown in fig. 10A (b). Or as shown in fig. 10B (a), the electronic device 100 receives an input operation (e.g., a long press operation) by a user with respect to the basketball shoe commodity picture, the large screen 200 displays a user interface 901 as shown in fig. 10B (B), the electronic device 100 selects the basketball shoe commodity picture, and in response to the input operation by the user, the electronic device 100 displays the user interface 901 as shown in fig. 10C (a). As shown in fig. 10C (b), in response to the operation of the basketball shoe commodity picture by the user, the shopping application obtains the basketball shoe commodity picture, draws a screen-throwing interface based on the basketball shoe commodity picture and the device information of the large screen 200, and sends the screen-throwing interface to the large screen 200 through the screen-throwing connection between the electronic device 100 and the large screen 200, so that the large screen 200 may display the screen-throwing interface, for example, the large screen 200 may display the screen-throwing interface 1001 as shown in fig. 10C (b). Alternatively, the electronic device 100 may display not the user interface 901, but a basketball shoe commodity image, which is not limited in this embodiment of the present application.

In other possible implementations, in response to a user selecting a picture of the basketball shoe commodity, as shown in fig. 10D (a), the electronic device 100 also displays a user interface 901. As shown in fig. 10D, (b), in response to the operation of the user basketball shoe commodity image, the shopping application obtains the image of the basketball shoe commodity in a plurality of directions, draws a screen-throwing interface based on the image of the basketball shoe commodity in a plurality of directions and the device information of the large screen 200, and sends the screen-throwing interface to the large screen 200 through the screen-throwing connection between the electronic device 100 and the large screen 200, so that the large screen 200 may display the screen-throwing interface, for example, the large screen 200 may display the screen-throwing interface 1002 as shown in fig. 10D (b). The screen interface 1002 includes a front picture and a side picture of the basketball shoe merchandise. Not only limited to the front side picture and the side picture, the shopping application may also obtain other pictures in more aspects, such as pictures of the rear positions of basketball shoes, so that the large screen 200 may display pictures of other commodities in more aspects, which is not limited in the embodiment of the present application. Alternatively, the electronic device 100 may display not the user interface 901, but a front picture and a side picture of the basketball shoe commodity, which is not limited in the embodiment of the present application.

Optionally, after the electronic device 100 establishes a screen-casting connection with the large screen 200, the electronic device 100 may receive a user operation to display the interface one of the application one. The electronic device 100 receives operation three of the user for interface one. And the third operation is an operation of selecting a part of the area in the interface. In response to operation two, the electronic device 100 may screen the partial area of the interface one selected by the user on the large screen 200. In one possible implementation, after the large screen 200 displays a partial region of the interface one selected by the user, the electronic device 100 may also display the interface one. In other possible implementations, after the large screen 200 displays the partial area of the first interface selected by the user, the electronic device 100 may also display the partial area of the first interface selected by the user, which is not limited in the embodiment of the present application. In this way, the electronic device 100 may display the content in the area selected by the user on the large screen 200 so that the user views the detailed content in the area selected by the user.

By way of example, application one may be a memo application. Interface one may be a memo main interface.

Fig. 11A-11D schematically illustrate a partial area of the electronic device 100 displaying an interface on the large screen 200.

As shown in (a) in fig. 11A, the electronic device 100 displays a main interface 801. As shown in (b) of fig. 11A, the electronic device 100 may display the main interface 801 on the large screen 200 in a mirror-image screen-projection manner.

As shown in (a) of fig. 11A, the electronic device 100 receives an input operation (e.g., a single click) of a user with respect to an icon of the memo application in the main interface 801, and in response to the input operation of the user, the electronic device 100 may display a user interface 1101 of the memo application as shown in (a) of fig. 11B. One or more note icons are displayed within the user interface 1101. Such as the icon of "note 5", the icon of "note 4", the icon of "note 3", and so forth. As shown in (B) of fig. 11B, the electronic device 100 may display the user interface 1101 on the large screen 200 in a screen-casting manner by mirroring.

As shown in fig. 11B (a), the electronic apparatus 100 receives an input operation (e.g., a click) of the icon of "note 5" by the user, and the electronic apparatus 100 displays a user interface 1102 shown in fig. 11C (a) corresponding to the input operation by the user. The user interface 1102 is the details of "note 5". As shown in (b) of fig. 11C, the electronic device 100 may screen-display the user interface 1102 on the large screen 200 by mirroring the screen.

As shown in fig. 11C (a), the electronic device 100 receives a selection operation of the user acting on the user interface 1102, and the electronic device 100 may screen-display a partial area of the user interface 1102 selected by the user on the large screen 200. Specifically, the memo application obtains a partial area of the user interface 1102 selected by the user, and draws a screen-throwing interface based on the partial area of the user interface 1102 selected by the user and the equipment of the large screen 200. The memo application transmits the screen-drop interface to the large screen 200 through a screen-drop connection between the electronic device 100 and the large screen 200 so that the large screen 200 can display the screen-drop interface. As shown in fig. 11D (a), the electronic device 100 also displays a user interface 1102, and the large screen interface displays a screen projection interface 1103 shown in fig. 11D (b), where the display content in the screen projection interface 1103 is the display content in the partial area of the user interface 1102 selected by the user. Alternatively, the electronic device 100 may not display the user interface 1102, but display a partial area of the user interface 1102 selected by the user, which is not limited in the embodiment of the present application.

Optionally, the electronic device 100 may also display the display content in the partial region of the user interface 1102 selected by the user on the large screen 200 in another language (e.g., english).

Alternatively, after the electronic device 100 displays the interface one of the application one and displays the multimedia content in the application one on the large screen 200, the electronic device 100 may receive the operation of the user to stop displaying the interface one of the application one. In one possible implementation, the large screen 200 may also continuously display multimedia content within an application one. In other possible implementations, after the electronic device 100 stops displaying the application one interface, the large screen 200 also stops displaying the multimedia content within the application one. The embodiments of the present application are not limited to specific implementations.

Referring to the embodiment shown in fig. 8D, after the electronic device 100 establishes a screen-casting connection with the large screen 200, the electronic device 100 may display a video interface 802 as shown in (a) of fig. 8D, and the large screen 200 may display a screen-casting interface 803 as shown in (b) of fig. 8C.

As shown in fig. 12, when the electronic device 100 receives the operation of the user to stop displaying the video interface 802, for example, when the electronic device 100 receives the operation of the user to the return key, the electronic device 100 displays the main interface 801 shown in (a) in fig. 12, and at this time, the large screen 200 still displays the multimedia content in the video application, for example, the large screen 200 continuously displays the screen-throwing interface 803, as shown in (b) in fig. 12.

Alternatively, after the electronic device 100 establishes a screen-cast connection with the large screen 200, the large screen 200 displays the multimedia content within the application one. Then, the electronic device 100 receives the multimedia content in the second application, and redraws the device information based on the multimedia content and the large screen 200 in the second application to obtain second screen-throwing content when the screen-throwing authority priority of the second application is higher than that of the first application, and sends the second screen-throwing content to the large screen 200 through the screen-throwing connection between the electronic device 100 and the large screen 200, so that the large screen 200 can display the second screen-throwing content.

For example, the application two may be a gallery application, and the multimedia content of the electronic device 100 displaying the application two may be a picture in the gallery application displayed by the electronic device 100. The screen-throwing authority priority of the gallery application is higher than that of the Hua screen-throwing application.

Fig. 13A-13D schematically illustrate a large screen 200 switching display of the screen contents.

As shown in (a) of fig. 13A, the electronic device 100 displays a main interface 801. As shown in (b) of fig. 13A, the electronic device 100 may display the main interface 801 on the large screen 200 in a mirror-image screen projection manner.

As shown in (a) of fig. 13A, the electronic device 100 receives an input operation (e.g., a click) of an icon of the gallery application by a user, and in response to the input operation by the user, the electronic device 100 may display an interface of the gallery application as shown in (a) of fig. 13B. As shown in (B) of fig. 13B, the electronic device 100 may display the interface of the gallery application on the large screen 200 in a mirror-image screen-casting manner. The gallery application interface shows a thumbnail of a plurality of pictures.

As shown in (a) of fig. 13B, the electronic device 100 receives an input operation (e.g., a click) by the user with respect to the thumbnail 1301, and in response to the input operation by the user, the electronic device 100 may display a user interface 1302 as shown in (a) of fig. 13C. The user interface 1302 includes a picture and a plurality of options. For example, the user interface 1302 includes pictures of animals (cats), return options, share options, favorites, edit options, delete options, more options, and so on.

In one possible implementation, the gallery application may draw a screen-drop interface based on the pictures shown in the user interface 1302 and the plurality of options, device information of the large screen 200, and send the screen-drop interface to the large screen 200 through a screen-drop connection between the electronic device 100 and the large screen 200, such that the large screen 200 may display the screen-drop interface, e.g., the large screen 200 may display the screen-drop interface 1303 shown in (b) of fig. 13C.

In other possible implementations, the gallery application may draw a screen-drop interface based on the picture shown in the user interface 1302, the device information of the large screen 200, and send the screen-drop interface to the large screen 200 through a screen-drop connection between the electronic device 100 and the large screen 200, such that the large screen 200 may display the screen-drop interface, e.g., the electronic device 100 may display the user interface 1302 shown in (a) in fig. 13D, and the large screen 200 may display the screen-drop interface 1304 shown in (b) in fig. 13D.

Alternatively, after the electronic device 100 establishes a screen-cast connection with the large screen 200, the large screen 200 displays the multimedia content within the application one. Then, the electronic device 100 receives the multimedia content in the second application, and if the screen-throwing authority priority of the second application is lower than or equal to the screen-throwing authority priority of the first application, the large screen 200 displays the multimedia content in the first application without switching the screen-throwing content.

For example, the application two may be a gallery application, and the multimedia content of the electronic device 100 displaying the application two may be a picture in the gallery application displayed by the electronic device 100. The screen-throwing authority priority of the gallery application is lower than or equal to the screen-throwing authority priority of the Chinese-style screen-watching application.

13A-13B, the electronic device 100 receives a user operation to display a user interface 1302.

As shown in fig. 14 (a), since the screen-throwing authority priority of the gallery application is lower than or equal to the screen-throwing authority priority of the Hua-into-view application, the electronic device 100 displays the user interface 1302 on the large screen 200 or displays the screen-throwing interface 803 as shown in fig. 14 (b). User interface 1302 is multimedia content in a gallery application and screen interface 803 is multimedia content in a video application. I.e. in case the electronic device 100 establishes a screen-cast connection with the large screen 200, multimedia content within different applications may be displayed on the electronic device 100 and on the large screen 200.

Fig. 15 is a schematic flowchart of a method of screen projection according to an embodiment of the present application.

The electronic device 100 includes a system service module, an application one, and an application two.

S1501, the electronic device 100 establishes a screen-throwing connection with the large screen 200, and the system service module acquires device information of the large screen 200 and detects a screen-throwing state.

For how the electronic device 100 establishes a screen-casting connection with the large screen 200, reference may be made to the embodiments shown in fig. 6A to 6E, and the embodiments of the present application will not be described herein again.

After the electronic device 100 establishes a screen-throwing connection with the large screen 200, the system service module may obtain device information of the large screen 200, where the device information of the large screen 200 includes, but is not limited to: the address of the large screen 200, the name of the large screen 200, the screen size of the large screen 200, the color format of the screen on the large screen 200, the pixel density of the screen on the large screen 200, etc.

The system service module is further configured to detect a screen-throwing state, that is, determine whether or not the multimedia content in the application is currently being displayed on the large screen 200.

S1502, an application is registered with the system service module.

S1503, registering the second application to the system service module.

The first application and the second application are respectively registered to the system service module, and are used for acquiring the screen-throwing state and the equipment information of the large screen 200 in real time. The screen-throwing state is used for determining whether the screen can be thrown currently or not by the application I and the application II. The device information of the large screen 200 is used for the application one and the application two to draw the screen throwing content through the device information of the large screen 200 under the condition that the screen throwing can be determined.

Alternatively, S1502 and S1503 may be performed before S1501 or after S1501, which is not limited in the embodiment of the present application.

S1504, starting the application one, and displaying the multimedia content in the application one.

S1505, after the application one displays the multimedia content, the system service module will determine whether there is an application in the screen casting?

In the case where there is no application in the screen casting at present, and the application-displayed multimedia content is supported for redrawing and then displayed on the large screen 200, the system service module performs S1506.

When there is an application on the screen, but the screen-throwing authority priority of the application on the screen is lower than the screen-throwing authority priority of the application one, and the application one displayed multimedia content is supported to be redrawn and then displayed on the large screen 200, the system service module executes S1506.

If there is an application currently on the screen, and the screen-throwing authority priority of the application currently on the screen is higher than or equal to the screen-throwing authority priority of the application one, the service module of the system does not execute S1506, i.e. the application one currently cannot throw the screen.

S1506, the system service module sends a screen-throwing start instruction to the application.

S1507, in the state of not being applied to screen casting, equipment information based on the large screen 200 and multimedia content in the application I are applied to draw to obtain first screen casting content.

The electronic device 100 displays multimedia content of application one, for example, displays an interface one of application one, which may obtain content displayed within interface one from locally or from a server of application one, or synthesizes a plurality of different layers of application one, or sub-interfaces of interface one (or a next-level interface referred to as interface one).

In one possible implementation, when the screen is displayed on the large screen 200 after the interface one of the application one supports redrawing, then the application one may draw the first screen content based on the content displayed in the interface one and the device information of the large screen 200, where the size of the first screen content is the same as the screen size of the large screen 200. The content displayed in the first screen-drop content is the same as the content displayed in the interface one, and the interface layout of the first screen-drop content and the interface one may be different.

In other possible implementations, when the screen is displayed on the large screen 200 after the interface one of the application one supports redrawing, the application one may draw the first screen content based on a portion of the content displayed in the interface one and the device information of the large screen 200, where the size of the first screen content is the same as the screen size of the large screen 200. The content displayed in the first screen projection content is the same as part of the content displayed in the interface I. The partial content may be text, pictures, etc. displayed within interface one.

In other possible implementations, interface one may be composed of multiple different layers while interface one of application one supports redrawing and then screen-casting to be displayed on large screen 200. The application one can draw first screen contents based on one or more layers of the composite interface one and the equipment information of the large screen 200, and the size of the first screen contents is the same as the screen size of the large screen 200.

In other possible implementations, when the sub-interface of the interface one supports redrawing and then the screen is displayed on the large screen 200, after the interface one is displayed, the electronic device 100 receives the operation of the user on the interface one, and applies a first screen content that may be drawn based on the sub-interface of the interface one (or referred to as the next-level interface of the interface one) and the device information of the large screen 200, where the size of the first screen content is the same as the screen size of the large screen 200.

If the application of the displayed multimedia content does not support redrawing and then the screen is displayed on the large screen 200, the electronic device 100 acquires the screen content in a screen recording and/or recording mode, and the electronic device 100 sends the screen content to the large screen 200, so that the large screen 200 displays the application of the displayed multimedia content in a non-full screen mode.

On the one hand, the application draws the screen throwing content, and different applications can draw different screen throwing contents, so that personalized screen throwing is realized. On the other hand, the application redraws the screen throwing content, so that the size of the screen throwing content can be drawn based on the size of the large screen 200, and the size of the screen throwing content is matched with the size of the large screen 200, so that the annoying screen utilization rate of the large screen 200 is improved.

S1508, apply a screen connection to send the first screen content to the large screen 200 via the electronic device 100 and the large screen 200.

S1509, after receiving the first screen contents, the large screen 200 displays the first screen contents.

S1510, opening the second application and displaying the multimedia content in the second application.

Alternatively, after the electronic device 100 stops displaying the multimedia content within application one, the large screen 200 may continue to display the first screen content in one possible implementation. In other possible implementations, after the electronic device 100 stops displaying the multimedia content within application one, the large screen 200 also stops displaying the first screen content.

It is assumed that the large screen 200 may continue to display the first screen content after the electronic device 100 stops displaying the multimedia content within application one. For example, the electronic device 100 opens the application two and displays the multimedia content in the application two, and the large screen 200 displays the first screen content.

S1511, after the second application is started, the system service module will determine whether the screen-dropping priority of the second application is higher than the screen-dropping priority of the first application?

And under the condition that the screen-throwing priority of the application two is higher than that of the application one, and the multimedia content displayed by the application one supports redrawing and is displayed on the large screen 200, the system service module executes S1512 and S1513.

And if the system service module determines that the screen-throwing priority of the application two is lower than or equal to the screen-throwing priority of the application one, the system service module executes S1507.

S1512, the system service module sends a screen-throwing start instruction to the application II.

S1513, the system service module sends a screen-throwing stopping instruction to the application.

After the application receives the stop screen-drop instruction, an execution stop S1507-S1509 is applied.

After the application II receives the start screen throwing instruction, the application initially executes S1514-S1516.

And S1514, under the condition that the screen-throwing priority of the second application is higher than that of the first application, the multimedia content displayed by the second application is supported to be redrawn and then displayed on the large screen 200, and the second application is based on the equipment information of the large screen 200 and the multimedia content in the second application, so that the second screen-throwing content is obtained by drawing.

For the principle of how to draw the second screen content and how to draw the first screen content, the principle is similar, and specific reference may be made to the related description in S1507, and the embodiments of the present application are not repeated here.

S1515, the second screen content is sent to the large screen 200 through the screen connection between the electronic device 100 and the large screen 200 by the second application.

S1516, after receiving the second screen content, the large screen 200 displays the second screen content.

Fig. 16 is a flowchart of another screen projection method according to an embodiment of the present application.

And S1601, the electronic equipment and the large-screen equipment are connected in a screen throwing way.

The electronic device may be electronic device 100 and the large screen device may be large screen 200.

For the manner in which the electronic device establishes the screen-throwing connection with the large-screen device, reference may be made to the descriptions in the embodiments of fig. 6A to 6E, which are not repeated in the embodiments of the present application.

S1602, the electronic device displays a first interface of a first application.

The first application may be, for example, the Hua video application shown in fig. 8B. The first interface may be the main interface of the Hua video application shown in fig. 8B.

The first application may also be a shopping application as shown in FIG. 9B. The first interface may be the user interface 901 of the shopping application shown in FIG. 9B.

The first application may also be a memo application shown in fig. 11B. The first interface may be the user interface 1101 of the memo application illustrated in fig. 11B.

S1603, the electronic device receives a first operation for the first interface, where the first operation is used to select the first screen content.

The first operation may be an input operation for a video thumbnail of "brave stride" shown in fig. 8B.

The first operation may also be an input operation for the basketball shoe merchandise icon shown in fig. 9B.

The first operation may also be an input operation for the icon of "note 5" shown in fig. 11B.

S1604, responding to the first operation, and sending the first screen throwing data to the large screen device through the screen throwing connection by the electronic device.

S1605, after receiving the first screen projection data, displaying a second interface, wherein the second interface comprises the first screen projection content.

In one possible implementation, the large screen device is specifically configured to: the second interface is displayed full screen. Therefore, the user interface is drawn on the virtual screen and then displayed on the large-screen equipment, so that the size of the screen throwing content is matched with the screen size of the large-screen equipment, and the screen utilization rate of the large-screen equipment is improved.

The second interface may be a drop interface 803 shown in fig. 8C (b). The second interface may be a drop screen interface 804 shown in fig. 8D (b).

The second interface may also be a drop interface 902 as shown in (b) of fig. 9C.

The second interface may also be a drop interface 1001 shown in fig. 10C (b). The second interface may also be a drop interface 1002 as shown in (b) of fig. 10D.

The second interface may also be a drop interface 1103 shown in (b) of fig. 11D.

S1606, the electronic device receives a third interface that displays the second application in response to the second operation.

The second application may be a gallery application.

The third interface may be the user interface 1302 shown in fig. 14 (a).

S1607, under the condition that the screen-throwing authority of the second application is lower than or equal to the screen-throwing authority of the first application, the large-screen equipment continues to display the second interface.

The large screen device continuing to display the second interface may be a drop screen interface 803 shown in fig. 14 (b).

In one possible implementation manner, the electronic device is further configured to obtain the second screen content and send the second screen data to the large-screen device through the screen connection when the screen-throwing authority of the second application is higher than the screen-throwing authority of the first application; and the large screen device is also used for displaying a fourth interface after receiving the second screen throwing data, wherein the fourth interface comprises second screen throwing content.

The large screen device is specifically used for: the fourth interface is displayed full screen. Therefore, the user interface is drawn on the virtual screen and then displayed on the large-screen equipment, so that the size of the screen throwing content is matched with the screen size of the large-screen equipment, and the screen utilization rate of the large-screen equipment is improved.

By way of example, the fourth interface may be the drop screen interface 1304 shown in fig. 13D (b).

In one possible implementation manner, the electronic device is further configured to obtain the second screen content and send the second screen data to the large-screen device through the screen connection when the screen-throwing authority of the second application is higher than the screen-throwing authority of the first application; and the large screen device is also used for displaying a third interface after receiving the second screen throwing data.

In one possible implementation, the large screen device is specifically configured to: the third interface is not displayed full screen. Therefore, the user interface does not support to be displayed on the large-screen device after being drawn on the virtual screen, the electronic device can only record the screen-throwing content in a screen recording and/or recording mode, and the size of the screen-throwing content cannot be matched with the screen size of the large-screen device.

In one possible implementation manner, the electronic device is further configured to receive a third operation after the large-screen device continues to display the second interface, where the third operation is used for stopping the electronic device from displaying the first interface; the electronic equipment is also used for responding to the third operation and displaying a fourth interface; the electronic equipment is further used for responding to the fourth operation and displaying a fifth interface of the second application; the electronic equipment is also used for sending the third screen throwing data to the large screen equipment through screen throwing connection; the large screen device is also used for displaying a fifth interface after receiving the third screen throwing data;

Or,

In one possible implementation, the electronic device is further configured to: acquiring equipment information of large-screen equipment, wherein the equipment information of the large-screen equipment comprises one or more of the following items: the screen size of the large screen device, the color format of the screen of the large screen device and the pixel density of the screen of the large screen device; the electronic equipment is also used for acquiring the first screen throwing content through the first application before the first screen throwing content is sent to the large screen equipment through the screen throwing connection; and the electronic equipment generates first screen throwing data through the first application based on the first screen throwing content and equipment information of the large-screen equipment. Therefore, for the screen throwing content which is supported to be displayed on the large screen equipment on the screen throwing after being drawn on the virtual screen, the screen throwing content can be displayed on the large screen equipment on the screen throwing after being drawn on the virtual screen, the size of the screen throwing content is matched with the screen size of the large screen equipment, and the screen utilization rate of the large screen equipment is improved.

Optionally, after the electronic device obtains the first screen content through the first application, the first screen content may be sent to the large screen device, and the large screen device generates the first screen content based on the first screen content and device information of the large screen device, and displays the first screen data.

In one possible implementation, the first screen shot content includes all or part of the display content within the first interface.

The first screen shot content may be display content within the user interface 903 shown in fig. 9D. The first screen shot content may also be a partial region of the user-selected user interface 1102 shown in fig. 11C (a).

With reference to the first aspect, in one possible implementation manner, the first screen content includes display content of a sub-interface of the first interface. The first drop content may be display content within the drop interface 902 shown in fig. 9C.

In one possible implementation manner, the electronic device is further configured to obtain, based on an application type of the first application, a screen-throwing authority of the first application; the electronic device is further configured to obtain, based on an application type of the second application, a screen-throwing authority of the second application. In this way, the electronic device can acquire the screen-throwing authority priority of the application based on the type of the application, so as to control the screen-throwing behavior of the application.

In one possible implementation manner, the electronic device is further configured to send, when the first interface is displayed, third screen-projection data to the large-screen device through the screen-projection connection; and the large screen device is also used for displaying the first interface after receiving the third screen projection data.

Illustratively, the large screen device displays a first interface, which may be the interface shown in (B) of fig. 8B, which is a video application.

The large screen device displays a first interface, which may also be the user interface 901 shown in (B) of fig. 9B. The large screen device displays a first interface, which may also be the user interface 1102 shown in fig. 11C (b).

Fig. 17 is a flowchart of another screen projection method according to an embodiment of the present application.

S1701, the electronic equipment and the large-screen equipment are connected in a screen throwing mode.

S1702, the electronic device displays a first interface of a first application, wherein the first application is a shopping application, and the first interface is a main interface of the first application or a commodity list interface of the first application.

The first interface may be the user interface 901 shown in FIG. 9B, the user interface 901 being the main interface for a shopping class application.

S1703, the electronic equipment receives a first operation aiming at the first interface, wherein the first operation is an operation of clicking a link of the first commodity.

The first operation may be an input operation for the basketball shoe merchandise icon in the user interface 901 as shown in fig. 9B.

The first operation may also be a selection operation for a display area in which the basketball shoe commodity icon is located as shown in fig. 10A (a).

The first operation may also be an operation of pressing the basketball shoe commodity picture for a long time as shown in fig. 10B (a).

The first article of merchandise may be basketball shoes.

In one possible implementation manner, the electronic device is further configured to obtain, before receiving the first operation for the first interface, second screen content, and send second screen data to the large-screen device through a screen connection; and the large screen device is also used for displaying the first interface after receiving the second screen throwing data. In one possible implementation, the large screen device is specifically configured to: the first interface is not displayed full screen.

The large screen device may not display the first interface full screen, and may be the non-full screen display user interface 901 shown in fig. 9B (a).

And S1704, responding to the first operation, and acquiring the first screen content by the electronic equipment.

S1705, the electronic equipment sends the first screen throwing data to the large screen equipment.

In one possible implementation, the electronic device is further configured to: acquiring equipment information of large-screen equipment, wherein the equipment information of the large-screen equipment comprises one or more of the following items: the screen size of the large screen device, the color format of the screen of the large screen device and the pixel density of the screen of the large screen device; the electronic equipment is further used for acquiring the first screen throwing content through a first application before the first screen throwing content is sent to the large screen equipment through screen throwing connection; and the electronic equipment generates first screen throwing data through the first application based on the first screen throwing content and equipment information of the large-screen equipment.

S1706, after receiving the first screen projection data, the large screen device displays a second interface, wherein the second interface comprises first screen projection content, and the second interface is a picture of the first commodity or a detail page of the first commodity.

In one possible implementation, the large screen device is specifically configured to: the second interface is displayed full screen.

The large screen device displays the second interface full screen, which may be the large screen device full screen display drop screen interface 902 shown in (b) in fig. 9C or (b) in fig. 9D.

The large screen device displays the second interface full screen, which may be the large screen device full screen display drop screen interface 1001 shown in (b) in fig. 10C.

The large screen device displays the second interface full screen, which may be the large screen device full screen display drop screen interface 1002 shown in (b) of fig. 10D.

The embodiments of the present application may be arbitrarily combined to achieve different technical effects.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a Solid State Disk (SSD)), or the like.

Those of ordinary skill in the art will appreciate that implementing all or part of the above-described method embodiments may be accomplished by a computer program to instruct related hardware, the program may be stored in a computer readable storage medium, and the program may include the above-described method embodiments when executed. And the aforementioned storage medium includes: ROM or random access memory RAM, magnetic or optical disk, etc.

In summary, the foregoing description is only exemplary embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of the present invention should be included in the protection scope of the present invention.

Claims

1. A screen projection system is characterized in that the system comprises an electronic device and a large screen device, wherein,

the electronic equipment is used for establishing screen throwing connection with the large screen equipment;

the electronic equipment is also used for displaying a first interface of the first application;

the electronic device is further configured to receive a first operation for the first interface, where the first operation is used to select first screen content;

The electronic equipment is further used for responding to the first operation and sending first screen throwing data to the large screen equipment through the screen throwing connection;

the large screen device is used for displaying a second interface after receiving the first screen projection data, and the second interface comprises the first screen projection content;

the electronic device is further configured to receive a second operation;

the electronic equipment is further used for responding to the second operation and displaying a third interface of a second application;

and the large-screen equipment is further used for continuously displaying the second interface under the condition that the screen-throwing authority of the second application is lower than or equal to the screen-throwing authority of the first application.

2. The system of claim 1, wherein the electronic device is further configured to obtain second screen content and send second screen data to the large screen device through the screen connection if the screen access right of the second application is higher than the screen access right of the first application;

the large screen device is further configured to display a fourth interface after receiving the second screen projection data, where the fourth interface includes the second screen projection content.

3. The system of claim 1, wherein the electronic device is further configured to obtain second screen content and send second screen data to the large screen device through the screen connection if the screen access right of the second application is higher than the screen access right of the first application;

And the large screen device is further used for displaying the third interface after receiving the second screen projection data.

4. The system of any of claims 1-3, wherein the electronic device is further configured to receive a third operation after the large screen device continues to display the second interface, the third operation being for the electronic device to cease displaying the first interface;

the electronic equipment is further used for responding to the third operation and displaying a fourth interface;

the electronic device is further configured to receive a fourth operation;

the electronic equipment is further used for responding to the fourth operation and displaying a fifth interface of the second application;

the electronic equipment is also used for sending third screen throwing data to the large screen equipment through the screen throwing connection;

the large screen device is further configured to display the fifth interface after receiving the third screen projection data;

or,

the electronic equipment is further used for sending the third screen projection data to the large screen equipment through the screen projection connection after acquiring the third screen projection content;

and the large screen device is further used for displaying a sixth interface after receiving the third screen projection data, wherein the sixth interface comprises the third screen projection content.

5. The system according to any of claims 1-4, wherein the large screen device is specifically configured to: and displaying the second interface in a full screen mode.

6. The system according to claim 2, characterized in that said large screen device is specifically adapted to: and displaying the fourth interface in a full screen mode.

7. A system according to claim 3, characterized in that the large screen device is specifically adapted to: and displaying the third interface in a non-full screen mode.

8. The system of any of claims 1-7, wherein the electronic device is further configured to: acquiring equipment information of the large-screen equipment, wherein the equipment information of the large-screen equipment comprises one or more of the following items: the method comprises the steps of selecting a screen size of large screen equipment, a color format of the screen of the large screen equipment and a pixel density of the screen of the large screen equipment;

the electronic device is further configured to obtain, by using a first application, the first screen-cast content before the first screen-cast content is sent to the large-screen device through the screen-cast connection;

the electronic equipment generates the first screen throwing data through the first application based on the first screen throwing content and equipment information of the large screen equipment.

9. The system of any of claims 1-8, wherein the first drop-on content comprises all or part of the display content within the first interface.

10. The system of any of claims 1-8, wherein the first interface comprises a plurality of layers; the first screen content includes display content of one or more layers in the first interface.

11. The system of any of claims 1-8, wherein the first drop-in content comprises display content of a sub-interface of the first interface.

12. The system of any one of claims 1-11, wherein the electronic device is further configured to obtain, based on an application type of the first application, a screen-casting right of the first application;

the electronic device is further configured to obtain, based on an application type of the second application, a screen-throwing authority of the second application.

13. The system of any of claims 1-12, wherein the electronic device is further configured to send third screen data to the large screen device via the screen connection while the first interface is displayed;

The large screen device is further configured to display the first interface after receiving the third screen projection data.

14. A method of screening, the method comprising:

the electronic equipment establishes screen-throwing connection with the large screen equipment;

the electronic equipment displays a first interface;

the electronic equipment receives a first operation aiming at the first interface, wherein the first operation is used for selecting first screen contents;

responding to the first operation, the electronic equipment sends first screen throwing data to the large screen equipment through the screen throwing connection, wherein the first screen throwing data are used for displaying a second interface by the large screen equipment, and the second interface comprises the first screen throwing content;

the electronic device receives a second operation;

in response to the second operation, the electronic device displays a third interface of a second application;

and under the condition that the screen throwing authority of the second application is lower than or equal to the screen throwing authority of the first application, the electronic equipment indicates the large-screen equipment to continue displaying the second interface.

15. The method of claim 14, wherein the method further comprises:

and under the condition that the screen-throwing authority of the second application is higher than the screen-throwing authority of the first application, the electronic equipment acquires second screen-throwing content and sends second screen-throwing data to the large screen equipment through the screen-throwing connection, wherein the second screen-throwing data are used for displaying a fourth interface by the large screen equipment, and the fourth interface comprises the second screen-throwing content.

16. The method of claim 14, wherein the method further comprises:

and under the condition that the screen-throwing authority of the second application is higher than the screen-throwing authority of the first application, the electronic equipment acquires second screen-throwing content and sends second screen-throwing data to the large screen equipment through the screen-throwing connection, wherein the second screen-throwing data is used for displaying the third interface by the large screen equipment.

17. The method of any of claims 14-16, wherein after the electronic device instructs the large screen device to continue displaying the second interface, the method further comprises:

the electronic equipment receives a third operation, wherein the third operation is used for stopping displaying the first interface by the electronic equipment;

in response to the third operation, the electronic device displays a fourth interface;

the electronic device receiving a fourth operation;

in response to the fourth operation, the electronic device displays a fifth interface of the second application;

the electronic equipment sends third screen throwing data to the large screen equipment through the screen throwing connection, wherein the third screen throwing data are used for displaying the fifth interface by the large screen equipment;

Or,

the electronic equipment acquires third screen projection content, the third screen projection data are sent to the large screen equipment through the screen projection connection, the third screen projection data are used for displaying a sixth interface of the large screen equipment, and the sixth interface comprises the third screen projection content.

18. The method of any of claims 14-17, wherein the first screen-cast data is used for full screen display of a second interface by the large screen device.

19. The method of claim 15, wherein the second screen-cast data is used for full screen display of a fourth interface by the large screen device.

20. The method of claim 16, wherein the second projection data is for non-full screen display of the third interface by the large screen device.

21. The method of any of claims 14-20, wherein after the electronic device establishes a screen-cast connection with a large screen device, the method further comprises:

the electronic equipment acquires equipment information of the large-screen equipment, wherein the equipment information of the large-screen equipment comprises one or more of the following items: the method comprises the steps of selecting a screen size of large screen equipment, a color format of the screen of the large screen equipment and a pixel density of the screen of the large screen equipment;

Before the electronic device sends the first screen projection data to the large screen device through the screen projection connection, the method further includes:

the electronic equipment acquires the first screen content through a first application;

and the electronic equipment generates the first screen throwing data through the first application based on the first screen throwing content and the equipment information of the large screen equipment.

22. The method of any of claims 14-21, wherein the first screen shot content comprises all or part of the display content within the first interface.

23. The method of any of claims 14-21, wherein the first interface comprises a plurality of layers; the first screen content includes display content of one or more layers in the first interface.

24. The method of any of claims 14-21, wherein the first drop-in content comprises display content of a sub-interface of the first interface.

25. The method according to any one of claims 14-24, wherein the method further comprises: the first electronic equipment acquires screen throwing authority of the first application based on the application type of the first application;

The first electronic equipment acquires the screen throwing authority of the second application based on the application type of the second application.

26. The method of any of claims 14-25, wherein while the electronic device is displaying the first interface, the method further comprises:

and the electronic equipment sends third screen throwing data to the large screen equipment through the screen throwing connection, wherein the third screen throwing data are used for displaying the first interface by the large screen equipment.

27. A method of screening, the method comprising:

the method comprises the steps that screen throwing connection is established between large-screen equipment and electronic equipment, wherein the electronic equipment displays a first interface of a first application;

the large screen device receives first screen throwing data sent by the electronic device through the screen throwing connection after the electronic device receives first operation aiming at the first interface, wherein the first operation is used for selecting first screen throwing content;

after receiving the first screen throwing data, the large screen equipment displays a second interface, wherein the second interface comprises the first screen throwing content;

after the electronic equipment displays the third interface of the second application, the large-screen equipment continues to display the second interface under the condition that the screen-throwing authority of the second application is lower than or equal to the screen-throwing authority of the first application.

28. The method according to claim 27, characterized in that the method comprises:

when the screen-throwing authority of the second application is higher than the screen-throwing authority of the first application, the large-screen device receives second screen-throwing data sent by the electronic device through the screen-throwing connection;

and after receiving the second screen throwing data, the large screen equipment displays a fourth interface, wherein the fourth interface comprises second screen throwing content.

29. The method according to claim 27, characterized in that the method comprises:

and the large screen device displays the third interface after receiving the second screen projection data.

30. The method of any of claims 27-29, wherein after the large screen device continues to display the second interface, the method further comprises:

the large screen device receives third screen throwing data sent by the electronic device after the electronic device stops displaying the first interface and displays a fifth interface of the second application;

The large screen device displays the fifth interface after receiving the third screen projection data;

or,

and after receiving the third screen projection data, the large screen device displays a sixth interface, wherein the sixth interface comprises the third screen projection content.

31. The method according to any one of claims 27-30, wherein the large screen device displays a second interface, comprising in particular:

and the large screen device displays the second interface in a full screen mode.

32. The method of claim 28, wherein the large screen device displays a fourth interface, specifically comprising:

and the large screen device displays the fourth interface in a full screen mode.

33. The method of claim 29, wherein the large screen device displays the third interface, specifically comprising:

and the large screen device displays the third interface in a non-full screen mode.

34. The method of any of claims 27-33, wherein the first drop-on content comprises all or part of the display content within the first interface.

35. The method of any one of claims 27-33, wherein the first interface comprises a plurality of layers; the first screen content includes display content of one or more layers in the first interface.

36. The method of any of claims 27-33, wherein the first drop-in content comprises display content of a sub-interface of the first interface.

37. The method of any of claims 27-36, wherein after the large screen device establishes a screen connection with an electronic device, before the large screen device receives first screen data sent by the electronic device over the screen connection, the method further comprises:

the large screen device receives third screen projection data sent by the electronic device through the screen projection connection;

and the large screen device displays the first interface after receiving the third screen projection data.

38. An electronic device, the electronic device comprising: one or more processors, one or more memories; the one or more memories coupled with the one or more processors, the one or more memories to store computer program code comprising computer instructions that the one or more processors invoke to cause the electronic device to perform the method of any of the above claims 14-26.

39. A computer readable storage medium storing computer instructions which, when run on an electronic device, cause the electronic device to perform the method of any of the preceding claims 14-26.

40. A computer program product, characterized in that the computer program product, when run on an electronic device, causes the electronic device to perform the method of any of the preceding claims 14-26.