CN113810760B

CN113810760B - Method for controlling screen projection, electronic device and computer readable storage medium

Info

Publication number: CN113810760B
Application number: CN202110945404.8A
Authority: CN
Inventors: 谷贺瑾; 鲍新彤
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2021-08-17
Filing date: 2021-08-17
Publication date: 2023-04-21
Anticipated expiration: 2041-08-17
Also published as: WO2023020008A1; CN113810760A

Abstract

The application provides a method for controlling screen projection, electronic equipment and a computer readable storage medium, and relates to the technical field of communication. When the screen-throwing source equipment (such as a mobile phone) and the screen-throwing target equipment (such as a television) are subjected to mirror image screen throwing, if the screen-throwing source equipment plays videos, the video is automatically switched to stream media screen throwing, if the video APP in the screen-throwing source equipment is moved back to the background for operation, the screen-throwing mode can be controlled to continue to keep stream media screen throwing, and if the video APP is required to be switched to the mirror image screen throwing, the screen-throwing menu is only required to be called for screen throwing switching operation. Because the screen-throwing quick switching entrance is provided in the screen-throwing menu, free switching between the mirror image screen throwing and the streaming media screen throwing can be realized, the requirements that the screen-throwing target equipment keeps the screen-throwing playing video and the user can perform other application operations on the screen-throwing source equipment can be met, and the screen-throwing experience of the user is improved.

Description

Method for controlling screen projection, electronic device and computer readable storage medium

Technical Field

The present disclosure relates to the field of communications technologies, and in particular, to a method for controlling screen projection, an electronic device, and a computer readable storage medium.

Background

With the development of terminal technology and internet technology, applications (APP) installed in electronic devices such as mobile phones are becoming more and more abundant, and the use functions are becoming more and more diversified. For example, the content displayed on the mobile phone can be displayed on a large-screen electronic device such as a television set in a screen projection mode, so that the visual effect is improved.

Generally, a mirror image screen projection or a streaming media screen projection mode can be adopted between two electronic devices for screen projection. For example, streaming media projection can be applied to video playing scenes, and mirror projection can be applied to various scenes where browsing or enlarged display of content on a mobile phone is required. Because different scenes adopt different screen throwing modes, when the scene changes, the screen throwing modes need to be switched.

However, the current switching between the streaming media screen and the mirror image screen is not flexible and convenient enough, and the user experience is poor.

Disclosure of Invention

The application provides a method for controlling screen projection, electronic equipment and a computer readable storage medium, which solve the problem that in the prior art, the switching between mirror image screen projection and streaming media screen projection is not flexible and convenient enough.

In order to achieve the above purpose, the present application adopts the following technical scheme:

In a first aspect, the present application provides a method for controlling a projection screen, the method comprising:

responding to a first operation of a user, and performing screen projection on screen projection target equipment by the screen projection source equipment in a first screen projection mode;

responding to a second operation of requesting the streaming media file in the first application by the user, wherein the screen-throwing source equipment throws the screen to the screen-throwing target equipment in a second screen-throwing mode, and the first application is the streaming media application in the screen-throwing source equipment;

responding to a third operation of the screen throwing source equipment by a user, wherein the screen throwing source equipment displays a desktop interface, and screen throwing icons are displayed in the desktop interface; the second screen projection mode is kept between the screen projection source equipment and the screen projection target equipment;

responding to a fourth operation of the user on the screen throwing icon, displaying a screen throwing menu bar by the screen throwing source equipment, wherein the screen throwing menu bar comprises a first control;

and responding to a fifth operation of the user on the first control, and performing screen projection on the screen projection target equipment by the screen projection source equipment in a first screen projection mode.

Through the scheme, when the screen-throwing source equipment (such as a mobile phone) and the screen-throwing target equipment (such as a television) are subjected to mirror image screen throwing, if the screen-throwing source equipment plays videos, the video is automatically switched to stream media screen throwing, if the video APP in the screen-throwing source equipment is moved back to the background for running, the screen-throwing mode can be controlled to continue to keep stream media screen throwing, and if the video APP is required to be switched to the mirror image screen throwing, the screen-throwing menu is only required to be called for screen throwing switching operation. Because the screen-throwing quick switching entrance is provided in the screen-throwing menu, free switching between the mirror image screen throwing and the streaming media screen throwing can be realized, the requirements that the screen-throwing target equipment keeps the screen-throwing playing video and the user can perform other application operations on the screen-throwing source equipment can be met, and the screen-throwing experience of the user is improved.

In some possible implementations of the first aspect, the screen-casting source device and the screen-casting target device are in a same wireless fidelity Wi-Fi network.

For example, assuming that the screen-throwing target device is in an on state and is connected with a Wi-Fi network, the first operation may be an operation of clicking a system screen-throwing control on the screen-throwing source device by a user, triggering the screen-throwing source device to establish connection with the screen-throwing target device through the Wi-Fi network, and throwing a screen to the screen-throwing target device by the screen-throwing source device through a first screen-throwing mode. The embodiments of the present application are not limited to the possible implementation forms of the first operation.

In some possible implementations of the first aspect, the first screen-throwing manner conforms to a first screen-throwing protocol, and the first screen-throwing protocol supports the screen-throwing target device to acquire screen display content of the screen-throwing source device from the screen-throwing source device and display the screen display content. Illustratively, the first screen-drop protocol includes a mirror screen-drop Miracst protocol or a cast+ protocol.

In some possible implementations of the first aspect, the second screen-casting manner conforms to the second screen-casting protocol, and the second screen-casting protocol supports the screen-casting target device to obtain the streaming media file from the server and play the streaming media file. Illustratively, the second screen-drop protocol includes a streaming media screen-drop DLNA protocol.

In some possible implementations of the first aspect, the screen-projection source device performs screen projection on the screen-projection target device in a first screen-projection manner, including:

the screen-throwing source equipment and the screen-throwing target equipment are connected based on a first screen-throwing protocol;

and the screen throwing source equipment sends the screen display content of the screen throwing source equipment to the screen throwing target equipment so that the screen throwing target equipment receives and displays the screen display content of the screen throwing source equipment.

In some possible implementations of the first aspect, the screen-projection source device performs screen projection on the screen-projection target device through a second screen-projection manner, including:

the screen-throwing source equipment and the screen-throwing target equipment are connected based on a second screen-throwing protocol;

the screen throwing source equipment sends the network address of the streaming media file to the screen throwing target equipment, so that the screen throwing target equipment obtains the streaming media file from the server corresponding to the first application according to the network address of the streaming media file.

In some possible implementations of the first aspect, the first control may be a screen-throwing switch control, configured to trigger a switch from the second screen-throwing mode to the first screen-throwing mode. In this case, the screen-casting target device stops acquiring the streaming media data for screen casting from the server of the first application, and the screen-casting target device receives and displays the streaming media data for screen casting sent by the screen-casting source device. Therefore, by operating on the screen-throwing switching control in the screen-throwing menu bar, the streaming media screen throwing can be triggered to stop and return to the mirror image screen throwing. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations of the first aspect, the first control may be a disconnect control, configured to trigger disconnection of a connection established based on the second screen-drop protocol. In this case, the screen-casting target device stops acquiring streaming media data for screen casting from the server of the first application. Thus by operating on a disconnect control in the drop menu bar, streaming media drop stops may be triggered, and the connection established based on the first drop protocol may be returned to mirrored drop without disconnection. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations of the first aspect, the drop menu bar further includes at least one drop information option, each of the at least one drop information option indicating a drop event of one of the streaming media applications. The method further comprises the steps of:

the screen-throwing source equipment receives a sixth operation of a user on a first screen-throwing information option, wherein the first screen-throwing information option indicates a screen-throwing event of the first application;

responding to the sixth operation, and judging whether the first application is in an operation state by the screen projection source equipment;

if the first application is in an operating state, the screen-throwing source equipment displays a first interface on which the first application is throwing a screen;

If the first application is in a closed state, the screen projection source equipment triggers the first application to be opened and displays a second interface of the first application; wherein the first application is in a state of having exited the screen.

Through the scheme, the user can trigger the mobile phone to quickly jump to the video application interface on which the screen is being projected only by calling out the screen projection menu on the mobile phone and operating the screen projection information option on the screen projection menu. The mobile phone can automatically pull up the video application for the special condition that the video application is closed, so that the video application is opened. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations of the first aspect, after the screen-casting source device displays a first interface that the first application is casting, the method further includes:

the screen projection source equipment receives a seventh operation of a user on a second control in the first interface;

responding to the seventh operation, stopping the screen projection to the screen projection target equipment by the screen projection source equipment in the second screen projection mode, and performing screen projection to the screen projection target equipment in the first screen projection mode.

Through the scheme, the streaming media screen throwing stopping can be triggered and stopped by operating on the video application interface, and the fast switching to the mirror image screen throwing can be realized.

In some possible implementations of the first aspect, after the screen-throwing source device triggers the first application to open and displays a second interface of the first application, the method further includes:

the screen throwing source equipment receives eighth operation of requesting streaming media files in the first application by a user;

and responding to the eight operations, and the screen-throwing source equipment throws the screen to the screen-throwing target equipment in the second screen-throwing mode.

According to the scheme, when the mobile phone can automatically pull up the video application to enable the video application to be started, once video-on-demand operation of a user is detected, screen-throwing source equipment such as the mobile phone performs screen-throwing on screen-throwing target equipment such as a television by adopting a streaming media screen-throwing mode. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations of the first aspect, the responding to the second operation of the user to request the streaming media file in the first application includes:

responding to a second operation of requesting the streaming media file in the first application by a user, if a preset switching condition is met, stopping the screen projection to the screen projection target device by the first screen projection mode by the screen projection source device, and performing screen projection to the screen projection target device by the second screen projection mode;

Wherein, the preset switching conditions include: the first application supports the second screen projection mode, or the residual electric quantity of the screen projection source device is lower than or equal to a preset electric quantity threshold, or the signal quality of a network where the screen projection target device is located is better than or equal to the preset signal quality.

Through the scheme, when the screen throwing source equipment is judged to play the audio and video files and the preset switching conditions are met, the screen throwing from the mirror image can be automatically switched to the streaming media screen throwing without user operation. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations of the first aspect, the method further includes: and under the condition that the screen projection source equipment displays the desktop interface, the screen projection source equipment switches the first application to background operation.

In a second aspect, the present application provides a method for controlling screen projection, including:

responding to a first operation of a user on screen-throwing source equipment, wherein the screen-throwing source equipment throws a screen to screen-throwing target equipment in a first screen-throwing mode;

Responding to a third operation of the screen throwing source equipment by a user, wherein the screen throwing source equipment displays a desktop interface, and screen throwing icons are displayed in the desktop interface; the screen projection mode between the screen projection source equipment and the screen projection target equipment is switched from the second screen projection mode to the first screen projection mode;

and responding to a fifth operation of the user on the first control, and performing screen projection on the screen projection target equipment by the screen projection source equipment in a second screen projection mode.

Through the scheme, when the screen-throwing source equipment (such as a mobile phone) and the screen-throwing target equipment (such as a television) are used for carrying out mirror image screen throwing, if the screen-throwing source equipment plays videos, the video is automatically switched to be streaming media screen throwing, when the video APP in the screen-throwing source equipment is moved back to the background for operation, the screen-throwing mode is switched back to mirror image screen throwing, and if the video APP is required to be switched from mirror image screen throwing to streaming media screen throwing, the screen-throwing menu is only required to be called for screen throwing switching operation. Because the screen-throwing quick switching entrance is provided in the screen-throwing menu, free switching between the mirror image screen throwing and the streaming media screen throwing can be realized, the requirements that the screen-throwing target equipment keeps the screen-throwing playing video and the user can perform other application operations on the screen-throwing source equipment can be met, and the screen-throwing experience of the user is improved.

In some possible implementations of the second aspect, the screen-casting source device and the screen-casting target device are in a same wireless fidelity Wi-Fi network.

In some possible implementations of the second aspect, the first screen-throwing manner conforms to a first screen-throwing protocol, and the first screen-throwing protocol supports the screen-throwing target device to acquire screen display content of the screen-throwing source device from the screen-throwing source device and display the screen display content. Illustratively, the first screen-drop protocol includes a mirror screen-drop Miracst protocol or a cast+ protocol.

In some possible implementations of the second aspect, the second screen-projection manner follows the second screen-projection protocol, and the second screen-projection protocol supports the screen-projection target device to acquire the streaming media file from the server and play the streaming media file. Illustratively, the second screen-drop protocol includes a streaming media screen-drop DLNA protocol.

In some possible implementations of the second aspect, the screen-projection source device performs screen projection on the screen-projection target device through a first screen-projection manner, including: the screen-throwing source equipment and the screen-throwing target equipment are connected based on a first screen-throwing protocol; and the screen throwing source equipment sends the screen display content of the screen throwing source equipment to the screen throwing target equipment so that the screen throwing target equipment receives and displays the screen display content of the screen throwing source equipment.

In some possible implementations of the second aspect, the screen-projection source device performs screen projection to the screen-projection target device through a second screen-projection manner, including: the screen-throwing source equipment and the screen-throwing target equipment are connected based on a second screen-throwing protocol; the screen throwing source equipment sends the network address of the streaming media file to the screen throwing target equipment, so that the screen throwing target equipment obtains the streaming media file from the server corresponding to the first application according to the network address of the streaming media file.

In some possible implementations of the second aspect, the first control may be a screen-switching control, configured to trigger switching from the first screen-switching mode to the second screen-switching mode. In this case, the screen-throwing target device stops receiving the streaming media data for throwing the screen, which is sent by the screen-throwing source device, and the screen-throwing target device obtains the streaming media data for throwing the screen from the server of the first application according to the network address for streaming media screen throwing, which is sent by the screen-throwing source device, and displays the streaming media data. Therefore, by operating on the screen-throwing switching control in the screen-throwing menu bar, the mirror image screen throwing stop can be triggered, and the streaming media screen throwing is returned. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations of the second aspect, the first control may be a disconnect control, configured to trigger disconnection of a connection established based on the first screen-drop protocol. In this case, the screen-casting source device stops transmitting the screen-casting data to the screen-casting target device. Thus by operating on the disconnect control in the drop menu bar, a mirror drop stop may be triggered and a return to streaming media drop may be made without the connection established based on the second drop protocol being broken. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations of the second aspect, the first control may also be a drop information option. The screen-throwing menu bar comprises at least one screen-throwing information option, and each screen-throwing information option in the at least one screen-throwing information option indicates a screen-throwing event of a streaming media application;

the responding to the fifth operation of the user to the first control, the screen-throwing source device throws the screen to the screen-throwing target device in a second screen-throwing mode, and the method comprises the following steps:

the screen-throwing source equipment receives a sixth operation of a user on a first screen-throwing information option, wherein the first screen-throwing information option indicates a screen-throwing event of the first application, and the first screen-throwing information option is used as the first control;

Responding to the sixth operation, and stopping the screen projection to the screen projection target equipment by the first screen projection mode and performing screen projection to the screen projection target equipment by the second screen projection mode by the screen projection source equipment under the condition that the first application is in an operation state.

Through the scheme, the user can trigger the mobile phone to quickly jump to the video application interface on which the screen is being projected and trigger the quick switch from the mirror image screen projection to the streaming media screen projection only by calling out the screen projection menu on the mobile phone and operating the screen projection information option on the screen projection menu. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations of the second aspect, the method further includes: responding to the sixth operation, and under the condition that the first application is in a closed state, triggering the first application to be opened by the screen projection source equipment, and displaying a second interface of the first application; wherein the first application is in a state of having exited the screen.

Through the scheme, for the special case that the video application is closed, the mobile phone can automatically pull up the video application, so that the video application is opened. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations of the second aspect, after the screen-throwing source device triggers the first application to open and displays a second interface of the first application, the method further includes: the screen throwing source equipment receives a seventh operation of requesting streaming media files in the first application by a user; and responding to the seven operations, and the screen-throwing source equipment throws the screen to the screen-throwing target equipment in the second screen-throwing mode.

In some possible implementations of the second aspect, the responding to the second operation of the user to request the streaming media file in the first application includes:

In some possible implementations of the second aspect, the method further includes: and under the condition that the screen projection source equipment displays the desktop interface, the screen projection source equipment switches the first application to background operation.

In a third aspect, the present application provides an apparatus for controlling a projection screen, the apparatus comprising means for performing the method of the first aspect described above. The apparatus may correspond to performing the method described in the first aspect, and the relevant descriptions of the units in the apparatus are referred to the description of the first aspect, which is omitted herein for brevity.

The method described in the first aspect may be implemented by hardware, or may be implemented by executing corresponding software by hardware. The hardware or software includes one or more modules or units corresponding to the functions described above. Such as a processing module or unit, a display module or unit, etc.

In a fourth aspect, the present application provides an apparatus for controlling a projection screen, the apparatus comprising means for performing the method of the second aspect described above. The apparatus may correspond to performing the method described in the second aspect, and the relevant descriptions of the units in the apparatus are referred to the description of the second aspect, which is not repeated herein for brevity.

The method described in the second aspect may be implemented by hardware, or may be implemented by executing corresponding software by hardware. The hardware or software includes one or more modules or units corresponding to the functions described above. Such as a processing module or unit, a display module or unit, etc.

In a fifth aspect, the present application provides an electronic device comprising a processor coupled to a memory, the memory for storing computer programs or instructions, the processor for executing the computer programs or instructions stored by the memory, such that the method of the first aspect is performed. For example, a processor is configured to execute a computer program or instructions stored in a memory, to cause the apparatus to perform the method in the first aspect.

In a sixth aspect, the present application provides an electronic device comprising a processor coupled to a memory, the memory for storing a computer program or instructions, the processor for executing the computer program or instructions stored by the memory such that the method of the second aspect is performed. For example, a processor is configured to execute a computer program or instructions stored in a memory, to cause the apparatus to perform the method in the second aspect.

In a seventh aspect, the present application provides a computer-readable storage medium having stored thereon a computer program (which may also be referred to as instructions or code) for implementing the method in the first aspect. For example, the computer program, when executed by a computer, causes the computer to perform the method of the first aspect.

In an eighth aspect, the present application provides a computer-readable storage medium having stored thereon a computer program (which may also be referred to as instructions or code) for implementing the method in the second aspect. For example, the computer program, when executed by a computer, causes the computer to perform the method of the second aspect.

In a ninth aspect, the present application provides a chip comprising a processor. The processor is configured to read and execute a computer program stored in the memory to perform the method of the first aspect and any possible implementation thereof. Optionally, the chip further comprises a memory, and the memory is connected with the processor through a circuit or a wire.

In a tenth aspect, the present application provides a chip comprising a processor. The processor is configured to read and execute a computer program stored in the memory to perform the method of the second aspect and any possible implementation thereof. Optionally, the chip further comprises a memory, and the memory is connected with the processor through a circuit or a wire.

In an eleventh aspect, the present application provides a system-on-a-chip comprising a processor. The processor is configured to read and execute a computer program stored in the memory to perform the method of the first aspect and any possible implementation thereof. Optionally, the chip system further comprises a memory, and the memory is connected with the processor through a circuit or a wire.

In a twelfth aspect, the present application provides a system-on-chip comprising a processor. The processor is configured to read and execute a computer program stored in the memory to perform the method of the second aspect and any possible implementation thereof. Optionally, the chip system further comprises a memory, and the memory is connected with the processor through a circuit or a wire.

In a thirteenth aspect, the present application provides a computer program product comprising a computer program (which may also be referred to as instructions or code) which, when executed by a computer, causes the computer to carry out the method of the first aspect.

In a fourteenth aspect, the present application provides a computer program product comprising a computer program (which may also be referred to as instructions or code) which, when executed by a computer, causes the computer to carry out the method of the second aspect.

It will be appreciated that the advantages of the third to fourteenth aspects may be found in the relevant description of the first and second aspects, and are not described here again.

Drawings

FIG. 1 is a system architecture diagram for implementing streaming media screen projection and mirror image screen projection between devices in an embodiment of the present application;

FIG. 2 is a schematic diagram of an interactive interface when mirror image screen projection is implemented between devices in an embodiment of the present application;

fig. 3 is a flowchart of a method for controlling screen projection according to an embodiment of the present application;

fig. 4 is an interface schematic diagram of a method for controlling screen projection in application according to an embodiment of the present application;

FIG. 5 is a flowchart of another method for controlling screen projection according to an embodiment of the present disclosure;

fig. 6 is an interface schematic diagram of another method for controlling screen projection provided in the embodiment of the present application when in application;

fig. 7 is a flowchart of another method for controlling screen projection according to an embodiment of the present disclosure;

fig. 8 is an interface schematic diagram of another method for controlling screen projection according to an embodiment of the present application when in application;

fig. 9 is an interface schematic diagram of a method for controlling screen projection provided in an embodiment of the present application when in application;

fig. 10 is a schematic flowchart of interaction between a video APP side and an electronic device side for screen projection, which is provided in an embodiment of the present application;

Fig. 11 is a schematic structural diagram of a device for controlling screen projection according to an embodiment of the present application;

fig. 12 is a schematic structural diagram of another device for controlling screen projection according to an embodiment of the present application;

fig. 13 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.

The term "and/or" herein is an association relationship describing an associated object, and means that there may be three relationships, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. The symbol "/" herein indicates that the associated object is or is a relationship, e.g., A/B indicates A or B.

The terms "first" and "second" and the like in the description and in the claims are used for distinguishing between different objects and not for describing a particular sequential order of objects. For example, a first operation and a second operation, etc. are used to distinguish between different operations and are not used to describe a particular sequence of operations.

In the embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as examples, illustrations, or descriptions. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality of" means two or more, for example, a plurality of processing units means two or more processing units and the like; the plurality of elements means two or more elements and the like.

To facilitate understanding of embodiments of the present application, some of the terms of embodiments of the present application are explained below to facilitate understanding by those skilled in the art.

(1) Streaming media screen projection: when the screen-throwing source device 1 and the screen-throwing target device 2 are in the same local area network, the screen-throwing source device 1 and the screen-throwing target device 2 can realize streaming media screen throwing based on a protocol authorized by a digital living network alliance (digital living network alliance, DLNA) (abbreviated as DLNA protocol).

For example, assuming that the screen-throwing source device 1 and the screen-throwing target device 2 are both in a power-on state and in the same local area network (for example, wi-Fi network), when the screen-throwing source device 1 plays a network video, in response to a streaming media screen-throwing instruction, the screen-throwing source device 1 may negotiate with the screen-throwing target device 2 based on a DLNA protocol, after the negotiation is completed, the screen-throwing source device 1 may send a link address of the network video being played by the screen-throwing source device 1 to the screen-throwing target device 2, and the screen-throwing target device 2 acquires a video resource from a server according to the link address of the network video and displays the video resource on a screen of the screen-throwing target device 2, so as to realize that the network video displayed by the screen-throwing source device 1 is projected on the screen of the screen-throwing target device 2 for display.

In the above-mentioned screen-projection display process, the screen display content of the screen-projection source device 1 may be inconsistent with the screen display content of the screen-projection target device 2, and at this time, the user may watch the screen-projection video through the television set, and perform other application operations on the screen-projection source device 1 at the same time.

(2) Mirror image screen projection: also referred to as system screen-casting, when the screen-casting source device 1 (e.g. mobile phone) and the screen-casting target device 2 (e.g. television) are in the same local area network, the screen-casting source device 1 and the screen-casting target device 2 can realize mirror image screen-casting based on the protocols of Miracast/cast+.

For example, assuming that the screen-throwing source device 1 and the screen-throwing target device 2 are both in a power-on state and in the same local area network (for example, wi-Fi network), after the screen-throwing source device 1 turns on the mirror image screen-throwing function, the screen-throwing source device 1 may search for all devices supporting screen throwing, after the screen-throwing source device 1 finds the screen-throwing target device 2, the screen-throwing source device 1 may negotiate with the screen-throwing target device 2 based on the Miracast/cast+ protocol to perform screen throwing, and after the negotiation is completed, the screen-throwing source device 1 may project the content displayed by the screen of the screen-throwing source device 1 onto the screen of the screen-throwing target device 2 to display.

In the above-mentioned screen-projection display process, since the screen display content of the screen-projection target device 2 changes with the screen display content of the screen-projection source device 1, and the screen display content of the screen-projection target device 2 and the screen display content of the screen-projection source device 1 keep consistent at the same time, this screen-projection mode is called mirror-image screen-projection or screen-image.

In comparison to the usage, the content of the streaming media projection screen comprises audio and/or video resources in the form of streaming media, which are commonly used to project the audio and/or video resources to the large-screen projection screen target device 2 for viewing. Since the mirror image screen-throwing is not limited in content, the screen-throwing source device 1 can mirror image screen-throwing of the screen display content to the large screen-throwing target device 2 for display when the screen-throwing source device 1 performs games, live broadcast, office and other businesses.

Fig. 1 illustrates a system architecture diagram according to various exemplary embodiments of the present application. As shown in (a) and (b) in fig. 1, the system architecture includes a screen-casting source device 1, a screen-casting target device 2, and a server 3.

The following describes an example in which the screen-casting source device 1 initiates the screen casting on the screen-casting target device 2. In this case, the screen-casting source device 1 serves as a control terminal that transmits a video resource for screen casting or an acquisition address of the video resource, such as a uniform resource locator (uniform resource locator ), to the screen-casting target device 2. The screen-throwing target device 2 serves as a controlled end and receives video resources for screen throwing sent by the screen-throwing source device 1 or an acquisition address of the video resources.

The screen-throwing source device 1 may be a device with a smaller screen than the screen-throwing target device 2, for example, the screen-throwing source device 1 may be a mobile phone. The screen-casting target device 2 may be a device that is larger in screen relative to the screen-casting source device 1, for example the screen-casting target device 2 may be a large-screen television. The screen-throwing source device 1 can play video by utilizing the video APP installed on the screen-throwing source device 1. The server 3 may be a streaming server corresponding to a video APP.

As shown in fig. 1 (a), a schematic diagram of a streaming media screen-throwing scene is shown, when a screen-throwing source device 1 initiates a streaming media screen-throwing to a screen-throwing target device 2, the screen-throwing source device 1 sends a link address of a currently played video to the screen-throwing target device 2, and the screen-throwing target device 2 needs to acquire a video resource from a streaming media server 3 according to the video link address provided by the screen-throwing source device 1, so that the screen-throwing target device 2 can display the video resource, thereby realizing streaming media screen-throwing display.

Here, the video asset currently played by the screen-cast source device 1 is acquired from the streaming server 3. Video resources to be displayed on screen by the screen-casting target device 2 are also acquired from the streaming server 3. That is, there is no data transmission of video resources between the screen-casting source device 1 and the screen-casting target device 2.

As shown in (b) of fig. 1, a schematic diagram of a mirrored screen-casting scene is shown, when the screen-casting source device 1 initiates a mirrored screen-casting to the screen-casting target device 2, the screen-casting source device 1 may send the video resource currently played to the screen-casting target device 2, that is, the screen-casting target device 2 may directly acquire the video resource from the screen-casting source device 1, without acquiring the video resource from the streaming server 3.

Here, the video resource currently played by the screen-throwing source device 1 may be acquired from the server 3 or may be acquired locally from the screen-throwing source device 1.

Compared with the streaming media screen-casting mode, when the mirror image screen-casting mode is adopted for screen casting, video resources are required to be transmitted between the screen-casting source equipment 1 and the screen-casting target equipment 2.

A possible implementation of the mirror projection of interactions between devices is described below in connection with fig. 2. For convenience of explanation, the screen-throwing source device 1 is taken as a mobile phone, the screen-throwing target device 2 is taken as a television, and the screen throwing from the mobile phone to the television is exemplified.

Firstly, a mirror image screen-throwing operation can be generally initiated from a mobile phone system entrance to a television, as shown in (a) of fig. 2, an interface schematic diagram for initiating the mirror image screen-throwing is shown, the screen-throwing source device 1 receives an operation that a user initiates the mirror image screen-throwing operation on the screen-throwing source device 1, for example, the screen-throwing source device 1 receives a click operation of the user on a system screen-throwing control 12 in a drop-down control menu 11 of the screen-throwing source device 1, in response to the user operation, the screen-throwing source device 1 starts a mirror image screen-throwing function, then the screen-throwing source device 1 searches for a screen-throwing target device 2 which is found to be in the same local area network with the screen-throwing source device 1, the screen-throwing source device 1 establishes a wireless connection with the screen-throwing target device 2, and performs information interaction, and negotiates whether the screen-throwing source device 1 and the screen-throwing target device 2 can support the screen-throwing. As shown in (a) of fig. 2, when the screen-throwing source device 1 establishes a connection with the screen-throwing target device 2 and negotiates, the screen-throwing target device 2 may display a prompt message: you are connecting a television.

As shown in fig. 2 (b), after the connection between the screen-throwing source device 1 and the screen-throwing target device 2 is established and the negotiation is completed, the content displayed on the screen of the screen-throwing source device 1 is displayed on the screen of the screen-throwing target device 2, that is, the content displayed on the screen of the screen-throwing target device 2 and the content displayed on the screen of the screen-throwing source device 1 are consistent at the same time. At this time, the screen-throwing source device 1 and the screen-throwing target device 2 are in a mirror image screen-throwing state.

As shown in fig. 2 (c), an interface schematic diagram of initiating playing of a video is shown, where the screen source device 1 receives an operation that a user triggers playing of the video on the screen source device 1, for example, the screen source device 1 receives a click operation of the user on a play control 13 of a video APP interface on the screen source device 1, in response to the operation, the screen source device 1 may play the video, and the screen target device 2 plays the same video screen as the screen source device 1.

In practical application, when mirror image screen projection is performed on a video, a mobile phone is required to be switched to full-screen display of the video, so that the television can be ensured to display the video in a full-screen mode. As shown in (d) of fig. 2, by the mirror image screen projection mode, the video image played by the screen projection source device 1 is projected onto the screen of the screen projection target device 2 for full screen display. In the case of mirror-image screen projection of video, the video screen displayed by the screen projection target device 2 varies with the video screen displayed by the screen projection source device 1.

In actual implementation, the following characteristics are provided when the video is subjected to mirror image screen projection: because of real-time coding transmission, the video Yi Kadu and video image quality are poor due to the influence of the mobile phone coding and decoding capability, wi-Fi chip capability of mobile phones and televisions, near-field Wi-Fi jitter and the like. In addition, because the display proportion of the mobile phone is inconsistent with the display proportion of the television, black edges are easily formed around the screen of the television during screen-throwing display. In addition, because the two-way coding transmission of the audio and video stream at the mobile phone side is different from the transmission mode of the audio and video stream at the television side, the video and the sound of the television are easy to be asynchronous when the video is displayed on the screen.

The influence on the user experience is great, and when the mirror image is thrown to play the video, the mobile phone screen is required to be always kept at the video playing interface. Once the mobile phone screen exits the video playing interface, the television also exits the video playing interface accordingly. Therefore, the mirror image screen-throwing mode cannot meet the requirements that a user can throw a mobile phone video picture on a television screen and perform other application operations on the mobile phone, and the user experience is affected.

Aiming at the problems existing in the above scenes, the embodiment of the application provides a method for controlling screen projection and electronic equipment (for example, screen projection source equipment), when the screen projection source equipment (for example, a mobile phone) and the screen projection target equipment (for example, a television) carry out mirror image screen projection, if the screen projection source equipment plays videos, the video is automatically switched to stream media for screen projection, if the video APP in the screen projection source equipment moves back to the background, the screen projection mode can be controlled to continue to keep the stream media for screen projection, and if the video APP is required to be switched to the mirror image screen projection, the screen projection menu is only required to be called for screen projection switching operation. Because the screen-throwing quick switching entrance is provided in the screen-throwing menu, free switching between the mirror image screen throwing and the streaming media screen throwing can be realized, the requirements that the screen-throwing target equipment keeps the screen-throwing playing video and the user can perform other application operations on the screen-throwing source equipment can be met, and the screen-throwing experience of the user is improved.

In this embodiment of the application, the electronic equipment manufacturer and the video APP manufacturer perform technical cooperation with respect to equipment video projection, so as to implement the scheme of the application: in the screen-throwing process, when certain conditions (such as playing video) are met, the switching between mirror image screen throwing based on Miracast/cast+ protocol and streaming media screen throwing based on DLNA protocol can be supported.

It should be noted that, the streaming media projection screen is usually related to the video APP, and not all video APPs support the streaming media projection screen, and specifically, in the embodiment of the present application, the premise that the streaming media projection screen and the mirror image projection screen can be switched is that the video APP to be projected supports the streaming media projection screen.

The following describes in detail the technical solution provided in the first embodiment of the present application with reference to the accompanying drawings.

First embodiment

Fig. 3 shows a schematic flow chart of switching between mirror screen projection and streaming media screen projection according to the first embodiment of the present application. As shown in fig. 3, the flow may include steps S101-S103 described below.

S101, the screen-throwing source device 1 and the screen-throwing target device 2 are in mirror image screen throwing.

For example, assuming that the screen-throwing target device 2 is in an on state and is connected to a Wi-Fi network, when the screen-throwing source device 1 receives an operation that a user clicks a system screen-throwing control on the screen-throwing source device, the screen-throwing source device 1 and the screen-throwing target device 2 may establish a connection through the Wi-Fi network, and the screen-throwing source device 1 throws a screen to the screen-throwing target device 2 in a first screen-throwing manner.

Optionally, in this embodiment of the present application, besides the above-mentioned mirror image screen-projection triggering manner, the screen-projection source device 1 may also implement mirror image screen-projection on the screen-projection target device 2 through a touch function, that is, the screen-projection source device 1 touches the screen-projection target device 2, and establishes wireless connection through various short-distance communication manners such as near field communication (near field communication, NFC), wi-Fi or bluetooth, and completes mirror image screen-projection.

Of course, the screen-throwing source device 1 may also implement the mirror image screen throwing on the screen-throwing target device 2 through other manners, such as sharing (share) function, so as to implement the cooperative operation between different electronic devices. The method can be specifically determined according to actual use requirements, and the embodiment of the application is not limited.

For example, it is assumed that the screen-casting source device 1 projects a currently played video screen onto the screen of the screen-casting target device 2 in a mirror-image screen-casting manner. At this time, the screen projection mode between the screen projection source device 1 and the screen projection target device 2 is mirror image screen projection.

Note that, if the screen-throwing target device 2 is in the off state, the screen-throwing source device 1 cannot establish a connection with the screen-throwing target device 2, and thus the screen throwing cannot be achieved. The embodiment of the application exemplarily describes a screen-throwing scene based on the condition that the screen-throwing target device 2 is in an on state.

S102, when the screen projection source equipment 1 opens the video APP and plays the video, the screen projection mode between the screen projection source equipment 1 and the screen projection target equipment 2 is automatically switched from mirror image screen projection to streaming media screen projection.

In this way, in the mirror image screen-throwing state, once the screen-throwing source equipment 1 is detected to start playing the video, the mirror image screen throwing is automatically switched into the streaming media screen throwing, and the display effect of playing the video through the streaming media screen throwing is good, so that the user experience can be improved.

S103, when the video APP in the screen-throwing source equipment 1 moves back to the background operation, the screen-throwing mode between the screen-throwing source equipment 1 and the screen-throwing target equipment 2 is automatically switched from streaming media screen throwing to mirror image screen throwing.

Through the above scheme provided by the first embodiment, when the screen-throwing source device 1 plays a video on the screen-throwing target device 2 through streaming media, once the video APP in the screen-throwing source device 1 moves back to the background operation, the screen-throwing mode between the screen-throwing source device 1 and the screen-throwing target device 2 can be automatically switched from streaming media screen throwing to mirror image screen throwing, so that the requirement that a user hopes a large screen to continuously display the video picture of the screen throwing cannot be met.

As shown by the dotted line in fig. 3, after switching from the streaming media screen-casting to the mirror image screen-casting, if the user wants to continue playing the video in the streaming media screen-casting mode, the user needs to operate on the screen-casting source device 1, trigger the screen-casting source device 1 to open the video APP again, and trigger the screen-casting source device 1 to play the video in the video APP. Accordingly, after the screen projection source device 1 receives the user operation, the screen projection source device 1 plays the video in the video APP, and automatically switches the screen projection mode between the screen projection source device 1 and the screen projection target device 2 from the mirror image screen projection mode to the streaming media screen projection mode.

Fig. 4 is a schematic diagram of an interface for switching between mirror screen projection and streaming media screen projection based on the implementation of fig. 3. The flow chart shown in fig. 3 is exemplarily described below with reference to fig. 4.

As shown in (a) of fig. 4, the screen projection mode between the screen projection source device 1 and the screen projection target device 2 is a mirror image screen projection. At this time, the screen-casting source device 1 and the screen-casting target device 2 are completely identical in screen display content.

As shown in (b) of fig. 4, when it is detected that the screen-throwing source device 1 starts playing the video of the video APP, the screen-throwing mode between the screen-throwing source device 1 and the screen-throwing target device 2 is automatically switched to streaming media screen throwing. At this time, the screen-throwing source device 1 and the screen-throwing target device 2 may be inconsistent in screen display content, for example, the screen display content of the screen-throwing source device 1 is an interface of the video APP, the screen display content of the screen-throwing target device 2 is a video picture of the video APP, and the display effect may be full-screen display.

As shown in (c) of fig. 4, when the screen-throwing source device 1 detects that the video APP is backing to the background, the screen-throwing mode between the screen-throwing source device 1 and the screen-throwing target device 2 is automatically switched back to the mirror image screen throwing mode. At this time, the screen-throwing source device 1 and the screen-throwing target device 2 are completely consistent in screen display content, for example, the screen-throwing source device 1 and the screen-throwing target device 2 each display a desktop interface or display a certain application interface, that is, the screen-throwing display content of the screen-throwing target device 2 as a large screen is no longer a video picture of the video APP.

As shown in (d) of fig. 4, when the screen-casting source device 1 detects that the video APP is opened again and plays the video in the video APP at the time of the mirror screen-casting, the screen-casting source device 1 automatically switches the screen-casting mode between the screen-casting source device 1 and the screen-casting target device 2 to streaming screen-casting. At this time, the screen-casting target device 2 displays a video picture of the video APP.

Through the scheme, the mutual switching between the mirror image screen projection and the streaming media screen projection can be realized. The defects are that: when the screen-throwing source device 1 plays a video on the screen-throwing target device 2 through streaming media, once the video APP in the screen-throwing source device 1 is moved back to the background operation, the screen-throwing mode can be automatically switched from streaming media screen throwing to mirror image screen throwing, so that the display contents of the screen-throwing target device 2 and the screen-throwing source device 1 are consistent and the video is stopped to be played, and therefore the requirement of a user on hopeing a large screen to continuously display the video picture of the screen is not met.

The application also provides a second embodiment, compared with the first embodiment, the second embodiment can solve the problem that when the video APP is returned to the background, the streaming media screen can be automatically switched to the mirror image screen, and the large screen can not be ensured to continuously display the screen video in the process of playing the video through the streaming media screen.

Second embodiment

Fig. 5 shows a schematic flow chart of switching between mirror screen projection and streaming media screen projection according to the second embodiment of the present application. As shown in fig. 5, the flow may include steps S201-S204 described below. The scheme shown in fig. 5 is based on the improvement scheme of fig. 3, and solves the problem that in the process of playing video through a streaming media screen, when a video APP is moved back to the background, the streaming media screen can be automatically switched to a mirror image screen, and the large screen can not be ensured to continuously display the screen video.

S201, the screen-throwing source device 1 and the screen-throwing target device 2 are in mirror image screen throwing.

S202, when the screen projection source device 1 opens the video APP and plays the video, the screen projection mode between the screen projection source device 1 and the screen projection target device 2 is switched from mirror image screen projection to streaming media screen projection.

S203, when the video APP in the screen-throwing source equipment 1 moves back to the background operation, the screen-throwing mode between the screen-throwing source equipment 1 and the screen-throwing target equipment 2 keeps streaming media screen throwing.

Unlike the above-mentioned first embodiment, in which the video APP being switched to the background operation by streaming media is automatically switched back to the mirror image to switch the screen, in the second embodiment of the present application, when the video APP being switched to the background operation by streaming media is in the streaming media screen switching state between the screen switching source device 1 and the screen switching target device 2, the streaming media screen switching can be maintained even if the video APP being switched to the background operation by the screen switching source device 1, and the screen switching target device 2 still maintains to display the video image at this time. That is, the scheme provided by the second embodiment can ensure that the streaming media screen is continuously kept when the video APP is returned to the background in the process of playing the video through the streaming media screen, so that the large screen can be ensured to continuously display the screen video, and the user experience is improved.

S204, when the screen-throwing source equipment 1 receives the switching operation of the user, the screen-throwing mode between the screen-throwing source equipment 1 and the screen-throwing target equipment 2 is switched from streaming media screen throwing to mirror image screen throwing.

In the embodiment of the application, when the screen-throwing source device 1 detects that the user stops the streaming media screen throwing from the system screen throwing menu or the video application, the screen-throwing source device 1 switches the screen throwing mode between the streaming media screen throwing mode and the screen throwing target device 2 from the streaming media screen throwing mode to the mirror image screen throwing mode.

In this application, when the screen source device 1 and the screen target device 2 are located between the streaming media screen, a system screen menu (also called a screen menu bar or a screen control menu) may be provided for the user to operate, where a current screen interface entry may be displayed in the system screen menu, and the current screen interface entry may trigger the screen source device 1 to jump to a screen interface, for example, a video playing interface of a video application.

In one possible implementation, when the screen-throwing source device 1 receives a stop play operation of the user on the video play interface, the screen-throwing source device 1 may disconnect the streaming media screen-throwing connection with the screen-throwing target device 2 and reestablish the mirror screen-throwing connection with the screen-throwing target device 2.

In one possible implementation, a disconnection control may be displayed in the system screen-drop menu, and when the screen-drop source device 1 receives an operation of the user on the disconnection control, the screen-drop source device 1 may disconnect the streaming media screen-drop connection with the screen-drop target device 2 and reestablish the mirror image screen-drop connection with the screen-drop target device 2.

In one possible implementation manner, a switching control can be displayed in the system screen-throwing menu, and the switching control can be used for triggering switching between streaming media screen throwing and mirror image screen throwing for viewing and operation by a user, so that the user can switch between streaming media screen throwing and mirror image screen throwing according to actual use requirements.

In this way, when the screen-throwing source device 1 receives the trigger switching operation of the user on the system screen-throwing menu, the screen-throwing mode between the screen-throwing source device 1 and the screen-throwing target device 2 is switched from streaming media screen throwing to mirror image screen throwing.

Unlike the first embodiment, in the second embodiment of the present application, in a case where the screen-throwing source device 1 and the screen-throwing target device 2 are in a screen-throwing state (mirror screen throwing or streaming screen throwing), the screen-throwing source device 1 may display (e.g., hover display) a screen-throwing icon on a screen, which may be used to trigger a display system screen-throwing menu.

Illustratively, the screen-throwing source device 1 may hover-display the screen-throwing icon in the desktop interface. Of course, the screen-throwing source device 1 may also hover-display the screen-throwing icon on an application interface other than the desktop interface.

That is, when the screen-throwing source device 1 is in the screen-throwing state, the screen-throwing icon may be continuously displayed on the screen of the screen-throwing source device 1 for the user to operate. The user can be according to the in-service use demand, when needs switch to throw the screen mode, click this and throw the screen icon and can trigger to throw the screen source equipment and pop up the system and throw the screen menu, and then the user can throw the screen menu on the system and switch over the operation to can realize throwing at the mirror image and throwing the screen and convenient switching between the screen with the streaming media, promote user experience.

Through the above scheme provided by the second embodiment, when the screen-throwing source device 1 throws the screen on the screen-throwing target device 2 through the streaming media, if the video APP in the screen-throwing source device 1 moves back to the background operation, the screen-throwing mode between the screen-throwing source device 1 and the screen-throwing target device 2 can keep streaming media screen throwing, and can not be automatically switched to the mirror image screen throwing, that is, through the above scheme provided by the second embodiment of the application, after the video APP in the screen-throwing source device 1 moves back to the background operation, the screen-throwing target device 2 can continuously display the screen-throwing video regardless of the applications of the screen-throwing source device 1 in the foreground operation, so that the scheme of the application can meet the requirement that a user continuously throws the video picture of the mobile phone to the television screen, and can also perform other application operations on the mobile phone.

Fig. 6 is a schematic diagram of an interface for switching between mirror screen projection and streaming media screen projection based on the implementation of fig. 5. The flow chart shown in fig. 5 is exemplarily described below in conjunction with fig. 6.

As shown in fig. 6 (a), the screen projection mode between the screen projection source device 1 and the screen projection target device 2 is a mirror image screen projection. At this time, the screen-casting source device 1 and the screen-casting target device 2 are completely identical in screen display content.

As shown in (b) of fig. 6, when it is detected that the screen-casting source device 1 starts playing the video of the video APP, the screen-casting mode between the screen-casting source device 1 and the screen-casting target device 2 is automatically switched to streaming media screen casting. At this time, the screen-throwing source device 1 and the screen-throwing target device 2 may be inconsistent in screen display content, for example, the screen display content of the screen-throwing source device 1 is an interface of the video APP, the screen display content of the screen-throwing target device 2 is a video picture of the video APP, and the display effect may be full-screen display.

As shown in fig. 6 (c), when the screen-throwing source device 1 detects that the video APP is backing to the background, the screen-throwing mode between the screen-throwing source device 1 and the screen-throwing target device 2 is continued to keep streaming media screen throwing. At this time, the screen-throwing source device 1 may display a desktop interface or a certain application interface, and the screen-throwing target device 2 may continue to display a video picture of the video APP.

As is clear from (b) and (c) in fig. 6, when the screen-throwing source device 1 and the screen-throwing target device 2 are in the streaming media screen-throwing state, even if the video APP of the screen-throwing source device 1 is cut to the background operation, the streaming media screen throwing can be maintained, and at this time, the screen-throwing target device 2 still maintains to display the video picture. If the user wishes to switch back to the mirror screen, the user may operate on the cell phone screen menu to trigger switching back to the mirror screen.

As further shown in fig. 6 (c), the screen-throwing source device 1 may display the screen-throwing icon 14 in suspension on the screen. When the user needs to switch the screen projection mode between the screen projection source device 1 and the screen projection target device 2 from streaming media screen projection to mirror image screen projection, the user can click on the screen projection icon 14.

Further, as shown in (d) of fig. 6, when the screen-throwing source device 1 receives an operation of the user on the screen-throwing icon 14, the screen-throwing source device 1 may display a system screen-throwing menu 15 on the screen, in which a video APP portal 16 (for example, prompt "enter video APP screen-throwing interface") of the current screen and a switching control 17 may be displayed.

When the screen-drop source device 1 receives a user's operation on the video APP portal 16, the screen-drop source device 1 may jump from the current interface (e.g., desktop interface) to the current screen-drop interface of the video APP.

When the screen-throwing source device 1 receives the operation of the user on the switching control 17, the screen-throwing source device 1 can switch the current screen-throwing mode to another screen-throwing mode. For example, as shown in (d) of fig. 6, assuming that the current screen-casting mode is streaming media screen casting, the switching control 17 prompts to be switchable to mirror image screen casting, and when the screen-casting source device 1 receives the operation of the user on the switching control 17, the screen-casting source device 1 may switch streaming media screen casting to mirror image screen casting. This returns to the mirror-image drop state shown in fig. 6 (a).

Through the scheme, the requirements of users for carrying out other application operations on the mobile phone when the mobile phone video pictures are continuously projected to the television screen can be met, the scheme of the application provides an inlet for switching different projection modes, and the operation can trigger the switching on the projection menu, so that the free switching between mirror image projection and streaming media projection can be realized, and the user experience is improved.

The third embodiment can be compared with the first embodiment, in the process of playing the video through the streaming media screen, when the video APP is returned to the background, the streaming media screen is automatically switched to the mirror image screen, the user can be supported to trigger the switching operation by calling out the screen menu, the switching from the mirror image screen to the streaming media screen is realized, the interactivity is better, the convenience and the rapidness are better, and the user experience is improved.

Third embodiment

Fig. 7 is a schematic flow chart of switching between mirror screen projection and streaming media screen projection according to the third embodiment of the present application. As shown in fig. 7, the flow may include steps S301-S304 described below.

S301, the screen-throwing source device 1 and the screen-throwing target device 2 are in mirror image screen throwing.

S302, when the screen projection source device 1 opens the video APP and plays the video, the screen projection mode between the screen projection source device 1 and the screen projection target device 2 is automatically switched from mirror image screen projection to streaming media screen projection.

S303, when the video APP in the screen-throwing source equipment 1 is returned to the background operation, the screen-throwing mode between the screen-throwing source equipment 1 and the screen-throwing target equipment 2 is automatically switched from streaming media screen throwing to mirror image screen throwing.

S304, when the screen-throwing source equipment 1 receives the triggering switching operation of the user on the system screen-throwing menu, the screen-throwing mode between the screen-throwing source equipment 1 and the screen-throwing target equipment 2 is switched from mirror image screen throwing to streaming media screen throwing.

When the video APP in the mobile phone is projected to the television for display in a streaming media projection mode in actual implementation, if the video APP is cut to background operation, the television returns to a screen mirror image, and then the solution of fast switching from the mirror image projection to the streaming media projection can be as follows: the user can trigger the cut-back flow media screen-throwing through operating on the mobile phone screen-throwing menu, so that the television can continue to play the video.

In the third embodiment of the present application, in the case where the screen-throwing source device 1 and the screen-throwing target device 2 are in a screen-throwing state (mirror screen throwing or streaming screen throwing), the screen-throwing source device 1 may display (e.g., hover display) a screen-throwing icon on a screen, which may be used to trigger a display system screen-throwing menu. For a description of the screen-throwing icon, refer to the detailed description of the screen-throwing icon in the second embodiment, and will not be repeated here.

Specifically, when the screen-throwing source device 1 is in the screen-throwing state, the screen-throwing icons can be continuously displayed on the screen of the screen-throwing source device 1 for the user to operate. The user can be according to the in-service use demand, when needs switch to throw the screen mode, click this and throw the screen icon and can trigger to throw the screen source equipment and pop up the system and throw the screen menu, and then the user can throw the screen menu on the system and switch over the operation to can realize throwing at the mirror image and throwing the screen and convenient switching between the screen with the streaming media, promote user experience.

The solution shown in fig. 7 is also a modification based on fig. 3, and steps S301-S303 in the third embodiment are the same as steps S101-S103 in the first embodiment described above, except for S304 in the third embodiment and S104 in the first embodiment.

Specifically, according to S104 of the first embodiment, in the process of playing video through streaming media screen, after the streaming media screen is automatically switched to mirror image screen when the video APP is moved back to the background, the video APP needs to be triggered and opened again to realize the scheme of switching from mirror image screen to streaming media screen.

In contrast, according to S304 of the third embodiment, in the process of playing video through the streaming media screen, when the video APP is moved back to the background, after the streaming media screen is automatically switched to the mirror image screen, the user can be supported to trigger the switching operation by calling out the screen menu, so that the switching from the mirror image screen to the streaming media screen is realized, the interactivity is better, and the convenience and the rapidness are improved, and the user experience is improved.

Through the above scheme provided by the third embodiment, when the screen-throwing source device 1 throws the screen on the screen-throwing target device 2 through the streaming media, if the video APP in the screen-throwing source device 1 moves back to the background operation, the screen-throwing mode between the screen-throwing source device 1 and the screen-throwing target device 2 is switched from streaming media to mirror image screen throwing, the user can trigger the switching operation by calling out the screen-throwing menu, so that the screen-throwing from mirror image screen throwing to streaming media screen throwing is realized, the interactivity is better, the convenience and the rapidness are better, and the user experience is improved.

Fig. 8 is a schematic diagram of an interface for switching between mirror screen projection and streaming media screen projection based on the implementation of fig. 7. The flow chart shown in fig. 7 is exemplarily described below with reference to fig. 8.

As shown in (a) of fig. 8, the screen projection manner between the screen projection source device 1 and the screen projection target device 2 is a mirror image screen projection. At this time, the screen-casting source device 1 and the screen-casting target device 2 are completely identical in screen display content.

As shown in (b) of fig. 8, when it is detected that the screen-casting source device 1 starts playing the video of the video APP, the screen-casting mode between the screen-casting source device 1 and the screen-casting target device 2 is automatically switched to streaming media screen casting. At this time, the screen-throwing source device 1 and the screen-throwing target device 2 may be inconsistent in screen display content, for example, the screen display content of the screen-throwing source device 1 is an interface of the video APP, the screen display content of the screen-throwing target device 2 is a video picture of the video APP, and the display effect may be full-screen display.

As shown in (c) of fig. 8, when the screen-throwing source device 1 detects that the video APP is backing to the background, the screen-throwing mode between the screen-throwing source device 1 and the screen-throwing target device 2 is automatically switched back to the mirror image screen throwing mode. At this time, the screen-throwing source device 1 and the screen-throwing target device 2 are completely identical in screen display content, for example, the screen-throwing source device 1 and the screen-throwing target device 2 each display a desktop interface or display a certain application interface, that is, at this time, the screen-throwing target device 2 as a large screen stops playing the video of the video APP.

As further shown in fig. 8 (c), the screen source device 1 may hover-display the screen icon 18 on the screen. When the user needs to switch the screen projection mode between the screen projection source device 1 and the screen projection target device 2 from the mirror screen projection mode to the streaming media screen projection mode, the user can click on the screen projection icon 18.

Further, as shown in (d) of fig. 8, when the screen-throwing source device 1 receives an operation of the user on the screen-throwing icon 18, the screen-throwing source device 1 may display a system screen-throwing menu 19 on the screen, in which a video APP portal 19 (e.g., "enter video APP screen-throwing interface") of the current screen and a switching control 20 may be displayed.

When the screen-drop source device 1 receives a user's operation on the video APP portal 19, the screen-drop source device 1 may jump from the current interface (e.g., desktop interface) to the last screen-drop interface of the video APP.

When the screen-throwing source device 1 receives the operation of the user on the switching control 20, the screen-throwing source device 1 can switch the current screen-throwing mode to another screen-throwing mode. For example, as shown in (d) of fig. 8, assuming that the current screen projection mode is mirror image screen projection, the switching control 20 prompts to be switchable to streaming media screen projection, and when the screen projection source device 1 receives the operation of the user on the switching control 20, the screen projection source device 1 may switch the screen projection mode to streaming media screen projection. This returns to the streaming media screen-on state shown in fig. 8 (b). Therefore, the scheme can improve the screen-throwing video watching experience.

However, it should be noted that, after the screen-throwing source device 1 switches the screen-throwing mode to streaming media screen throwing in response to the operation of the user on the screen-throwing menu, the display content of the screen-throwing source device 1 is not limited in the embodiments of the present application, and may remain unchanged, for example, as shown in (d) in fig. 8, the screen-throwing source device 1 may continue to display the screen-throwing menu 19; the display video APP playing interface may also be updated, for example, as shown in (b) of fig. 8, and the projection source device 1 may jump to the interface of the video APP.

In the embodiment of the present application, it should be noted that, in each of the foregoing embodiments, when the screen-throwing source device 1 starts to play a video, it is exemplified by automatically switching from mirror image screen throwing to streaming media screen throwing, and in actual implementation, the embodiment of the present application may further increase condition judgment, and trigger switching from mirror image screen throwing to streaming media screen throwing when a preset condition is satisfied.

Wherein, the preset condition may include at least one of: the screen-throwing source equipment 1 starts to play videos, the network quality where the screen-throwing target equipment 2 is located is good, and the residual electric quantity of the screen-throwing source equipment 1 is smaller than or equal to a preset electric quantity threshold value. It should be noted that, the preset conditions are exemplified herein, and the preset conditions may also include other condition definitions, and specifically may refer to that the embodiment of the present application is not limited according to the actual use situation.

When the screen-throwing source device 1 and the screen-throwing target device 2 are in the mirror image screen-throwing state, if the screen-throwing source device 1 and/or the screen-throwing target device 2 are judged to meet the preset condition, for example, if the screen-throwing source device 1 starts to play video and the network quality where the screen-throwing target device 2 is located is good, the mirror image screen-throwing between the screen-throwing source device 1 and the screen-throwing target device 2 is automatically switched into the streaming media screen-throwing state, and the screen-throwing target device 2 obtains video resources from a server under the streaming media screen-throwing scene to realize screen-throwing display.

A possible implementation of the jump to the video APP interface through the drop menu is described exemplarily below in connection with fig. 9.

As shown in fig. 9 (a), in the case where the screen-throwing source device 1 pops up the screen-throwing menu 30, the screen-throwing menu 30 may display a video APP portal 31 for the current screen throwing, a control 32 for triggering switching of the screen throwing mode, and a control 33 for triggering disconnection.

When the screen-throwing source device 1 receives the operation of the user on the video APP entry 31, the screen-throwing source device 1 may first determine whether the progress of the video APP is still present, and then execute different steps according to the determination result.

As shown in fig. 9 (b), if the progress of the video APP is found to be still present, the screen-throwing source device 1 jumps to the video APP's screen-throwing interface. In this case, the screen-cast icon is still displayed on the screen of the screen-cast source device 1.

As shown in fig. 9 (c), if the progress of the video APP is found to be absent, the screen-casting source device 1 restarts the video APP. Alternatively, in this case, the screen-cast icon may still be displayed on the screen of the screen-cast source device 1.

It should be noted that, under the condition that the progress of the video APP does not exist, the screen-throwing source device 1 loses control over the screen-throwing content, so that the system of the screen-throwing source device 1 can only pull up the video APP, so that the video APP is restarted, but the screen-throwing source device 1 cannot accurately jump to the screen-throwing interface of the video APP last time. In actual implementation, the display interface after video APP is started depends on APP itself.

When the screen-throwing source equipment 1 and the screen-throwing target equipment 2 are in a screen-throwing state, if the screen-throwing source equipment 1 receives that a user clicks other video sources in an interface of the video APP, the screen-throwing source equipment 1 plays the video sources, and correspondingly, the screen-throwing content of the screen-throwing target equipment 2 is updated to be the video sources.

Alternatively, when the screen-throwing source device 1 receives the operation of the control 33 by the user, the screen-throwing source device 1 may disconnect the wireless connection with the screen-throwing target device 2, canceling the wireless screen-throwing function. In this case, the screen-cast source device 1 may cancel the display of the screen-cast icon on the screen.

According to the scheme provided by the embodiment of the application, the video APP inlet and the switching control of the wireless screen are provided through the screen-throwing menu, so that no matter when the screen is thrown through the mirror image or the streaming media, the user can freely switch between the screen-throwing of the streaming media and the screen-throwing of the mirror image through the screen-throwing menu operation, and the screen-throwing experience of the user is improved.

Fig. 10 shows a schematic flow chart of a third party video APP side interacting with an electronic device side to implement screen casting. As shown in fig. 10, the flowchart includes steps S401 to S410 described below.

S401, playing video of the video APP.

S402, judging whether the electronic equipment starts the system mirror image screen projection.

The electronic device described herein, i.e. the electronic device initiating the screen projection, for example, corresponds to the screen projection source device 1 above, for example, a mobile phone.

S403, under the condition that the electronic equipment starts the system mirror image screen projection, acquiring the information of the large screen equipment connected with the electronic equipment.

Wherein the large screen device described herein may correspond to the above projection target device 2, e.g. a television set.

S404, calling a DLNA interface corresponding to the video APP.

S405, switching from mirror image screen projection to streaming media screen projection.

According to the above-mentioned S401-S405, when the electronic device plays the video of the video APP and the electronic device is in the mirror image screen-throwing state, the electronic device may automatically switch the screen-throwing mode from the mirror image screen-throwing mode to the streaming media screen-throwing mode, so that the large-screen device plays the video in the streaming media screen-throwing mode, thereby meeting the user requirement and improving the user experience.

S406, under the condition that the electronic equipment does not start the system mirror image screen projection, when the electronic equipment receives the triggering operation of starting the streaming media screen projection by the user, the electronic equipment starts the streaming media screen projection function.

S407, judging whether the electronic equipment has connected equipment.

And S408, if the electronic equipment does not have the connected equipment, the electronic equipment searches an equipment list, and after the electronic equipment finds the large-screen equipment in the same local area network, the electronic equipment establishes wireless connection with the large-screen equipment and performs screen-throwing negotiation.

S409, if the electronic equipment has the connected equipment, the electronic equipment is directly connected with the equipment and performs screen projection negotiation.

After the electronic device performs the screen projection negotiation with the large-screen device, the electronic device can broadcast the screen projection negotiation result to the third-party video APP.

S410, the electronic device writes the information of the connected device into a Database (DB).

In step S403 described above, the large-screen device information to which the electronic device has been connected may be acquired from the DB.

In the embodiment of the present application, as can be seen from the above steps S401 to S410, the precondition for implementing screen projection needs to be considered: whether the mobile phone and the television are in a connection state, whether the mobile phone is in mirror image screen projection, and whether the television is connected.

It should be noted that, the schemes provided by the embodiments of the present application may be applied not only to the video playing scene illustrated above, but also to other scenes of streaming media projection, such as gallery, music, etc. The method can be specifically determined according to actual use requirements, and the embodiment of the application is not limited.

It should also be noted that, in the embodiment of the present application, "greater than" may be replaced with "greater than or equal to", "less than or equal to" may be replaced with "less than", or "greater than or equal to" may be replaced with "greater than", "less than" may be replaced with "less than or equal to".

The various embodiments described herein may be separate solutions or may be combined according to inherent logic, which fall within the scope of the present application.

It will be appreciated that the methods and operations described above as being performed by an electronic device in various method embodiments may also be performed by components (e.g., chips or circuits) that may be used in an electronic device.

Having described the method embodiments provided herein, embodiments of the apparatus provided herein are described below. It should be understood that the descriptions of the apparatus embodiments and the descriptions of the method embodiments correspond to each other, and thus, descriptions of details not described may be referred to the above method embodiments, which are not repeated herein for brevity.

The solutions provided in the embodiments of the present application are mainly described above from the perspective of method steps. It will be appreciated that, in order to implement the above-described functions, an electronic device implementing the method includes corresponding hardware structures and/or software modules that perform the respective functions. Those of skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The embodiment of the present application may divide the functional modules of the electronic device according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated modules may be implemented in hardware or in software functional modules. It should be noted that, in the embodiment of the present application, the division of the modules is merely a logic function division, and other possible division manners may be implemented in practice. The following description will take an example of dividing each functional module into corresponding functions.

Fig. 11 is a schematic block diagram of an apparatus 700 for controlling screen projection according to an embodiment of the present application. The apparatus 700 may be used to perform the actions performed by the screen source device in the method embodiments above. The apparatus 700 comprises a screen projection control unit 710 and a display unit 720.

The screen-throwing control unit 710 is configured to control the screen-throwing source device to throw a screen to the screen-throwing target device in a first screen-throwing manner in response to a first operation of a user;

the screen-throwing control unit 710 is further configured to control the screen-throwing source device to throw a screen to the screen-throwing target device in a second screen-throwing manner in response to a second operation of requesting a streaming media file in a first application by a user, where the first application is a streaming media application in the screen-throwing source device;

A display unit 720, configured to respond to a third operation of the screen-throwing source device by a user, and display a desktop interface on a screen of the screen-throwing source device, where a screen-throwing icon is displayed in the desktop interface; the second screen projection mode is kept between the screen projection source equipment and the screen projection target equipment;

the display unit 720 is further configured to display a screen-throwing menu bar on a screen of the screen-throwing source device in response to a fourth operation of the screen-throwing icon by the user, where the screen-throwing menu bar includes a first control;

the screen-throwing control unit 710 is further configured to control the screen-throwing source device to throw a screen to the screen-throwing target device in a first screen-throwing manner in response to a fifth operation of the first control by the user.

In some possible implementations, the first screen-throwing mode conforms to a first screen-throwing protocol, and the first screen-throwing protocol supports the screen-throwing target device to acquire screen display content of the screen-throwing source device from the screen-throwing source device and display the screen display content. Illustratively, the first screen-drop protocol includes a mirror screen-drop Miracst protocol or a cast+ protocol.

In some possible implementations, the second screen-projection manner conforms to the second screen-projection protocol, and the second screen-projection protocol supports the screen-projection target device to acquire the streaming media file from the server and play the streaming media file. Illustratively, the second screen-drop protocol includes a streaming media screen-drop DLNA protocol.

Optionally, as shown in fig. 11, the apparatus 700 further includes a transceiver unit 730;

the screen-projection control unit 710 is specifically configured to control the screen-projection source device and the screen-projection target device to establish a connection based on a first screen-projection protocol;

and the transceiver unit 730 is configured to send, by the screen-throwing source device, the screen display content of the screen-throwing source device to the screen-throwing target device, so that the screen-throwing target device receives and displays the screen display content of the screen-throwing source device.

In some possible implementations, the screen-projection control unit 710 is specifically configured to control the screen-projection source device and the screen-projection target device to establish a connection based on a second screen-projection protocol;

And the transceiver unit 730 is configured to send, by the screen-throwing source device, the network address of the streaming media file to the screen-throwing target device, so that the screen-throwing target device obtains, according to the network address of the streaming media file, the streaming media file from the server corresponding to the first application.

In some possible implementations, the first control may be a screen-throwing control, which is used to trigger a switch from the second screen-throwing mode to the first screen-throwing mode. In this case, the screen-casting target device stops acquiring the streaming media data for screen casting from the server of the first application, and the screen-casting target device receives and displays the streaming media data for screen casting sent by the screen-casting source device. Therefore, by operating on the screen-throwing switching control in the screen-throwing menu bar, the streaming media screen throwing can be triggered to stop and return to the mirror image screen throwing. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations, the first control may be a disconnect control, configured to trigger disconnection of a connection established based on the second screen-drop protocol. In this case, the screen-casting target device stops acquiring streaming media data for screen casting from the server of the first application. Thus by operating on a disconnect control in the drop menu bar, streaming media drop stops may be triggered, and the connection established based on the first drop protocol may be returned to mirrored drop without disconnection. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations, the screen-drop menu bar further includes at least one screen-drop information option, each of the at least one screen-drop information option indicating a screen-drop event of one streaming media application.

Optionally, as shown in fig. 11, the apparatus 700 further includes a sensing unit 740, where the sensing unit 740 is configured to receive a sixth operation of the user on a first screen information option, and the first screen information option indicates a screen-throwing event of the first application;

the screen-projection control unit 710 is further configured to determine, in response to the sixth operation, whether the first application is in an operating state; if the first application is in an operating state, displaying a first interface of the first application which is on the screen source equipment; if the first application is in a closed state, triggering the first application to be opened, and displaying a second interface of the first application; wherein the first application is in a state of having exited the screen.

In some possible implementations, the sensing unit 740 is further configured to receive a seventh operation by the user on the second control in the first interface;

the screen-throwing control unit 710 is further configured to control the screen-throwing source device to stop throwing the screen to the screen-throwing target device in the second screen-throwing manner and to throw the screen to the screen-throwing target device in the first screen-throwing manner in response to the seventh operation.

In some possible implementations, the sensing unit 740 is further configured to receive an eighth operation that the screen-cast source device requests the streaming media file in the first application from the user;

and the screen-throwing control unit 710 is further configured to control the screen-throwing source device to throw a screen to the screen-throwing target device in the second screen-throwing mode in response to the eight operations.

In some possible implementations, the responding to the second operation of requesting the streaming media file in the first application by the user, the screen-throwing source device performs screen throwing to the screen-throwing target device through a second screen-throwing mode, including:

In some possible implementations, the first application switches to a background run of the screen-throwing source device with the screen-throwing source device displaying the desktop interface.

In some possible implementations, the screen-casting source device and the screen-casting target device are in the same wireless fidelity Wi-Fi network.

Fig. 12 is a schematic block diagram of an apparatus 800 for controlling screen projection according to an embodiment of the present application. The apparatus 800 may be used to perform the actions performed by the screen source device in the method embodiments above. The apparatus 800 includes a projection screen control unit 810 and a display unit 820.

The screen-throwing control unit 810 is configured to control, in response to a first operation of a user on a screen-throwing source device, the screen-throwing source device to throw a screen to a screen-throwing target device in a first screen-throwing manner;

the screen-throwing control unit 810 is further configured to respond to a second operation of requesting the streaming media file in the first application by the user, where the screen-throwing source device performs screen throwing on the screen-throwing target device in a second screen-throwing manner, and control the first application to be the streaming media application in the screen-throwing source device;

a display unit 820, configured to respond to a third operation of the screen-throwing source device by a user, where the screen-throwing source device displays a desktop interface, and a screen-throwing icon is displayed in the desktop interface; the screen projection mode between the screen projection source equipment and the screen projection target equipment is switched from the second screen projection mode to the first screen projection mode;

The display unit 820 is further configured to, in response to a fourth operation of the screen-drop icon by the user, display a screen-drop menu bar by the screen-drop source device, where the screen-drop menu bar includes a first control;

the screen-throwing control unit 810 is further configured to control the screen-throwing source device to throw a screen to the screen-throwing target device in a second screen-throwing manner in response to a fifth operation of the first control by the user.

Optionally, as shown in fig. 12, the apparatus 800 may further include a transceiver unit 830.

In some possible implementations, the screen-projection control unit 810 is specifically configured to control the screen-projection source device and the screen-projection target device to establish a connection based on a first screen-projection protocol. The transceiver unit 830 is configured to send, by the screen-throwing source device, screen display content of the screen-throwing source device to the screen-throwing target device, so that the screen-throwing target device receives and displays the screen display content of the screen-throwing source device.

In some possible implementations, the screen-projection control unit 810 is specifically configured to control the screen-projection source device and the screen-projection target device to establish a connection based on a second screen-projection protocol. The transceiver unit 830 is configured to send, by the screen-throwing source device, a network address of the streaming media file to the screen-throwing target device, so that the screen-throwing target device obtains, according to the network address of the streaming media file, the streaming media file from a server corresponding to the first application.

In some possible implementations, the first control may be a screen-throwing control, which is used to trigger a switch from a first screen-throwing mode to a second screen-throwing mode. In this case, the screen-throwing target device stops receiving the streaming media data for throwing the screen, which is sent by the screen-throwing source device, and the screen-throwing target device obtains the streaming media data for throwing the screen from the server of the first application according to the network address for streaming media screen throwing, which is sent by the screen-throwing source device, and displays the streaming media data. Therefore, by operating on the screen-throwing switching control in the screen-throwing menu bar, the mirror image screen throwing stop can be triggered, and the streaming media screen throwing is returned. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations, the first control may also be a disconnect control, configured to trigger disconnection of a connection established based on the first screen-drop protocol. In this case, the screen-casting source device stops transmitting the screen-casting data to the screen-casting target device. Thus by operating on the disconnect control in the drop menu bar, a mirror drop stop may be triggered and a return to streaming media drop may be made without the connection established based on the second drop protocol being broken. Because the operation is convenient, the screen throwing experience of the user can be improved.

In some possible implementations, the first control may also be a drop information option. The screen-throwing menu bar comprises at least one screen-throwing information option, and each screen-throwing information option in the at least one screen-throwing information option indicates a screen-throwing event of a streaming media application;

optionally, as shown in fig. 12, the apparatus 800 may further include a sensing unit 840, where the sensing unit 840 is configured to receive, by the screen source device, a sixth operation of the user on a first screen information option, where the first screen information option indicates a screen event of the first application, and the first screen information option is used as the first control;

The screen-projection control unit 810 is specifically configured to: responding to the sixth operation, and stopping the screen projection to the screen projection target equipment by the first screen projection mode and performing screen projection to the screen projection target equipment by the second screen projection mode by the screen projection source equipment under the condition that the first application is in an operation state.

In some possible implementations, the screen-projection control unit 810 is further configured to control, in response to the sixth operation, opening of the first application when the first application is in the closed state. The display unit 820 is configured to display a second interface of the first application; wherein the first application is in a state of having exited the screen.

In some possible implementations, the sensing unit 830 is further configured to receive a seventh operation of requesting the streaming media file in the first application by the user. The screen-projection control unit 810 is further configured to perform screen projection on the screen-projection target device by using the screen-projection source device in the second screen-projection manner in response to the seven operations.

In some possible implementations, the first application is switched to a background run of the screen-casting source device with the screen-casting source device displaying the desktop interface.

The apparatus 800 according to the embodiment of the present application may correspond to performing the method described in the embodiment of the present application, and the foregoing and other operations and/or functions of the units in the apparatus 800 are respectively for implementing the corresponding flows of the method, and are not described herein for brevity.

Fig. 13 is a schematic structural diagram of an electronic device 900 provided in an embodiment of the present application. The electronic device 900 includes: processor 910, memory 920, communication interface 930, bus 940.

Wherein the processor 910 may be coupled to a memory 920. The memory 920 may be used to store the program codes and data. Accordingly, the memory 920 may be a storage unit internal to the processor 910, an external storage unit independent of the processor 910, or a component including a storage unit internal to the processor 910 and an external storage unit independent of the processor 910.

Optionally, the electronic device 900 may also include a bus 940. The memory 920 and the communication interface 930 may be connected to the processor 910 through a bus 940. Bus 940 may be a peripheral component interconnect standard (peripheral component interconnect, PCI) bus or an extended industry standard architecture (extended industry standard architecture, EISA) bus, among others. The bus 940 may be classified as an address bus, a data bus, a control bus, etc. For ease of illustration, only one line is shown in fig. 13, but not only one bus or one type of bus.

It should be appreciated that in embodiments of the present application, the processor 910 may employ a central processing unit (central processing unit, CPU). The processor may also be other general purpose processors, digital signal processors (digital signal processor, DSP), application specific integrated circuits (application specific integrated circuit, ASIC), off-the-shelf programmable gate arrays (field programmable gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. Or the processor 910 may employ one or more integrated circuits for executing associated programs to perform the techniques provided in the embodiments of the present application.

The memory 920 may include read only memory and random access memory and provide instructions and data to the processor 910. A portion of the processor 910 may also include nonvolatile random access memory. For example, the processor 910 may also store information of the device type.

When the electronic device 900 is running, the processor 910 executes computer-executable instructions in the memory 920 to perform the operational steps of the methods described above.

It should be understood that the electronic device 900 according to the embodiment of the present application may correspond to the apparatus 700 or the apparatus 800 in the embodiment of the present application, the processor 910 in the electronic device 900 may correspond to the screen-on control unit 710 in the apparatus 700 or the screen-on control unit 810 in the apparatus 800, and the communication interface 930 in the electronic device 900 may correspond to the transceiver unit 730 in the apparatus 700 or the transceiver unit 830 in the apparatus 800. The foregoing and other operations and/or functions of each unit in the apparatus 800 are respectively used to implement the corresponding flow of the foregoing method, and are not repeated herein for brevity.

Optionally, in some embodiments, a chip including a processor is further provided in embodiments of the present application. The processor is configured to read and execute the computer program stored in the memory to perform the methods of the aspects described above.

Optionally, in some embodiments, the embodiments further provide a computer readable medium storing a program code, which when run on a computer, causes the computer to perform the method in the above aspects.

Optionally, in some embodiments, embodiments of the present application further provide a computer program product comprising: computer program code which, when run on a computer, causes the computer to perform the method of the above aspects.

In an embodiment of the present application, an electronic device includes a hardware layer, an operating system layer running above the hardware layer, and an application layer running above the operating system layer. The hardware layer may include a central processing unit (central processing unit, CPU), a memory management unit (memory management unit, MMU), and a memory (also referred to as a main memory). The operating system of the operating system layer may be any one or more computer operating systems that implement business processing through processes (processes), for example, a Linux operating system, a Unix operating system, an Android operating system, an iOS operating system, or windows operating system, etc. The application layer may include applications such as a browser, address book, word processor, instant messaging software, and the like.

The present embodiment does not particularly limit the specific structure of the execution body of the method provided in the present embodiment, as long as communication can be performed in the method provided in the present embodiment by running a program in which the code of the method provided in the present embodiment is recorded. For example, the execution body of the method provided in the embodiment of the present application may be an electronic device, or a functional module in the electronic device that can call a program and execute the program.

Various aspects or features of the present application can be implemented as a method, apparatus, or article of manufacture using standard programming and/or engineering techniques. The term "article of manufacture" as used herein may encompass a computer program accessible from any computer-readable device, carrier, or media. For example, computer-readable media may include, but are not limited to: magnetic storage devices (e.g., hard disk, floppy disk, or magnetic tape, etc.), optical disks (e.g., compact Disk (CD), digital versatile disk (digital versatile disc, DVD), etc.), smart cards, and flash memory devices (e.g., erasable programmable read-only memory (EPROM), cards, sticks, key drives, etc.).

Various storage media described herein can represent one or more devices and/or other machine-readable media for storing information. The term "machine-readable medium" may include, but is not limited to: wireless channels, and various other media capable of storing, containing, and/or carrying instruction(s) and/or data.

It should be appreciated that the processors referred to in the embodiments of the present application may be central processing units (central processing unit, CPU), but may also be other general purpose processors, digital signal processors (digital signal processor, DSP), application specific integrated circuits (application specific integrated circuit, ASIC), off-the-shelf programmable gate arrays (field programmable gate array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

It should also be understood that the memory referred to in the embodiments of the present application may be volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an electrically Erasable EPROM (EEPROM), or a flash memory. The volatile memory may be random access memory (random access memory, RAM). For example, RAM may be used as an external cache. By way of example, and not limitation, RAM may include the following forms: static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous DRAM (SLDRAM), and direct memory bus RAM (DR RAM).

It should be noted that when the processor is a general purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, the memory (storage module) may be integrated into the processor.

It should also be noted that the memory described herein is intended to comprise, without being limited to, these and any other suitable types of memory.

Those of ordinary skill in the art will appreciate that the elements and steps of the examples described in connection with the embodiments disclosed herein can be implemented as electronic hardware, or as a combination of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Furthermore, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interface, device or unit indirect coupling or communication connection, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present application, or the part contributing to the prior art, or the part of the technical solution, may be embodied in the form of a computer software product stored in a storage medium, the computer software product comprising several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present application. The foregoing storage medium may include, but is not limited to: a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk, etc.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.

The foregoing is merely specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes and substitutions are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method of controlling a projection screen, comprising:

responding to a first operation of a user, and enabling the screen-throwing source equipment to throw a screen to the screen-throwing target equipment in a first screen-throwing mode;

responding to a third operation of the screen throwing source equipment by a user, wherein the screen throwing source equipment displays a desktop interface, and screen throwing icons are displayed in the desktop interface; the second screen-throwing mode is kept between the screen-throwing source equipment and the screen-throwing target equipment, and streaming media screen-throwing connection is kept;

responding to a fourth operation of the user on the screen throwing icon, displaying a screen throwing menu bar by the screen throwing source equipment, wherein the screen throwing menu bar comprises a first control and a screen throwing video APP inlet;

Under the condition that the operation of a user on the screen-throwing video APP entrance is received, if the process of the first application exists, the screen-throwing source equipment jumps to the video playing interface of the first application from the desktop interface, and if the process of the first application does not exist, the screen-throwing source equipment triggers the first application to restart; wherein, the screen throwing icon is kept to be displayed in the desktop interface;

under the condition that a fifth operation of the first control by the user is received, responding to the fifth operation, the screen-throwing source equipment disconnects the streaming media screen-throwing connection, and performs screen-throwing to the screen-throwing target equipment in the first screen-throwing mode, and the screen-throwing icon is canceled from being displayed in the desktop interface.

2. The method of claim 1, wherein the first screen-casting manner conforms to a first screen-casting protocol, the first screen-casting protocol comprising a mirrored screen-casting Miracst protocol or cast+ protocol;

the second screen-throwing mode conforms to a second screen-throwing protocol, and the second screen-throwing protocol comprises a streaming media screen-throwing DLNA protocol.

3. The method according to claim 1, wherein the responding to the second operation of requesting the streaming media file in the first application by the user, the screen-casting source device performs screen casting to the screen-casting target device through a second screen-casting mode, including:

4. The method according to claim 1, wherein the method further comprises:

and under the condition that the screen projection source equipment displays the desktop interface, the screen projection source equipment switches the first application to background operation.

5. The method of claim 1, wherein the drop menu bar further comprises at least one drop information option, each of the at least one drop information option indicating a drop event for a streaming media application;

the method further comprises the steps of:

6. The method of claim 5, wherein after the screen-casting source device displays a first interface that the first application is casting, the method further comprises:

7. The method of claim 5, wherein after the screen-cast source device triggers the first application to open and displays a second interface of the first application, the method further comprises:

8. The method according to any one of claims 1 to 7, wherein the screen-casting source device performs screen casting to a screen-casting target device by a first screen-casting mode, including:

9. The method according to any one of claims 1 to 7, wherein the screen-casting source device performs screen casting to the screen-casting target device by a second screen-casting manner, including:

10. The method of any of claims 1-7, wherein the screen-casting source device and the screen-casting target device are in the same wireless fidelity Wi-Fi network.

11. An electronic device comprising a processor coupled to a memory, the processor for executing a computer program or instructions stored in the memory to cause the electronic device to implement the method of any one of claims 1-10.

12. A chip system coupled to a memory for reading and executing a computer program stored in the memory for implementing the method according to any of claims 1 to 10.

13. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when run on an electronic device, causes the electronic device to perform the method of any one of claims 1 to 10.