WO2023142389A1

WO2023142389A1 - Screen mirroring method and apparatus, and electronic device and storage medium

Info

Publication number: WO2023142389A1
Application number: PCT/CN2022/103975
Authority: WO
Inventors: 李宾; 田园; 候志龙
Original assignee: 深圳创维－Rgb电子有限公司
Priority date: 2022-01-30
Filing date: 2022-07-05
Publication date: 2023-08-03
Also published as: CN114428598A

Abstract

Disclosed in the present application are a screen mirroring method and apparatus, and an electronic device and a storage medium. The screen mirroring method comprises: pausing transmission of a screen mirroring signal when it is detected that an upper-layer application switches from a first target application to a second target application during a screen mirroring process; acquiring a screen mirroring whitelist, and determining, according to the screen mirroring whitelist, whether the second target application is a whitelist application; and if it is determined that the second target application is a whitelist application, continuing to transmit the screen mirroring signal. The present application solves the technical problem of privacy disclosure during a screen mirroring process in the prior art.

Description

Screen projection method, device, electronic device and storage medium

This application claims the priority of the Chinese patent application with application number 202210113740.0 and titled "screen projection method, device, electronic equipment and storage medium" submitted to the China Patent Office on January 30, 2022.

technical field

The present application relates to the technical field of screen projection, and in particular to a screen projection method, device, electronic equipment, and storage medium.

Background technique

With the development of science and technology and the improvement of people's living standards, the function of displaying the screens of mobile devices such as mobile phones, tablet computers, and computers through large TV screens, projectors, and other display devices has become increasingly popular. , video, etc. are pushed to the display device for playback. However, when the screen of the mobile device is projected on the same screen, when the private content is displayed on the mobile phone, it will also be projected to the display device synchronously, and the display device is often public. properties of the screen, so it will cause the leakage of personal privacy.

technical problem

The main purpose of the present application is to provide a screen projection method, device, electronic equipment and storage medium, aiming to solve the technical problem of privacy leakage during the screen projection process in the prior art.

technical solution

In order to achieve the above purpose, the present application provides a screen projection method, the screen projection method includes:

During the screen projection process, it is detected that the upper-layer application is switched from the first target application to the second target application, and the transmission of the screen projection signal is suspended;

Obtaining a screen projection whitelist, and judging whether the second target application is a whitelist application according to the screen projection whitelist; and

Determine that the second target application is a whitelist application, and continue to transmit the screen projection signal.

In an embodiment, after the step of judging whether the second target application is a whitelist application according to the screen projection whitelist, further includes:

determining that the second target application is not a whitelist application, and detecting whether the upper-layer application is switched to a whitelist application; and

It detects that the upper-layer application is switched to the whitelist application, and continues to transmit the screen projection signal.

In an embodiment, before the step of detecting that the upper-layer application switches from the first target application to the second target application during the screen projection process, and suspending the transmission of the screen projection signal, further includes:

Get the current projection mode;

Determining that the current projection screen display mode is a privacy protection mode, and monitoring whether the upper-layer application performs application switching.

In one embodiment, the step of detecting that the upper-layer application is switched from the first target application to the second target application during the screen projection process, and suspending the transmission of the screen projection signal includes:

During the screen projection process, it is detected that the upper layer application is switched from the first target application to the second target application, the playing content corresponding to the first target application is suspended, and the transmission of the screen projection signal is suspended.

In an embodiment, the step of pausing and playing the playing content corresponding to the first target application includes:

judging whether the playback content corresponding to the first target application is a recording resource;

Determine that the playback content corresponding to the first target application is a recording resource, pause playing the recording resource, and acquire a pause time of the recording resource; and

It is detected that the upper-layer application is switched to the first target application, and the recording and broadcasting resource is continued to be played from the pause time.

judging whether the playback content corresponding to the first target application is a live resource;

determining that the playback content corresponding to the first target application is a live broadcast resource, freezing the current playback screen of the live broadcast resource, and recording the live broadcast resource to obtain a recording file; and

It is detected that the upper layer application is switched to the first target application, and the recorded file is played.

In an embodiment, after the step of suspending the transmission of the screen projection signal, it further includes:

The display device displays the last frame received before suspending the transmission of the projection signal.

In an embodiment, the screen projection signal includes a screen projection audio signal and a screen projection image signal.

In an embodiment, the upper-layer application is an application displayed on the uppermost layer of the screen projection push terminal, and the way for the upper-layer application to switch from the first target application to the second target application includes pop-up message notification, incoming call, or through the top message Notify to switch applications or switch applications directly by switching screens.

In one embodiment, the method also includes:

Set exception scenarios for upper-layer applications;

determining that the current upper-layer application belongs to the exception scenario, re-determining a new upper-layer application from other applications except the current upper-layer application,

In an embodiment, if it is determined that the current upper-layer application belongs to the exception scenario, it includes:

Determine that the exception scenario is the top floating window, receive the top floating window of the current upper application, and re-determine a new upper application from other applications except the current upper application.

In one embodiment, the privacy protection mode includes:

The privacy protection mode is a mode in which no screen projection is performed for privacy protection applications that require privacy protection, and the privacy protection application corresponding to the privacy protection mode is determined according to the screen projection whitelist or screen projection blacklist, and the screen projection whitelist The list is a list of applications that are allowed to be displayed on the screen, and the blacklist is a list of applications that are not allowed to be displayed on the screen

The present application also provides a screen projection device, the screen projection device is applied to a screen projection device, and the screen projection device includes:

The pause module is used to detect that the upper-layer application is switched from the first target application to the second target application during the screen projection process, and suspend the transmission of the screen projection signal;

A judging module, configured to obtain a screen projection whitelist, and judge whether the second target application is a whitelist application according to the screen projection whitelist;

The transmission module is configured to determine that the second target application is a whitelist application, and continue to transmit the screen projection signal.

In one embodiment, the judging module is further used to determine that the second target application is not a whitelist application, detect whether the upper-layer application is switched to a whitelist application; and detect that the upper-layer application is switched to a whitelist application, and continue to transmit the cast screen signal.

The present application also provides an electronic device, the electronic device is a physical device, and the electronic device includes: a memory, a processor, and the screen projection method stored in the memory and operable on the processor A program. When the program of the screen projection method is executed by the processor, the steps of the above screen projection method can be realized.

The present application also provides a storage medium, the storage medium is a computer-readable storage medium, and the computer-readable storage medium stores a program for implementing the screen projection method, and the program for the screen projection method is implemented when the processor executes the program. The steps of the above screen casting method.

The present application also provides a computer program product, including a computer program, and when the computer program is executed by a processor, the steps of the above screen projection method are realized.

Beneficial effect

The present application provides a screen projection method, device, electronic equipment, and storage medium, by suspending the transmission of the screen projection signal when it is detected that the upper layer application is switched from the first target application to the second target application during the screen projection process. When each application is switched, the transmission of the screen projection signal is suspended to ensure that if the display content of the switched-to second target application contains private content, it will not be displayed synchronously immediately, and then by obtaining the screen projection whitelist, according to the screen projection The whitelist judges whether the second target application is a whitelist application, and if it is determined that the second target application is a whitelist application, then continue to transmit the screen projection signal, realizing whether the second target application can be determined according to the screen projection whitelist Screen projection display, if it is determined that the second target application is a whitelist application, it means that the second target application does not contain private content, then the screen projection signal can be continuously transmitted, and the display corresponding to the second target application can be displayed on the screen projection The screen realizes the suspension of transmission of projection signals only for applications that are not on the projection whitelist, which effectively improves the protection of personal privacy during the projection process and overcomes the technical problem of privacy leakage during the projection process in the prior art.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application.

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, In other words, other drawings can also be obtained from these drawings without paying creative labor.

FIG. 1 is a schematic diagram of a screen projection connection scenario of an embodiment of the screen projection call method of the present application;

FIG. 2 is a schematic structural diagram of an electronic device in a hardware operating environment involved in the method of casting a call in an embodiment of the present application;

FIG. 3 is a schematic flow diagram of an embodiment of the screen projection method of the present application;

FIG. 4 is a schematic diagram of a scenario of an implementation mode of the method for casting a call in the present application;

FIG. 5 is a schematic structural diagram of a device involved in a method of casting a call in an embodiment of the present application.

The realization of the purpose, functions and advantages of the present application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

Embodiments of the present invention

In order to make the above objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

Referring to FIG. 1 , FIG. 1 is a schematic diagram of a screen projection connection involved in an embodiment of the present invention.

As shown in Figure 1, the screen projector includes: a screen projector transmitter and/or a screen projector receiver, wherein the first electronic device may be a personal computer, a smart phone, a tablet computer, an e-book reader or a portable computer, etc. For the mobile terminal device, the second electronic device may be a display device with a display function such as a television, a monitor, or a projector.

In some embodiments, the first electronic device is connected to the screen projector transmitter and/or screen projector receiver through a wired or wireless network for data transmission and interaction; the screen projector transmitter is connected to the screen projector receiver through a wireless network for data transmission and interaction. Data transmission and interaction, or the screen projector transmitter is connected to the second electronic device through a wireless network for data transmission and interaction; the screen projector receiver is connected to the second electronic device through a wired or wireless network for data transmission and interaction. In an implementation manner, the wired connection between the screen projector receiver and the second electronic device and between the screen projector transmitter and the first electronic device may include HDMI (High Definition Multimedia Interface, USB (Universal Serial Bus, Universal Serial Bus), DP (DisplayPort, Display Interface) and VGA (Video Graphics Array, Video Graphics Array) and other wired connections. Between the first electronic device and the screen projector transmitter and the screen projector receiver, between the second electronic device and the screen projector transmitter and the screen projector receiver, Bluetooth (Bluetooth), wireless broadband (Wi- Fi), infrared communication and other wireless communication.

Possible connection methods for screen projection between the first electronic device, the screen projector transmitter, the screen projector receiver, and the second electronic device at least include:

(1) The screen projector transmitter is connected to the screen projector receiver, and the screen of the first electronic device is finally projected to the second electronic device through the screen projector transmitter and screen projector receiver;

(2) The screen projector transmitter is wirelessly connected to the second electronic device, and the screen of the first electronic device is projected to the second electronic device through the screen projector transmitter. At this time, the screen projector transmitter and the built-in second electronic device The wireless communication modules are connected via a wireless network; and

(3) The first electronic device is connected to the screen projector receiver, and the screen of the first electronic device is projected to the second electronic device through the screen projector receiver.

Referring to FIG. 2 , FIG. 2 is a schematic structural diagram of an electronic device in a hardware operating environment involved in the screen-casting call method in the embodiment of the present application. Electronic devices in the embodiments of the present disclosure may include, but are not limited to, TVs, screen projectors, screen projector receivers, screen projector transmitters, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants) , PAD (tablet computer), PMP (portable multimedia player), vehicle terminal (such as vehicle navigation terminal), digital TV, desktop computer and other fixed terminals.

As shown in FIG. 2 , the electronic device further includes: a processor 1001 , such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002 , a network interface 1003 , and a memory 1004 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. Optionally, the network interface 1003 may include a standard wired interface and a wireless interface (such as a Wireless-Fidelity (Wireless-Fidelity, WI-FI) interface). Memory 1004 can be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as disk memory. Optionally, the memory 1004 may also be a storage device independent of the aforementioned processor 1001 .

In one embodiment, the terminal may also include a camera, RF (Radio Frequency, radio frequency) circuits, sensors, audio circuits, WiFi modules, etc. Among them, sensors such as light sensors, motion sensors and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display screen according to the brightness of the ambient light, and the proximity sensor may turn off the display screen and/or backlight. As a kind of motion sensor, the gravitational acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the application of mobile terminal posture (such as horizontal and vertical screen switching, Related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tap), etc.; of course, the mobile terminal can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. No longer.

Those skilled in the art can understand that the structure shown in FIG. 2 does not constitute a limitation on the operating equipment, and may include more or less components than shown in the figure, or combine some components, or arrange different components.

As shown in FIG. 2 , the memory 1004 as a storage medium may include an operating system, a data storage module, a network communication module, and a screen-casting call program.

In the running device shown in FIG. 2 , the network interface 1003 is mainly used for data communication with other devices. The processor 1001 and memory 1004 in the operating device of the present invention can be set in the operating device, and the operating device invokes the screen projection call program stored in the memory 1004 through the processor 1001, and performs the following operations:

When it is detected that the upper layer application is switched from the first target application to the second target application during the screen projection process, the transmission of the screen projection signal is suspended;

Obtaining a screen projection whitelist, and judging whether the second target application is a whitelist application according to the screen projection whitelist;

If it is determined that the second target application is a whitelist application, continue to transmit the screen projection signal.

In an embodiment, the processor 1001 may invoke the screen-casting call program stored in the memory 1004, and further perform the following operations:

If it is determined that the second target application is not a whitelist application, then detecting whether the upper layer application is switched to a whitelist application;

When it is detected that the upper-layer application is switched to the whitelist application, continue to transmit the screen projection signal.

Get the current projection mode;

If it is determined that the current projection screen display mode is a privacy protection mode, then it is monitored whether the upper layer application performs application switching.

When it is detected that the upper-layer application is switched from the first target application to the second target application during the screen projection process, the playback of the content corresponding to the first target application is suspended, and the transmission of the screen projection signal is suspended.

If it is determined that the playback content corresponding to the first target application is a recording and broadcasting resource, then pause playing the recording and broadcasting resource, and obtain the pause time of the recording and broadcasting resource;

When it is detected that the upper-layer application is switched to the first target application, the recording resource is continued to be played from the pause time.

If it is determined that the playback content corresponding to the first target application is a live broadcast resource, freeze the current playback screen of the live broadcast resource, and record the live broadcast resource to obtain a recording file;

When it is detected that the upper layer application is switched to the first target application, the recorded file is played.

An embodiment of the present application provides a screen projection method. In the first embodiment of the screen projection method of the present application, referring to FIG. 3 , the screen projection method includes:

Step S10, when it is detected that the upper-layer application is switched from the first target application to the second target application during the screen projection process, suspending the transmission of the screen projection signal;

In this embodiment, it should be noted that the screen projection is a process of projecting the display screen of the screen projection push end to the screen projection receiving end for display, and the screen projection receiving end communicates with the screen projection push end. The execution subject of the embodiment may be a screen projection pusher or a screen projection receiver, wherein the screen projection receiver is a device that receives a screen projection, such as a TV, a computer or a projector, etc., in an implementable manner , the screen projection receiving end may also be a screen projection receiver connected to a display and/or a speaker, and the screen projection receiver may be connected to the display and/or a speaker through a wired or wireless connection. After the audio signal and image signal of the screen, the audio signal and image signal received by the screen projection are output through the display and/or speaker connected to the receiver of the screen projection device; Devices such as mobile phones, computers, or tablets. In an implementable manner, the screen projection push end may also be a screen projection transmitter connected to a mobile device, and the screen projection transmitter and the mobile device may be connected through a wired or wireless connection, and the mobile device Send the audio signal and image signal of the desired screen projection to the screen projection receiver through the screen projection device transmitter.

Specifically, during the process of projecting the screen from the screen projection pusher to the screen projection receiver, it is detected in real time whether the upper-layer application corresponding to the screen projection pusher has changed, and when it is detected that the upper-layer application is switched from the currently displayed first target application to the When the second target application is used, the transmission of the screen projection signal to the screen projection receiving end is suspended, wherein the screen projection signal includes a screen projection audio signal and a screen projection image signal, etc., and the upper layer application is the uppermost layer of the screen projection push terminal For the display application, the method of switching the upper-level application from the first target application to the second target application includes pop-up message notification, incoming call, or switching applications (for example: switching applications through top message notifications or switching applications directly by switching screens, etc. ), etc., in an implementable manner, the exception scenario of the upper-layer application can also be set, and if it is determined that the current upper-layer application belongs to the exception scenario, then re-determined from other applications except the current upper-layer application For a new upper-level application, for example, if it is determined that the exception scene is the top floating window, and the top floating window of WeChat is received during the process of watching the video on the screen, it will be re-determined from other applications except the WeChat application. The new upper-level application, at this time, the new upper-level application should be the original application for watching videos, which can avoid the bad experience of continuous interruption of WeChat messages during the process of watching videos and other continuous screen projections, in an implementable way In the above, the privacy protection of the upper-layer application corresponding to the exception scenario may be performed by obfuscating or other concealment processing on the upper-layer application corresponding to the exception scenario.

In one embodiment, before the step of suspending the transmission of the screen projection signal when it is detected that the upper layer application is switched from the first target application to the second target application during the screen projection process, it further includes:

Step A10, obtaining the current projection display mode;

Step A20, if it is determined that the current projection screen display mode is the privacy protection mode, then monitor whether the upper layer application performs application switching.

In this embodiment, specifically, the screen projection display mode currently set by the screen projection connection is obtained, and it is judged whether the currently set screen projection display mode is a privacy protection mode, and if it is determined that the current screen projection display mode is a privacy protection mode, Then monitor whether the upper-level application of the mobile device at the screen projection push end performs application switching, wherein the screen projection display mode is a display mode for performing screen projection display or not performing screen projection display determined according to different scenarios during the screen projection process , including privacy protection mode, unlimited casting mode, meeting mode and/or game mode, etc., which can be pre-set according to big data or test data, etc., and can also guide users to set and change according to their own needs. The privacy protection mode is For the privacy protection application that needs privacy protection, the mode that does not perform screen projection display, the privacy protection application corresponding to the privacy protection mode can be determined according to the screen projection whitelist or the screen projection blacklist, and the screen projection whitelist is to allow projection. The list of applications displayed on the screen, the blacklist is a list of applications that are not allowed to be displayed on the screen, the white list of screen projection and the blacklist of screen projection can be pre-set according to big data or test data, etc., and users can also be guided according to Set and change according to your own needs. The privacy protection mode can be enabled by default when establishing a screen projection connection, can be enabled when a user operation to switch to the privacy protection mode is detected, or can be captured by the sound signal collected by the microphone and/or the camera The received image signal determines the number of viewers on the projection screen, and if it is detected that the number of viewers on the projection screen exceeds the preset number, the privacy protection mode is automatically turned on.

In an implementable manner, after the step of obtaining the current screen projection display mode, it further includes: outputting prompt information of the current screen projection display mode to remind the user of the current screen projection display mode, if the If the current projected screen display mode does not meet the current needs of the user, the user can make adjustments in time.

In an embodiment, when it is detected that the upper-layer application is switched from the first target application to the second target application during the screen projection process, the step of suspending the transmission of the screen projection signal includes:

In this embodiment, specifically, during the screen projection process, it is detected in real time whether the upper-layer application changes, and when it is detected that the upper-layer application is switched from the currently displayed first target application to the second target application, the playing of the first target application is paused. The playback content corresponding to the target application, and suspend the transmission of the screen projection signal to the screen projection receiver, wherein the playback content includes recording resources (such as: online video, music, etc.), live resources (such as: webcast, radio, etc.) and/or instant resources (eg: games, calls, etc.), etc.

Step B10, judging whether the playback content corresponding to the first target application is a recording resource;

In this embodiment, specifically, according to the resource information of the playback content corresponding to the first target application, it is judged whether the playback content is a recording resource, wherein the resource information is related information of the playback resource, which is used to Determine whether the playback resource is a live broadcast resource or a recorded broadcast resource. For example, if it is detected that the playback content is a video content of a live broadcast platform, then the playback content is a live broadcast resource; if it is detected that the playback content is an update on a video website episodes, the broadcast content is a recorded resource. In an implementable manner, the resource information can also be identified by character recognition of the broadcast content. The broadcast content is a live broadcast resource, and if no text related to the live broadcast is recognized, it is determined that the broadcast content is a recorded broadcast resource.

Step B20, if it is determined that the playback content corresponding to the first target application is a recording and broadcasting resource, then pause playing the recording and broadcasting resource, and obtain the pause time of the recording and broadcasting resource;

Step B30, when it is detected that the upper-layer application is switched to the first target application, continue to play the recording resource from the pause time.

In this embodiment, specifically, if it is determined that the playback content corresponding to the first target application is a recorded resource, the playback of the recorded resource is paused, and the pause time of the recorded resource is obtained. When the application is switched to the first target application, continue to play the recorded resource from the pause time; if it is determined that the currently played content is not a recorded resource, the currently played content may be a live resource or cannot Pause resources, etc., then do not pause the current playback content, or freeze the current playback screen of the live broadcast resource, and record the current playback content to obtain a recording file. When it is detected that the upper-layer application is switched to the first target application to play the recording.

In this embodiment, the content being played is automatically paused when the application is switched, and the originally played content is automatically resumed when the application is switched back to the original application, which can avoid the problem of privacy leakage that may be caused by switching applications, and can also avoid missing information caused by switching applications. The content played in the original application can continue to watch the content played in the original application from the time of switching applications without manually pausing or reverting, which not only protects user privacy, but also ensures the mirroring experience and simplifies user operations.

Step C10, judging whether the playback content corresponding to the first target application is a live resource;

In this embodiment, specifically, according to the resource information of the broadcast content corresponding to the first target application, it is judged whether the broadcast content is a live broadcast resource, wherein the resource information is related information of the broadcast resource, and is used for judging Whether the broadcast resource is a live broadcast resource or a recorded broadcast resource, for example, if it is detected that the broadcast content is video content of a live broadcast platform, then the broadcast content is a live broadcast resource; if it is detected that the broadcast content is an updated If it is a drama series, the playback content is a recorded broadcast resource. In an implementable manner, the resource information can also be identified by character recognition of the playback content. The content is a live broadcast resource. If no text related to the live broadcast is recognized, it is determined that the broadcast content is a recorded broadcast resource.

Step C20, if it is determined that the playback content corresponding to the first target application is a live broadcast resource, freeze the current playback screen of the live broadcast resource, and record the live broadcast resource to obtain a recording file;

Step C30, when it is detected that the upper layer application is switched to the first target application, playing the recorded file.

In this embodiment, specifically, if it is determined that the playback content corresponding to the first target application is a recording resource, freeze the current playback screen of the live broadcast resource, and start recording the video from the frozen current playback screen. Live resource, obtain the recorded file, when it is detected that the upper-layer application is switched to the first target application, start playing the recorded file from the frozen current playback screen, and continue to record the live resource until the live resource End or the user ends the playback of the live broadcast resource; if it is determined that the playback content corresponding to the first target application is not a live broadcast resource, then the current playback content may be a recorded broadcast resource or a resource that cannot be paused, etc., then pause or not For the currently playing content, if it is detected that the current playing content is successfully paused, the pause time of the recording resource is obtained, and when it is detected that the upper layer application switches to the first target application, continue from the pause time Play the recorded resource.

In this embodiment, by recording the content being played when switching applications, and playing the recorded file when switching back to the original application, the problem of privacy leakage that may be caused by switching applications can be avoided, and the loss of the original content caused by switching applications can be avoided. The live broadcast content played in the app not only protects the user's privacy, but also guarantees the screencasting experience.

In this embodiment, specifically, it is determined to suspend transmission of the last frame of picture received before the screen projection signal is suspended, and the display device corresponding to the screen projection receiving end outputs and displays the last frame of picture, wherein the screen projection The last frame of picture received by the receiving end is the last frame of picture when the upper-level application is the first target application before the upper-layer application of the projection pusher switches from the first target application to the second target application. The screen projection receiving end sends a pause projection instruction so that the screen projection receiving end displays the last frame received, and when the upper layer application switches back to the first target application and continues to transmit the screen projection signal to the screen projection receiving end, The coherence between the screens can be made, and the impact on the user's screen projection experience can be reduced.

In an implementable manner, after the step of suspending the transmission of the screen projection signal, it further includes:

Send a prompt message of suspending screen projection to the screen projection receiving end to remind the user of the reason for the current suspension of screen projection, so as to avoid the user from mistakenly thinking that there is a fault, and also remind the user to deal with private information in time.

Step S20, obtaining a screen projection whitelist, and judging whether the second target application is a whitelist application according to the screen projection whitelist;

In this embodiment, specifically, the screen projection whitelist is obtained, and it is judged whether there is application information matching the second target application in the screen projection whitelist. If it is determined that there is no application information matching the second target application in the screen projection whitelist, the The second target application is not a whitelist application, wherein the screen projection whitelist is a list of applications that are allowed to be displayed on the screen projection receiving end through screen projection, and the screen projection whitelist can be based on big data or test data, etc. It can also be pre-set and guide users to set and change according to their own needs.

Step D10, if it is determined that the second target application is not a whitelist application, then detecting whether the upper layer application is switched to a whitelist application;

Step D20, when it is detected that the upper layer application is switched to the white list application, continue to transmit the screen projection signal.

In this embodiment, specifically, if it is determined that the second target application is not a whitelist application, it is detected in real time whether the upper-layer application changes, and when it is detected that the upper-layer application is switched to the third target application, the third The target application is matched with the screen projection whitelist, and it is judged whether the third target application is a whitelist application, and if it is determined that the third target application is not a whitelist application, then return to the step: real-time detection of whether the upper layer application changes , if it is determined that the third target application is a whitelist application, continue to transmit a screen projection signal to the screen projection receiving end, wherein the third target application may be the first target application or other applications .

Step S30, if it is determined that the second target application is a whitelist application, continue to transmit the screen projection signal;

In this embodiment, specifically, if it is determined that the second target application is a whitelist application, cancel the pause transmission operation of the screen projection signal, and continue to transmit the screen projection signal to the screen projection receiving end; If the second target application is not a whitelist application, continue to suspend the transmission of the screen projection signal to the screen projection receiver.

In an implementable manner, referring to FIG. 4 , the screen projection receiving end includes a TV 400 and a screen projection receiver 300, the TV 400 and the screen projection receiver 300 are connected in communication, and the projection The screen push end includes a mobile phone 100 and a screen projector transmitter 200, the mobile phone 100 is communicatively connected to the screen projector transmitter 200, and the screen projector receiver 300 is communicatively connected to the screen projector transmitter 200, During the screen projection process from the mobile phone 100 to the TV 400 , the screen projector transmitter 200 synchronously transmits the screen image and sound of the mobile phone 100 to the screen projector receiver 300 , and the screen projector receiver 300 transmits the received screen of the mobile phone 100 The picture and sound are sent to the TV 400 for picture display and sound playback. When the mobile phone 100 detects that the upper-level application is switched from the first target application to the second target application during the screen projection process, the mobile phone 100 suspends sending the projection to the screen projection device transmitter 200. screen signal, so as to prevent the screen projector transmitter 200 from sending private information to the screen projector receiver 300, thereby preventing the TV 400 from outputting private information, obtaining a screen projection whitelist, and judging the first screen projection whitelist according to the screen projection whitelist 2. Whether the target application is a whitelist application, if it is determined that the second target application is a whitelist application, it means that the playback content of the second target application can be displayed on the screen, so continue to transmit the projection to the screen projector transmitter 200 screen signal, so that the screen projector transmitter 200 can continue to send the screen projection signal to the screen projector receiver 300, and then send it to the TV 400 through the screen projector 300 for screen display and sound playback.

In this embodiment, when it is detected that the upper-layer application is switched from the first target application to the second target application during the screen projection process, the transmission of the screen projection signal is suspended, so that the transmission of the screen projection signal is suspended every time the application is switched. , so as to ensure that if the displayed content of the switched-to second target application contains private content, it will not be displayed synchronously immediately, and then by obtaining the screen projection white list, judge whether the second target application is white or not according to the screen projection white list The list application, if it is determined that the second target application is a whitelist application, then continue to transmit the screen projection signal, realizing whether the second target application can be displayed on the screen according to the screen projection whitelist, if it is determined that the second target application If it is a whitelist application, it means that the second target application does not contain private content, then the screen projection signal can be continuously transmitted, and the display screen corresponding to the second target application can be displayed on the screen, which realizes that only users who are not on the screen projection whitelist The application suspends the transmission of the screen projection signal, which effectively improves the protection of personal privacy during the screen projection process, and overcomes the technical problem of privacy leakage during the screen projection process in the prior art.

In an embodiment, the embodiment of the present application also provides a screen projection device. Referring to FIG. 5 , the screen projection device is applied to a screen projection device, and the screen projection device includes:

The pause module 10 is used to suspend the transmission of the screen projection signal when it is detected that the upper layer application is switched from the first target application to the second target application during the screen projection process;

The judging module 20 is configured to obtain a screen projection whitelist, and judge whether the second target application is a whitelist application according to the screen projection whitelist;

The transmission module 30 is configured to continue to transmit the screen projection signal if it is determined that the second target application is a whitelist application.

In an embodiment, the transmission module 30 is also used for:

In an embodiment, the screen projection device further includes a monitoring module, and the monitoring module is also used for:

Get the current projection mode;

If it is determined that the current projection screen display mode is the privacy protection mode, then it is monitored whether the upper layer application performs application switching.

In one embodiment, the suspension module 10 is also used for:

In an embodiment, the screen projection device further includes an instruction sending module, and the instruction sending module is also used for:

The screen projection device provided by the present invention adopts the screen projection method in the above embodiments, and solves the technical problem of privacy leakage during the screen projection process in the prior art. Compared with the prior art, the beneficial effect of the screen projection device provided by the embodiment of the present invention is the same as that of the screen projection method provided by the above embodiment, and other technical features of the screen projection device are the same as those disclosed by the method of the above embodiment The features are the same, and will not be repeated here.

In an embodiment, the present application further provides a computer program product, including a computer program, and when the computer program is executed by a processor, the steps of the above screen projection method are realized.

The computer program product provided by the present application solves the technical problem of privacy leakage in the process of screen projection in the prior art. Compared with the prior art, the beneficial effect of the computer program product provided by the embodiment of the present invention is the same as the beneficial effect of the screen projection method provided by the foregoing embodiment, and details are not repeated here.

The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structures or equivalent process transformations made by using the description of the application and the accompanying drawings are directly or indirectly used in other related technical fields. , are all included in the patent processing scope of the present application in the same way.

Claims

A screen projection method, wherein the screen projection method includes:

During the screen projection process, it is detected that the upper-layer application is switched from the first target application to the second target application, and the transmission of the screen projection signal is suspended;

Obtaining a screen projection whitelist, and judging whether the second target application is a whitelist application according to the screen projection whitelist;

Determine that the second target application is a whitelist application, and continue to transmit the screen projection signal.
The screen projection method according to claim 1, wherein, after the step of judging whether the second target application is a whitelist application according to the screen projection whitelist, further comprising:

determining that the second target application is not a whitelist application, and detecting whether the upper-layer application is switched to a whitelist application; and

It detects that the upper-layer application is switched to the whitelist application, and continues to transmit the screen projection signal.
The screen projection method according to claim 1, wherein, before the step of detecting that the upper layer application is switched from the first target application to the second target application during the screen projection process, and suspending transmission of the screen projection signal, further comprising:

Get the current projection mode;

Determining that the current projection screen display mode is a privacy protection mode, and monitoring whether the upper-layer application performs application switching.
The screen projection method according to claim 1, wherein, during the screen projection process, it is detected that the upper layer application is switched from the first target application to the second target application, and the step of suspending transmission of the screen projection signal comprises:

During the screen projection process, it is detected that the upper layer application is switched from the first target application to the second target application, the playing content corresponding to the first target application is suspended, and the transmission of the screen projection signal is suspended.
The screen projection method according to claim 4, wherein the step of pausing playing the playing content corresponding to the first target application comprises:

judging whether the playback content corresponding to the first target application is a recording resource;

Determine that the playback content corresponding to the first target application is a recording resource, pause playing the recording resource, and acquire a pause time of the recording resource; and

It is detected that the upper-layer application is switched to the first target application, and the recording and broadcasting resource is continued to be played from the pause time.
The screen projection method according to claim 4, wherein the step of pausing playing the playing content corresponding to the first target application comprises:

judging whether the playback content corresponding to the first target application is a live resource;

determining that the playback content corresponding to the first target application is a live broadcast resource, freezing the current playback screen of the live broadcast resource, and recording the live broadcast resource to obtain a recording file; and

When it is detected that the upper layer application is switched to the first target application, the recorded file is played.
The screen projection method according to claim 1, wherein, after the step of suspending transmission of the screen projection signal, further comprising:

The display device displays the last frame received before suspending the transmission of the projection signal.
The screen projection method according to claim 1, wherein the screen projection signal includes a screen projection audio signal and a screen projection image signal.
The screen projection method according to claim 1, wherein the upper-layer application is an application displayed on the uppermost layer of the screen-casting push terminal, and the method of switching the upper-layer application from the first target application to the second target application includes a pop-up message notification , an incoming call, or switch applications through the top message notification or switch applications directly by switching screens.
The screen projection method according to claim 1, wherein the method further comprises:

Set exception scenarios for upper-layer applications;

It is determined that the current upper-layer application belongs to the exception scenario, and a new upper-layer application is re-determined from other applications except the current upper-layer application.
The screen projection method according to claim 10, wherein said determining that the current upper-layer application belongs to said exception scenario comprises:

The exception scene is determined to be the top floating window, the top floating window of the current upper-layer application is received, and a new upper-layer application is re-determined from other applications except the current upper-layer application.
The screen projection method according to claim 3, wherein the privacy protection mode comprises:

The privacy protection mode is a mode in which no screen projection is performed for privacy protection applications that require privacy protection, and the privacy protection application corresponding to the privacy protection mode is determined according to the screen projection whitelist or screen projection blacklist, and the screen projection whitelist The list is a list of applications that are allowed to be displayed on the screen, and the blacklist is a list of applications that are not allowed to be displayed on the screen.
A screen projection device, wherein the screen projection device includes:

The pause module is used to detect that the upper-layer application is switched from the first target application to the second target application during the screen projection process, and suspend the transmission of the screen projection signal;

A judging module, configured to obtain a screen projection whitelist, and judge whether the second target application is a whitelist application according to the screen projection whitelist;

The transmission module is configured to determine that the second target application is a whitelist application, and continue to transmit the screen projection signal.
The screen projection device according to claim 13, wherein the judging module is further used to determine that the second target application is not a whitelist application, detect whether the upper-layer application is switched to a whitelist application; and detect that the upper-layer application is switched to a whitelist application. The list application continues to transmit the projection signal.
An electronic device, wherein the electronic device includes:

at least one processor; and,

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor, so that the at least one processor can perform any one of claims 1 to 12 The steps of the screencasting method.