CN114489549A - Screen projection image processing method and device, electronic equipment and storage medium - Google Patents

Abstract

The present application discloses a screen projection image processing method, device, electronic device and storage medium. The screen projection image processing method includes: acquiring at least one initial screen projection image frame; The message notification area is identified; if at least one of the message notification areas is identified in each of the initial screen projection image frames, each of the message notification areas is hidden to obtain at least one target screen projection image frame. The present application solves the technical problem of privacy leakage during screen projection in the prior art.

Description

Screen projection image processing method, device, electronic device and storage medium

technical field

The present application relates to the technical field of screen projection, and in particular, to a method, device, electronic device and storage medium for processing a screen projection image.

Background technique

With the development of science and technology and the improvement of people's living standards, the function of displaying the screen of mobile devices such as mobile phones, tablet computers, computers and other mobile devices has become increasingly popular through display devices such as large TV screens and projectors. , video, etc. are pushed to the display device for playback. However, when the screen of the mobile device is sent to the same screen, the notification messages received on the mobile device will also be sent to the display device synchronously, and the display device is often On the screen of public properties, if there is private information in the notification message, it will cause privacy leakage.

SUMMARY OF THE INVENTION

The main purpose of this application is to provide a screen projection image processing method, device, electronic device and storage medium, which aims to solve the technical problem of privacy leakage in the screen projection process in the prior art.

In order to achieve the above purpose, the present application provides a projection image processing method, the projection image processing method includes:

Obtain at least one initial projected screen image frame;

Identifying the message notification area in each of the initial screen projection image frames;

If at least one of the message notification areas is identified in each of the initial screen projection image frames, each of the message notification areas is hidden to obtain at least one target screen projection image frame.

Optionally, the step of identifying the message notification area in each of the initial screen projection image frames includes:

intercepting a regional image from a preset region range of each of the initial screen projection image frames;

Each of the area images is compared with the preset standard area images, and a message notification area with block-like differences in each of the area images is identified.

Optionally, before the step of comparing each of the area images with a preset standard area image, and identifying the message notification areas with block differences in each of the area images, the method further includes:

According to the frame sequence, sequentially detect the block difference area between the two adjacent area images of the frame sequence;

When it is detected that there is a blocky difference area between two adjacent area images of the frame sequence, determine whether the blocky difference has an edge line according to the pixel value of the blocky difference area;

The area image corresponding to the block-shaped difference area without the edge line is used as the preset standard area image.

Optionally, after the step of identifying the message notification area in each of the initial screen projection image frames, the step further includes:

If the message notification area is not identified in each of the initial screen projection image frames, each of the initial screen projection image frames is used as a target screen projection image frame.

Optionally, the step of performing concealment processing on each of the message notification areas to obtain at least one target screen projection image frame includes:

acquiring at least one initial pixel value of each of the message notification areas;

Each of the initial pixel values is converted into a blurred pixel value according to a preset deformation algorithm to obtain at least one target screen projection image frame.

Optionally, the step of performing concealment processing on each of the message notification areas to obtain at least one target screen projection image frame includes:

Each of the message notification areas is replaced with a preset message notification standard image to obtain at least one target screen projection image frame.

Optionally, before the step of acquiring at least one initial screen projection image frame, the method further includes:

Get the current screen projection display mode;

If the current screen projection display mode is the privacy protection mode, a prompt message that the privacy protection mode is turned on is generated.

The present application further provides a screen projection image processing device, the screen projection image processing device is applied to a screen projection image processing device, and the screen projection image processing device includes:

an acquisition module, used to acquire at least one initial screen projection image frame;

an identification module, configured to identify the message notification area in each of the initial screen projection image frames;

A concealment processing module, configured to perform concealment processing on each of the message notification areas if at least one of the message notification areas is identified in each of the initial screen projection image frames to obtain at least one target screen projection image frame.

The present application also provides an electronic device, the electronic device is a physical device, and the electronic device includes: a memory, a processor, and the screen projection image processing that is stored in the memory and can run on the processor The program of the method, when the program of the projected screen image processing method is executed by the processor, can realize the steps of the above-mentioned projected screen image processing method.

The present application also provides a storage medium, the storage medium is a computer-readable storage medium, and the computer-readable storage medium stores a program for implementing the screen projection image processing method, and the program of the screen projection image processing method is processed The steps of the above-mentioned projection image processing method are realized when the device is executed.

The present application also provides a computer program product, including a computer program, when the computer program is executed by a processor, the steps of the above-mentioned method for processing a projected screen image are implemented.

The present application provides a screen projection image processing method, device, electronic device and storage medium. By acquiring at least one initial screen projection image frame, the acquisition of the initial screen projection image frame to be projected is realized. The message notification area in the initial screen projection image frame is identified, which realizes the determination of the message notification area that may contain privacy information that appears in the initial screen projection image frame to be projected. If at least one of the message notification areas is identified in the frame, each of the message notification areas is hidden to obtain at least one target screen projection image frame, which realizes the transmission of the message notification area in each of the initial screen projection image frames. Hiding processing, that is, hiding the message notification information of the possible privacy information in each of the initial screen projection image frames, and obtaining the target screen projection image frame with the message notification information hidden, which effectively improves the personal privacy in the screen projection image frame. The protection of the existing technology overcomes the technical problem of privacy leakage during the screen projection process in the prior art.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application.

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. In other words, on the premise of no creative labor, other drawings can also be obtained from these drawings.

FIG. 1 is a schematic diagram of a screen projection connection scenario according to an embodiment of a screen projection image processing method of the present application;

FIG. 2 is a schematic structural diagram of an electronic device of a hardware operating environment involved in a method for processing a projected screen image according to an embodiment of the present application;

FIG. 3 is a schematic flowchart of an embodiment of a method for processing a projected screen image of the present application;

FIG. 4 is a schematic diagram of a scenario that can be implemented in a method for screen-casting a call according to the present application;

FIG. 5 is a schematic flowchart of another embodiment of a method for processing a projected screen image of the present application;

FIG. 6 is a schematic structural diagram of a device involved in a method for processing a projected screen image according to an embodiment of the present application.

The realization, functional features and advantages of the present application will be further described with reference to the accompanying drawings in conjunction with the embodiments.

Detailed ways

In order to make the above objects, features and advantages of the present invention more obvious and easy to understand, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present invention.

Referring to FIG. 1 , FIG. 1 is a schematic diagram of a screen projection connection involved in an embodiment of the present invention.

As shown in FIG. 1 , the screen projector includes: a screen projector transmitter and/or a screen projector receiver, wherein the first electronic device may be a personal computer, or may be a smart phone, a tablet computer, an e-book reader, For portable terminal devices such as portable computers, the second electronic device may be a television, or may be a display device with a display function, such as a monitor and a projector.

In some embodiments, the first electronic device connects the screen projector transmitter and/or the screen projector receiver through a wired or wireless network for data transmission and interaction; the screen projector transmitter is connected to the screen projector receiver through a wireless network for data transmission and interaction; Data transmission and interaction, or the screen projector transmitter connects to the second electronic device through a wireless network for data transmission and interaction; the screen projector receiver connects to the second electronic device through a wired or wireless network for data transmission and interaction. In an optional implementation manner, the wired connection between the screen projector receiver and the second electronic device and between the screen projector transmitter and the first electronic device may include a high definition multimedia interface based on HDMI (High Definition Multimedia Interface). Interface), USB (Universal Serial Bus, Universal Serial Bus), DP (DisplayPort, Display Interface) and VGA (VideoGraphics Array, Video Graphics Array) and other wired connections. The wireless communication methods between the first electronic device and the screen projector transmitter and screen projector receiver, and between the second electronic device and the screen projector transmitter and screen projector receiver may include Bluetooth, wireless Wireless communication such as broadband (Wi-Fi) and infrared communication.

Therefore, the possible connection modes for realizing screen projection among the first electronic device, the screen projector transmitter, the screen projector receiver and the second electronic device at least include:

(1) The screen projector transmitter is connected to the screen projector receiver, and the screen of the first electronic device is finally projected to the second electronic device through the screen projector transmitter and the screen projector receiver;

(2) The screen projector transmitter is wirelessly connected to the second electronic device, and the screen of the first electronic device is projected to the second electronic device through the screen projector transmitter. At this time, the screen projector transmitter and the built-in wireless device of the second electronic device The communication module is connected through a wireless network;

(3) The first electronic device is connected to the screen projector receiver, and the screen of the first electronic device is projected to the second electronic device through the screen projector receiver.

Referring to FIG. 2 , FIG. 2 is a schematic structural diagram of an electronic device of a hardware operating environment involved in a method for processing a projected screen image according to an embodiment of the present application. Electronic devices in the embodiments of the present disclosure may include, but are not limited to, such as televisions, screen projectors, screen projector receivers, screen projector transmitters, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants) , PAD (tablet computer), PMP (portable multimedia player), vehicle terminal (such as vehicle navigation terminal), digital TV, desktop computer and so on.

As shown in FIG. 2 , the electronic device further includes: a processor 1001 , such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002 , a network interface 1003 , and a memory 1004 . Among them, the communication bus 1002 is used to realize the connection and communication between these components. Optionally, the network interface 1003 may include a standard wired interface and a wireless interface (eg, a Wireless-Fidelity (WI-FI) interface). The memory 1004 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. Optionally, the memory 1004 may also be a storage device independent of the aforementioned processor 1001 .

Optionally, the terminal may further include a camera, an RF (Radio Frequency, radio frequency) circuit, a sensor, an audio circuit, a WiFi module, and the like. Among them, sensors such as light sensors, motion sensors and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display screen according to the brightness of the ambient light, and the proximity sensor may turn off the display screen and/or turn off the display screen when the mobile terminal is moved to the ear. Backlight. As a kind of motion sensor, the gravitational acceleration sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, and can be used for applications that recognize the posture of mobile terminals (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; of course, the mobile terminal can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc. No longer.

Those skilled in the art can understand that the structure shown in FIG. 2 does not constitute a limitation on the operating equipment, and may include more or less components than the one shown, or combine some components, or arrange different components.

As shown in FIG. 2 , the memory 1004 as a storage medium may include an operating system, a data storage module, a network communication module, and a screen projection image processing program.

In the operating device shown in FIG. 2, the network interface 1003 is mainly used for data communication with other devices. The processor 1001 and the memory 1004 in the operating device of the present invention may be set in the operating device, and the operating device invokes the screen projection image processing program stored in the memory 1004 through the processor 1001, and performs the following operations:

Obtain at least one initial projected screen image frame;

Identifying the message notification area in each of the initial screen projection image frames;

If at least one of the message notification areas is identified in each of the initial screen projection image frames, each of the message notification areas is hidden to obtain at least one target screen projection image frame.

Further, the processor 1001 can call the screen projection image processing program stored in the memory 1004, and also perform the following operations:

intercepting a regional image from a preset region range of each of the initial screen projection image frames;

Each of the area images is compared with the preset standard area images, and a message notification area with block-like differences in each of the area images is identified.

Further, the processor 1001 can call the screen projection image processing program stored in the memory 1004, and also perform the following operations:

According to the frame sequence, sequentially detect the block difference area between the two adjacent area images of the frame sequence;

When it is detected that there is a blocky difference area between two adjacent area images of the frame sequence, determine whether the blocky difference has an edge line according to the pixel value of the blocky difference area;

The area image corresponding to the block-shaped difference area without the edge line is used as the preset standard area image.

Further, the processor 1001 can call the screen projection image processing program stored in the memory 1004, and also perform the following operations:

If the message notification area is not identified in each of the initial screen projection image frames, each of the initial screen projection image frames is used as a target screen projection image frame.

Further, the processor 1001 can call the screen projection image processing program stored in the memory 1004, and also perform the following operations:

acquiring at least one initial pixel value of each of the message notification areas;

Each of the initial pixel values is converted into a blurred pixel value according to a preset deformation algorithm to obtain at least one target screen projection image frame.

Further, the processor 1001 can call the screen projection image processing program stored in the memory 1004, and also perform the following operations:

Each of the message notification areas is replaced with a preset message notification standard image to obtain at least one target screen projection image frame.

Further, the processor 1001 can call the screen projection image processing program stored in the memory 1004, and also perform the following operations:

Get the current screen projection display mode;

If the current screen projection display mode is the privacy protection mode, a prompt message that the privacy protection mode is turned on is generated.

An embodiment of the present application provides a projection image processing method. In the first embodiment of the projection image processing method of the present application, referring to FIG. 3 , the projection image processing method includes:

Step S10, obtaining at least one initial screen projection image frame;

In this embodiment, it should be noted that the screen projection is a process of sending the display screen of the screen projection pusher to the screen projection receiver for display. During the screen projection process, the screen projection pusher sends the projection image frame It is sent to the screen-casting receiver for display. After the screen-casting pusher generates the screen-casting image frame, before the screen-casting receiver displays the screen-casting image frame, either the screen-casting pusher or the screen-casting receiver can display the screen-casting image frame. The message notification area in the screen projection image frame can be hidden, and the message notification information that may have private information in the screen projection image frame can be hidden, so that the screen projection receiving end finally displays the screen projection image frame after the hidden processing, thereby realizing Effective protection of private information in projected images.

The execution body of this embodiment may be a screen projection push terminal or a screen projection receiver, wherein the screen projection receiver is a device that receives a screen projection, such as a TV, a computer, or a projector, etc. In an implementable manner , the screen projection receiver can also be a signal receiver connected to a display and/or a speaker, and the signal receiver and the display and/or speaker can be wired or wireless After the signal and the image signal, the audio signal and image signal received by the screen projection are output through the display and/or speaker connected to the signal receiver; the screen projection push terminal is a mobile device that pushes the projection screen, such as a mobile phone, Tablet computer, etc., the screen projection push terminal can communicate with other mobile devices through a traditional communication network or the Internet, and the screen projection push terminal and the screen projection receiver can be connected through wired or wireless connections. In an implementable manner, the screen-casting push terminal may also be a signal transmitter connected to the mobile device, and the signal transmitter and the mobile device may be connected by wire or wirelessly, and the mobile device transmits the required information through the signal transmitter. The projected audio signal and image signal are sent to the projected screen receiver.

Specifically, after the screen projection push terminal generates an initial screen projection image frame, at least one of the initial screen projection image frames is acquired, wherein the initial screen projection image frame is an image frame to be projected generated by the screen projection push terminal , the method of obtaining the initial screen projection image frames may be to obtain all the initial screen projection image frames corresponding to the preset time period, or to obtain the initial screen projection image frames of the preset number of image frames, the preset time period and the preset image frames. The number can be set according to the actual situation. For example, starting from the initial projection image frame of the first frame to be processed, all initial projection image frames within T milliseconds are obtained in sequence, or, starting from the initial projection image frame of the first frame to be processed. The screen image frame starts, and C initial screen projection image frames are obtained in sequence.

Optionally, before the step of acquiring at least one initial screen projection image frame, the method further includes:

Step A10, obtaining the current screen projection display mode;

Step A20, if the current screen projection display mode is the privacy protection mode, generate a prompt message that the privacy protection mode has been turned on.

In this embodiment, specifically, the screen projection display mode currently set by the screen projection connection is obtained, and it is determined whether the currently set screen projection display mode is the privacy protection mode. If the current screen projection display mode is the privacy protection mode, then Generating prompt information that the privacy protection mode has been turned on, and outputting the prompt information through the display device corresponding to the screen projection receiver, wherein the screen projection display mode is determined according to different scenarios in the screen projection process to perform screen projection display Display modes without screen projection, including privacy protection mode, unlimited casting mode, conference mode and/or game mode, etc., can be pre-set according to big data or test data, etc., or can guide users to set according to their own needs and modification, the trigger timing of the step of acquiring the current screen projection display mode may be when the screen projection push terminal and the screen projection receiver establish a screen projection connection, or when the screen projection display mode is changed, or the like.

Step S20, identifying the message notification area in each of the initial screen projection image frames;

In this embodiment, specifically, image pixel information corresponding to each of the initial screen projection image frames is acquired, and the message notification area in each of the initial screen projection image frames is identified according to each of the image pixel information, wherein, The manner of identifying the message notification area in each of the initial screen projection image frames according to each of the image pixel information includes identifying the message notification area in each of the initial screen projection image frames through image recognition technology, or, By comparing each of the initial screen projection images with the preset standard screen projection images, the block-shaped difference images between the two are identified, and the area corresponding to the block-shaped difference images between the two is used as the message notification area , wherein the preset standard screen projection image may be one of the initial screen projection images, or may be set in advance according to the actual situation, and the block-shaped difference image refers to an area exceeding the preset area and having For the entire image of the regular frame, the preset area can be determined according to the actual screen size or actual test results, etc. The determination of the regular frame can be determined by judging whether the same or similar pixel values are connected to each other to form a closed loop, and further It is also possible to perform similarity matching between the graphics formed by the closed-loop pixel value groups and the graphics in the preset graphics library, and determine the entire image corresponding to the pixel value group whose graphics similarity is higher than the preset similarity as a block. shape difference image.

Step S30, if at least one of the message notification areas is identified in each of the initial screen projection image frames, hide each of the message notification areas to obtain at least one target screen projection image frame.

In this embodiment, specifically, if at least one of the message notification areas is identified in each of the initial screen projection image frames, the message notification area corresponding to each of the initial screen projection image frames is Partially performing hiding processing to obtain at least one target screen projection image frame, and outputting the target screen projection image frame through a display device, wherein the hiding processing is an operation of hiding information in each of the message notification areas, including blurring processing, image replacement, etc., the target screen projection image frame is the screen projection image output and displayed by the display device corresponding to the screen projection receiving end.

Optionally, after the step of identifying the message notification area in each of the initial screen projection image frames, the step further includes:

If the message notification area is not identified in each of the initial screen projection image frames, each of the initial screen projection image frames is used as a target screen projection image frame.

In this embodiment, specifically, if the message notification area is not identified in each of the initial screen projection image frames, it means that no message notification has been received within the time range corresponding to each of the initial screen projection image frames, and no message notification is received. There will be a problem of leakage of private information in the message notification. Therefore, each initial screen projection image frame is directly used as a target screen projection image frame, and the target screen projection image frame is output through a display device.

Optionally, the step of performing concealment processing on each of the message notification areas to obtain at least one target screen projection image frame includes:

Step B10, acquiring at least one initial pixel value of each of the message notification areas;

In this embodiment, specifically, part or all of the initial pixel values of each of the message notification areas are acquired, for example, the text areas in each of the message notification areas are identified, and only the initial pixel values of the text areas are acquired.

Step B20: Convert each of the initial pixel values into blurred pixel values according to a preset deformation algorithm to obtain at least one target screen projection image frame.

In this embodiment, specifically, each of the initial pixel values is input into a preset deformation algorithm, and the blurred pixel value corresponding to each of the initial pixel values is converted to obtain the blurred pixel value corresponding to each of the initial pixel values. If the pixel values of other areas other than the message notification area remain unchanged, the target projection image frame after the message notification area is hidden can be obtained. The initial pixel value of the message notification area is converted to obtain the pixel value that cannot be accurately represented by the original semantics. The image composed of the blurred pixel value is blurred compared to the image composed of the initial pixel value. For example, mosaic processing , Gaussian blur, etc. The preset variant algorithm is similar to the algorithms for blur processing such as mosaic processing and Gaussian blur processing in the prior art, and details are not described here.

Optionally, the step of performing concealment processing on each of the message notification areas to obtain at least one target screen projection image frame includes:

Each of the message notification areas is replaced with a preset message notification standard image to obtain at least one target screen projection image frame.

In this embodiment, specifically, each of the message notification areas is replaced with a preset message notification standard image, and other areas except the message notification area in each of the initial screen projection image frames are kept unchanged. to obtain at least one target screen projection image frame, wherein the message notification standard image is a standard image that prompts the user to receive a message notification.

In an implementable manner, the step of replacing each of the message notification areas with a preset message notification standard image includes: acquiring area specification information and a message notification initial image of each of the message notification areas, and according to the The area specification information is used to perform specification adjustment on the message notification standard image to obtain a message notification standard image, and replace each message notification area with a preset message notification standard image, wherein the specification adjustment includes cropping, stretching, zoom etc.

In an implementable manner, the step of replacing each of the message notification areas with a preset message notification standard image includes: identifying text information in each of the message notification areas, and judging the information according to the text information. the target application information corresponding to the message notification area, determine the target message notification standard image corresponding to the target application information according to the mapping relationship between the application information and the message notification standard image, and replace each of the message notification areas with the target message notification Standard image.

In an implementable manner, referring to FIG. 4 , the screen projection receiver includes a TV set 400 and a screen projection receiver 300, the TV 400 and the screen projection receiver 300 are communicatively connected, and the screen projection receiver 300 is connected in communication. The screen-casting push terminal includes a mobile phone 100 and a screen-caster transmitter 200 , the mobile phone 100 and the screen-caster transmitter 200 are connected in communication, and the screen-caster receiver 300 is communicatively connected with the screen-caster transmitter 200 , during the process of screencasting from the mobile phone 100 to the TV set 400 , the screencaster transmitter 200 transmits the screen image and sound of the mobile phone 100 to the screencaster receiver 300 synchronously, and the screencaster receiver 300 transmits the received mobile phone 100 The screen picture and sound are sent to the TV 400 for picture display and sound playback. The screen projector transmitter 200 obtains at least one initial screen projection image frame generated by the mobile phone 100, and informs the message notification area in each of the initial screen projection image frames. Perform identification, if at least one of the message notification areas is identified in each of the initial screen projection image frames, then hide each of the message notification areas to obtain at least one target screen projection image frame, and the target projection image frame is The screen image frame is sent to the screen projector receiver 300, and then sent to the TV 400 through the screen projector 300 to display the target screen projected image frame.

In this embodiment, by acquiring at least one initial screen projection image frame, the acquisition of the initial screen projection image frame to be projected is realized, and then by identifying the message notification area in each of the initial screen projection image frames, It realizes the determination of a message notification area that may have private information that appears in the initial screen projection image frame to be projected, and then, if at least one of the message notification areas is identified in each of the initial screen projection image frames, then Each of the message notification areas is hidden to obtain at least one target screen projection image frame, which realizes the hidden processing of the message notification area in each of the initial screen projection image frames, that is, hides each of the initial screen projection image frames. The message notification information of the possible privacy information in the screen is obtained, and the target screen projection image frame with the message notification information hidden is obtained, which effectively improves the protection of personal privacy in the screen projection image frame, and overcomes the prior art in the screen projection process. Leaked technical issues.

Further, in another embodiment of the screen projection image processing method of the present application, referring to FIG. 5 , the step of identifying the message notification area in each of the initial screen projection image frames includes:

Step S21, intercepting a regional image from a preset region range of each of the initial screen projection image frames;

In this embodiment, specifically, each of the initial screen projection image frames is cut according to a preset area range to obtain a corresponding area image of each of the initial screen projection image frames, wherein the preset area range may be Set according to the actual situation. For example, message notifications are often displayed at the top of the screen, so the image can be divided into four equal parts, and the top quarter area can be used as the preset area range, or the image can be set at a preset distance from the top. area as a preset area range, etc.

Step S22, comparing each of the area images with the preset standard area images, and identifying a message notification area with block differences in each of the area images.

In this embodiment, specifically, each of the area images is compared with a preset standard area image to determine whether there is a blocky difference between each of the area images and the preset standard area image, and there will be a blocky difference. The preset area range of the difference is used as the message notification area, wherein the preset standard area image may be one of the area images, or may be set in advance according to the actual situation, and the block difference refers to the area The entire difference area that exceeds the preset area and has a regular border, the preset area can be determined according to the actual screen size or actual test results, etc., and the regular border can be determined by judging whether there are the same or similar pixel values. It is determined by connecting to form a closed loop. Further, the graphics composed of the pixel value groups forming the closed loop can also be matched with the graphics in the preset graphics library for similarity, and the pixel value groups whose graphics similarity is higher than the preset similarity are corresponding to The preset area of is determined as the message notification area.

In an implementable manner, the step of recognizing the message notification areas with block-like differences in each of the regional images includes: performing a pairwise comparison of each of the regional images, and comparing and detecting any two regions Whether there is a difference area between the images that exceeds the preset difference area, if it is detected that the difference area exists between the two target area images, it is determined whether there is an edge line in the difference area according to the pixel value of the difference area, if If the edge line exists in any one of the two initial area images, it is determined that there is a block difference between the two target area images.

Optionally, before the step of comparing each of the area images with a preset standard area image, and identifying the message notification areas with block differences in each of the area images, the method further includes:

Step C10, sequentially detecting block-shaped difference regions between two adjacent regional images of the frame sequence according to the frame sequence;

In this embodiment, specifically, the frame sequence of the initial screen projection image frame corresponding to each of the initial area images is determined, the two adjacent initial area images of the frame sequence are sequentially acquired according to the frame sequence, and the frame sequences are sequentially detected according to the frame sequence. A blocky difference region between two adjacent initial region images in a frame sequence.

Step C20, when it is detected that there is a blocky difference area between two adjacent regional images of the frame sequence, determine whether the blocky difference has an edge line according to the pixel value of the blocky difference area;

In this embodiment, specifically, when it is detected that a block-shaped difference area exists between two adjacent area images in a frame sequence, the pixel value of the block-shaped difference area is acquired, and the pixel value of the block-shaped difference area is obtained according to the pixel value of the block-shaped difference area. value to determine whether there is an edge line in the block difference. When no block difference area is detected between two adjacent regional images in the frame sequence, continue to detect other adjacent regional image pairs in turn according to the frame sequence until all The detection of the detectable area images is completed. If there is no block-like difference area between the two adjacent area images of the frame sequence, it means that there is no message notification area in each of the initial projected image frames, and each of the The initial screen projection image frame is used as the target screen projection image frame, and the initial screen projection image frame is output through the display device, wherein the edge line is a continuous and end-to-end frame line composed of pixel points with the same or similar pixel values.

Step C30, taking the area image corresponding to the block-shaped difference area without the edge line as the preset standard area image.

In this embodiment, specifically, the area image corresponding to the block-shaped difference area without the edge line is used as a preset standard area image, and the area image corresponding to the block-shaped difference area with the edge line is used as a message notification area.

In this embodiment, by performing image comparison on regional images, the range of the region to be compared can be reduced, the comparison time can be effectively shortened, the screen projection delay can be reduced, and the range of the region can be limited, which can effectively avoid Other unexpected situations other than the message notification in the projected image cause misjudgment in the identification of the message notification area, which effectively improves the accuracy of the identification of the message notification area that may lead to privacy leakage.

Further, an embodiment of the present application further provides a screen projection image processing apparatus. Referring to FIG. 6 , the screen projection image processing apparatus is applied to a screen projection image processing device, and the screen projection image processing apparatus includes:

an acquisition module 10, configured to acquire at least one initial screen projection image frame;

The identification module 20 is used to identify the message notification area in each of the initial screen projection image frames;

The concealment processing module 30 is configured to perform concealment processing on each of the message notification areas if at least one of the message notification areas is identified in each of the initial projection image frames to obtain at least one target projection image frame.

Optionally, the identification module 20 is also used for:

intercepting a regional image from a preset region range of each of the initial screen projection image frames;

Comparing each of the area images with the preset standard area images, identifying a message notification area with block differences in each of the area images.

Optionally, the identification module 20 is also used for:

According to the frame sequence, sequentially detect the block difference area between the two adjacent area images of the frame sequence;

When it is detected that there is a blocky difference area between two adjacent area images of the frame sequence, determine whether the blocky difference has an edge line according to the pixel value of the blocky difference area;

The area image corresponding to the block difference area without the edge line is used as the preset standard area image.

Optionally, the identification module 20 is also used for:

If the message notification area is not identified in each of the initial screen projection image frames, each of the initial screen projection image frames is used as a target screen projection image frame.

Optionally, the hidden processing module 30 is further configured to:

acquiring at least one initial pixel value of each of the message notification areas;

Each of the initial pixel values is converted into a blurred pixel value according to a preset deformation algorithm to obtain at least one target screen projection image frame.

Optionally, the hidden processing module 30 is further configured to:

Each of the message notification areas is replaced with a preset message notification standard image to obtain at least one target screen projection image frame.

Optionally, the screen projection image processing apparatus further includes a prompting module, and the prompting module is used for:

Get the current screen projection display mode;

If the current screen projection display mode is the privacy protection mode, a prompt message indicating that the privacy protection mode is turned on is generated.

The screen projection image processing device provided by the present invention adopts the screen projection image processing method in the above-mentioned embodiments, so as to solve the technical problem of privacy leakage in the screen projection process in the prior art. Compared with the prior art, the beneficial effects of the screen projection image processing apparatus provided by the embodiments of the present invention are the same as those of the screen projection image processing method provided by the above-mentioned embodiments, and other technical features of the screen projection image processing apparatus are the same as those of the present invention. The disclosed features of the methods in the above embodiments are the same, and are not described in detail here.

Further, the present application also provides a computer program product, including a computer program, when the computer program is executed by a processor, the steps of the above-mentioned method for processing a projected screen image are implemented.

The computer program product provided by this application solves the technical problem of privacy leakage in the screen projection process in the prior art. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiments of the present invention are the same as those of the screen projection image processing method provided by the above-mentioned embodiments, which will not be repeated here.

The above are only the preferred embodiments of the present application, and are not intended to limit the scope of the patent of the present application. Any equivalent structure or equivalent process transformation made by using the contents of the description and drawings of the present application, or directly or indirectly applied in other related technical fields , are similarly included within the scope of patent processing of this application.

Claims (10)

1. A screen projection image processing method is characterized by comprising the following steps:

acquiring at least one initial screen projection image frame;

identifying a message notification area in each initial screen projection image frame;

if at least one message notification area is identified in each initial screen projection image frame, hiding each message notification area to obtain at least one target screen projection image frame.

2. The screen-shot image processing method of claim 1, wherein the step of identifying a message notification area in each of the initial screen-shot image frames comprises:

intercepting a region image from a preset region range of each initial screen projection image frame;

and comparing each area image with a preset standard area image, and identifying a message notification area with block difference in each area image.

3. The screen-projection image processing method of claim 2, wherein before the step of comparing each area image with a preset standard area image and identifying the message notification area with block difference in each area image, the method further comprises:

sequentially detecting block-shaped difference regions between two region images adjacent to the frame sequence according to the frame sequence;

when a block-shaped difference area exists between two area images adjacent to a frame sequence, judging whether an edge line exists in the block-shaped difference according to the pixel value of the block-shaped difference area;

and taking the area image corresponding to the block-shaped difference area without the edge line as a preset standard area image.

4. The screen-shot image processing method of claim 1, wherein the step of identifying a message notification area in each of the initial screen-shot image frames is followed by the step of:

and if the message notification area is not identified in each initial screen projection image frame, taking each initial screen projection image frame as a target screen projection image frame.

5. The screen-shot image processing method of claim 1, wherein the step of performing concealment processing on each of the message notification areas to obtain at least one target screen-shot image frame comprises:

acquiring at least one initial pixel value of each message notification area;

and converting each initial pixel value into a fuzzy pixel value according to a preset deformation algorithm to obtain at least one target screen projection image frame.

6. The screen-shot image processing method of claim 1, wherein the step of performing concealment processing on each of the message notification areas to obtain at least one target screen-shot image frame comprises:

and replacing each message notification area with a preset message notification standard image to obtain at least one target screen projection image frame.

7. The screen-shot image processing method of claim 1, wherein said step of obtaining at least one initial screen-shot image frame is preceded by the steps of:

acquiring a current screen projection display mode;

and if the current screen projection display mode is the privacy protection mode, generating prompt information of which the privacy protection mode is started.

8. A screen-projected image processing apparatus characterized by comprising:

the acquisition module is used for acquiring at least one initial screen projection image frame;

the identification module is used for identifying the message notification area in each initial screen projection image frame;

and the hiding processing module is used for hiding each message notification area to obtain at least one target screen projection image frame if at least one message notification area is identified in each initial screen projection image frame.

9. An electronic device, characterized in that the electronic device comprises:

at least one processor; and the number of the first and second groups,

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the projected image processing method of any of claims 1 to 7.

10. A storage medium, characterized in that the storage medium is a computer-readable storage medium having stored thereon a program for implementing a projected image processing method, the program being executed by a processor to implement the steps of the projected image processing method according to any one of claims 1 to 7.

Images