WO2022095359A1

WO2022095359A1 - Anti-screen-capturing-based information security protection method and apparatus, electronic device and medium

Info

Publication number: WO2022095359A1
Application number: PCT/CN2021/090723
Authority: WO
Inventors: 顾佳页
Original assignee: 平安科技（深圳）有限公司
Priority date: 2020-11-06
Filing date: 2021-04-28
Publication date: 2022-05-12
Also published as: CN112347526A

Abstract

The present application relates to information security technology, and discloses an anti-screen-capturing-based information security protection method, comprising: according to a set sampling frequency, acquiring a frame of video signal every preset time by using a front-facing camera of an electronic device, and obtaining an image frame according to the video signal; performing screen capturing determination on the image frame by using a pre-trained target detection model, to obtain an image confidence; comparing the image confidence and a preset confidence threshold and determining the relationship therebetween, and determining the possibility of a screen capturing operation according to the relationship; and performing information security early-warning according to the possibility of a screen capturing operation. The present application also relates to blockchain technology, and the image frame, etc. may be stored in a blockchain node. The present application also discloses an anti-screen-capturing-based information security protection apparatus, an electronic device and a storage medium. According to the present application, an information theft behavior by means of screen capturing can be discovered in a timely manner, so as to improve information security.

Description

Information security protection method, device, electronic device and medium based on anti-camera screen

This application claims the priority of the Chinese patent application filed on November 06, 2020 with the application number 202011231145.4 and the title of the invention is "information security protection method, device, electronic device and medium based on anti-camera screen". The entire contents of this application are incorporated by reference.

technical field

The present application relates to the technical field of information security, and in particular, to an information security protection method, device, electronic device, and computer-readable storage medium based on an anti-camera screen.

Background technique

With the rapid development of information technology, the situation of information leakage is becoming more and more serious. At present, most information leakage protection solutions on the market use document operation authorization, and document operation authorization mainly prevents information leakage with digital information as the carrier. , but for data theft through screen capture, it is powerless. The screen-taking method refers to taking pictures of digital information displayed on the screen by using an electronic device with a camera function, so as to achieve the purpose of data theft.

The inventor realized that for the scene of data theft through screen capture, at present, only retrospective methods such as workplace monitoring can be used to pursue accountability and stop losses. The loss of the company's economy, law, and reputation caused by the leak has actually occurred.

SUMMARY OF THE INVENTION

An information security protection method based on an anti-screening screen provided by this application includes:

According to the set sampling frequency, use the front camera of the electronic device to collect a frame of video signal every preset time, and obtain an image frame according to the video signal;

Use the pre-trained target detection model to judge the image frame by taking a screen shot to obtain the image confidence;

Comparing the relationship between the image confidence and a preset confidence threshold, and determining the possibility of the screen capture operation according to the relationship;

According to the possibility of the screen-capture operation, an early warning of information security is performed.

The present application also provides an information security protection device based on an anti-camera screen, the device comprising:

an image frame module, configured to use the front camera of the electronic device to collect a frame of video signal every preset time according to the set sampling frequency, and obtain an image frame according to the video signal;

a confidence module, used for using the pre-trained target detection model to perform screen-shot judgment on the image frame to obtain the image confidence;

a comparison module, configured to compare the relationship between the image confidence and a preset reliability threshold, and determine the possibility of a screen-capture operation according to the relationship;

A security pre-warning module, configured to perform pre-warning of information security according to the possibility of the screen-capture operation.

The present application also provides an electronic device, the electronic device comprising:

at least one processor; and,

a memory communicatively coupled to the at least one processor; wherein,

The memory stores computer program instructions executable by the at least one processor, the computer program instructions being executed by the at least one processor to enable the at least one processor to perform the Screen information security protection methods:

The present application also provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, implements the following information security protection method based on an anti-screening screen:

Description of drawings

1 is a schematic flowchart of an information security protection method based on an anti-screening screen provided by an embodiment of the present application;

FIG. 2 is a schematic flowchart of one of the steps in the information security protection method based on the anti-screening screen shown in FIG. 1;

FIG. 3 is a schematic flowchart of another step in the information security protection method based on the anti-screening screen shown in FIG. 1;

4 is a schematic diagram of a module of an information security protection device based on an anti-screening screen provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of an internal structure of an electronic device for implementing an information security protection method based on an anti-screening screen according to an embodiment of the present application.

The realization, functional characteristics and advantages of the purpose of the present application will be further described with reference to the accompanying drawings in conjunction with the embodiments.

Detailed ways

It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

An embodiment of the present application provides an information security protection method based on an anti-screening screen, and the execution subject of the information security protection method based on an anti-screening screen includes, but is not limited to, a server, a terminal, and the like, which can be configured to execute the methods provided by the embodiments of the present application. at least one of the electronic devices of the method. In other words, the information security protection method based on the anti-camera screen can be executed by software or hardware installed in a terminal device or a server device, and the software can be a blockchain platform. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, and the like.

Referring to FIG. 1 , it is a schematic flowchart of an information security protection method based on an anti-screening screen provided by an embodiment of the present application. In this embodiment, the information security protection method based on the anti-screening screen is applied to an electronic device including a front camera, and includes:

S1. According to the set sampling frequency, use the front camera of the electronic device to collect a frame of video signal every preset time, and obtain an image frame according to the video signal.

In this embodiment of the present application, the sampling frequency may be set according to actual requirements, for example, may be set to one minute.

Further, the front camera of the electronic device may be a built-in camera of the electronic device or an on-screen camera.

In the embodiment of the present application, the existing image frame extraction software is used to extract and process the video signal, and an image frame including N continuous shooting images is obtained. Preferably, N can be set to 3.

S2. Use the pre-trained target detection model to judge the image frame by taking a screen shot to obtain the image confidence.

In the embodiment of the present application, the target detection model may be three common models based on deep learning target detection: FasterR-CNN, R-FCN, and SSD. The target detection model can extract features from the image, perform probability calculation of the category of the target object according to the extracted features, and output the classification of the target object according to the probability.

Specifically, referring to FIG. 2 , the pre-trained target detection model is used to judge the image frame by taking a screen shot to obtain the image confidence, including:

S21, using a pre-trained target detection model to perform feature extraction on the image frame to obtain a feature image;

S22. Use the pre-trained target detection model to classify and calculate the probability of the feature image, to obtain the image confidence about the screen capture operation.

In detail, performing feature extraction on the image frame by using a pre-trained target detection model to obtain a feature image includes: performing convolution processing on the image frame by using a convolution layer of the target detection model to obtain a volume using the activation layer of the target detection model to perform activation processing on the convolutional image to obtain an activation image; using the pooling layer of the target detection model to perform pooling processing on the activation image to obtain a feature image.

Among them, convolution processing is a linear operation, and performing convolution processing on the image frame can not only eliminate noise and enhance features, but also increase the receptive field, so that the pre-built target detection model can extract more Rich feature information to make up for the loss of internal data structure, loss of spatial level information and other information losses.

In detail, the convolution processing includes:

According to the preset convolution kernel, the image frame is divided in the order from top to bottom and from left to right to obtain the initial sub-image;

Multiplying the preset convolution kernel with the pixel value in the initial sub-image to obtain a pixel product value;

The pixel product values are summed to obtain a target pixel value, and a convolution image is determined according to the target pixel value.

Further, there is a preset activation function in the activation layer, and the embodiment of the present application uses the activation function to process the convolution image to obtain the activation image.

The activation function may be a Sigmoid function, a tanh function, a Relu function, or the like.

Preferably, the activation process can increase the nonlinearity of the target detection network, map the features to a high-dimensional nonlinear interval for interpretation, and solve problems that cannot be solved by a linear model.

The pooling process can perform feature selection and information filtering on the activation image. By reducing the dimension of the feature and retaining valid information, overfitting can be avoided to a certain extent, and rotation, translation, and scaling can be maintained without deformation.

Specifically, the pooling process includes:

dividing the activation image into N*N blocks in the order from left to right and from top to bottom;

Using the pooling layer to perform pooling processing on several blocks in the activation image, a feature image is obtained.

Further, in the embodiment of the present application, the feature image is classified and probability calculated by using the full connection and the softmax function to obtain the image confidence.

In another embodiment of the present application, before the pre-trained target detection model is used to judge the image frame by taking a screen shot to obtain the image confidence, the method further includes:

Step A: obtaining the training data set and the standard target detection result corresponding to the training data set;

Step B: inputting the training data set into the target detection model for screen-shot judgment to obtain a training result;

Step C: using a preset loss function to calculate the loss value on the training result and the standard target detection result to obtain the loss value;

Step D: when the loss value is greater than or equal to the preset loss threshold, it indicates that the output result of the target detection model is not accurate enough, and the parameters of the target detection model need to be adjusted, and then return to the step B;

Step E: When the loss value is less than the loss threshold, it means that the output result of the target detection model is accurate, and the pre-trained target detection model is obtained.

In detail, the embodiment of the present application uses the following loss function to calculate the loss value on the training result and the preset target result to obtain the loss value, including:

Calculate the loss value using the following loss function:

in,

is the training result, Y is the standard target detection result, α is the error factor, N is the number of the training results, and i is the ith training result. .

S3. Compare the relationship between the image confidence and a preset confidence threshold, and determine the possibility of a screen capture operation according to the relationship.

In this embodiment of the present application, two confidence thresholds may be preset, which are a first confidence threshold and a second confidence threshold, respectively.

Referring to FIG. 3 , specifically, the comparing the relationship between the image confidence and the preset reliability threshold, and determining the possibility of the screen capture operation according to the relationship, includes:

S31. Compare the image confidence with a preset confidence threshold, wherein the preset confidence threshold includes a first confidence threshold and a second confidence threshold;

S32. When the confidence of the image is greater than or equal to the first confidence threshold, determine that the possibility of the screen capture operation is to determine the screen capture; or

S33. When the image confidence is less than the first confidence threshold and greater than or equal to the second confidence threshold, determine that the possibility of the screen capture operation is a suspected screen capture; or

S34. When the image confidence level is less than the second confidence level threshold, determine that the possibility of the screen-capturing operation is that the screen is not being captured.

Preferably, the first confidence threshold may be 10, and the second confidence threshold may be 5.

S4. Perform an early warning of information security according to the possibility of the screen capture operation.

In this embodiment of the present application, when the possibility of the screen-capturing operation is determined to be screen-capturing or suspected to be screen-capturing, an early warning of information security is performed. Wherein, the early warning includes the electronic device ringing, or sending early warning information to a preset monitoring terminal, and the like.

Further, when it is determined that the possibility of the screen capture operation is to determine the screen capture or the suspected screen capture, the embodiment of the present application may also perform a screen capture process on the content currently displayed on the screen of the electronic device to obtain a screen capture image. ; When it is determined that the possibility of the screen capture operation is to determine the screen capture, or the possibility of the screen capture operation is determined to be a suspected screen capture, the image frame corresponding to the image after the screenshot is sent to the preset monitoring device, and further locked or logged out The currently logged in user.

In other embodiments of the present application, when it is determined that the possibility of the screen capture operation is a suspected screen capture, the image frame corresponding to the possibility of the screen capture operation being a suspected screen capture may also be sent to a preset monitoring device and the corresponding monitoring device is reminded The personnel conducts a second confirmation, and when the possibility of manually confirming the screen capture operation is determined to be the screen capture operation, the operation of locking or logging out the currently logged-in user is performed.

When it is determined that the possibility of the screen capture operation is that the screen is not captured, the electronic device continues to collect a frame of video signal every preset time, and maintains the normal operation of the screen of the electronic device.

As shown in FIG. 4 , it is a schematic diagram of a module of an information security protection device based on an anti-photographing screen provided by an embodiment of the present application.

The information security protection device 100 based on the anti-camera screen described in this application can be installed in an electronic device. According to the implemented functions, the information security protection device 100 based on the anti-screening screen may include an image frame module 101 , a confidence module 102 , a comparison module 103 and a security warning module 104 . The modules described in this application may also be referred to as units, which refer to a series of computer program segments that can be executed by the processor of an electronic device and can perform fixed functions, and are stored in the memory of the electronic device.

In this embodiment, the functions of each module/unit are as follows:

The image frame module 101 is configured to use the front camera of the electronic device to collect a frame of video signal every preset time according to the set sampling frequency, and obtain an image frame according to the video signal;

The confidence module 102 is configured to use the pre-trained target detection model to judge the image frame by taking a screen shot to obtain the image confidence;

The comparison module 103 is configured to compare the relationship between the image confidence and a preset reliability threshold, and determine the possibility of the screen-capture operation according to the relationship;

The security early warning module 104 is configured to perform early warning of information security according to the possibility of the screen capture operation.

In detail, when the information security protection device 100 based on the anti-screening screen is executed by the processor of the electronic device, it can implement an information security protection method based on the anti-screening screen including the following steps:

Step 1: The image frame module 101 uses the front camera of the electronic device to collect a frame of video signal every preset time according to the set sampling frequency, and obtains an image frame according to the video signal.

The image frame module 101 described in this embodiment of the present application uses existing image frame extraction software to extract and process the video signal to obtain an image frame including N continuous shooting images. Preferably, N can be set to 3.

Step 2: The confidence module 102 uses the pre-trained target detection model to perform screen-shot judgment on the image frame to obtain the image confidence.

Specifically, the confidence module 102 uses the following operations to perform screen-shot judgment on the image frame to obtain the image confidence:

Use the pre-trained target detection model to perform feature extraction on the image frame to obtain a feature image;

The feature images are classified and probability calculated by using the pre-trained target detection model, so as to obtain the image confidence about the screen capture operation.

Specifically, the confidence module 102 adopts the following operations to perform feature extraction on the image frame to obtain a feature image: perform convolution processing on the image frame by using the convolution layer of the target detection model to obtain a convolution image; use the activation layer of the target detection model to perform activation processing on the convolutional image to obtain an activation image; use the pooling layer of the target detection model to perform pooling processing on the activation image to obtain a feature image.

In detail, the convolution processing includes:

Specifically, the pooling process includes:

In another embodiment of the present application, the confidence module 102 further performs training of the target detection model. Wherein, the training process includes:

In detail, the confidence module 102 in this embodiment of the present application uses the following loss function to calculate the loss value between the training result and the preset target result, and obtain the loss value, including:

Calculate the loss value using the following loss function:

in,

Step 3: The comparison module 103 compares the relationship between the image confidence level and a preset confidence level threshold, and determines the possibility of a screen capture operation according to the relationship.

Specifically, as shown in FIG. 3 , the comparison module 103 compares the relationship between the image confidence level and the preset confidence level threshold, and determines the possibility of the screen capture operation according to the relationship, including:

comparing the image confidence with a preset confidence threshold, wherein the preset confidence threshold includes a first confidence threshold and a second confidence threshold;

When the image confidence level is greater than or equal to the first confidence level threshold, determining the possibility of the screen-capturing operation is determining the screen-capturing operation; or

When the image confidence level is less than the first confidence level threshold and greater than or equal to the second confidence level threshold, determine that the possibility of the screen capture operation is a suspected screen capture; or

When the image confidence level is less than the second confidence level threshold, it is determined that the possibility of the screen capture operation is that the screen is not captured.

Step 4: The security early warning module 104 performs information security early warning according to the possibility of the screen capture operation.

Further, when it is determined that the possibility of the screen capture operation is to determine the screen capture or the suspected screen capture, the security early warning module 104 described in this embodiment of the present application may also perform a screen capture process on the content currently displayed on the screen of the electronic device, to obtain: The image after the screen capture; when the possibility of the screen capture operation is determined to be a confirmed screen capture, or the possibility of the screen capture operation is determined to be a suspected screen capture, the image frame corresponding to the screen capture image is sent to the preset monitoring device, and the Further lock out or log out the currently logged in user.

In other embodiments of the present application, when it is determined that the possibility of the screen capture operation is a suspected screen capture, the security warning module 104 may also send the image frame corresponding to the suspected screen capture operation to the preset The monitoring device reminds the corresponding monitoring personnel to perform a second confirmation, and when the possibility of manually confirming the screen capture operation is determined to be the screen capture operation, the operation of locking or logging out the currently logged-in user is performed.

As shown in FIG. 5 , it is a schematic structural diagram of an electronic device implementing an information security protection method based on an anti-screening screen according to the present application.

The electronic device 1 may include a processor 10, a memory 11 and a bus, and may also include a computer program stored in the memory 11 and running on the processor 10, such as an information security protection program based on an anti-camera screen 12.

Wherein, the memory 11 includes at least one type of readable storage medium, and the readable storage medium may be volatile or non-volatile. Specifically, the readable storage medium includes a flash memory, a mobile hard disk, a multimedia card, a card-type memory (eg, SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, and the like. In some embodiments, the memory 11 may be an internal storage unit of the electronic device 1, such as a mobile hard disk of the electronic device 1. In other embodiments, the memory 11 may also be an external storage device of the electronic device 1, such as a pluggable mobile hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) equipped on the electronic device 1. card, flash memory card (FlashCard), etc. Further, the memory 11 may also include both an internal storage unit of the electronic device 1 and an external storage device. The memory 11 can not only be used to store the application software and various data installed in the electronic device 1, such as the code of the information security protection program 12 based on the anti-camera screen, etc., but also can be used to temporarily store the data that has been output or will be output. data.

In some embodiments, the processor 10 may be composed of integrated circuits, for example, may be composed of a single packaged integrated circuit, or may be composed of multiple integrated circuits packaged with the same function or different functions, including one or more integrated circuits. Central processing unit (Central Processing unit, CPU), microprocessor, digital processing chip, graphics processor and combination of various control chips, etc. The processor 10 is the control core (ControlUnit) of the electronic device, and uses various interfaces and lines to connect various components of the entire electronic device, and by running or executing the program or module stored in the memory 11 (for example, executing a The information security protection program of the anti-screening screen, etc.), and call the data stored in the memory 11 to execute various functions of the electronic device 1 and process data.

The bus may be a peripheral component interconnect (PCI for short) bus or an extended industry standard architecture (extended industry standard architecture, EISA for short) bus or the like. The bus can be divided into address bus, data bus, control bus and so on. The bus is configured to implement connection communication between the memory 11 and at least one processor 10 and the like.

FIG. 5 only shows an electronic device with components. Those skilled in the art can understand that the structure shown in FIG. 5 does not constitute a limitation on the electronic device 1, and may include fewer or more components than those shown in the drawings. components, or a combination of certain components, or a different arrangement of components.

For example, although not shown, the electronic device 1 may also include a power supply (such as a battery) for powering the various components, preferably, the power supply may be logically connected to the at least one processor 10 through a power management device, so that the power management The device implements functions such as charge management, discharge management, and power consumption management. The power source may also include one or more DC or AC power sources, recharging devices, power failure detection circuits, power converters or inverters, power status indicators, and any other components. The electronic device 1 may further include various sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be repeated here.

Further, the electronic device 1 may also include a network interface, optionally, the network interface may include a wired interface and/or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), which is usually used in the electronic device 1 Establish a communication connection with other electronic devices.

Optionally, the electronic device 1 may further include a user interface, and the user interface may be a display (Display), an input unit (eg, a keyboard (Keyboard)), optionally, the user interface may also be a standard wired interface or a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode, organic light-emitting diode) touch device, and the like. The display may also be appropriately called a display screen or a display unit, which is used for displaying information processed in the electronic device 1 and for displaying a visualized user interface.

It should be understood that the embodiments are only used for illustration, and are not limited by this structure in the scope of the patent application.

The information security protection program 12 based on the anti-screening screen stored in the memory 11 in the electronic device 1 is a combination of multiple instructions, and when running in the processor 10, it can realize:

Further, if the modules/units integrated in the electronic device 1 are implemented in the form of software functional units and sold or used as independent products, they may be stored in a computer-readable storage medium. The computer-readable storage medium may be volatile or non-volatile. Specifically, the computer-readable storage medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM, Read Only Memory) -Only Memory).

Further, the computer-readable storage medium may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function, and the like; The data created by the use of the node, etc.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the modules is only a logical function division, and there may be other division manners in actual implementation.

The modules described as separate components may or may not be physically separated, and components shown as modules may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional module in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware, or can be implemented in the form of hardware plus software function modules.

It will be apparent to those skilled in the art that the present application is not limited to the details of the above-described exemplary embodiments, but that the present application can be implemented in other specific forms without departing from the spirit or essential characteristics of the present application.

Accordingly, the embodiments are to be regarded in all respects as illustrative and not restrictive, and the scope of the application is to be defined by the appended claims rather than the foregoing description, which is therefore intended to fall within the scope of the claims. All changes within the meaning and scope of the equivalents of , are included in this application. Any accompanying reference signs in the claims should not be construed as limiting the involved claims.

Furthermore, it is clear that the word "comprising" does not exclude other units or steps and the singular does not exclude the plural. Several units or means recited in the system claims can also be realized by one unit or means by means of software or hardware. Second-class terms are used to denote names and do not denote any particular order.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application rather than limitations. Although the present application has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present application can be Modifications or equivalent substitutions can be made without departing from the spirit and scope of the technical solutions of the present application.

Claims

An information security protection method based on an anti-camera screen, wherein the method is applied to an electronic device, comprising:

According to the set sampling frequency, use the front camera of the electronic device to collect a frame of video signal every preset time, and obtain an image frame according to the video signal;

Use the pre-trained target detection model to judge the image frame by taking a screen shot to obtain the image confidence;

Comparing the relationship between the image confidence and a preset confidence threshold, and determining the possibility of the screen capture operation according to the relationship;

According to the possibility of the screen-capture operation, an early warning of information security is performed.
The information security protection method based on an anti-screening screen according to claim 1, wherein the image frame is judged by using a pre-trained target detection model to obtain an image confidence level, comprising:

Use the pre-trained target detection model to perform feature extraction on the image frame to obtain a feature image;

The feature images are classified and probability calculated by using the pre-trained target detection model, so as to obtain the image confidence about the screen capture operation.
The method for information security protection based on an anti-screening screen according to claim 2, wherein the feature extraction is performed on the image frame by using a pre-trained target detection model to obtain a feature image, comprising:

Use the convolution layer of the target detection model to perform convolution processing on the image frame to obtain a convolution image;

Use the activation layer of the target detection model to activate the convolution image to obtain an activation image;

The activation image is pooled by using the pooling layer of the target detection model to obtain a feature image.
The information security protection method based on an anti-screening screen according to claim 1, wherein before the image frame is judged by using a pre-trained target detection model to obtain the image confidence, the method further comprises: :

Obtain the training data set and the standard target detection result corresponding to the training data set;

Inputting the training data set into the initial target detection model for screen-shot judgment to obtain a training result;

Use a preset loss function to perform loss value calculation on the training result and the standard target detection result to obtain a loss value;

When the loss value is greater than or equal to the preset loss threshold, adjust the parameters of the target detection model, and return to the step of inputting the training data set into the target detection model for screen-taking judgment, and obtaining the training result. step;

When the loss value is less than the loss threshold, the pre-trained target detection model is obtained.
The information security protection method based on an anti-screening screen according to claim 4, wherein the loss value calculation is performed on the training result and the standard target detection result by using a preset loss function, and the loss value is obtained, comprising:

Calculate the loss value using the following loss function:

in,
is the training result, Y is the standard target detection result, α is the error factor, N is the number of the training results, and i is the ith training result.
The information security protection method based on an anti-photographing screen according to any one of claims 1 to 5, wherein the comparing the relationship between the image confidence and a preset confidence threshold, and determining according to the relationship Possibilities of camera operation, including:

comparing the image confidence with a preset confidence threshold, wherein the preset confidence threshold includes a first confidence threshold and a second confidence threshold;

When the image confidence level is greater than or equal to the first confidence level threshold, determining the possibility of the screen-capturing operation is determining the screen-capturing operation; or

When the image confidence level is less than the first confidence level threshold and greater than or equal to the second confidence level threshold, determine that the possibility of the screen capture operation is a suspected screen capture; or

When the image confidence level is less than the second confidence level threshold, it is determined that the possibility of the screen capture operation is that the screen is not captured.
The information security protection method based on an anti-screening screen according to claim 6, wherein the determining the possibility of the screen-taking operation is to determine the screen-taking operation, or the determining the possibility of the screen-taking operation is after the suspected screen-taking operation, the The method also includes:

Perform screenshot processing on the content currently displayed on the screen of the electronic device to obtain an image after the screenshot;

When it is determined that the possibility of the screen capture operation is determined to be the screen capture, or the possibility of the screen capture operation is determined to be a suspected screen capture, the image frame corresponding to the image after the screenshot is sent to the preset monitoring.
An information security protection device based on an anti-camera screen, wherein the device comprises:

an image frame module, configured to use the front camera of the electronic device to collect a frame of video signal every preset time according to the set sampling frequency, and obtain an image frame according to the video signal;

a confidence module, used for using the pre-trained target detection model to perform screen-shot judgment on the image frame to obtain the image confidence;

a comparison module, configured to compare the relationship between the image confidence and a preset reliability threshold, and determine the possibility of a screen-capture operation according to the relationship;

A security pre-warning module, configured to perform pre-warning of information security according to the possibility of the screen-capture operation.
An electronic device, wherein the electronic device comprises:

at least one processor; and,

a memory communicatively coupled to the at least one processor; wherein,

The memory stores computer program instructions executable by the at least one processor, the computer program instructions being executed by the at least one processor to enable the at least one processor to perform the Screen information security protection methods:

According to the set sampling frequency, use the front camera of the electronic device to collect a frame of video signal every preset time, and obtain an image frame according to the video signal;

Use the pre-trained target detection model to judge the image frame by taking a screen shot to obtain the image confidence;

Comparing the relationship between the image confidence and a preset confidence threshold, and determining the possibility of the screen capture operation according to the relationship;

According to the possibility of the screen-capture operation, an early warning of information security is performed.
The electronic device according to claim 9, wherein the image frame is judged by using a pre-trained target detection model to obtain the image confidence, comprising:

Use the pre-trained target detection model to perform feature extraction on the image frame to obtain a feature image;

The feature images are classified and probability calculated by using the pre-trained target detection model, so as to obtain the image confidence about the screen capture operation.
The electronic device according to claim 10, wherein the feature extraction is performed on the image frame by using a pre-trained target detection model to obtain a feature image, comprising:

Use the convolution layer of the target detection model to perform convolution processing on the image frame to obtain a convolution image;

Use the activation layer of the target detection model to activate the convolution image to obtain an activation image;

The activation image is pooled by using the pooling layer of the target detection model to obtain a feature image.
The electronic device according to claim 9, wherein, before the image frame is judged by using the pre-trained target detection model to obtain the image confidence, the method further comprises:

Obtain the training data set and the standard target detection result corresponding to the training data set;

Inputting the training data set into the initial target detection model for screen-shot judgment to obtain a training result;

Use a preset loss function to perform loss value calculation on the training result and the standard target detection result to obtain a loss value;

When the loss value is greater than or equal to the preset loss threshold, adjust the parameters of the target detection model, and return to the step of inputting the training data set into the target detection model for screen-taking judgment, and obtaining the training result. step;

When the loss value is less than the loss threshold, the pre-trained target detection model is obtained.
The electronic device according to claim 12, wherein the loss value calculation is performed on the training result and the standard target detection result by using a preset loss function, and the loss value is obtained, comprising:

Calculate the loss value using the following loss function:

in,
is the training result, Y is the standard target detection result, α is the error factor, N is the number of the training results, and i is the ith training result.
The electronic device according to any one of claims 9 to 13, wherein the comparing the relationship between the image confidence and a preset confidence threshold, and determining the possibility of a screen capture operation according to the relationship, include:

comparing the image confidence with a preset confidence threshold, wherein the preset confidence threshold includes a first confidence threshold and a second confidence threshold;

When the confidence of the image is greater than or equal to the first confidence threshold, determining the possibility of a screen-capture operation is to determine the screen-capture; or

When the image confidence level is less than the first confidence level threshold and greater than or equal to the second confidence level threshold, determine that the possibility of the screen capture operation is a suspected screen capture; or

When the image confidence level is less than the second confidence level threshold, it is determined that the possibility of the screen capture operation is that the screen is not captured.
A computer-readable storage medium storing a computer program, wherein when the computer program is executed by a processor, the following information security protection method based on an anti-screening screen is implemented:

According to the set sampling frequency, use the front camera of the electronic device to collect a frame of video signal every preset time, and obtain an image frame according to the video signal;

Use the pre-trained target detection model to judge the image frame by taking a screen shot to obtain the image confidence;

Comparing the relationship between the image confidence and a preset confidence threshold, and determining the possibility of the screen capture operation according to the relationship;

According to the possibility of the screen-capture operation, an early warning of information security is performed.
The computer-readable storage medium according to claim 15, wherein the image frame is judged by using a pre-trained target detection model to obtain the image confidence, comprising:

Use the pre-trained target detection model to perform feature extraction on the image frame to obtain a feature image;

The feature images are classified and probability calculated by using the pre-trained target detection model, so as to obtain the image confidence about the screen capture operation.
The computer-readable storage medium according to claim 16, wherein the feature extraction is performed on the image frame by using a pre-trained target detection model to obtain a feature image, comprising:

Use the convolution layer of the target detection model to perform convolution processing on the image frame to obtain a convolution image;

Use the activation layer of the target detection model to activate the convolution image to obtain an activation image;

The activation image is pooled by using the pooling layer of the target detection model to obtain a feature image.
The computer-readable storage medium according to claim 15, wherein, before the image frame is judged by using a pre-trained target detection model to obtain the image confidence, the method further comprises:

Obtain the training data set and the standard target detection result corresponding to the training data set;

Inputting the training data set into the initial target detection model for screen-shot judgment to obtain a training result;

Use a preset loss function to perform loss value calculation on the training result and the standard target detection result to obtain a loss value;

When the loss value is greater than or equal to the preset loss threshold, adjust the parameters of the target detection model, and return to the step of inputting the training data set into the target detection model for screen-taking judgment to obtain the training result. step;

When the loss value is less than the loss threshold, the pre-trained target detection model is obtained.
The computer-readable storage medium according to claim 18, wherein the loss value calculation is performed on the training result and the standard target detection result by using a preset loss function to obtain the loss value, comprising:

Calculate the loss value using the following loss function:

in,
is the training result, Y is the standard target detection result, α is the error factor, N is the number of the training results, and i is the ith training result.
The computer-readable storage medium according to any one of claims 15 to 19, wherein the comparing the relationship between the image confidence level and a preset confidence threshold value, and determining a screen capture operation based on the relationship Possibilities, including:

comparing the image confidence with a preset confidence threshold, wherein the preset confidence threshold includes a first confidence threshold and a second confidence threshold;

When the image confidence level is greater than or equal to the first confidence level threshold, determining the possibility of the screen-capturing operation is determining the screen-capturing operation; or

When the image confidence level is less than the first confidence level threshold and is greater than or equal to the second confidence level threshold, determine that the possibility of the screen capture operation is a suspected screen capture; or

When the image confidence level is less than the second confidence level threshold, it is determined that the possibility of the screen capture operation is that the screen is not captured.