CN115049760B

CN115049760B - Moore effect enhancement-based video privacy protection method, device and equipment

Info

Publication number: CN115049760B
Application number: CN202210978536.5A
Authority: CN
Inventors: 王滨; 陈加栋; 林克章; 王星
Original assignee: Hangzhou Hikvision Digital Technology Co Ltd
Current assignee: Hangzhou Hikvision Digital Technology Co Ltd
Priority date: 2022-08-16
Filing date: 2022-08-16
Publication date: 2022-12-02
Anticipated expiration: 2042-08-16
Also published as: CN115049760A

Abstract

The embodiment of the invention provides a method, a device and equipment for protecting video privacy based on molar effect enhancement, which relate to the field of data processing and comprise the following steps: obtaining a video to be protected; obtaining a data protection pattern, wherein the data protection pattern is obtained according to an original pattern drawn with transverse lines and longitudinal lines, and the intervals between the transverse lines and the intervals between the longitudinal lines are intervals at which the transverse lines and the longitudinal lines are densely distributed; and processing the video to be protected based on the data protection pattern. By applying the molar effect enhancement-based video privacy protection scheme provided by the embodiment of the invention, the video to be protected is processed, so that the processed video to be protected can be protected.

Description

Moore effect enhancement-based video privacy protection method, device and equipment

Technical Field

The invention relates to the technical field of data processing, in particular to a method, a device and equipment for protecting video privacy based on molar effect enhancement.

Background

Video data is now flooded in people's work and life, and various electronic devices convey to people the information that video providers want to express by presenting videos. However, some people in some scenes may use an image capturing device such as a camera or a mobile phone to capture the video displayed by the electronic device while watching the video displayed by the electronic device.

However, people are increasingly aware of protection of copyright and privacy, and a video provider does not want videos provided by the video provider to be captured by others without authorization, and wants to protect copyright and privacy of the video provider.

Disclosure of Invention

The embodiment of the invention aims to provide a method, a device and equipment for protecting video privacy based on molar effect enhancement, so that a video provided by a video provider is protected. The specific technical scheme is as follows:

in a first aspect, an embodiment of the present invention provides a method for protecting video privacy based on moir e effect enhancement, where the method includes:

obtaining a video to be protected;

obtaining a data protection pattern, wherein the data protection pattern is obtained according to an original pattern drawn with transverse lines and longitudinal lines, and the intervals between the transverse lines and the intervals between the longitudinal lines are intervals at which the transverse lines and the longitudinal lines are densely distributed;

and processing the video to be protected based on the data protection pattern.

In a second aspect, an embodiment of the present invention provides an apparatus for enhancing video privacy based on the moir effect, where the apparatus includes:

the to-be-protected video obtaining module is used for obtaining a to-be-protected video;

the data protection pattern obtaining module is used for obtaining a data protection pattern, wherein the data protection pattern is obtained according to an original pattern drawn with transverse lines and longitudinal lines, and intervals between the transverse lines and intervals between the longitudinal lines are set based on a sensor sampling frequency of image acquisition equipment;

and the to-be-protected video processing module is used for processing the to-be-protected video based on the data protection pattern.

In a third aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete mutual communication through the communication bus;

a memory for storing a computer program;

a processor configured to implement the method steps of the first aspect when executing the program stored in the memory.

In a fourth aspect, the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the method steps of the first aspect.

In a fifth aspect, embodiments of the present invention further provide a computer program product including instructions, which, when executed on a computer, cause the computer to perform the method steps of the first aspect.

As can be seen from the above, when video protection is performed by applying the scheme provided by the embodiment of the present invention, a data protection pattern is obtained first, where the data protection pattern is obtained based on lines at target intervals, and the target intervals are lines at which the lines are densely distributed, so that the densely distributed lines in the data protection pattern easily satisfy a condition that moire is generated when an image acquisition device acquires an image, and then the image acquisition device easily obtains an image with moire after shooting the data protection pattern. And then, processing the video to be protected by adopting the data protection pattern, so that lines in the data protection pattern are displayed in the video to be protected, and the image with Moire patterns can be easily obtained after the image acquisition equipment shoots the video to be protected. Because the moire can interfere the content in the image, the difficulty of identifying data from the image by human eyes or electronic equipment is increased, the data is protected, the risk of data leakage caused by the fact that a provider of the video to be protected is shouldered when the video to be protected is displayed is reduced, and the safety of the video to be protected is improved.

In addition, when the data protection pattern is adopted to process the video to be protected, the non-line area in the data protection pattern is subjected to transparent processing, so that the non-line area in the data protection pattern cannot be displayed in the video to be protected, only the line can be displayed in the video to be protected, and the video to be protected can still be directly identified by human eyes.

In conclusion, by applying the scheme provided by the embodiment of the invention to perform video protection, the video to be protected can be protected without affecting the condition that human eyes directly identify the video to be protected, and the safety of the video to be protected is improved.

Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by referring to these drawings.

Fig. 1 is a schematic flowchart of a first method for generating a data protection pattern according to an embodiment of the present invention;

fig. 2 is a schematic flowchart of a second method for generating a data protection pattern according to an embodiment of the present invention;

fig. 3 is a schematic diagram of a first target area selection process according to an embodiment of the present invention;

fig. 4 is a schematic diagram of a second target area selection process according to an embodiment of the present invention;

FIG. 5 is a diagram illustrating a first image according to an embodiment of the present invention;

FIG. 6 is a diagram illustrating a second type of first image according to an embodiment of the present invention;

fig. 7 is a schematic flowchart of a first method for privacy protection based on moir effect enhancement according to an embodiment of the present invention;

fig. 8 is a schematic flowchart of a second method for protecting video privacy based on moir e effect enhancement according to an embodiment of the present invention;

fig. 9 is a schematic flowchart of a third method for protecting video privacy based on moir effect enhancement according to an embodiment of the present invention;

fig. 10 is a schematic flowchart of a fourth method for privacy protection based on moir effect enhancement according to an embodiment of the present invention;

fig. 11 is a schematic flowchart of a fifth method for protecting video privacy based on moir e effect enhancement according to an embodiment of the present invention;

fig. 12 is a schematic structural diagram of a data protection pattern generating apparatus according to an embodiment of the present invention;

fig. 13 is a schematic structural diagram of a video privacy protecting apparatus based on moir e effect enhancement according to an embodiment of the present invention;

fig. 14 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived from the embodiments of the present invention by those skilled in the art based on the description, are within the scope of the present invention.

First, a description will be given of a concept related to the embodiment of the present invention.

Moire pattern: colored, high frequency, irregular stripes appear in the image. Moire fringes can affect the recognition of content in the image.

And (3) video to be protected: it can be any format video file that needs to be played in real time and projected on screen.

Data protection pattern: the image acquisition equipment is used for protecting the pattern of the video to be protected, and Moire fringes can be generated in an image obtained by shooting a data protection pattern.

Since the video privacy protection method based on the moir e effect enhancement provided by the embodiment of the present invention is implemented based on the data protection pattern, in order to facilitate understanding of the video privacy protection scheme based on the moir effect enhancement provided by the embodiment of the present invention, first, a data protection pattern generation method provided by the embodiment of the present invention is described below.

Referring to fig. 1, fig. 1 is a schematic flowchart of a first method for generating a data protection pattern according to an embodiment of the present invention, where the method includes the following steps S101 to S103.

Step S101: an image of the target size is created.

The target size may be determined based on the following:

first, the target size may be determined based on the video to be protected. For example, the target size may be the size of a video frame in the video to be protected.

Second, the target size may be determined based on hardware information of the electronic device displaying the video to be protected. For example, the target size may be a screen resolution of a display screen of an electronic device for displaying the above-described document, or the like.

The image can be a pure color image, so that after lines are drawn on the pure color image, the line area and the non-line area in the image can be favorably distinguished subsequently. The embodiment of the present invention does not limit the specific color of the solid image. For example, the color of the solid image may be white, blue, etc.; the image may also be a non-solid image, such as a textured image, an image containing multiple colors, or the like.

Step S102: a target spacing is obtained that results in a dense distribution of lines.

The lines with the target intervals are drawn on the image, so that the lines distributed densely appear in the image, the densely distributed lines greatly increase the detail part in the obtained data protection pattern picture, the spatial frequency of the lines with the target intervals is easily greater than 1/2 of the sampling frequency of a sensor of the image acquisition equipment, and then the image acquisition equipment generates signal aliasing when shooting the lines, so that moire fringes appear in the shot image. Wherein 1/2 of the above sensor sampling frequency is also called nyquist frequency.

Specifically, the target interval determines the spatial frequency of the obtained data protection pattern, and the smaller the target interval, the higher the spatial frequency; conversely, the larger the target interval, the lower the spatial frequency. The line target interval of the moire appearing in the image shot by the image acquisition device can be 1 pixel value, can be 2 pixel values, and certainly can also be 3, 4 or 5 pixel values.

The manner of obtaining the above-described target interval is explained below.

In one embodiment, the target interval may be set based on a sensor sampling frequency of the image capturing device.

The sensor sampling frequency for setting the target interval can be determined in different ways, as will be explained separately below.

In one case, the image capturing devices used in the application scene may be counted to obtain the image capturing device with the largest number of used image capturing devices, and the sensor sampling frequency of the image capturing device may be determined as the sensor sampling frequency for setting the target interval.

In another case, the sensor sampling frequency of a specific image capturing device may be determined as the sensor sampling frequency for setting the target interval.

In another case, the sensor sampling frequency of the image capturing device used in the application scenario may be collected, and then the collected sensor sampling frequency may be subjected to statistical analysis, for example, calculating a mean value of the collected sensor sampling frequencies, obtaining a maximum value of the collected sensor sampling frequencies, and the like, so as to obtain a statistical result, and the statistical result may be used as the sensor sampling frequency for setting the target interval.

Specifically, the target interval may be determined based on the magnitude of the sensor sampling frequency through experiments in advance. Therefore, the target interval is determined based on the sampling frequency of the sensor of the image acquisition equipment, and the spatial frequency of the lines with the target interval can meet the condition that Moire fringes are generated when the image acquisition equipment shoots an image.

In another embodiment, the target interval may be set based on a screen resolution of the display device.

Because the video to be protected is displayed on the screen of the display device, when the image acquisition device acquires an image for the video to be protected, the image acquisition device actually shoots the screen of the display device. Therefore, the target interval can be intuitively determined based on the screen resolution of the display device. For example, different target intervals are set by the worker according to different screen resolutions, according to experience or through preset experiments.

Thus, according to the screen resolution of the display device, the target interval matched with the screen resolution can be intuitively determined.

In one embodiment of the present invention, the target interval may be a preset general interval. As can be seen from the foregoing description, the smaller the target spacing, the higher the spatial frequency of the resulting data protection pattern. Thus, a smaller target spacing may be set such that the spatial frequency of the resulting data protection pattern based on the target spacing is greater than the nyquist frequency of most image acquisition devices. For example, the general interval may be a small interval of 1 pixel, 2 pixels, or the like.

Step S103: and drawing a transverse line with a target interval and a longitudinal line with the target interval on the image to obtain a data protection pattern.

The color of the transverse lines and the longitudinal lines is not limited in the embodiments of the present invention, and for example, the color of the transverse lines and the longitudinal lines may be black, red, or the like. The color of the transverse lines may be the same as or different from the color of the longitudinal lines.

In one case, the colors of the transverse lines and the longitudinal lines may be colors that are clearly contrasted with the colors of the solid-color image. For example, when the image is a solid image, the line color may be a color that clearly contrasts with the image color; when the image is a non-solid image, the line color may be a color that clearly contrasts with a color represented by an average value of pixels of the image.

In addition, the embodiment of the present invention does not limit the image type of the generated data protection pattern.

In one case, the generated data protection pattern may be an image having a transparent channel, and for example, may be a PNG (Portable Network Graphics) Format image having a transparent channel, a GIF (Graphics Interchange Format) image having a transparent channel, or the like.

It can be seen that the data protection pattern obtained by drawing the horizontal lines with the target interval and the vertical lines with the target interval on the image is a static pattern.

It can be seen that in this step, a pattern with lines is generated on the basis of an image, the data protection pattern does not contain moire patterns visible to human eyes, but the detail parts in the obtained data protection pattern picture are increased by drawing dense transverse lines and longitudinal lines with target intervals on the image, that is, the spatial frequency of the image is increased, so that the image acquisition device generates moire patterns on the image which is easily obtained when the data protection pattern is shot.

In one case, the thickness of the transverse lines is the same as that of the longitudinal lines, so that the uniformity of the lines on the generated data protection pattern can be ensured, and the visual effect of the lines in the data protection pattern on human eyes can be favorably reduced.

In another embodiment, a data protection pattern with dynamic effect may be generated according to the horizontal lines of the target interval, the vertical lines of the target interval, and the image. The detailed description of the specific implementation manner is given in the following embodiment shown in fig. 2, and the detailed description is omitted here.

As can be seen from the above, when the scheme provided by the embodiment of the present invention is applied to generate a pattern, a data protection pattern is generated according to the horizontal lines of the target interval, the vertical lines of the target interval, and the created image, and since the target interval of the lines is an interval at which the lines are densely distributed, the lines in the data protection pattern obtained according to the lines of the target interval are densely distributed, a detailed portion in a picture is increased, the spatial frequency of the generated data protection pattern is improved, the data protection pattern can easily satisfy a condition that moire fringes are generated in the image when the image acquisition device captures the image, and then the moire appears in the image captured by the image acquisition device for the data protection pattern. The moire pattern can interfere the content in the image, and the difficulty of identifying the data in the image by human eyes or electronic equipment is increased, so that the data protection pattern for preventing the data from being leaked due to the fact that the data are shoplifted can be obtained.

On the basis of the embodiment shown in fig. 1, when the data protection pattern is generated according to the horizontal lines of the target interval, the vertical lines of the target interval and the created image, the data protection pattern with dynamic effect can be generated. In view of the above, the embodiment of the present invention provides a second data protection pattern generation method.

Referring to fig. 2, fig. 2 is a schematic flowchart of a second method for generating a data protection pattern according to an embodiment of the present invention, where the method includes the following steps S201 to S207.

Step S201: an image of a target size is created.

Step S202: a target spacing is obtained that results in a dense distribution of lines.

The steps S201 and S202 are the same as the steps S101 and S102 in the embodiment shown in fig. 1, and are not repeated here.

Step S203: and drawing a transverse line with a target interval and a longitudinal line with a target interval on the image to obtain an original pattern.

This step can be obtained on the basis of step S103 in the foregoing embodiment shown in fig. 1, and the difference is only that the data protection pattern is replaced by the original pattern, which is not described herein again.

Step S204: a first number of target regions is determined from the original pattern along a predetermined trajectory.

The preset trajectory may be a trajectory of any shape, for example, an arc trajectory, a circular trajectory, a straight trajectory, or the like.

The first number is any number greater than 1, and the embodiment of the present invention does not limit the specific value of the first number. For example, the first number may be 5, 10, 20, etc.

This facilitates a consistent determination of a first number of target regions from the original pattern along the predetermined trajectory.

Specifically, a second number of fixed vertices of the target area in the preset shape may be selected from the original pattern, and the other vertices of the target area are selected along the preset trajectory a first number of times with the selected fixed vertices as fixed points, so as to obtain a first number of target areas determined by the fixed vertices and the other vertices selected each time.

The predetermined shape may be any shape having a closed area, and for example, the predetermined shape may be a triangle, a quadrangle, or the like.

The second number may be any value not greater than the number of vertices of the preset shape. For example, the predetermined shape is a quadrilateral, and the second number may be 1, 2, or 3.

It will be appreciated that when other vertices are selected along the predetermined trajectory, the other vertices are selected differently each time, and thus the target area defined by the fixed vertex and the other selected vertices are different each time.

In one case, two fixed vertices at the upper left and lower right of the target area may be selected from the original pattern, the vertices at the lower left and upper right may be selected multiple times along the predetermined circular trajectory, and the area surrounded by the vertices at the lower left and upper right and the fixed vertices at the upper left and lower right selected each time may be determined as the target area.

The preset circular track corresponding to the lower left vertex can be a circular track which takes the preset fixed point as the center of a circle and the distance between the lower left vertex and the preset fixed point as the radius; the preset circular locus of the top right vertex is the same, and is not described herein again.

The following describes the above-mentioned manner in detail by taking the predetermined shape as a parallelogram as an example and by referring to fig. 3 and 4.

First, a process of first selecting a target area from an original pattern is described with reference to fig. 3.

Fig. 3 is a schematic diagram of a first target area selection process provided in an embodiment of the present invention, where a rectangle with longitudinal and transverse lines in fig. 3 represents an original pattern, the longitudinal and transverse lines are drawn in the pattern, a vertex a located at a lower left side and a vertex B located at an upper right side in the pattern are preset 2 fixed vertices, circles of dotted lines in the pattern are respectively a preset trajectory corresponding to the vertex at the upper left side and a preset trajectory corresponding to the vertex at the lower right side, and the vertex C1 and the vertex D1 located on the trajectories can be selected by performing first selection along the preset trajectories.

Thus, a target area is determined by the fixed vertexes a and B and the vertexes C1 and D1 selected on the preset trajectory, and the target area can be referred to as a target area ABC1D1.

The process of selecting the target area for the second time from the original pattern is illustrated by fig. 4.

Fig. 4 is a schematic diagram of a second target area selection process according to an embodiment of the present invention, where similarly, circles of dotted lines in fig. 4 are respectively a preset trajectory corresponding to an upper left vertex and a preset trajectory corresponding to a lower right vertex, and the second selection is performed along the preset trajectories, so that a vertex C2 and a vertex D2 on the trajectories can be selected.

Thus, a target area is determined by the fixed vertexes a and B and the vertexes C2 and D2 selected on the preset trajectory, and the target area can be called as a target area ABC2D2.

Similarly, on the basis of the above description, the third and fourth times of \8230 \8230and \823030arecarried out along the preset track, so that the Nth time of vertex selection can obtain N target areas determined by the fixed vertices and the vertices selected each time, and when N is the first number, the first number of target areas can be determined.

Thus, the vertex is selected along the preset track, and the adjacent target areas determined based on the selected vertex can be more coherent.

Therefore, different target areas can be determined continuously from the original pattern, different second images can be generated based on the different target areas, the dynamic data protection pattern generated based on the second image comprises a plurality of different patterns, and the included patterns have strong correlation front and back, so that Moire with various trends and shapes can be generated in the image obtained by the image acquisition equipment aiming at the dynamic data protection pattern.

Step S205: and carrying out perspective transformation on each target area to obtain a first number of first images with preset sizes.

The embodiment of the present invention does not limit the size of the preset dimension. In one case, a preset size may be set such that the area of the first image is smaller than the area of the target region, so that a black border may be prevented from appearing in the obtained first image after the target region is subjected to perspective transformation.

Specifically, perspective transformation such as affine transformation and projective transformation may be performed on each target region, and each target region may be transformed into a first image of a preset size, thereby obtaining a first number of first images.

After perspective transformation is performed on each target area, original lines of each target area may also be changed, and then different moire fringes can appear in images acquired by the image acquisition equipment for the target areas with different lines.

The difference in moir e in the first image obtained from different target areas will be specifically exemplified by referring to fig. 5 and 6.

Fig. 5 is a schematic diagram of a first image according to an embodiment of the present invention, where the first image shown in fig. 5 is obtained by performing perspective transformation on the target area ABC1D1 in fig. 3; fig. 6 is a schematic diagram of a second first image according to an embodiment of the present invention, where the first image shown in fig. 6 is obtained by performing perspective transformation on the target area ABC2D2 in fig. 4.

It should be noted that fig. 5 and 6 are schematic diagrams of the first image for easy understanding, and do not represent an actual first image obtained by subjecting the target region to perspective transformation.

Since the target region ABC1D1 is different from the target region ABC2D2, the lines in the first image obtained by perspective transformation of the target region are different.

Comparing the lines in the first image shown in fig. 5 and fig. 6, it can be seen that the longitudinal lines in fig. 5 are different in inclination degree from the longitudinal lines in fig. 6, and the transverse lines in fig. 5 are different in inclination degree from the transverse lines in fig. 6.

It will be appreciated that after a coherent target region is determined, a first image with a coherent change in line direction may be obtained based on the target region.

In an embodiment of the present invention, in the process of performing perspective transformation on the target region, the target region is deformed, specifically, the target region is randomly deformed, so that lines in the target region are randomly distorted and deformed, and therefore, for the first image obtained after transformation, intervals of adjacent lines at different positions may also be different, that is, intervals of adjacent lines in the first image at different positions are randomly changed.

Step S206: and carrying out scaling processing on each first image to obtain a second image with the target size.

Specifically, the ratio of the length of the target size to the length of the first image may be calculated as a scaling of the length of the first image; the ratio of the width of the target size to the width of the first image is calculated as the scaling of the width of the first image. And then, scaling the first image along the length direction and the width direction according to the corresponding scaling ratios respectively to obtain a second image with the target size.

Because the second image is obtained by scaling the first image, the line directions in the adjacent second images can be continuously changed, and thus, the image acquisition equipment can generate moire patterns with various trends and shapes in the image obtained by shooting the dynamic data protection pattern containing the second image, and a photographer can shoot the stably-appearing moire patterns at any angle or in any scene.

As can be seen from the foregoing embodiments, the intervals of the adjacent lines in the first image at different positions may be randomly changed, and therefore, in an embodiment of the present invention, the intervals of the adjacent lines in the second image of the target size scaled from the first image at different positions may be randomly changed.

Step S207: and generating a data protection pattern with a dynamic effect according to the determined sequence of the target areas corresponding to the second images.

The embodiment of the invention does not limit the pattern format of the data protection pattern with the dynamic effect.

In one case, the format of the dynamic data protection pattern may be an image including a transparent channel, for example, a PNG image having a transparent channel, a GIF image having a transparent channel, or the like.

Specifically, the data protection pattern having a dynamic effect and including the second images may be generated in the order of determination of the target areas corresponding to the second images.

As can be seen from the above, the data protection pattern generation scheme provided by the embodiment of the present invention can generate a data protection pattern with a dynamic effect, where the data protection pattern includes a second image that is determined consecutively, and lines in different second images may be different, so that a plurality of different moire patterns may appear in an image captured by an image capture device for the dynamic data protection pattern, and the protection effect of the data protection pattern on data to be protected is improved.

As can be seen from the foregoing embodiments, the line directions in the adjacent second images are continuously changed, and thus the data protection pattern generated based on the second images includes the line directions in the adjacent patterns which are continuously changed.

The image acquisition equipment can generate Moire with various trends and shapes in the image obtained by shooting the dynamic data protection pattern containing the second image, so that the image acquisition equipment is more favorable for shooting the Moire which stably appears when a photographer shoots the data protection pattern at any angle or scene.

As can be seen from the foregoing embodiments, the intervals of adjacent lines in the second image at different positions may be randomly changed, and therefore, in one embodiment of the present invention, the data protection pattern generated based on the second image includes patterns in which the intervals of adjacent lines at different positions may be randomly changed.

It can be seen that in the scheme provided by the above embodiment, the intervals between adjacent lines in the data protection pattern are changed, and even the intervals between adjacent lines at different positions are randomly changed, so that the characteristics of moire in a real scene can be more favorably simulated, and moire can be more realistically collected when the image collection device collects data of the data protection pattern.

The foregoing embodiment describes a method for generating a data protection pattern according to an embodiment of the present invention, and after the data protection pattern is generated by using the method, a video to be protected is processed based on the data protection pattern, so that privacy protection for the video to be protected can be achieved.

The following describes in detail the enhanced video privacy protection based on the Moore effect provided by the embodiments of the present invention with specific embodiments.

Referring to fig. 7, fig. 7 is a schematic flowchart of a first method for protecting video privacy based on moir e effect enhancement according to an embodiment of the present invention, where the method includes the following steps S701 to S703.

Step S701: and obtaining the video to be protected.

Step S702: a data protection pattern is obtained.

The data protection pattern is obtained according to an original pattern drawn with transverse lines and longitudinal lines, and the intervals between the transverse lines and the intervals between the longitudinal lines are intervals at which the transverse lines and the longitudinal lines are densely distributed.

The following is a description of the above-described intervals between the transverse lines and the intervals between the longitudinal lines.

In one case, the interval between the transverse lines and the interval between the longitudinal lines are set based on a sensor sampling frequency of the image pickup device. The specific implementation manner is shown in fig. 1 for details of the determination manner of the target interval in step S101, and is not described herein again. Therefore, the target interval is determined based on the sampling frequency of the sensor of the image acquisition equipment, and the spatial frequency of the lines with the target interval can meet the condition that Moire fringes are generated when the image acquisition equipment shoots an image.

In another case, the interval between the horizontal lines and the interval between the vertical lines are set based on the screen resolution of the display device. Detailed description of specific embodiments is given in the embodiment shown in fig. 1, and details of the determination method of the target interval in step S101 are omitted here. Thus, according to the screen resolution of the display device, the target interval matched with the screen resolution can be intuitively determined.

The specific manner of generating the data protection pattern is detailed in the embodiment shown in the data protection pattern generation method, and will not be detailed here.

As can be seen from the embodiment shown in the previous data protection pattern generation method, the data protection pattern may be a static pattern or a dynamic pattern.

Step S703: and processing the video to be protected based on the data protection pattern.

Specifically, the video to be protected may be processed in the following manner.

In one embodiment, a non-line area in the data protection pattern may be subjected to a transparentization process, and then the data protection pattern after the transparentization process is displayed as a mask on the uppermost layer, and a video to be protected is displayed on the next layer of the uppermost layer. The detailed description is given in the following embodiment shown in fig. 8, and will not be described in detail here.

In another embodiment, data fusion can be performed on the data protection pattern and the video to be protected, so as to obtain the video fused with the line region. The detailed description of the specific implementation manner is given in the following embodiment shown in fig. 10, and the detailed description is omitted here.

As can be seen from the above, when video protection is performed by applying the scheme provided by the embodiment of the present invention, a data protection pattern is obtained first, where the data protection pattern is obtained based on lines at target intervals, and the target intervals are lines at which the lines are densely distributed, so that the lines densely distributed in the data protection pattern easily satisfy a condition that moire occurs when an image acquisition device acquires an image, and then the image acquisition device easily obtains an image with moire after shooting the data protection pattern. And then, processing the video to be protected by adopting the data protection pattern, so that lines in the data protection pattern are displayed in the video to be protected, and the image with Moire patterns can be easily obtained after the image acquisition equipment shoots the video to be protected. Because the moire can interfere the content in the image, the difficulty of identifying data from the image by human eyes or electronic equipment is increased, the data is protected, the risk of data leakage caused by the fact that a provider of the video to be protected is shone by stealing when the video to be protected is displayed is reduced, and the safety of the video to be protected is improved.

In addition, when the data protection pattern is used for processing a video to be protected, the non-line area in the data protection pattern is subjected to transparent processing, so that the non-line area in the data protection pattern cannot be displayed in the video to be protected, only lines can be displayed in the video to be protected, and the video to be protected can still be directly identified by human eyes.

In an embodiment of the present invention, step S703 in the embodiment shown in fig. 7 can be implemented by the following steps a to C.

Step A: and determining the data protection strength of the video to be protected.

The data protection level may be set by a provider of the video to be protected.

And B: and determining the transparency of the lines in the data protection pattern based on the data protection strength.

When the transparency of the lines in the data protection pattern is changed, and when the image acquisition device shoots the pattern, the texture strength of the moire pattern in the shot image is changed along with the change of the transparency of the lines, so that the recognition interference strength of the moire pattern on the content in the pattern is changed, namely the data protection capability of the pattern is changed.

Specifically, the higher the line transparency is, the stronger the identification interference intensity of the moire fringes is, and the higher the data protection capability of the pattern is; conversely, the lower the line transparency is, the weaker the recognition interference strength of the moire pattern is, and the weaker the data protection capability of the pattern is.

On the other hand, for human eyes, when the transparency of the line in the data protection pattern changes, after the video to be protected is processed based on the data protection pattern, the transmission degrees of the regions corresponding to the line regions in the video to be protected are different, that is, the viewing experience of human eyes is different.

In some cases, the provider of the video to be protected may not need the highest data protection level, but needs a better viewing experience, so that the provider of the video to be protected can properly turn down the data protection level, and obtain a better data viewing experience while considering data protection.

Based on the understanding, the line transparency determined in this step may be inversely proportional to the data protection degree, and the higher the data protection degree is, the lower the line transparency may be set, so that the stronger the identification interference strength of the moire fringes is, thereby improving the data protection degree; the lower the data protection strength is, the higher the line transparency can be set, so that the recognition interference strength of the moire is weaker, and the data protection strength is reduced.

For example, when the data protection strength is 100%, the line transparency may be 0%, that is, the line is completely opaque, in which case the data protection capability of the data protection pattern is strongest; when the data protection strength is 30%, the line transparency may be 70%, that is, the line is relatively transparent, in which case the data protection capability of the data protection pattern is relatively weak, and the like.

Of course, the above examples are only provided for ease of understanding, and the embodiments of the present invention do not limit the way of determining the specific line transparency based on the data protection strength.

And C: and processing the video to be protected based on the determined transparency and the data protection pattern.

In one embodiment, this step C can be achieved by the following step C1.

Step C1: and taking the data protection pattern after the transparentization processing as a mask, setting the transparency of the mask based on the determined transparency, displaying the mask on the uppermost layer, and displaying the video to be protected on the next layer of the uppermost layer. The specific implementation of step C1 is detailed in the following examples in fig. 8, and will not be detailed here.

In another embodiment, the step C can be implemented by the following step C2:

and C2: and determining a target weight based on the determined transparency, and performing weighted fusion on the video to be protected and the data protection pattern based on the target weight to obtain the video fused with the line region. The detailed implementation of step C2 is described in the following examples in fig. 10, and will not be described in detail here.

Therefore, the transparency of the lines in the data protection pattern can be adjusted according to the data protection strength, namely, the recognition interference strength of the moire fringes generated in the image obtained by shooting the data protection pattern by the image acquisition equipment is adjusted, therefore, the video to be protected is processed based on the data protection pattern after the transparency of the lines is adjusted, the recognition interference strength of the moire fringes in the image obtained by shooting the video to be protected by the image acquisition equipment can be adjusted, the difficulty of recognizing data by human eyes or the image acquisition equipment is further changed, namely, the data protection strength of the video to be protected is adjusted, and the processing of the video to be protected can be suitable for various data protection strengths.

In an embodiment of the present invention, when processing a video to be protected based on the determined transparency and the data protection pattern, a non-line region in the data protection pattern may be subjected to transparency processing first, and then the video to be protected may be processed based on the determined transparency and the data protection pattern after the transparency processing.

Therefore, the processed video can not contain the non-line area of the data protection pattern, the shielding of the non-line area on the video content is avoided, and the watching experience of a video viewer is improved.

On the basis of the embodiment shown in fig. 7, when processing a video to be protected, the data protection pattern after the transparentization processing may be displayed as a mask in the top layer, and the video to be protected is displayed in the next layer of the top layer. In view of the above, the embodiments of the present invention provide a second method for protecting privacy of video based on molar effect enhancement.

Referring to fig. 8, fig. 8 is a schematic flowchart of a second method for protecting video privacy based on moir e effect enhancement according to an embodiment of the present invention, where the method includes the following steps S801 to S804.

Step S801: and obtaining the video to be protected.

Step S802: a data protection pattern is obtained.

The steps S801 to S802 are the same as the steps S701 to S702 in the embodiment shown in fig. 7, and are not repeated here.

Step S803: and carrying out transparentization treatment on the non-line area in the data protection pattern.

Specifically, as can be seen from the foregoing embodiment of the data protection pattern generation method, the data protection pattern may be an image containing a transparent channel, and therefore, the bit value of the transparent channel of the pixel point of the non-line region in the data protection pattern may be set to change the non-line region into a transparent state.

Step S804: and obtaining a mask based on the data protection pattern after the transparentization treatment, displaying the mask on the uppermost layer, and displaying the video to be protected on the next layer of the uppermost layer.

Specifically, the implementation of this step can be divided into the following two cases:

in a first case, the data protection pattern is a sheet pattern. In this case, the data protection pattern after the transparentization process may be used as a mask, the mask may be displayed in the uppermost layer, and the video to be protected may be displayed in the next layer of the mask.

Because the non-line area in the mask is transparent, after the processing, the display screen of the electronic device for displaying the video to be protected comprises two types of areas: the line area in the mask and the area of the video to be protected corresponding to the non-line area in the mask.

And for the image acquisition equipment, when the image acquisition equipment shoots images on a video to be protected, the acquisition window of the image acquisition equipment also comprises the two types of areas, and because the line areas are dense lines with target intervals, the image acquisition equipment can generate signal aliasing, so that the shot images contain Moire patterns.

In a second case, as can be seen from the foregoing embodiments shown in fig. 1 and fig. 2, the data protection pattern may include a plurality of patterns, each pattern being obtained according to an original pattern, and the line content of each pattern being different.

In this case, masks may be obtained based on the respective patterns after the transparentization processing in the data protection pattern, the patterns serving as the masks are cyclically displayed in the top layer according to the preset mask display frequency, and the video to be protected is displayed in the next layer of the top layer.

The embodiment of the present invention does not limit the specific value of the preset mask display frequency.

In one case, a higher mask display frequency may be set to reduce the visual impact of the mask on the human eye. For example, the mask display frequency may be 25 frames/second, 30 frames/second, or the like.

It can be understood that, because the pattern as the mask is displayed circularly, contains a plurality of different patterns, and thus displays the dynamic mask on the top layer of the video to be protected, when the image acquisition equipment shoots the image aiming at the processed video to be protected, the shot image may contain a plurality of different and more vivid moire images, and the image of the moire that appears can be shot by the shooter at any angle, thereby improving the data protection effect.

In one embodiment of the present invention, the data protection pattern may include adjacent patterns in which the direction of lines may vary consecutively.

Therefore, when the image acquisition equipment shoots the video to be protected processed by the data protection pattern, the Moire patterns with various trends and shapes can be generated in the shot image, so that the probability of the Moire patterns appearing in the shot image is increased when a photographer shoots the video to be protected at any angle or scene, and the protectiveness of the video to be protected is increased.

In one embodiment of the invention, the data protection pattern may comprise a pattern in which the spacing at different positions of adjacent lines may vary randomly.

It can be seen that in the scheme provided by the above embodiment, the intervals between adjacent lines in the data protection pattern are changed, and even the intervals between adjacent lines at different positions are randomly changed, which is more favorable for simulating the characteristics of moire in a real scene, so that when the image acquisition device shoots a video to be protected after the data protection pattern is processed, more vivid moire can appear in the shot image, and the protectiveness of the video to be protected is enhanced.

In another embodiment of the present invention, the data protection pattern may have the characteristics for the line direction and the line interval mentioned in the above two embodiments.

In the effect testing stage, after the dynamic mask is displayed on the upper layer of the video to be protected by adopting the embodiment, the image is shot by using the image acquisition equipment aiming at the video to be protected, and text recognition is carried out on characters in the shot image.

It can be seen from the above that, a mask is obtained based on a data protection pattern after transparentization processing, the mask is displayed on the uppermost layer, and a to-be-protected video is displayed on the next layer of the uppermost layer, so that the mask is displayed on the upper layer of the to-be-protected video, and when the to-be-protected video is shot by an image acquisition device, a shooting window of the image acquisition device can include a line region in the mask and a region where the to-be-protected video corresponds to a non-line region in the mask. Because the moire can interfere the content in the image, the difficulty of identifying data from the image by human eyes or electronic equipment is increased, the data is protected, the risk of data leakage caused by the fact that a provider of the video to be protected is shone by stealing when the video to be protected is displayed is reduced, and the safety of the video to be protected is improved.

In addition, the above embodiment does not depend on the presentation form of the video to be protected, and the mask is directly created on the upper layer image layer of the video to be protected, so that the mask can cover any form of video to be protected, and the universality of the video privacy protection method based on the mole effect enhancement provided by the embodiment of the invention is expanded.

As can be seen from the foregoing embodiment, the foregoing step C can be implemented by a step C1, and the foregoing step C1 is specifically described as follows:

step C1: and taking the data protection pattern after the transparentization processing as a mask, setting the transparency of the mask based on the determined transparency, displaying the mask on the uppermost layer, and displaying the video to be protected on the next layer of the uppermost layer.

Since the non-line region in the data protection pattern after the transparentization process is already transparent, the setting of the transparency of the mask refers to setting the transparency of the line region in the mask.

Therefore, the mask with the adjusted transparency is displayed on the upper layer of the video to be protected, namely the transparency of the line area of the data protection pattern in the video to be protected is changed.

In one case, a slider may be added to the mask to control the transparency of the mask. For example, the adjustable range of the slider for transparency may be 0% -100%, and the initial transparency may be set to 0%, i.e. the mask is opaque. Therefore, the user can conveniently and fast control the transparency of the mask by sliding, and the data protection strength required by the user can be conveniently adjusted.

In an embodiment of the present invention, step S801 in the basis of the above-mentioned embodiment shown in fig. 8 can be implemented by the following step F, and step S804 can be implemented by the following step G.

Step F: and obtaining the video to be protected to be displayed in the target window.

The target window may be any application window on the display screen for displaying the video to be protected, for example, various communication program windows, video program windows, a browser window, and other application program windows.

In this case, the obtained size of the video to be protected is actually the size of the target window.

G: and obtaining a mask based on the data protection pattern after the transparentization treatment, displaying the mask on the uppermost layer of the target window, and displaying the video to be protected on the next layer of the uppermost layer of the target window.

Therefore, for the video to be protected displayed in the target window, the mask is displayed on the uppermost layer of the target window, and the video to be protected is displayed on the next layer of the uppermost layer of the target window, so that when the video to be protected displayed in the target window is shot by the image acquisition equipment, the shooting window of the video to be protected can contain lines in the mask corresponding to the target window area, and therefore moire fringes can be easily generated in the area where the target window is located in the shot image.

In an embodiment of the present invention, a "protection enable" button and a "protection close" button may be added to the mask, and are respectively used to display the mask to an upper layer of the video to be protected, which is displayed on the video to be protected, and to remove the mask in the upper layer of the target pattern. This can enable the user to freely control whether to open data protection for the video to be protected.

Based on the embodiment shown in fig. 8, after obtaining the mask based on the data protection pattern, in some cases, the video to be protected may be processed according to the first data protection area in the mask selected by the user. In view of the above, the embodiments of the present invention provide a third method for protecting video privacy based on moir effect enhancement.

Referring to fig. 9, fig. 9 is a schematic flowchart of a third method for protecting video privacy based on moir effect enhancement according to an embodiment of the present invention, where the method includes the following steps S901 to S906.

Step S901: and obtaining the video to be protected.

Step S902: a data protection pattern is obtained.

Step S903: and carrying out transparency processing on the non-line area in the data protection pattern.

The above steps S901 to S903 are the same as the steps S801 to S803 in the embodiment shown in fig. 8, and are not repeated here.

Step S904: and obtaining a mask based on the data protection pattern after the transparentization treatment, and displaying the mask on the uppermost layer.

The implementation of this step has already been described in the foregoing step S804, and is not described here again.

Step S905: a first data protection area selected by a user on a mask is obtained.

The first data protection area is an area which is selected by a user according to needs.

Step S906: and performing transparentization processing on the line area in the area outside the first data protection area in the mask, and displaying the video to be protected on the next layer of the topmost layer.

Specifically, as can be seen from the foregoing embodiment, the data protection pattern may be an image including a transparent channel, and therefore, the bit value of the transparent channel of the pixel point of the line region in the region other than the first data protection region of the mask may be set to change the non-line region into a transparent state.

It can be seen from the above that, a mask is obtained based on a data protection pattern after transparentization, after the mask is displayed on the uppermost layer, the strip area in the area outside the first data protection area in the mask is subjected to transparentization, so that the strip area in the area outside the first data protection area in the mask is transparent, and thus, a video to be protected is displayed on the next layer of the uppermost layer, so that when the video to be protected is shot by an image acquisition device, the acquisition window of the video to be protected can include the strip area of the first data protection area in the mask, and the area outside the first data protection area in the window is the original area of the video to be protected. The dense lines easily cause the image acquisition equipment to generate signal aliasing, so that the first data protection area in the shot image easily generates moire lines, and the moire lines can interfere the identification of the content in the first data protection area, so that the data corresponding to the first data protection area in the video to be protected is pertinently protected.

In addition, the user can determine the first data protection area in real time for multiple times, so that the data corresponding to the first data protection area in the video to be protected can be protected continuously and pertinently according to the first data protection area determined by the user each time, and the controllability of the user for the data protection area is improved.

On the basis of the embodiment shown in fig. 7, when a video to be protected is processed, data fusion can be performed on the data protection pattern and the video to be protected, so as to obtain a video fused with a line region. In view of the above, the embodiments of the present invention provide a fourth method for protecting video privacy based on moir effect enhancement.

Referring to fig. 10, fig. 10 is a schematic flowchart of a fourth method for enhancing video privacy protection based on moir effect according to an embodiment of the present invention, where the method includes the following steps S1001 to S1003.

Step S1001: and obtaining the video to be protected.

Step S1002: a data protection pattern is obtained.

The steps S1001 to S1002 are the same as the steps S701 to S702 in the embodiment shown in fig. 7, and are not repeated here.

Step S1003: and carrying out data fusion on the data protection pattern and the video to be protected to obtain the video fused with the line region.

Specifically, data fusion may be performed in the following manner.

In one embodiment, the non-line region in the data protection pattern may be subjected to transparency processing, and then the data protection pattern subjected to transparency processing and the video to be protected may be subjected to data fusion. In this case, the non-line region in the data protection pattern is transparent, and the line region is normally displayed, so that the video fused with the line region can be obtained by fusing the data protection pattern and the video to be protected.

The following describes a method for performing data fusion on a data protection pattern after transparentization processing and a video to be protected by taking two ways as examples.

In the first mode, each video frame of the video to be protected can be determined, a target area corresponding to a line area in the data protection pattern in each video frame is determined, and then the pixel value of each pixel point in the target area is correspondingly set as the pixel value of each pixel point in the line area, so that the video fused with the line area is obtained.

Therefore, the line area in the data protection pattern can cover each video frame of the video to be protected, so that when the image acquisition equipment shoots an image aiming at the video to be protected, the line area can be shot, and the shot image containing moire fringes can be shot.

In the second mode, when the data protection pattern is a binary pattern, the video frames of the video to be protected and the data protection pattern can be fused in a pixel value and calculation mode to obtain the video fused with the line region.

For example, if the pixel value of the line region in the data protection pattern is 1, the pixel value of each pixel point in the data protection pattern and the pixel value of each pixel point in the video frame may be subjected to and calculation, and based on the calculated result, the video in which the line region is fused is obtained; if the pixel value of the line region in the data protection pattern is 0, the pixel value of each pixel point in the data protection pattern can be inverted and then subjected to and calculation with the pixel value of each pixel point in the video frame, and based on the calculated result, the video fused with the line region is obtained.

It should be noted that, in the above-mentioned pixel value and calculation process, it is necessary to exclude the pixel value of the pixel point in the background area after the transparentization process in the data protection pattern.

This also enables the line areas in the data protection pattern to be displayed in the video to be protected.

In another embodiment, a weight of a non-line region in the data protection pattern may be set to 0, a weight of a first region of each video frame corresponding to the non-line region is set to 100%, and the non-line region and the first region of each video frame are subjected to weighted fusion; and then correspondingly setting the target area of each video frame as the pixel value of the line area in the data protection pattern to obtain the video fused with the line area.

In this case, since the weight of the non-line region in the data protection pattern is 0, after the fusion is completed, the non-line region in the data protection pattern is not displayed in each video frame, and the line region in the data protection pattern can be normally displayed in each video frame, so that a video with the line region fused therein can be obtained.

In another implementation, as can be seen from the foregoing embodiments shown in fig. 1 and fig. 2, the data protection pattern may be a dynamic pattern, which includes a plurality of patterns, each pattern is obtained according to an original pattern, and the line content of each pattern is different.

In this case, the target pattern may be selected from patterns in the data protection pattern, and the target pattern and the video to be protected are subjected to data fusion to obtain the video fused with the line region.

Specifically, each frame pattern in the data protection pattern may be captured, and each captured pattern may be fused with each video frame in the video to be protected, so as to obtain the video with the line region. The specific way of fusing the single pattern and the video to be protected has been described in the first two embodiments, and is not described herein again.

Because different target patterns have different lines, different target patterns are used for fusing each image in the video to be protected, and the video with different lines can be obtained after fusion, so that when the image acquisition equipment shoots the image aiming at the fused video, the shot image can obtain various different Moire images, and the data protection aiming at each image in the video to be protected is realized.

As can be seen from the above, after data fusion is performed on the data protection pattern subjected to the transparentization processing and the video to be protected, a line region in the data protection pattern can be displayed in the video to be protected, because the line region is dense lines with target intervals, signal aliasing is easily generated in the image acquisition device, so that when the video is shot by the image acquisition device, moire fringes are generated in the shot image, and interference can be brought to the content in the image due to the moire fringes, the difficulty of identifying data from the image by human eyes or electronic equipment is increased, so that the data is protected, the risk of data leakage caused by the fact that a provider of the video to be protected is stolen when the video to be protected is displayed is reduced, and the safety of the data is improved.

As can be seen from the foregoing embodiment, the foregoing step C can be implemented by a step C2, and the foregoing step C2 is explained as follows:

and step C2: and determining a target weight value based on the determined transparency, and performing weighted fusion on the data protection pattern and the video to be protected based on the target weight value to obtain the video fused with the line region.

The target weights may include a first weight applied to the video to be protected and a second weight applied to the data protection pattern.

Specifically, the first weight may be the same as the determined transparency, and the second weight may be a difference between 1 and the transparency.

For example, the determined transparency is 60%, the first weight may be 0.6, and the second weight may be 1-0.6=0.4.

After the weight is determined, weighting calculation can be performed on pixel values of corresponding pixel points in each video frame and the data protection pattern in the video to be protected according to the weight, and a new video frame can be generated based on the pixel values of the pixel points after calculation, so that the video fused with the line region is obtained.

Based on the embodiment shown in fig. 10, in some cases, it may be necessary to perform targeted data protection only on certain areas in the video to be protected. In view of the foregoing, embodiments of the present invention provide a fifth method for protecting privacy of video based on moir e effect enhancement.

Referring to fig. 11, fig. 11 is a schematic flowchart of a fifth method for protecting video privacy based on moir e effect enhancement according to an embodiment of the present invention, where the method includes the following steps S1101-S1105.

Step S1101: and obtaining the video to be protected.

Step S1102: a data protection pattern is obtained.

Step S1103: and determining a second data protection area of the video to be protected.

The second data protection area may be determined by a user as needed.

Step S1104: a third data protection region corresponding to the location of the second data protection region is determined in the data protection pattern.

In one embodiment, since the data protection pattern has the same size as the video to be protected, the third data protection area may be determined by the pixel coordinates of the corner point of the second data protection area.

For example, the second data protection area is a rectangle, target points located at the coordinates of the four corner points may be determined from the data protection pattern, and an area surrounded by the target points is the third data protection area.

Step S1105: and fusing the third data protection area to a second data protection area in the video to be protected to obtain the video with the second data protection area fused with the line area.

Specifically, data fusion may be performed in the following manner.

In one embodiment, the non-line region in the data protection pattern may be subjected to transparency processing, and then the third data protection region may be fused to the second data protection region in the video to be protected. In this case, the non-line region in the third data protection region is transparent, and the line region is normally displayed, so that after the third data protection region is fused to the second data protection region in the video to be protected, the second data protection region can be provided with the line region.

The following two ways are taken as examples to describe a method for fusing the third data protection region to the second data protection region in the video to be protected after the transparentization processing.

In the first way, it may be determined that each video frame of the video to be protected corresponds to the target data protection area of the second data protection area, and then the pixel values of each pixel point in the target data protection area of the video frame are correspondingly set as the pixel values of each pixel point in the third data protection area of the data protection pattern, so as to obtain the video of the merged linear area.

In the second mode, when the data protection pattern is a binary pattern, the video to be protected and the data protection pattern can be fused in a pixel value and calculation mode to obtain the video fused with the line region. The following is divided into two cases for illustration:

in the first case, if the pixel value of the line region in the data protection pattern is 1, the pixel value of each pixel point in the target data protection region of the video frame and the pixel value of each pixel point in the third data protection region in the data protection pattern may be summed, and the pixel value of the pixel point in the region outside the second data protection region in the video to be protected is unchanged, so that the video with the line region fused therein may be obtained.

In the second case, if the pixel value of the line region in the data protection pattern is 0, the pixel value of each pixel point in the target data protection region of the video frame may be inverted from the pixel value of each pixel point in the third data protection region in the data protection pattern, and then the pixel value of the pixel point in the region outside the target data protection region is unchanged, so that the video fused with the line region may be obtained.

In another embodiment, the weight of the non-line region in the third data protection region may be set to 0, the weight of the second region corresponding to the non-line region in the target data protection region of each video frame may be set to 100%, and the non-line region and the second region of each video frame may be subjected to weighted fusion; then, the other regions in the target data protection region of each video frame are correspondingly set as the pixel values of the line region in the third data protection region.

In this case, since the weight of the non-line region in the third data protection region is 0, after the fusion is completed, the non-line region in the third data protection region is not displayed in the target data protection region, and the line region in the third data protection region can be normally displayed in the target data protection region, and since the target data protection region of each video frame corresponds to the second data protection region of the video to be protected, the video in which the line region is fused in the second data protection region is obtained.

As can be seen from the above, after the third data protection region in the data protection pattern is fused to the second data protection region in the video to be protected, only the second data protection region in the fused video has a line region, and other regions outside the second data protection region do not include the line region, so that when the fused video is shot by the image acquisition device, the acquisition window of the fused video includes dense lines of the second data protection region in the data, thereby easily generating moire in the region corresponding to the second data protection region in the shot image, while the other regions are not affected, and since the moire interferes with the identification of the content in the image, the data of the second data protection region in the video to be protected is pertinently protected.

Corresponding to the above data protection pattern generation method, the embodiment of the present disclosure provides a data protection pattern generation apparatus.

Referring to fig. 12, fig. 12 is a schematic structural diagram of a data protection pattern generating apparatus according to an embodiment of the present invention, where the apparatus includes the following modules 1201 to 1203.

An image creation module 1201 for creating an image of a target size;

a target interval obtaining module 1202, configured to obtain a target interval at which lines are densely distributed;

a data protection pattern generating module 1203, configured to draw, on the image, a transverse line with the target interval and a longitudinal line with the target interval, so as to obtain a data protection pattern.

As can be seen from the above, when the scheme provided by the embodiment of the present invention is applied to generate the pattern, the data protection pattern is generated according to the horizontal lines of the target interval, the vertical lines of the target interval, and the created image, and because the target interval of the lines is an interval at which the lines are densely distributed, the lines in the data protection pattern obtained according to the lines of the target interval are densely distributed, so that the detailed parts in the picture are increased, the spatial frequency of the generated data protection pattern is improved, the data protection pattern can easily meet the condition that the image acquisition device generates moire fringes when shooting the image, and further, the image acquisition device can easily generate moire fringes in the image obtained by shooting the data protection pattern. Because the moire fringes can interfere the content in the image, the difficulty of identifying the data in the image by human eyes or electronic equipment is increased, and thus, a data protection pattern for preventing the data from being leaked due to the fact that the data is stolen can be obtained.

In an embodiment of the present invention, the data protection pattern generating module 1203 includes:

an original pattern obtaining submodule, configured to draw, on the image, a transverse line with the target interval and a longitudinal line with the target interval, so as to obtain an original pattern;

the target area determining submodule is used for determining a first number of target areas from the original pattern along a preset track;

the first image obtaining submodule is used for carrying out perspective transformation on each target area to obtain a first number of first images with preset sizes;

the second image obtaining submodule is used for carrying out scaling processing on each first image to obtain a second image with the target size;

and the data protection pattern generation submodule is used for generating a data protection pattern with a dynamic effect according to the determined sequence of the target areas corresponding to the second images.

As can be seen from the above, the data protection pattern generation scheme provided by the embodiment of the present invention can generate a data protection pattern with a dynamic effect, where the data protection pattern includes multiple frames of different second images, and lines in different second images may be different, so that multiple different moire patterns may appear in an image captured by an image capture device for the dynamic data protection pattern, and the protection effect of the data protection pattern on data to be protected is improved.

In an embodiment of the present invention, the target area determining submodule is specifically configured to select a second number of fixed vertices of a target area in a preset shape from the original pattern; and selecting other vertexes of the target area along a preset track for a first number of times by taking the selected fixed vertex as a fixed point to obtain a first number of target areas determined by the fixed vertex and the other vertexes selected each time.

Therefore, different target areas can be determined continuously from the original pattern, and different second images can be generated based on the different target areas, so that the dynamic data protection pattern generated based on the second image comprises a plurality of different patterns, and the front and the back of each pattern have strong relevance, which is beneficial to the fact that Moire with various trends and shapes can be generated in the image obtained by the image acquisition equipment aiming at the dynamic data protection pattern.

Corresponding to the above method for protecting video privacy based on molar effect enhancement, the embodiment of the present disclosure provides a device for protecting video privacy based on molar effect enhancement.

Referring to fig. 13, fig. 13 is a schematic structural diagram of a video privacy protection apparatus based on moir e effect enhancement according to an embodiment of the present invention, where the apparatus includes the following modules 1301-1303.

A to-be-protected video obtaining module 1301, configured to obtain a to-be-protected video;

a data protection pattern obtaining module 1302, configured to obtain a data protection pattern, where the data protection pattern is obtained according to an original pattern drawn with horizontal lines and longitudinal lines, and intervals between the horizontal lines and intervals between the longitudinal lines are intervals at which the horizontal lines and the longitudinal lines are densely distributed;

and the to-be-protected video processing module 1303 is configured to process the to-be-protected video based on the data protection pattern.

As can be seen from the above, when video protection is performed by applying the scheme provided by the embodiment of the present invention, a data protection pattern is obtained first, where the data protection pattern is obtained based on lines at target intervals, and the target intervals are lines at which the lines are densely distributed, so that the lines densely distributed in the data protection pattern easily satisfy a condition that moire occurs when an image acquisition device acquires an image, and then the image acquisition device easily obtains an image with moire after shooting the data protection pattern. And then, processing the video to be protected by adopting the data protection pattern, so that lines in the data protection pattern are displayed in the video to be protected, and the image acquisition equipment can easily obtain an image with Moire patterns after shooting the video to be protected. Because the moire can interfere the content in the image, the difficulty of identifying data from the image by human eyes or electronic equipment is increased, the data is protected, the risk of data leakage caused by the fact that a provider of the video to be protected is shone by stealing when the video to be protected is displayed is reduced, and the safety of the data is improved.

In conclusion, by applying the scheme provided by the embodiment of the invention to perform video protection, the video processing to be protected can be protected without affecting the situation that human eyes directly identify the video processing to be protected, and the safety of the video processing to be protected is improved.

In one embodiment of the invention, the target interval is set based on a sensor sampling frequency of the image acquisition device;

therefore, the target interval is determined based on the sampling frequency of the sensor of the image acquisition equipment, and the spatial frequency of the lines with the target interval can meet the condition that Moire fringes are generated when the image acquisition equipment shoots an image.

Or

The target interval is set based on a screen resolution of the display device.

Thus, based on the screen resolution of the electronic device, the target interval matched with the screen resolution can be intuitively determined.

In an embodiment of the present invention, the to-be-protected video processing module 1303 includes:

the first processing submodule is used for performing transparency processing on a non-line area in the data protection pattern, obtaining a mask based on the data protection pattern after the transparency processing, displaying the mask on the topmost layer, and displaying the video to be protected on the next layer of the topmost layer;

it can be seen from the above that, a mask is obtained based on a data protection pattern after transparentization processing, the mask is displayed on the uppermost layer, and a to-be-protected video is displayed on the next layer of the uppermost layer, so that the mask is displayed on the upper layer of the to-be-protected video, and when the to-be-protected video is shot by an image acquisition device, a shooting window of the to-be-protected video can include a line region in the mask and a region of the to-be-protected video, which corresponds to a non-line region in the mask. Because the moire can interfere the content in the image, the difficulty of identifying data from the image by human eyes or electronic equipment is increased, the data is protected, the risk of data leakage caused by the fact that a provider of the video to be protected is shone by stealing when the video to be protected is displayed is reduced, and the safety of the data is improved.

Or

And the second processing submodule is used for carrying out data fusion on the data protection pattern and the video to be protected to obtain the video fused with the line area.

As can be seen from the above, after data fusion is performed on the data protection pattern subjected to the transparentization processing and the video to be protected, a line region in the data protection pattern can be displayed in the video to be protected, because the line region is dense lines with target intervals, signal aliasing is easily generated in the image acquisition device, and therefore when the video to be protected is shot by the image acquisition device, moire fringes are generated in the shot image.

In an embodiment of the present invention, the data protection pattern includes a plurality of patterns, each pattern is obtained according to the original pattern, and line contents of each pattern are different;

the first processing sub-module is specifically configured to perform transparency processing on a non-line region in the data protection pattern, obtain masks based on the transparentized patterns in the data protection pattern, and cyclically display the patterns serving as the masks in the uppermost layer according to a preset mask display frequency;

like this with dynamic mask display in the top map layer of treating the protection video, can make image acquisition equipment when treating the protection video shooting image after handling, probably contain multiple difference, more lifelike moire image in the image of shooing, and be favorable to making the shooter can both shoot the image of the moire that appears at arbitrary angle, improved data protection effect.

Or

The second processing submodule is specifically configured to select a target pattern from each pattern in the data protection pattern, and perform data fusion on the target pattern and the video to be protected to obtain a video fused with a line region.

Because different target patterns have different lines, different target patterns are used for fusing each image in the video to be protected, and images with different lines can be obtained after fusion, so that when the image acquisition equipment shoots the images according to the fused images, the shot images can obtain various different Moire images, and the data protection of each image in the video to be protected is realized.

In an embodiment of the present invention, the data protection pattern includes consecutive variation of line directions in each pattern; and/or

The data protection pattern comprises a pattern in which the spacing at different positions of adjacent lines varies randomly.

Therefore, when the image acquisition equipment shoots the video to be protected processed by the data protection pattern, the Moire patterns with various trends and shapes can be generated in the shot image, so that the probability of the Moire patterns appearing in the shot image is increased when a photographer shoots the video to be protected at any angle or scene, and the protectiveness of the video to be protected is increased. In addition, the intervals between adjacent lines in the data protection pattern are changed, even the intervals between the adjacent lines at different positions are changed randomly, so that the characteristics of moire in a real scene can be more favorably simulated, and when the image acquisition equipment shoots a video to be protected after the data protection pattern is processed, more vivid moire can appear in the shot image, so that the protectiveness of the video to be protected is enhanced.

In an embodiment of the present invention, the to-be-protected video obtaining module 1301 is specifically configured to obtain a to-be-protected video to be displayed in a target window;

the first processing sub-module is specifically configured to display the mask on a top layer of the target window, and display the video to be protected on a next layer of the top layer of the target window.

Therefore, the mask is displayed on the topmost layer of the target window aiming at the video to be protected displayed on the target window, and the video to be protected is displayed on the next layer of the topmost layer of the target window, so that when the video to be protected displayed on the target window is shot by the image acquisition equipment, the shooting window of the video to be protected comprises lines in the mask corresponding to the target window area, and therefore moire fringes are easily generated in the area where the target window is located in the shot image.

In an embodiment of the present invention, after the first processing sub-module, the method further includes:

the first data protection area obtaining module is used for obtaining a first data protection area selected by a user on the mask;

and the first transparentizing processing module is used for performing transparentizing processing on the line area in the area outside the first data protection area in the mask.

Therefore, when the video to be protected is shot by the image acquisition equipment, the acquisition window of the video to be protected can include the line area of the first data protection area in the mask, and the area outside the first data protection area in the window is the original area of the video to be protected. The dense lines easily cause the image acquisition equipment to generate signal aliasing, so that the first data protection area in the shot image easily generates moire lines, and the moire lines can interfere the identification of the content in the first data protection area, so that the data corresponding to the first data protection area in the video to be protected is pertinently protected.

In an embodiment of the present invention, the second processing sub-module is specifically configured to determine a second data protection area of the video to be protected; determining a third data protection area corresponding to the position of the second data protection area in the data protection pattern; and fusing the third data protection region to the second data protection region in the video to be protected to obtain the video with the second data protection region fused with the line region.

In an embodiment of the present invention, the to-be-protected video processing module is specifically configured to determine a data protection level of the to-be-protected video; determining the transparency of lines in the data protection pattern based on the data protection strength; processing the video to be protected based on the determined transparency and the data protection pattern.

Therefore, the transparency of the lines in the data protection pattern can be adjusted according to the data protection strength, namely, the recognition interference strength of the moire fringes generated in the image obtained by shooting the data protection pattern by the image acquisition equipment is adjusted, therefore, the video to be protected is processed based on the data protection pattern after the transparency of the lines is adjusted, the recognition interference strength of the moire fringes in the image obtained by shooting the video to be protected by the image acquisition equipment can be adjusted, the difficulty of recognizing data by human eyes or the image acquisition equipment is further adjusted, namely, the data protection strength of the video to be protected is adjusted, and the processing of the video to be protected can be adapted to various data protection strengths.

The embodiment of the present invention further provides an electronic device, as shown in fig. 14, which includes a processor 1401, a communication interface 1402, a memory 1403, and a communication bus 1404, wherein the processor 1401, the communication interface 1402, and the memory 1403 complete communication with each other through the communication bus 1404,

a memory 1403 for storing a computer program;

the processor 1401 is configured to implement the method for protecting video privacy based on moir effect enhancement according to the embodiment of the present invention when executing the program stored in the memory 1403.

The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the electronic equipment and other equipment.

The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.

The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.

In still another embodiment provided by the present invention, a computer-readable storage medium is further provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the method for protecting video privacy based on moir effect enhancement provided by the embodiment of the present invention.

In yet another embodiment provided by the present invention, a computer program product containing instructions is also provided, which when run on a computer, causes the computer to perform the method for video privacy protection based on moir e effect enhancement provided by an embodiment of the present invention.

In the above embodiments, all or part of the implementation may be realized by software, hardware, firmware, or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), among others.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.

All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus, device and storage medium embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference may be made to some descriptions of the method embodiments for relevant points.

The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims

1. A method for enhanced video privacy based on the moir effect, the method comprising:

obtaining a video to be protected;

processing the video to be protected based on the data protection pattern;

the processing the video to be protected based on the data protection pattern comprises:

and performing transparency processing on a non-line area in the data protection pattern, obtaining a mask based on the data protection pattern after the transparency processing, displaying the mask on the uppermost layer, and displaying the video to be protected on the next layer of the uppermost layer.

2. The method of claim 1, wherein the spacing between the transverse lines and the spacing between the longitudinal lines are set based on a sensor sampling frequency of an image acquisition device;

or

The intervals between the horizontal lines and the intervals between the vertical lines are set based on the screen resolution of the display device.

3. The method according to claim 1, wherein the data protection pattern comprises a plurality of patterns, each pattern is obtained according to the original pattern, and the line content of each pattern is different;

the obtaining of the mask based on the data protection pattern after the transparentization processing and the displaying of the mask on the uppermost layer include:

and respectively obtaining masks based on the patterns subjected to the transparentization treatment in the data protection patterns, and circularly displaying the patterns serving as the masks in the uppermost layer according to a preset mask display frequency.

4. The method of claim 3, wherein the data protection pattern comprises consecutive variations of line directions in adjacent patterns;

and/or

5. The method according to claim 1, wherein the obtaining the video to be protected comprises:

obtaining a video to be protected to be displayed in a target window;

the displaying the mask on the uppermost layer and the displaying the video to be protected on the next layer of the uppermost layer comprises:

and displaying the mask on the topmost layer of the target window, and displaying the video to be protected on the next layer of the topmost layer of the target window.

6. The method according to claim 1, further comprising, after said displaying the mask in the topmost layer,:

obtaining a first data protection area selected by a user on the mask;

and carrying out transparentization treatment on the line area in the area outside the first data protection area in the mask.

7. The method according to claim 1 or 2, wherein the processing the video to be protected based on the data protection pattern comprises:

determining the data protection strength of the video to be protected;

determining the transparency of lines in the data protection pattern based on the data protection strength;

processing the video to be protected based on the determined transparency and the data protection pattern.

8. The method of claim 1 or 2, wherein the data protection pattern is generated as follows:

creating an image of a target size;

obtaining a target interval which enables lines to be distributed densely;

and drawing a transverse line with the target interval and a longitudinal line with the target interval on the image to obtain a data protection pattern.

9. The method according to claim 8, wherein the drawing the horizontal lines with the target interval and the vertical lines with the target interval on the image to obtain a data protection pattern comprises:

drawing a transverse line with the target interval and a longitudinal line with the target interval on the image to obtain an original pattern;

determining a first number of target areas from the original pattern along a preset track;

carrying out perspective transformation on each target area to obtain a first number of first images with preset sizes;

zooming each first image to obtain a second image with the target size;

and generating a data protection pattern with a dynamic effect according to the determined sequence of the target areas corresponding to the second images.

10. The method of claim 9, wherein determining a first number of target regions from the original pattern along a predetermined trajectory comprises:

selecting a second number of fixed vertexes of a target area with a preset shape from the original pattern;

and selecting other vertexes of the target area for a first number of times along a preset track by taking the selected fixed vertex as a fixed point to obtain a first number of target areas determined by the fixed vertex and the other vertexes selected each time.

11. An apparatus for enhancing video privacy based on Moore effect, the apparatus comprising:

the video to be protected obtaining module is used for obtaining a video to be protected;

the to-be-protected video processing module is used for processing the to-be-protected video based on the data protection pattern;

the video processing module to be protected comprises:

and the first processing submodule is used for performing transparency processing on a non-line area in the data protection pattern, obtaining a mask based on the data protection pattern after the transparency processing, displaying the mask on the topmost layer, and displaying the video to be protected on the next layer of the topmost layer.

12. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;

a memory for storing a computer program;

a processor for implementing the method steps of any one of claims 1 to 10 when executing a program stored in the memory.

13. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1 to 10.