CN117522663A

CN117522663A - Watermark embedding method, watermark tracing method and related device

Info

Publication number: CN117522663A
Application number: CN202311457958.9A
Authority: CN
Inventors: 孙一冉; 汪艺伟; 许明军; 刘永亮
Original assignee: Shupeng Information Technology Shenzhen Co ltd
Current assignee: Shupeng Information Technology Shenzhen Co ltd
Priority date: 2023-11-04
Filing date: 2023-11-04
Publication date: 2024-02-06

Abstract

The embodiment of the application provides a watermark embedding method, a watermark tracing method and a related device, wherein in the watermark embedding method, watermark graphics of a screen display object are generated according to watermark attribute information of the screen display object; generating base color data of the screen display object according to the color information of the screen display object, generating a watermark to be embedded of the screen display object according to the watermark graph and the base color data of the screen display object, and embedding the watermark to be embedded into the screen display object. Therefore, the generation of the watermark to be embedded acquired by the method combines the watermark attribute information of the screen display object and the color information of the screen display object. In other words, a binding relation is established between the watermark to be embedded and the screen display object, so that the watermark embedded in the screen display object has uniqueness, and the protection strength of the screen display object is improved.

Description

Watermark embedding method, watermark tracing method and related device

Technical Field

The present invention relates to the field of image processing, and in particular, to a watermark embedding method, device and electronic equipment. The application also relates to a watermark tracing method, a watermark tracing device and electronic equipment.

Background

In the fields of computers and image processing, information protection is an important research field. In the prior art, files are usually protected by encrypting the files or filtering out the files to be protected from network traffic. In the above manner, when a user obtains information by photographing a screen display object, the above manner cannot protect the information and track the file source.

Therefore, how to improve the protection of the screen display object is a problem to be solved.

Disclosure of Invention

The embodiment of the application provides a watermark embedding method for improving the protection of a screen display object. The embodiment of the application also relates to a watermark embedding device, electronic equipment and a computer storage medium. The embodiment of the application also relates to a watermark tracing method, a watermark tracing device, electronic equipment and a computer storage medium.

The embodiment of the application provides a watermark embedding method, which comprises the following steps: obtaining watermark attribute information of a screen display object; generating a watermark pattern of the screen display object according to the watermark attribute information of the screen display object; generating ground color data of the screen display object according to the color information of the screen display object; fusing the watermark pattern with the ground color data of the screen display object to obtain a watermark to be embedded aiming at the screen display object; and embedding the watermark to be embedded into the screen display object.

Optionally, the generating the ground color data of the screen display object according to the color information of the screen display object includes: acquiring a color value of a pixel point of the screen display object; and generating the ground color data of the screen display object according to the color value of the pixel point of the screen display object.

Optionally, the obtaining the color value of the pixel point of the screen display object includes: converting screen information of the screen display object into screen image data; and acquiring a color value of each pixel point in the screen image data.

Optionally, the generating the ground color data of the screen display object according to the color value of the pixel point of the screen display object includes: analyzing the color value of each pixel point in the screen image data to obtain the color value of each pixel point corresponding to the color matrix; respectively corresponding all pixel points in the screen image data to color values in a color matrix, and storing the color values in the color matrix corresponding to the pixel points of the screen display object; and combining image processing and matrix operation with a color matrix corresponding to the pixel points of the screen display object to obtain the ground color data of the screen display object.

Optionally, the method further comprises: determining the watermark embedding position of the screen display object; if the screen display object is switched from the screen first display object to the screen second display object, the watermark embedding position of the screen first display object and the watermark embedding position of the screen second display object are the same watermark embedding position.

Optionally, the method further comprises: acquiring color values of pixel points at watermark embedding positions of the screen display objects; the generating the ground color data of the screen display object according to the color information of the screen display object comprises the following steps: and generating the ground color data of the screen display object according to the color value of the pixel point at the watermark embedding position of the screen display object.

Optionally, the method further comprises: acquiring a first display object of a screen at a first time point, and acquiring a second display object of the screen at a second time point, wherein the time interval between the first time point and the second time point is a preset time interval; and judging whether the first display object of the screen and the second display object of the screen are the same screen display object, and if not, respectively obtaining the watermark to be embedded of the first display object of the screen and the watermark to be embedded of the second display object of the screen.

Optionally, the screen display object includes a screen first display object acquired at a first time point; the generating the ground color data of the screen display object according to the color information of the screen display object comprises the following steps: generating ground color data of the first display object of the screen according to the color information of the first display object of the screen; the method further comprises the steps of: acquiring a second display object of a screen at a second time point, wherein the time interval between the second time point and the first time point is a preset time interval; judging whether the second display object of the screen and the first display object of the screen are the same screen display object or not, if not, generating the ground color data of the screen display object according to the color information of the screen display object, including: and generating the ground color data of the second display object of the screen according to the color information of the second display object of the screen.

Optionally, the screen display object includes a screen main object and a screen additional object; and if any one of the following conditions is met between the first screen display object and the second screen display object, the first screen display object and the second screen display object are different screen display objects: display difference information aiming at a screen main body object exists between the first display object of the screen and the second display object of the screen; display difference information for the screen additional object exists between the screen first display object and the screen second display object.

Optionally, the screen display object includes a screen main object and a screen additional object; the generating the ground color data of the screen display object according to the color information of the screen display object comprises the following steps: generating ground color data of the position of the screen main body object according to the color value of the pixel point of the screen main body object; and generating the ground color data of the position of the screen additional object according to the color value of the pixel point of the screen additional object.

Optionally, the method further comprises: and if a change operation of the screen display information for the screen display object is detected, re-executing the step of generating the ground color data of the screen display object according to the color information of the screen display object.

Optionally, the operation of changing the screen display information for the screen display object includes at least one of the following cases: an operation of adding new display information for current screen display information of the screen display object; and reducing the operation of the existing display information with respect to the current screen display information of the screen display object.

Optionally, the watermark attribute information of the screen display object includes screenshot acquisition time information of the screen display object and equipment attribute information of the screen display object; the device attribute information to which the screen display object belongs includes at least one of the following information: server equipment information of the screen display object, wherein the server equipment information comprises at least one of the following information: internet protocol address information, medium access control address information, and processor model information; the method comprises the steps that client equipment information of a screen display object is acquired, wherein the client equipment information comprises binding account information of the screen display object acquired at a client; the screen displays watermark configuration information which is already set by the server equipment to which the object belongs.

Optionally, the generating the watermark pattern of the screen display object according to the watermark attribute information of the screen display object includes: and obtaining time information according to the screenshot of the screen display object and equipment attribute information of the screen display object, and generating a watermark pattern of the screen display object.

Optionally, the generating the watermark pattern of the screen display object according to the watermark attribute information of the screen display object includes: encoding the watermark attribute information of the screen display object to obtain watermark encoding information of the screen display object; and converting the watermark coding information of the screen display object into a dot matrix watermark pattern serving as the watermark pattern of the screen display object.

Optionally, the watermark pattern of the screen display object comprises a dot matrix watermark pattern; the encoding processing of the watermark attribute information of the screen display object comprises the following steps: converting the watermark attribute information of the screen display object into a binary digital sequence; and converting each data in the binary data sequence into a dot matrix graph to obtain the dot matrix watermark graph of the screen display object.

Optionally, the watermark pattern of the screen display object comprises a two-dimensional code watermark pattern; the encoding processing of the watermark attribute information of the screen display object comprises the following steps: converting watermark attribute information of the screen display object into a two-dimensional code aiming at the screen display object; converting the two-dimensional code of the screen display object into a binary matrix aiming at the screen display object; and converting each data in the binary matrix into a dot pattern to obtain a two-dimensional code watermark pattern of the screen display object.

The embodiment of the application also provides a watermark tracing method, which comprises the following steps: acquiring a shot screen image, wherein the screen image is an image obtained by shooting a screen display object of a display screen; determining screen attribute information of the screen image according to watermark information of the screen image, wherein the screen attribute information comprises acquisition time information of an original screen display object corresponding to the screen image and original equipment attribute information to which the original screen display object belongs; and obtaining a tracing result of the shot screen image according to the acquisition time information of the original screen display object and the attribute information of the original equipment, wherein the tracing result is the source information of the original screen display object corresponding to the shot screen image.

Optionally, the determining the screen attribute information of the screen image according to the watermark information of the screen image includes: analyzing watermark information of the screen image to obtain watermark graphics and ground color data of the watermark information; the watermark pattern of the screen image is generated by watermark attribute information of an original screen display object corresponding to the screen image, the watermark attribute information comprises object acquisition time and equipment attribute information of the original screen display object, and the ground color data is generated by color information of the original screen display object.

The embodiment of the application also provides a watermark embedding device, which comprises: the watermark attribute information acquisition unit is used for acquiring watermark attribute information of the screen display object; the watermark pattern generation unit is used for generating watermark patterns of the screen display object according to the watermark attribute information of the screen display object; the watermark ground color data generating unit is used for generating ground color data of the screen display object according to the color information of the screen display object; the watermark to be embedded obtaining unit is used for fusing the watermark graph with the ground color data of the screen display object to obtain the watermark to be embedded aiming at the screen display object; and the embedding unit is used for embedding the watermark to be embedded into the screen display object.

The embodiment of the application also provides a watermark tracing device, which comprises: a screen image acquisition unit for acquiring a shot screen image, wherein the screen image is an image obtained by shooting a screen display object of a display screen; a screen attribute information determining unit, configured to determine screen attribute information of the screen image according to watermark information of the screen image, where the screen attribute information includes acquisition time information of an original screen display object corresponding to the screen image and original equipment attribute information to which the original screen display object belongs; and the tracing result obtaining unit is used for obtaining the tracing result of the shot screen image according to the obtaining time information of the original screen display object and the attribute information of the original equipment, wherein the tracing result is the source information of the original screen display object corresponding to the shot screen image.

The embodiment of the application also provides electronic equipment, which comprises a processor and a memory; the memory stores a computer program, and the processor executes the method after running the computer program.

The embodiment of the application also provides a computer storage medium, which stores a computer program, and the computer program executes the method after being executed by a processor.

Compared with the prior art, the embodiment of the application has the following advantages:

According to the method, watermark graphics of the screen display object are generated according to watermark attribute information of the screen display object; generating base color data of the screen display object according to the color information of the screen display object, generating a watermark to be embedded of the screen display object according to the watermark graph and the base color data of the screen display object, and embedding the watermark to be embedded into the screen display object. Therefore, the generation of the watermark to be embedded acquired by the method combines the watermark attribute information of the screen display object and the color information of the screen display object. In other words, a binding relation is established between the watermark to be embedded and the screen display object, so that the watermark embedded in the screen display object has uniqueness, and the protection strength of the screen display object is improved.

According to the watermark tracing method provided by the method, the source information of the original screen display object corresponding to the screen image is obtained according to the watermark information in the shot image. The screen attribute information of the screen image comprises acquisition time information of an original screen display object corresponding to the screen image and equipment attribute information of the original screen display object. Based on the process, the source information of the original screen display object corresponding to the shot image is timely obtained, so that the protection degree of the original screen display object and the source tracking rate after secret leakage are improved.

Drawings

Fig. 1 is a schematic view of a scenario of a watermark embedding method according to an embodiment of the present application.

Fig. 2 is a first process diagram of a screen display object according to an embodiment of the present application.

Fig. 3 is a second process diagram of a screen display object according to an embodiment of the present application.

Fig. 4 is a flowchart of a watermark embedding method according to a first embodiment of the present application.

Fig. 5 is a first schematic diagram of a watermark embedded screen display object according to a first embodiment of the present application.

Fig. 6 is a second schematic diagram of a watermark embedded screen display object according to the first embodiment of the present application.

Fig. 7 is a third schematic diagram of a watermark embedded screen display object according to the first embodiment of the present application.

Fig. 8 is a schematic diagram of a watermark embedding device according to a second embodiment of the present application.

Fig. 9 is a flowchart of a watermark tracing method according to a third embodiment of the present application.

Fig. 10 is a schematic diagram of a watermark tracing device according to a fourth embodiment of the present application.

Fig. 11 is a schematic diagram of an electronic device according to a fifth embodiment of the present application.

Detailed Description

For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, but not all embodiments. The components of the embodiments of the present application, which are generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, as provided in the accompanying drawings, is not intended to limit the scope of the application, as claimed, but is merely representative of selected embodiments of the application. Based on the embodiments of the present application, every other embodiment that a person skilled in the art would obtain without making any inventive effort is within the scope of protection of the present application.

The terms "a," "an," "the," and "said" are used in this specification to denote the presence of one or more elements/components/etc.; the terms "comprising" and "having" are intended to be inclusive and mean that there may be additional elements/components/etc. in addition to the listed elements/components/etc.; the terms "first" and "second" and the like are used merely as labels, and are not intended to limit the number of their objects.

It should be understood that in embodiments of the present application, "at least one" means one or more, and "a plurality" means two or more. "and/or" is merely an association relationship describing an association object, meaning that there may be three relationships, e.g., a and/or B, may represent: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship. "comprising A, B and/or C" means comprising any 1 or any 2 or 3 of A, B, C.

It should be understood that in the embodiments of the present application, "B corresponding to a", "a corresponding to B", or "B corresponding to a", means that B is associated with a, from which B may be determined. Determining B from a does not mean determining B from a alone, but may also determine B from a and/or other information.

Before describing embodiments of the present application in detail, the background of the solutions related to the present application will be described first.

In the fields of computers and image processing, information protection is an important research field. In the prior art, files are usually protected by encrypting the files or filtering out the files to be protected from network traffic. For example, when a user obtains the content of an encrypted file, the user can obtain the content of the file by providing a correct password. Alternatively, in order to prevent leakage of encrypted files, such files are excluded from the list of e-mail attachments, thereby preventing leakage of such encrypted files when sending mail.

In the above manner, when a user obtains information by photographing a screen display object, the above manner cannot protect the information and track the file source.

In the prior art, in order to increase the strength of protecting information, watermark embedding is performed on files to be protected. For example, in a first prior art method of watermark embedding, features are extracted by using coefficients that do not participate in watermark processing according to statistical differences between graphic content and text content in a screen, so as to implement classification of image content. Based on the classification results, a hybrid JND (Just Noticeable Difference/display, just noticeable differences/distortions) model is constructed, wherein the structural complexity is used to simulate the contrast shading factors of the text patch. However, the disadvantage of this first solution is the lack of concealment. Since a content-based classification strategy simply cannot cover all cases, partial-case watermarking is less covert.

A second prior art method of watermark embedding is a technique for protecting video content by means of an overlay. It discusses the relationship between JND and overlay opacity, the overlay containing the watermark generated by the set-top box, presented on the image displayed by the multimedia device. A drawback of the second solution is that additional equipment is required to generate the watermark overlay, the watermark itself not containing unique time and equipment identification information.

A third prior art method of watermark embedding is a watermarking scheme using an intensity-based scale-invariant feature transform algorithm and DCT transformation. This approach has good robustness to the screen shot process and visual quality. The third solution has the disadvantage that the simple texture and color of the document can cause weakening of the intensity of the key points of the intensity-based scale-invariant feature transform algorithm, so that the watermark region cannot be accurately located.

A fourth method for generating a screen watermark in the prior art, wherein watermark information is encoded to obtain a binary code string, and the binary code string is processed based on time information of a current system to obtain watermark codes; grouping watermark codes to obtain code information with fixed code length; determining the size of a watermark block based on the display resolution of the screen and the coding information of the fixed code length to obtain the watermark block with the fixed size; dynamically fusing the watermark blocks with pixel values of screen display content based on the display color of the screen, circularly embedding the fused watermark blocks into the screen display content, and displaying the content and the watermark on the screen. The fourth scheme has the defect of poor effect on a screen with rich content, insufficient adaptation granularity and poor watermark hiding effect. And carrying out background fusion based on the watermark blocks, wherein the adaptation granularity is not fine enough. Each time watermark is laid, the watermark needs to be circularly embedded into the content displayed on the screen, and the time consumption is long and the performance is low.

Aiming at the problems, the embodiment of the application provides a watermark embedding method and a watermark tracing method so as to solve the technical problems.

Please refer to fig. 1, which is a schematic diagram of a scenario of a watermark embedding method according to an embodiment of the present application. Wherein, 100 in fig. 1 represents a specific step diagram of a watermark embedding method, 200 in fig. 1 represents a situation diagram of each stage involved in the process of embedding a watermark in a screen display object.

In the specific step diagram of 100 in fig. 1, the watermark embedding method includes the following main processes, first, watermark pattern generation process; the second, the process of generating the ground color data of the screen display object, the third, the process of generating the watermark to be embedded, the fourth, the process of embedding the watermark into the screen display object.

The following is a detailed description of the portions 100 of fig. 1 and 200 of fig. 1.

First, a watermark pattern generation process, as in S101 in fig. 1: obtaining watermark patterns, which correspond to the steps 1 to 3.

Step 1: watermark information is initialized.

The watermark information is initialized to be a preliminary setting of the screen embedded watermark, and comprises at least one of the following information: the color of the watermark display, the density of the watermark display, and the size of the watermark display.

Step 2: watermark information is acquired.

In this embodiment, the watermark is embedded in the screen display object. In order to enable the watermark to be embedded in the screen display object to have a binding relation with the screen display object, watermark information to be acquired comprises at least one of the following information: acquisition time information of the screen display object, and device attribute information to which the screen display object belongs.

The device attribute information includes at least one of the following information: server device information, client device information, and watermark information conditions previously configured by the server. The server device information includes at least one of the following: IP (Internet Protocol Address ) information, MAC (Media Access Control Address, media access control address) information, CPU (Center Processing Unit, processor) model information. The client device information comprises user account information of a user login client, and after the user logs in the client by using the user account information, a binding relationship is established between a screen display object of the screen and the user account information. The watermark information condition previously configured by the server comprises at least one of the following information: color of watermark display, density of watermark display, size of watermark display.

Step 3: a corresponding code is generated.

And (3) carrying out coding processing on the watermark information obtained in the step (2), so as to convert the coded information after the coding processing into watermark patterns. The process of encoding watermark information varies with the type of watermark pattern that is ultimately required to be formed.

For example, (1) dot matrix watermark pattern: the method comprises the steps of embedding a dot matrix watermark pattern in a screen display object, specifically, encoding watermark information to obtain a binary digital sequence form, and converting binary digital into watermark points. (2) two-dimensional code watermark pattern: embedding a two-dimensional code watermark pattern in a screen display object, converting black color blocks and white color blocks in the two-dimensional code into 1 and 0 respectively, storing the 1 and 0 into a binary matrix, and then converting each number in the binary matrix into a watermark point.

The process of generating different watermark patterns is described in detail below:

(1) Dot matrix watermark pattern: and (3) carrying out coding processing on the watermark information obtained in the step (2), and particularly converting the watermark information into a binary digital sequence according to coding rules. The corresponding numbers in the binary digital sequence are then converted to watermark points. The dot matrix watermark pattern is suitable for a scene with less embedded information, and is convenient to compress and deform.

(2) Two-dimensional code watermark pattern: and (3) converting the watermark information obtained in the step (2) into a two-dimensional code, wherein the two-dimensional code contains watermark attribute information of the screen display object. And carrying out coding treatment on the two-dimensional code, namely respectively converting a black color block and a white color block in the two-dimensional code into 1 and 0, and storing the 1 and 0 into a binary matrix. Each element information (i.e., the numbers 1 and 0) in the binary matrix is then replaced with a corresponding watermark point pattern. Thus, the entire binary matrix is converted into a dot pattern containing the complete information of the screen display object. The two-dimensional code watermark pattern is suitable for scenes with more embedded information or higher security.

Step 1, step 2 and step 3 generate watermark patterns of the screen display object. The watermark pattern may refer to the watermark pattern illustrated at 201 in fig. 1. As can be seen from 201 in fig. 1, the watermark pattern is a dot pattern, where no color is given to watermark points in the dot pattern, the ground color data of the screen display object is generated through the second stage, and the watermark pattern and the ground color data of the screen display object are fused to obtain the watermark to be embedded.

Next, a process of generating ground color data of the screen display object is described.

Second, the ground color data generation process of the screen display object is as in S102 in fig. 1: and generating ground color data of the screen display object, wherein the ground color data correspond to the steps 4 to 6.

Step 4: the current screenshot is obtained.

The ground color data of the screen display object is related to the color information of the screen display object, and thus, the current screen display object, also referred to as a current screenshot, is first acquired. The current screen shot includes all information currently displayed on the display screen, including, for example, a screen body object (the content currently displayed on the screen) and a screen additional object (a header on the screen display page, applet icons, a toolbar, etc.). The screen display object is shown as 202 in fig. 1, and the color displayed by the current screen display object is described by taking gray as an example, and the color displayed by the actual screen display object is related to the information displayed by the actual screen display object, which may be any color.

Step 5: the screenshot RGB (Red Green Blue, representing three color channels of Red, green and Blue, respectively) matrix was analyzed.

In the RGB color mode, each pixel is determined by the values of the R, G, B three channels, which typically range from 0 to 255. When the values of the R, G, B channels are all 0, the pixel point is displayed as black; when the values of the R, G, B channels are 255, the pixel point is displayed as white; when the values of the R, G, B three channels are different, the pixel dots are displayed in different colors.

And obtaining a color value corresponding to each pixel point in the screen shot in the color matrix according to the screen shot. And storing the color value corresponding to each pixel point in the color matrix to obtain the color matrix corresponding to the pixel point of the screen shot, wherein the color matrix comprises the color value corresponding to each pixel point. In other words, the color matrix is composed of a plurality of color values, each of which is an element in the color matrix, and each element corresponds to a color value of each pixel point in the screen image data.

Step 6: the base color data of the screen shot is generated.

The color matrix of the pixel points in the screenshot obtained in the step 5 is calculated and obtained through image processing and matrix operation processes to obtain the processed ground color data of the screen display object for embedding the watermark, as shown by 203 in fig. 1.

Thirdly, the watermark to be embedded generating process corresponds to S103 in fig. 1, and generates the watermark to be embedded, which specifically includes steps 7 to 8.

Step 7: the watermark generation algorithm is to be embedded.

The watermark generation algorithm to be embedded comprises the step of fusing the watermark pattern of the screen display object obtained in the step 3 with the ground color data of the screen display object obtained in the step 6.

Step 8: obtaining the watermark to be embedded.

The watermark to be embedded obtained in this step is shown as 204 in fig. 1, and is obtained by performing fusion processing on the watermark pattern of the screen display object obtained in step 3 and the ground color data of the screen display object obtained in step 6.

Fourth, the watermark is embedded in the screen display object.

Step 9: the current process name is obtained.

Acquiring the current process name refers to acquiring the process name of the screen display object being displayed by the current display screen.

Step 10: and adaptively selecting a watermark strategy according to the application type.

And determining the watermark strategy corresponding to the current screen display object according to the application type of the screen display object of the current screen display and the preset watermark strategy.

Step 11: watermark embedding algorithm.

And (3) performing watermark embedding operation according to the watermark strategy of the current screen display object determined in the step (10). The watermark to be embedded obtained in the step 8 is embedded into the screen display object, that is, the screen display object with the watermark embedded is obtained according to 204 in fig. 1 and 202 in fig. 1, 205 in fig. 1 is obtained, and the watermark embedding is completed.

The specific process is that the gray value of the watermark data to be embedded is combined with the self-adaptive strategy and is added to at least one channel of R channel, G channel and B channel of RGB of each pixel point, so as to obtain the screen display object with the watermark embedded.

Step 12: and (5) displaying on a screen.

After embedding the watermark to be embedded in the screen display object according to step 11, the screen display is the screen display object containing the watermark shown as 205 in fig. 1.

Compared with the RG channel, because human eyes are insensitive to the information embedded in the B channel, the gray value of the watermark data to be embedded is added to the B channel in the RGB value corresponding to each pixel point, so that the invisibility of the watermark embedded in the screen display object can be further enhanced, and the watermark information embedded in the screen display object is not easy to be perceived.

The process is a process of generating the watermark to be embedded into the screen display object and embedding the watermark to be embedded into the screen display object. In the process of generating the watermark to be embedded, the acquisition time information of the screen display object and the equipment attribute information of the screen display object are combined, so that the generated watermark to be embedded contains the attribute information of the screen display object, and the watermark and the screen display object have a binding relationship.

In addition, the server dynamically monitors the screen, and the dynamic monitoring of the screen is described below.

Step 13: and (5) dynamically monitoring a screen.

If the information of the screen display object changes, generating the watermark for the changed screen display object again. Referring to fig. 2 and fig. 3, fig. 2 is a first process diagram of a screen display object according to an embodiment of the present application. Fig. 3 is a second process diagram of a screen display object according to an embodiment of the present application.

Wherein the process of changing the screen display object comprises at least one of the following conditions: the screen body object adds new display information (such as the changing state of the page 2a in fig. 2 to the page 2b in fig. 2), and the screen body object reduces part of the original display information (such as the changing state of the page 2a in fig. 2 to the page 2c in fig. 2); the screen addition object adds new display information (e.g., the changed state of page 3a in fig. 3 to page 3b in fig. 3), and the screen addition object reduces part of the original display information (e.g., the changed state of page 3a in fig. 3 to page 3c in fig. 3).

The server dynamically monitors the screen and further comprises: and re-acquiring the screen display object according to a preset fixed time interval, judging whether the re-acquired screen display object and the previous screen display object are changed, and if so, re-generating the watermark to be embedded for the screen display object.

The watermark generated for the screen display object combines the acquisition time information and the equipment attribute information of the screen display object. Therefore, after the screen display object is shot by other users, the source position of the original screen display object corresponding to the shot image can be determined according to the watermark information in the shot image. Not only improves the protection of the screen display object, but also is beneficial to tracing the leakage source of the leaked image.

First embodiment

Please refer to fig. 4, which is a flowchart of a watermark embedding method according to a first embodiment of the present application. The watermark embedding method provided in the first embodiment of the present application is described in detail below with reference to fig. 4. The watermark embedding method provided in the first embodiment corresponds to a scene embodiment, and specific reference may be made to the scene embodiment, which is not described herein.

As shown in fig. 4, in step S401, watermark attribute information to which a screen display object belongs is acquired.

The step is used for acquiring watermark attribute information of the screen display object, wherein the watermark attribute information is information for identifying the uniqueness of the screen display object.

The watermark attribute information of the screen display object comprises screenshot acquisition time information of the screen display object and equipment attribute information of the screen display object; the device attribute information to which the screen display object belongs includes at least one of the following information: server equipment information of the screen display object, wherein the server equipment information comprises at least one of the following information: internet protocol address information, medium access control address information, and processor model information; the method comprises the steps that client equipment information of a screen display object is acquired, wherein the client equipment information comprises binding account information of the screen display object acquired at a client; the screen displays watermark configuration information which is already set by the server equipment to which the object belongs.

In this step, the time information of the screen display object is obtained when the watermark to be embedded is generated for the screen display object, which means the time information when the screen display object is displayed for the first time on the display screen. The device attribute information of the screen display object is also the device information corresponding to the screen display when the screen display object is displayed for the first time on the screen display and watermark graphics are generated for the screen display object. Thus, the watermark attribute information of the screen display object characterizes the characteristic information of the screen display object having uniqueness. And generating a watermark graph of the screen display object according to the watermark attribute information, so as to provide a protection effect for the screen display object, and tracing the source of the shot image according to the watermark graph after the screen display object is shot by a user by using other acquisition equipment.

In this step, before watermark attribute information of the screen display object is acquired, the screen display object is acquired first. The screen display object may refer to all objects presented by the display screen, such as page 2a in fig. 2, which includes a screen main object and a screen additional object. After the screen display object and the watermark attribute information thereof are acquired, the watermark pattern of the screen display object is further generated, so that the generation process of the watermark pattern combines the main object and the additional object of the screen display object, and the association relationship between the screen display object and the watermark pattern is increased.

As shown in fig. 4, in step S402, a watermark pattern of the screen display object is generated according to watermark attribute information to which the screen display object belongs.

The step is used for generating the watermark pattern of the screen display object according to the watermark attribute information obtained in the previous step. The generating of the watermark pattern of the screen display object according to the watermark attribute information of the screen display object can be realized in the following manner: and obtaining time information according to the screenshot of the screen display object and equipment attribute information of the screen display object, and generating a watermark pattern of the screen display object.

The watermark graph of the screen display object comprises the acquisition time information of the screen display object and the equipment attribute information of the screen display object, so that the screen display object can be conveniently traced according to the watermark information in the shot image after being shot. In the above manner, the time when the watermark information is generated by the original screen display object corresponding to the photographed image and the belonging device attribute information, for example, server device information and client binding account information, are obtained.

The watermark pattern may be different according to the screen display object, for example, the dot matrix watermark pattern is selected when the screen display object needs to embed a small amount of information, and the two-dimensional code watermark pattern is selected when the screen display object needs to embed a large amount of information.

The generation process of the watermark pattern is described in detail below:

the generating of the watermark pattern of the screen display object according to the watermark attribute information of the screen display object can be realized in the following manner:

encoding the watermark attribute information of the screen display object to obtain watermark encoding information of the screen display object; and converting the watermark coding information of the screen display object into a dot matrix watermark pattern serving as the watermark pattern of the screen display object.

The watermark attribute information of the screen display object acquired in step S401 is encoded, and the watermark attribute information is different according to the type of the finally generated watermark image, which specifically includes at least two cases:

case one: the watermark pattern is a dot matrix watermark pattern:

the watermark pattern of the screen display object comprises a dot matrix watermark pattern; the encoding processing of the watermark attribute information of the screen display object can be realized by the following modes:

converting the watermark attribute information of the screen display object into a binary digital sequence; and converting each data in the binary data sequence into a dot matrix graph to obtain the dot matrix watermark graph of the screen display object.

The watermark attribute information is converted into a binary digital sequence, and the numbers 1 and 0 in the binary digital sequence are respectively converted into watermark points in the dot matrix watermark pattern. The final watermark shape is a dot matrix watermark pattern in the form of binary digit sequence.

And a second case: the watermark pattern is a two-dimensional code watermark pattern:

the watermark pattern of the screen display object comprises a two-dimensional code watermark pattern; the encoding processing of the watermark attribute information of the screen display object can be realized by the following modes: converting watermark attribute information of the screen display object into a two-dimensional code aiming at the screen display object; converting the two-dimensional code of the screen display object into a binary matrix aiming at the screen display object; and converting each data in the binary matrix into a dot pattern to obtain a two-dimensional code watermark pattern of the screen display object.

The watermark attribute information is converted into a two-dimensional code shape, the two-dimensional code contains watermark attribute information of a screen display object, and a black color block and a white color block in the two-dimensional code are respectively converted into numbers 1 and 0 to form a binary matrix. And then, converting the data in the binary matrix into watermark points to form a two-dimensional code watermark pattern containing the watermark points, wherein the two-dimensional code watermark pattern is used as a screen display object.

In the two cases, the dot matrix watermark pattern and the two-dimensional code watermark pattern both contain watermark points, and the dot matrix watermark and the two-dimensional code watermark are formed by adopting the watermark points, so that the watermark concealment distributed in each area of the screen display object is improved. Meanwhile, the distribution granularity of watermarks is increased, the watermark distribution range of the screen display object is increased, and the protected intensity of the screen display object is improved. In addition, after the screen display object is photographed and compromised, a compromise source can be searched according to watermark information in the photographed photograph.

As shown in fig. 4, in step S403, the ground color data of the screen display object is generated according to the color information of the screen display object.

The step is used for generating the ground color data of the screen display object according to the color information of the screen display object, and is used for fusing the ground color data of the screen display object with the watermark pattern obtained in the step S402 to obtain the watermark to be embedded.

Wherein, the generating the ground color data of the screen display object according to the color information of the screen display object can be realized by the following modes: acquiring a color value of a pixel point of the screen display object; and generating the ground color data of the screen display object according to the color value of the pixel point of the screen display object.

The obtaining the color value of the pixel point of the screen display object can be achieved by the following modes: converting screen information of the screen display object into screen image data; and acquiring a color value of each pixel point in the screen image data.

The generating the ground color data of the screen display object according to the color value of the pixel point of the screen display object can be realized by the following steps: analyzing the color value of each pixel point in the screen image data to obtain the color value of each pixel point corresponding to the color matrix; respectively corresponding all pixel points in the screen image data to color values in a color matrix, and storing the color values in the color matrix corresponding to the pixel points of the screen display object; and combining image processing and matrix operation with a color matrix corresponding to the pixel points of the screen display object to obtain the ground color data of the screen display object.

The analyzing the color value of each pixel point in the screen image data to obtain the color value of each pixel point corresponding to the color matrix comprises the following steps: and analyzing the color value of each pixel point of the background image data in the screen image data to obtain the color value of each pixel point of the background image data corresponding to the color matrix.

The color value of each pixel point of the background image data in the screen image data is taken as each element in the color matrix, thereby obtaining the color matrix for the screen image data. Each element in the color matrix corresponds to a color value of each pixel point in the screen image data.

And combining image processing and matrix operation with a color matrix corresponding to the pixel points of the screen display object to obtain the ground color data of the screen display object. The base color data of the screen display object obtained by the method is used for being fused with the watermark graph to generate the watermark to be embedded for embedding the screen display object.

The watermark to be embedded is obtained through the mode, the watermark to be embedded is embedded into the screen display object, and the screen display object with the complete watermark embedded is obtained. The specific process is that the gray value of the watermark data to be embedded is combined with the self-adaptive strategy and is added to at least one channel of R channel, G channel and B channel of RGB of each pixel point, so as to obtain the screen display object with the watermark embedded. Thus, the invisibility of the watermark in the screen display object makes the watermark information embedded in the screen display object less noticeable to the user.

Compared with the RG channel, because human eyes are insensitive to the information embedded in the B channel, the gray value of the watermark data to be embedded is added to the B channel in the RGB value corresponding to each pixel point, so that the invisibility of the watermark embedded in the screenshot can be further enhanced, and the watermark information embedded in the screenshot is not easy to be perceived.

Referring to fig. 5 to fig. 7, fig. 5 is a first schematic diagram of a watermark embedded screen display object according to a first embodiment of the present application. Fig. 6 is a second schematic diagram of a watermark embedded screen display object according to the first embodiment of the present application. Fig. 7 is a third schematic diagram of a watermark embedded screen display object according to the first embodiment of the present application.

Fig. 5 depicts a schematic diagram of watermarking information against a light background. The background color of the screen display object shown in fig. 5 is a light background, and the background color data of the screen display object is generated according to the color value of the pixel point of the light background. And fusing the watermark graph and the ground color data of the screen display object to generate the watermark to be embedded. The screen display object to be embedded with the watermark is obtained in the above manner, and the screen capture of which the watermark is embedded is obtained, wherein the screen capture is shown in fig. 5 and is not perceived by a user.

Fig. 6 depicts a schematic diagram of watermarking information against a dark background. The background color of the screen display object shown in fig. 6 is a dark background, and the background color data of the screen display object is generated according to the color value of the pixel point of the dark background. And generating the watermark to be embedded by using the watermark graph and the ground color data of the screen display object. The screen display object to be embedded with the watermark is obtained in the above manner, and the screen capture of which the watermark is embedded is obtained, wherein the watermark in the screen capture is not perceived by a user.

Fig. 7 depicts a schematic diagram of watermarking information across a mixed color background. The background color of the screen display object shown in fig. 7 is a mixed background. And generating the ground color data of the screen display object according to the color values of the pixel points of the mixed color background. Specifically, in a light background area of a screen display object, according to color values of pixel points of the light background, base color data of the light background area are generated. And fusing the watermark pattern with the background data of the light background area, and generating a first watermark to be embedded for embedding the light background area. And generating background color data of the dark background area according to the color values of the pixel points of the dark background in the dark background area of the screen display object. And fusing the watermark pattern with the background data of the dark background area, and embedding the generated second watermark to be embedded into the dark background area. The screen display object with watermark embedding completed is obtained in the above manner, as the screen shot shown in fig. 7. The watermark in the screenshot shown in fig. 7 is not perceptible to the user.

The schematic diagrams of fig. 5 to 7 illustrate that the watermark pattern and the background color data of the screen display object are fused to generate the watermark to be embedded according to the background color of the screen display object to generate the background color data of the screen display object. After embedding the watermark to be embedded in the screen display object, the watermark in the screen display object is imperceptible to the user. In addition, the background color data of the screen display object is generated according to the background color in each display area of the screen display object, and the watermark pattern is a dot matrix watermark pattern formed by watermark points, so that the distribution density of the watermarks is increased. Meanwhile, when other users shoot the screen display object displayed by the display screen, the source information of the original screen display object corresponding to the shot image can be tracked according to the watermark information in the shot image.

In the process of generating the base color data of the screen display object, the color values of the pixel points of each object in the screen display object are analyzed, and the color values of the pixel points of the object corresponding to the color matrix are obtained. And storing all the pixel points of the screen display object in the color matrix corresponding to the pixel points of the screen display object corresponding to the color values in the color matrix. The color matrix corresponding to the pixel points of the screen display object finally obtained here may refer to that color data of all the pixel points in the screen display object are stored in the color matrix, so that the color matrix of the screen display object includes color values of all the pixel points of the screen display object. And generating the ground color data of the screen display object by the color matrix through graphic processing and matrix operation.

As shown in fig. 4, in step S404, the watermark pattern and the ground color data of the screen display object are fused, and a watermark to be embedded for the screen display object is obtained.

The watermark to be embedded for the screen display object is generated by the watermark pattern obtained in step S402 and the ground color data of the screen display object obtained in step S403.

As shown in fig. 4, in step S405, the watermark to be embedded is embedded in the screen display object.

The watermark to be embedded is obtained through step S404, and the watermark to be embedded is embedded into the screen display object, specifically, the gray value of the watermark data to be embedded is added to at least one channel of the R channel, the G channel and the B channel in the RGB value of each pixel point, so as to obtain the screen display object with the watermark embedded. The invisibility of the watermark in the screen display object makes the watermark information embedded in the screen display object less noticeable to the user.

The watermark generation process for the screen display object is generated by the method provided by the embodiment of the application, firstly, the watermark pattern is generated, the generation of the watermark pattern comprises the acquisition time information and the equipment attribute information of the screen display object, and the uniqueness of the watermark pattern of the screen display object is represented. And generating the ground color data of the screen display object according to the color information of the screen display object, and finally fusing the watermark pattern with the ground color data of the screen display object so that the color contained in the watermark embedded in the screen display object is matched with the pixel points of each position of the screen display object. In addition, the watermark of the screen display object is a dot matrix watermark, namely, a binary data sequence form or a two-dimensional code form is generated by watermark points, so that the dot matrix watermark can be distributed in each area of the screen display object, the watermark distribution fine granularity of the screen display object is increased, the concealment of the screen display object is improved, and a leakage source is conveniently searched after the screen display object is photographed and leaked.

Wherein, when embedding the watermark with the screen display object, still include: determining the watermark embedding position of the screen display object; if the screen display object is switched from the screen first display object to the screen second display object, the watermark embedding position of the screen first display object and the watermark embedding position of the screen second display object are the same watermark embedding position.

Before embedding watermark into the screen display object, the watermark embedding position of the screen display object can be determined, if the screen display object changes, the screen first display object is switched into the screen second display object, and the watermark embedding position can be continuously multiplexed.

After determining the watermark embedding position, when determining the ground color data of the screen display object, the method can be realized as follows: acquiring color values of pixel points at watermark embedding positions of the screen display objects; the generating the ground color data of the screen display object according to the color information of the screen display object comprises the following steps: and generating the ground color data of the screen display object according to the color value of the pixel point at the watermark embedding position of the screen display object.

As shown in fig. 5 to 7, watermark embedding positions are respective background distribution areas of the screen display object, and the background data of the screen display object of the background distribution areas is generated according to the color values of the pixel points of the respective background distribution areas.

The obtaining the color value of the pixel point at the watermark embedding position of the screen display object can be achieved by the following steps: converting screen information at a watermark embedding position of the screen display object into screen image data at the watermark embedding position; and acquiring a color value of each pixel point in the screen image data at the watermark embedding position.

The generating of the ground color data of the screen display object according to the color value of the pixel point at the watermark embedding position of the screen display object can be realized in the following manner:

analyzing the color value of each pixel point in the screen image data at the watermark embedding position to obtain the color value of each pixel point at the watermark embedding position corresponding to the color matrix; respectively corresponding all pixel points in the screen image data at the watermark embedding position to color data in a color matrix, and storing the pixel points in the color matrix corresponding to the pixel points of the screen display object at the watermark embedding position; and combining image processing and matrix operation with a color matrix corresponding to the pixel point of the screen display object at the watermark embedding position to obtain the ground color data of the screen display object at the watermark embedding position.

As shown in fig. 7, the background color of the screen display object of fig. 7 is a mixed background. And generating the background color data of the light background area according to the color values of the pixel points of the light background in the light background area of the screen display object. And generating background color data of the dark background area according to the color values of the pixel points of the dark background in the dark background area of the screen display object.

When the watermark to be embedded is generated on the screen display object, the screen display object is re-acquired according to a preset time interval, and if the screen display object changes, the watermark is generated on the screen display object again. The method specifically comprises the following steps: acquiring a first display object of a screen at a first time point, and acquiring a second display object of the screen at a second time point, wherein the time interval between the first time point and the second time point is a preset time interval; and judging whether the first display object of the screen and the second display object of the screen are the same screen display object, and if not, respectively obtaining the watermark to be embedded of the first display object of the screen and the watermark to be embedded of the second display object of the screen.

The screen display object comprises a screen first display object acquired at a first time point; the generating the ground color data of the screen display object according to the color information of the screen display object comprises the following steps: generating ground color data of the first display object of the screen according to the color information of the first display object of the screen; the method further comprises the steps of: acquiring a second display object of a screen at a second time point, wherein the time interval between the second time point and the first time point is a preset time interval; judging whether the second display object of the screen and the first display object of the screen are the same screen display object or not, if not, generating the ground color data of the screen display object according to the color information of the screen display object, including: and generating the ground color data of the second display object of the screen according to the color information of the second display object of the screen.

For example, the preset time interval is 3s, every 3s, the server acquires the screen display object, and determines whether the screen display object changes, for example, the screen second display object acquired at the second time point changes with the screen display object acquired at the first time point, for example, in the page change process in fig. 2 or fig. 3, so that the watermark needs to be generated on the screen display object again. Specifically, the method can include regenerating the ground color data of the screen display object for the screen display object.

Wherein the screen display object comprises a screen main object and a screen additional object; and if any one of the following conditions is met between the first screen display object and the second screen display object, the first screen display object and the second screen display object are different screen display objects: display difference information aiming at a screen main body object exists between the first display object of the screen and the second display object of the screen; display difference information for the screen additional object exists between the screen first display object and the screen second display object.

The display difference information of the screen first display object and the screen second display object for the screen main body object, such as the change process of the page 2a in fig. 2 to the page 2b in fig. 2, and the change process of the page 2a in fig. 2 to the page 2c in fig. 2.

The display difference information of the screen first display object and the screen second display object for the screen additional object, such as the change process of the page 3a in fig. 3 to the page 3b in fig. 3, and the change process of the page 3a in fig. 3 to the page 3c in fig. 3.

Wherein the screen display object comprises a screen main object and a screen additional object; the generating the ground color data of the screen display object according to the color information of the screen display object can be realized by the following modes: generating ground color data of the position of the screen main body object according to the color value of the pixel point of the screen main body object; and generating the ground color data of the position of the screen additional object according to the color value of the pixel point of the screen additional object.

The process of generating the base color data of the screen display object according to the color information of the screen display object may be to generate the base color data of the position where the screen main object is located according to the color value of the pixel point at the background of the screen main object. And generating the ground color data of the position of the screen additional object according to the color value of the pixel point at the background of the screen additional object.

Dynamically monitoring a screen display object, and if a change operation of screen display information of the screen display object is detected, re-executing the step of generating the ground color data of the screen display object according to the color information of the screen display object.

Wherein the operation of changing the screen display information for the screen display object includes at least one of the following: an operation of adding new display information for current screen display information of the screen display object; and reducing the operation of the existing display information with respect to the current screen display information of the screen display object.

The case where the screen display object is monitored to be changed may refer to the page information changing process in fig. 2 and 3. And regenerating the ground color data of the screen display object by detecting that the screen display object changes, and then fusing the watermark graph with the ground color data of the screen display object to obtain the watermark to be embedded for the screen display object. In the process, the watermark changes along with the change of the screen display object, so that the protection granularity of the screen display object is improved. When shooting the screen display object in the face of other users, the source information of the screen display object corresponding to the shot image can be determined in time according to shooting time and watermark information in the shot image. The source information comprises shooting time of the screen display object, and equipment attribute information of the screen display object is convenient for acquiring a leakage source when the screen display object is leaked.

According to the method, watermark graphics of the screen display object are generated according to watermark attribute information of the screen display object; generating watermark base color data of the screen display object according to the color information of the screen display object, generating watermark to be embedded of the screen display object according to the watermark graph and the base color data of the screen display object, and embedding the watermark to be embedded into the screen display object. Therefore, the generation of the watermark to be embedded acquired by the method combines the watermark attribute information of the screen display object and the color information of the screen display object. In other words, a binding relation is established between the watermark to be embedded and the screen display object, so that the watermark embedded in the screen display object has uniqueness, and the protection strength of the screen display object is improved.

Second embodiment

In correspondence with the watermark embedding method provided in the first embodiment, a watermark embedding device is provided in a second embodiment of the present application, please refer to fig. 8, which is a schematic diagram of the watermark embedding device provided in the second embodiment of the present application. The apparatus claims provided by the second embodiment correspond to the method claims provided by the first embodiment, and specific reference may be made to the scene embodiment and the first embodiment, which are not described herein.

The watermark embedding device provided in fig. 8 includes:

a watermark attribute information obtaining unit 801, configured to obtain watermark attribute information to which a screen display object belongs;

a watermark pattern generation unit 802, configured to generate a watermark pattern of the screen display object according to watermark attribute information to which the screen display object belongs;

a watermark base color data generating unit 803, configured to generate base color data of the screen display object according to color information of the screen display object;

a watermark to be embedded obtaining unit 804, configured to fuse the watermark pattern with the ground color data of the screen display object, and obtain a watermark to be embedded for the screen display object;

and an embedding unit 805, configured to embed the watermark to be embedded in the screen display object.

Third embodiment

Fig. 9 is a flowchart of a watermark tracing method according to a third embodiment of the present application. The watermark tracing method provided in the third embodiment of the present application is described in detail below with reference to fig. 9. The watermark tracing method provided in the third embodiment corresponds to the scene embodiment and the first embodiment, and specific reference may be made to the scene embodiment, which is not described herein.

As shown in fig. 9, in step S901, a photographed screen image, which is an image obtained by photographing a screen display object of a display screen, is acquired.

The step is used for obtaining a screen image obtained by shooting a screen display object of a display screen, wherein a shooting subject for shooting the screen display object of the display screen can be a user using the current display screen or can be a screen display object of the display screen shot by other users through an image acquisition device.

Because the shot screen image is obtained by shooting a screen display object of the display screen, the watermark is embedded in the screen display object, the embedded watermark is watermark graphics generated by the acquisition time information of the screen display object and the equipment attribute information of the screen display object, and the ground color data of the screen display object is generated according to the color information of the screen display object. Therefore, the tracing position of the original screen display object corresponding to the screen image can be obtained according to the watermark information in the shot screen image.

As shown in fig. 9, in step S902, screen attribute information of the screen image is determined according to watermark information of the screen image, where the screen attribute information includes acquisition time information of an original screen display object corresponding to the screen image and original equipment attribute information to which the original screen display object belongs.

The method comprises the steps of determining screen attribute information of a screen image according to watermark information of the screen image, wherein the screen attribute information of the screen image comprises acquisition time information of an original screen display object and original equipment attribute information, so that a leakage source of the screen image is acquired.

The determining the screen attribute information of the screen image according to the watermark information of the screen image can be realized by the following modes:

analyzing watermark information of the screen image to obtain watermark graphics and ground color data of the watermark information; the watermark pattern of the screen image is generated by watermark attribute information of an original screen display object corresponding to the screen image, the watermark attribute information comprises object acquisition time and equipment attribute information of the original screen display object, and the ground color data is generated by color information of the original screen display object.

And determining watermark attribute information of the original screen display object based on the watermark graph and the ground color data of the original screen display object, wherein the watermark attribute information comprises: object acquisition time of the screen display object and device attribute information. The ground color data may acquire color information of the original screen display object. Based on the above process, the source position information of the original screen display object corresponding to the screen image is determined, and the leakage source of the shot screen image is obtained.

As shown in fig. 9, in step S903, a tracing result of the photographed screen image is obtained according to the acquisition time information of the original screen display object and the attribute information of the original equipment to which the original screen display object belongs, where the tracing result is the source information of the original screen display object corresponding to the photographed screen image.

In this step, the tracing result, that is, the source information of the original screen display object corresponding to the screen image, is obtained according to the obtaining time information of the original screen display object and the attribute information of the original device to which the original screen display object belongs, which are obtained in step S902.

In the method, the watermark information corresponding to the shot screen image can determine the acquisition time information, the equipment attribute information and the color information of the original screen display object corresponding to the image. Therefore, the time information of generating the watermark by the screen display object can be determined according to the acquired time information of the screen display object, and the device information and the client binding account information of the screen display object can be determined according to the device attribute information of the screen display object. An original object frame of the screen display object is determined according to color information of the screen display object. And determining the leakage source of the shot screen image based on the three information.

A third embodiment of the present application provides a watermark tracing method, including: acquiring a shot screen image, wherein the screen image is an image obtained by shooting a screen display object of a display screen; determining screen attribute information of the screen image according to watermark information of the screen image, wherein the screen attribute information comprises acquisition time information of an original screen display object corresponding to the screen image and original equipment attribute information to which the original screen display object belongs; and obtaining a tracing result of the shot screen image according to the acquisition time information of the original screen display object and the attribute information of the original equipment, wherein the tracing result is the source information of the original screen display object corresponding to the shot screen image.

Fourth embodiment

Corresponding to the watermark tracing method provided in the third embodiment, a watermark tracing device is provided in a fourth embodiment of the present application, please refer to fig. 10, which is a schematic diagram of the watermark tracing device provided in the fourth embodiment of the present application. The apparatus claims provided by the fourth embodiment correspond to the method claims provided by the third embodiment, and specific reference may be made to the scene embodiment and the first embodiment, which are not described herein.

The watermark tracing device provided in fig. 10 includes:

a screen image acquisition unit 1001 configured to acquire a captured screen image, which is an image obtained by capturing a screen display object of a display screen;

a screen attribute information determining unit 1002, configured to determine screen attribute information of the screen image according to watermark information of the screen image, where the screen attribute information includes acquisition time information of an original screen display object corresponding to the screen image and original equipment attribute information to which the original screen display object belongs;

and a tracing result obtaining unit 1003, configured to obtain a tracing result of the captured screen image according to the acquisition time information of the original screen display object and the attribute information of the original device, where the tracing result is source information of the original screen display object corresponding to the captured screen image.

Fifth embodiment

The fifth embodiment of the present application also provides an electronic device corresponding to the methods of the first embodiment and the third embodiment of the present application. Fig. 11 is a schematic view of an electronic device according to a fifth embodiment of the present application. The electronic device includes: at least one processor 1101, at least one communication interface 1102, at least one memory 1103 and at least one communication bus 1104; alternatively, the communication interface 1102 may be an interface of a communication module, such as an interface of a GSM module; the processor 1101 may be a processor CPU, or a specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement embodiments of the present invention. The memory 1103 may include a high-speed RAM memory or may further include a non-volatile memory (non-volatile memory), such as at least one magnetic disk memory. In which a program is stored in the memory 1103, and the processor 1101 calls the program stored in the memory 1103 to execute the methods of the first and third embodiments of the present invention.

Sixth embodiment

The sixth embodiment of the present application also provides a computer storage medium corresponding to the methods of the first and third embodiments of the present application. The computer storage medium stores a computer program that is executed by a processor to perform the methods of the first and third embodiments.

While the preferred embodiment has been described, it is not intended to limit the invention thereto, and any person skilled in the art may make variations and modifications without departing from the spirit and scope of the present invention, so that the scope of the present invention shall be defined by the claims of the present application.

In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory. The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.

1. Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable Media, as defined herein, does not include non-Transitory computer-readable Media (transmission Media), such as modulated data signals and carrier waves.

2. It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein. It should be noted that, in the embodiments of the present application, the use of user data may be involved, and in practical applications, user specific personal data may be used in the schemes described herein within the scope allowed by applicable legal regulations in the country where the applicable legal regulations are met (for example, the user explicitly agrees to the user to actually notify the user, etc.).

It should be noted that, the user information (including but not limited to user equipment information, user personal information, etc.) and the data (including but not limited to data for analysis, stored data, presented data, etc.) related to the present application are information and data authorized by the user or fully authorized by each party, and the collection, use and processing of the related data need to comply with the related laws and regulations and standards of the related country and region, and provide corresponding operation entries for the user to select authorization or rejection.

Claims

1. A method of watermark embedding, comprising:

obtaining watermark attribute information of a screen display object;

generating a watermark pattern of the screen display object according to the watermark attribute information of the screen display object;

generating ground color data of the screen display object according to the color information of the screen display object;

fusing the watermark pattern with the ground color data of the screen display object to obtain a watermark to be embedded aiming at the screen display object;

and embedding the watermark to be embedded into the screen display object.

2. The method of claim 1, wherein generating the ground color data of the screen display object according to the color information of the screen display object comprises:

acquiring a color value of a pixel point of the screen display object;

and generating the ground color data of the screen display object according to the color value of the pixel point of the screen display object.

3. The method of claim 2, wherein the obtaining the color value of the pixel of the screen display object comprises:

converting screen information of the screen display object into screen image data;

And acquiring a color value of each pixel point in the screen image data.

4. A method according to claim 3, wherein generating the ground color data of the screen display object according to the color values of the pixels of the screen display object comprises:

analyzing the color value of each pixel point in the screen image data to obtain the color value of each pixel point corresponding to the color matrix;

respectively corresponding all pixel points in the screen image data to color values in a color matrix, and storing the color values in the color matrix corresponding to the pixel points of the screen display object;

and combining image processing and matrix operation with a color matrix corresponding to the pixel points of the screen display object to obtain the ground color data of the screen display object.

5. The method as recited in claim 1, further comprising: determining the watermark embedding position of the screen display object;

if the screen display object is switched from the screen first display object to the screen second display object, the watermark embedding position of the screen first display object and the watermark embedding position of the screen second display object are the same watermark embedding position.

6. The method as recited in claim 5, further comprising: acquiring color values of pixel points at watermark embedding positions of the screen display objects;

the generating the ground color data of the screen display object according to the color information of the screen display object comprises the following steps:

and generating the ground color data of the screen display object according to the color value of the pixel point at the watermark embedding position of the screen display object.

7. The method as recited in claim 1, further comprising:

acquiring a first display object of a screen at a first time point, and acquiring a second display object of the screen at a second time point, wherein the time interval between the first time point and the second time point is a preset time interval;

and judging whether the first display object of the screen and the second display object of the screen are the same screen display object, and if not, respectively obtaining the watermark to be embedded of the first display object of the screen and the watermark to be embedded of the second display object of the screen.

8. The method of claim 1, wherein the screen display object comprises a screen first display object acquired at a first point in time; the generating the ground color data of the screen display object according to the color information of the screen display object comprises the following steps: generating ground color data of the first display object of the screen according to the color information of the first display object of the screen;

The method further comprises the steps of:

acquiring a second display object of a screen at a second time point, wherein the time interval between the second time point and the first time point is a preset time interval;

judging whether the second display object of the screen and the first display object of the screen are the same screen display object or not, if not, generating the ground color data of the screen display object according to the color information of the screen display object, including: and generating the ground color data of the second display object of the screen according to the color information of the second display object of the screen.

9. The method of claim 7 or 8, wherein the screen display object comprises a screen body object and a screen add-on object; and if any one of the following conditions is met between the first screen display object and the second screen display object, the first screen display object and the second screen display object are different screen display objects:

display difference information aiming at a screen main body object exists between the first display object of the screen and the second display object of the screen;

display difference information for the screen additional object exists between the screen first display object and the screen second display object.

10. The method of claim 1, wherein the screen display objects include a screen body object and a screen add-on object;

generating ground color data of the position of the screen main body object according to the color value of the pixel point of the screen main body object;

and generating the ground color data of the position of the screen additional object according to the color value of the pixel point of the screen additional object.

11. The method as recited in claim 1, further comprising:

and if a change operation of the screen display information for the screen display object is detected, re-executing the step of generating the ground color data of the screen display object according to the color information of the screen display object.

12. The method of claim 11, wherein the operation of changing the screen display information for the screen display object comprises at least one of:

an operation of adding new display information for current screen display information of the screen display object;

and reducing the operation of the existing display information with respect to the current screen display information of the screen display object.

13. The method of claim 1, wherein the watermark attribute information to which the screen display object belongs includes screenshot acquisition time information of the screen display object and device attribute information to which the screen display object belongs;

the device attribute information to which the screen display object belongs includes at least one of the following information:

server equipment information of the screen display object, wherein the server equipment information comprises at least one of the following information: internet protocol address information, medium access control address information, and processor model information;

the method comprises the steps that client equipment information of a screen display object is acquired, wherein the client equipment information comprises binding account information of the screen display object acquired at a client;

the screen displays watermark configuration information which is already set by the server equipment to which the object belongs.

14. The method according to claim 13, wherein generating the watermark pattern of the screen display object according to the watermark attribute information to which the screen display object belongs comprises:

and obtaining time information according to the screenshot of the screen display object and equipment attribute information of the screen display object, and generating a watermark pattern of the screen display object.

15. The method according to claim 1, wherein generating the watermark pattern of the screen display object according to the watermark attribute information to which the screen display object belongs comprises:

encoding the watermark attribute information of the screen display object to obtain watermark encoding information of the screen display object;

and converting the watermark coding information of the screen display object into a dot matrix watermark pattern serving as the watermark pattern of the screen display object.

16. The method of claim 15, wherein the watermark pattern of the screen display object comprises a dot matrix watermark pattern;

the encoding processing of the watermark attribute information of the screen display object comprises the following steps:

converting the watermark attribute information of the screen display object into a binary digital sequence;

and converting each data in the binary data sequence into a dot matrix graph to obtain the dot matrix watermark graph of the screen display object.

17. The method of claim 15, wherein the watermark pattern of the screen display object comprises a two-dimensional code watermark pattern;

Converting watermark attribute information of the screen display object into a two-dimensional code aiming at the screen display object;

converting the two-dimensional code of the screen display object into a binary matrix aiming at the screen display object;

and converting each data in the binary matrix into a dot pattern to obtain a two-dimensional code watermark pattern of the screen display object.

18. A watermark tracing method, comprising:

acquiring a shot screen image, wherein the screen image is an image obtained by shooting a screen display object of a display screen;

determining screen attribute information of the screen image according to watermark information of the screen image, wherein the screen attribute information comprises acquisition time information of an original screen display object corresponding to the screen image and original equipment attribute information to which the original screen display object belongs;

and obtaining a tracing result of the shot screen image according to the acquisition time information of the original screen display object and the attribute information of the original equipment, wherein the tracing result is the source information of the original screen display object corresponding to the shot screen image.

19. The method of claim 18, wherein determining screen attribute information of the screen image based on watermark information of the screen image comprises:

Analyzing watermark information of the screen image to obtain watermark graphics and ground color data of the watermark information;

the watermark pattern of the screen image is generated by watermark attribute information of an original screen display object corresponding to the screen image, the watermark attribute information comprises object acquisition time and equipment attribute information of the original screen display object, and the ground color data is generated by color information of the original screen display object.

20. An electronic device comprising a processor and a memory;

the memory having stored therein a computer program which, when executed by the processor, performs the method of any of claims 1-19.

21. A computer storage medium, characterized in that the computer storage medium stores a computer program which, when executed by a processor, performs the method of any of claims 1-19.