WO2009065361A1

WO2009065361A1 - A digital watermark processing system, digital watermark embedding and detecting method and apparatus thereof

Info

Publication number: WO2009065361A1
Application number: PCT/CN2008/073114
Authority: WO
Inventors: Yongping Zhang; Tao HAO
Original assignee: Huawei Technologies Co., Ltd.
Priority date: 2007-11-23
Filing date: 2008-11-19
Publication date: 2009-05-28
Also published as: CN101442672A; CN101442672B

Abstract

A digital watermark processing system, digital watermark embedding and detecting method and apparatus thereof. Determining the first assistant information according to the original multimedia frame's frame sequence number information, and embedding the digital watermark information into the original multimedia frame according to the first assistant information, then obtaining the multimedia frame embedded with the digital watermark. Determining the second assistant information according to the frame sequence number information of the multimedia frame embedded with digital watermark, and detecting the digital watermark information of the multimedia frame embedded with digital watermark according to the second assistant information. When detecting the watermark, the tampering of intra-frame relationship could be detected.

Description

Digital watermark processing system, digital watermark embedding and detecting method and device

[1] This application claims the priority of the Chinese application filed on November 23, 2007, with the application number CN200710187733.0, the invention titled "Digital Watermark Processing System, Digital Watermark Embedding and Detection Method and Apparatus", all of which The content is incorporated by reference in this application.

[2] Technical field

[3] The present invention relates to the field of digital multimedia technologies, and in particular, to a digital watermark processing system, a digital watermark embedding and detecting method and apparatus.

[4] Background of the invention

[5] At present, with the rapid development and wide application of multimedia technology, the digital dissemination of media has become possible.

Digital multimedia content such as images, audio, video, etc., has become a part of our lives with its powerful portability, efficiency, speed and accuracy. At the same time as the popularization of digital multimedia content, many powerful multimedia modification tools have emerged. The emergence of these tools and the popularity of the network have made the modification of pirated and multimedia content a breeze.

[6] The traditional conditional access system can authenticate users who handle multimedia content in the system. However, once the user connects to the system, the multimedia content in the system cannot be effectively protected, and the user can tamper with it at will. How to ensure that digital video content is not illegally tampered with, so that digital video content is trusted by the judiciary, is an urgent problem to be solved.

[7] In response to the above problems, a digital watermarking technique has emerged in recent years. Digital watermarking technology refers to embedding identification signals in digital multimedia content by means of signal processing. The identification signals may be invisible or visible. By extracting these identification signals, copyright tracking of digitized multimedia content can be realized. , copyright statements and content for tampering purposes. Digital watermarking technology is an important branch of research direction of information hiding technology. The security of digital watermarking is solved by traditional encryption technology. By encrypting the watermark embedding location or encrypting the watermark information itself, the security of the digital watermarking system can be solved.

[8] There is a watermark embedding method for still images, in which a user uses a key to encrypt a piece of information unrelated to image content, such as time, place, etc., and selects the obtained encrypted information. The watermark is embedded in the location and the watermark information is embedded in the corresponding location. The still image processed by the watermark embedding method can detect the tampering of the still image by detecting, and the position of the watermark embedding is determined by an encrypted information, so that it is not easily cracked by the tamper, and the embedded watermark information is further improved. Safety.

[9] In the course of the invention of the present invention, the inventors have found that the prior art has at least the following problems:

[10] Since the encrypted information used for watermark embedding position selection is completely independent of the audio and video content, the watermark embedding position of each frame selected by the information is the same, if the tampering person falsifies the inter-frame relationship, such as After the frame is deleted or the position of a frame is changed, the watermark information will not change, so the tampering between frames cannot be detected.

[11] Summary of the invention

[12] A digital watermark processing system, a digital watermark embedding device, a digital watermark detecting device, a digital watermark embedding method, and a digital watermark detecting method are provided, which can detect tampering of inter-frame relationships.

[13] A digital watermark processing system, the system comprising:

[14] a digital watermark embedding apparatus, configured to receive frame number information of an original multimedia frame and the original multimedia frame, and determine first auxiliary information according to frame number information of the original multimedia frame, according to the first auxiliary information Embedding digital watermark information in the original multimedia frame to obtain a multimedia frame embedded in the digital watermark

[15] The digital watermark detection apparatus is configured to receive the frame number information of the multimedia frame embedded in the digital watermark and the multimedia frame embedded in the digital watermark, and determine the second auxiliary information according to the frame serial number information of the multimedia frame embedded in the digital watermark; And detecting digital watermark information in the digital watermark embedded multimedia frame according to the second auxiliary information.

[16] A digital watermark embedding device, the device comprising:

[17] an auxiliary information processing module, configured to receive frame serial number information of the original multimedia frame, and determine first auxiliary information according to the frame serial number information of the original multimedia frame;

[18] The watermark embedding module is configured to receive the original multimedia frame and the first auxiliary information, and embed the digital watermark information in the original multimedia frame according to the first auxiliary information.

[19] A digital watermark detecting apparatus, the apparatus comprising:

[20] an auxiliary information processing module, configured to receive frame serial number information of a multimedia frame embedded with a digital watermark, according to The frame number information of the multimedia frame embedded in the digital watermark determines the second auxiliary information;

[21] a watermark detection module, configured to acquire the second auxiliary information from the auxiliary information processing module, and detect the digital watermark information in the embedded digital watermarked multimedia frame according to the second auxiliary information

[22] A digital watermark embedding method, the method comprising:

[23] receiving frame number information of the original multimedia frame and the original multimedia frame;

[24] determining first auxiliary information according to frame number information of the original multimedia frame;

[25] embedding digital watermark information in the original multimedia frame according to the first auxiliary information.

[26] A digital watermark detection method, the method comprising:

[27] receiving a multimedia frame embedded in the digital watermark and frame number information of the multimedia frame embedded in the digital watermark;

[28] determining second auxiliary information according to frame number information of the multimedia frame embedded with the digital watermark;

[29] detecting digital watermark information in the digital watermark embedded multimedia frame according to the second auxiliary information.

[30] It can be seen that the method, the system and the device provided by the embodiment of the present invention determine the first auxiliary information according to the frame serial number information of the original multimedia frame, and embed the digital in the original multimedia frame according to the first auxiliary information. Watermark information, to obtain a multimedia frame embedded in a digital watermark. Determining second auxiliary information according to frame number information of the multimedia frame embedded with the digital watermark; and detecting digital watermark information in the digital frame embedded in the digital watermark according to the second auxiliary information. Therefore, the digital watermark information embedded in the original multimedia frame is associated with the frame number thereof. If the inter-frame relationship of the multimedia content is tampered with, the watermark information embedded in the original multimedia frame is changed, and after the watermark detection, the inter-frame can be detected. Tampering of relationships

[31] BRIEF DESCRIPTION OF THE DRAWINGS

1 is a structural diagram of a digital watermark processing system according to an embodiment of the present invention;

2 is a structural diagram of a digital watermark embedding apparatus according to an embodiment of the present invention;

FIG. 3 is a structural diagram of an auxiliary information processing module according to an embodiment of the present invention; FIG.

4 is a structural diagram of an auxiliary information determining unit according to an embodiment of the present invention;

FIG. 5 is a structural diagram of an auxiliary information determining unit according to another embodiment of the present invention; FIG.

6 is a structural diagram of a digital watermark detecting apparatus according to an embodiment of the present invention; FIG. 7 is a specific flowchart of a digital watermark embedding method according to an embodiment of the present invention; FIG.

8 is a schematic diagram of a method for determining a watermark embedding coefficient according to an embodiment of the present invention;

FIG. 9 is a specific flowchart of a watermark detecting method according to an embodiment of the present invention.

[41] Mode for carrying out the invention

[42] In order to make the objects, technical solutions and advantages of the present invention more clear, the following embodiments are described with reference to the accompanying drawings.

The invention is further described in detail.

[43] The embodiment of the present invention mainly determines the auxiliary information embedded in the watermark according to the frame serial number and the security information in the multimedia content, and embeds the auxiliary information as a watermark embedding factor. Thereby, the watermark information embedded in each frame of the multimedia content is associated with the frame number of the frame, and when the inter-frame tampering of the multimedia content occurs, such as the frame being exchanged or deleted, the embedded watermark information will be changed, thereby For the detection of the watermark, tampering of the relationship between the frames is detected.

1 is a structural diagram of a digital watermark processing system according to an embodiment of the present invention. As shown, the system includes: [45] a digital watermark embedding apparatus 101, configured to receive an original multimedia frame and the original multimedia frame. Frame number information, determining first auxiliary information according to frame number information of the original multimedia frame, embedding digital watermark information in the original multimedia frame according to the first auxiliary information, to obtain a multimedia frame embedded with the digital watermark;

[46] The digital watermark detecting apparatus 102 is configured to receive a frame number information of the multimedia frame embedded in the digital watermark and the multimedia frame embedded in the digital watermark, and determine the second auxiliary information according to the frame serial number information of the multimedia frame embedded in the digital watermark And detecting the digital watermark information in the digital watermark embedded multimedia frame according to the second auxiliary information.

[47] The specific structure of the digital watermark embedding device is shown in FIG. 2. FIG. 2 is a structural diagram of a digital watermark embedding device according to an embodiment of the present invention.

[28] The digital watermark embedding apparatus of the embodiment of the present invention includes: an auxiliary information processing module 201 and a watermark embedding module 202;

[49] The auxiliary information processing module 201 is configured to receive frame sequence number information of the original multimedia frame, and determine first auxiliary information according to frame number information of the original multimedia frame;

[50] The watermark embedding module 202 is configured to receive the original multimedia frame and the first auxiliary information, and embed the digital watermark information in the original multimedia frame according to the first auxiliary information. The watermark embedding module 202 is specifically configured to determine an intra prediction residual obtained by encoding the original multimedia frame as a watermark generation domain, and obtain the digital watermark information from the watermark generation domain, or Determining the first auxiliary information as the digital watermark information; determining a watermark embedding coefficient in the original multimedia frame according to the first auxiliary information, and embedding the digital watermark information in the watermark embedding coefficient.

[52] In order to improve security, the auxiliary information processing module 201 is further configured to receive security information, and determine the first auxiliary information according to the security information and frame serial number information of the original multimedia frame.

[53] The specific structure of the auxiliary information processing module 201 is as shown in FIG. 3, which is a structural diagram of the auxiliary information processing module according to the embodiment of the present invention.

[54] The auxiliary information processing module 201 specifically includes:

[55] a frame number receiving unit 301, configured to receive frame sequence number information of the original multimedia frame;

The auxiliary information determining unit 303 is configured to receive the frame serial number information of the original multimedia frame sent by the frame serial number receiving unit 301, and determine the first auxiliary information according to the frame serial number information of the original multimedia frame, and Sended to the watermark embedding module 202.

[57] In order to improve security, the auxiliary information processing module 201 may further include:

[58] The security information receiving unit 304 is configured to receive the security information, and send the information to the auxiliary information determining unit 303.

The auxiliary information determining unit 303 further receives the security information sent by the security information receiving unit 304, and determines the first auxiliary information according to the security information and the frame serial number information of the original multimedia frame.

[60] In the multimedia content, when the last frame or the plurality of frames are deleted, the auxiliary information processing module may further include:

[61] The frame number processing unit 302 is configured to receive the security information, and after the frame number receiving unit 301 determines that the original multimedia frame is the last frame, the receiving the frame number receiving unit 301 sends the The frame number information of the original frame of the original frame, determining the verification frame number of the original frame of the last frame according to the security information and the frame number information of the original frame of the last frame, and using the verification frame number as The frame number information of the last frame is sent to the auxiliary information determining unit 303;

[62] The security information receiving unit 304 is further configured to send the security information to the frame serial number processing unit 302. [63] The auxiliary information determining unit 303 further receives the frame serial number information sent by the frame serial number processing unit 302.

[64] wherein the frame number processing unit 302, the specific process of calculating the verification frame number is: converting the security information into decimal and subtracting the frame number of the original frame of the last frame, and subtracting the result from the absolute Value, the verification frame number is obtained.

[65] In the auxiliary information processing module 201, the specific structure of the auxiliary information determining unit 303 is as shown in FIG. 4, which is a structural diagram of the auxiliary information determining unit according to the embodiment of the present invention.

[66] The auxiliary information determining unit 303 specifically includes:

[67] The parameter receiving subunit 401 is configured to receive the frame serial number processing unit 302 or the frame serial number receiving unit.

Frame number information of the original multimedia frame sent by 301; and receiving the security information receiving unit 30

4 the security information sent;

[68] an encryption subunit 402, configured to acquire frame number information of the original multimedia frame and the security information from the parameter receiving subunit 401; and use the security information to frame number information of the original multimedia frame. Performing encryption to obtain the first auxiliary information;

[69] an auxiliary information sending subunit 403, configured to receive the first auxiliary information sent by the encryption subunit

And sent to the watermark embedding module 202.

[00] The specific structure of the auxiliary information determining unit 303 may also be as shown in FIG. 5, which is a structural diagram of the auxiliary information determining unit according to another embodiment of the present invention.

[71] In this embodiment, the auxiliary information determining unit 303 includes:

[72] The parameter receiving subunit 501 is configured to receive frame sequence information of the original multimedia frame sent by the frame sequence number processing unit 302 or the frame sequence number receiving unit 301; and receive the security information receiving unit 30 4 to send The security information;

[73] an operation subunit 502, configured to acquire frame number information of the original multimedia frame and the security information from the parameter receiving subunit 501; and the security information and frame number information of the original multimedia frame Converting to a binary number, and complementing the security information and one of the frame number information of the original multimedia frame with less binary digits, so that the security information and the frame number information of the original multimedia frame are binary The number of bits is the same; the security information of the same binary digit and the frame serial number information of the original multimedia frame are subjected to a modulo two addition operation, or a logical OR operation is performed to obtain the first auxiliary information. [74] an auxiliary information sending subunit 503, configured to obtain the first auxiliary information from the operation subunit 502

And sent to the watermark embedding module 202.

The digital watermark embedding apparatus of the embodiment of the present invention is described above. The digital watermark detecting apparatus of the embodiment of the present invention is described below for detecting the watermark embedding multimedia content processed by the digital watermark embedding apparatus of the embodiment of the present invention. Whether it has been tampered with.

[76] The specific structure of the device is shown in FIG. 6, and includes: an auxiliary information processing module 601 and a watermark detection module 60.

2;

[77] The auxiliary information processing module 601 is configured to receive frame serial number information of the multimedia frame embedded in the digital watermark, and determine second auxiliary information according to the frame serial number information of the multimedia frame embedded in the digital watermark;

[78] The watermark detection module 602 is configured to acquire the second auxiliary information from the auxiliary information processing module 601, and detect the digital watermark information in the embedded digital watermarked multimedia frame according to the second auxiliary information. .

[79] In order to improve security, the auxiliary information processing module 601 may be further configured to receive security information, and determine the second auxiliary according to the security information and frame number information of the embedded digital watermarked multimedia frame.

Ι π Λ∑! ,.

[80] The specific structure of the auxiliary information processing module is identical to the structure of the auxiliary information processing module in the watermark embedding apparatus described above, except that the determined second auxiliary information is sent to the watermark detecting module instead of being sent to The watermark embedding module is not mentioned here.

[81] The watermark detection module 602 is specifically configured to determine, according to the second auxiliary information, a watermark extraction coefficient from the embedded digital watermarked multimedia frame, and extract digital watermark information from the watermark extraction coefficient. Determining the intra prediction residual obtained by decoding the digital watermark embedded multimedia frame as a reference watermark generation domain, obtaining reference watermark information from the reference watermark generation domain, or using the second auxiliary information as reference watermark information And comparing the extracted digital watermark information with the reference watermark information; if the comparison result of the reference watermark information and the extracted digital watermark information is different, obtaining a detection result that the embedded digital watermarked multimedia frame is tampered with; If the comparison result of the reference watermark information and the extracted digital watermark information is the same, the detection result that the multimedia frame embedded in the digital watermark is not falsified is obtained. The digital watermark embedding apparatus and the digital watermark detecting apparatus of the embodiment of the present invention are described above. The digital watermark embedding method of the embodiment of the present invention will be described below. The digital watermark embedding method of the embodiment of the present invention is to receive the original multimedia frame and the The frame number information of the original multimedia frame is determined; the first auxiliary information is determined according to the frame serial number information of the original multimedia frame; and the digital watermark information is embedded in the original multimedia frame according to the first auxiliary information. The specific process is shown in Figure 7;

[83] Step 701: Determine a watermark embedding domain and a watermark generating domain in the original multimedia frame, and determine the digital watermark information according to the watermark generating domain.

[84] First, determining an intra prediction residual obtained by encoding the original multimedia frame as the watermark generation domain, and determining an inter prediction residual obtained by encoding the original multimedia frame as the watermark embedding domain . The coding 吋 can use various encoders according to actual needs; in addition, in the coding 吋, according to the needs of the watermark algorithm, parameters obtained in various coding processes can be selected as the watermark embedding domain and the watermark generation domain. In this embodiment, Determining the inter prediction residual as a watermark embedding domain, determining an intra prediction residual as a watermark generation domain, the watermark embedding domain is a location set in which the watermark can be embedded, and the watermark generating domain is a location for generating watermark information . Specifically, determining the digital watermark information based on the watermark generation domain may be any information in the watermark generation domain as digital watermark information. Of course, any other information can also be used as the watermark information, such as the first auxiliary information determined in the next step.

[85] Step 702: Determine first auxiliary information according to frame sequence information and security information of the original multimedia frame. [86] The watermark embedding device encodes the original frame signal, and the frame number information of the encoded original multimedia frame is encoded. The processing is sent to the auxiliary information processing module, and the auxiliary information processing module determines the first auxiliary information and returns it to the watermark embedding device by using the security information and the frame serial number information of the original multimedia frame. Of course, it is also possible to determine the first auxiliary information by using the frame number information of the original multimedia frame separately, or directly use the frame serial number as the first auxiliary information.

[87] Step 703: Determine a watermark embedding coefficient in the watermark embedding domain according to the first auxiliary information;

[88] There are many methods for determining watermark embedding coefficients in the watermark embedding domain. In this embodiment, each bit of the binary first auxiliary information is mapped one by one to each position in the watermark embedding domain, and the watermark embedding domain is determined. The corresponding first auxiliary information bit is "the coefficient at the position of Γ is the watermark embedding coefficient, as shown in Fig. 8, the coefficient at the gray position in the figure is selected as the watermark embedding coefficient. Of course, the position at "0" is selected. Coefficients are also possible. [89] Step 704, embedding the digital watermark information in the watermark embedding coefficient.

[90] The digital watermark information generated from the watermark generation domain is embedded into the determined watermark embedding coefficient by a certain embedding method, such as quantization or adjustment of the embedding coefficient, to obtain a multimedia frame embedded with the digital watermark information. Of course, the first auxiliary information may be directly embedded as digital watermark information into the determined watermark embedding coefficient to obtain a watermark embedded multimedia frame.

[91] Loop through the above steps until the last frame is processed, and the complete digital watermarked video content is obtained.

[92] In the above step 702, the specific method for determining the first auxiliary information is:

[93] First, it is judged whether the original multimedia frame currently processed is the last frame, and if not, the security information, such as the user password, various keys, etc., using various symmetric encryption algorithms, or asymmetric encryption algorithms, The frame number PicNum of the frame is encrypted to obtain the first auxiliary information; if it is the last frame, the verification frame number PicNum' of the last frame is calculated by the following formula, and PicNum' is used as the frame number of the last frame.

[94] where bin2dec() converts a binary number to a decimal number; key is a security message; abs () is an absolute value. After the verification frame number of the last frame is calculated, the verification frame number is encrypted by the security information to obtain the first auxiliary information, as with other frames.

[95] Here, the last frame is judged so that the last frame or frames of the multimedia content can be deleted, and the watermark detecting device can also detect the tampering. Of course, it is also possible not to judge and process the last frame. .

[96] In addition, in step 702, the method of determining the first auxiliary information may also be performed without using an encryption algorithm, but by a relatively simple operation. First, the frame serial number information and the security information of the original multimedia frame are converted into binary numbers, and then the frame number information of the converted original multimedia frame and the number of bits of the security information are compared, and the one with a smaller number of bits is complemented. The security information is identical to the binary digits of the frame number information of the original multimedia frame. Specifically, the complement is to add "0" before the binary bit, or to loop the binary bit, for example, the binary number of the frame number information of the original multimedia frame is 10, and the binary digit of the security information is 8, Add two "0"s before the binary bits of the security information, or add the lowest 2 bits of the binary bits of the security information to the highest 2 digits of the binary bits of the security information, ie 9, 10 bits, so that the security information becomes Is a 10-bit binary number. Then the binary bit The same number of the security information and the frame number information of the original multimedia frame are subjected to a binary operation, and the modulo 2 addition or the logical OR operation may be used to determine the calculated result as the first auxiliary information.

[97] In step 703, in order to ensure that as many watermark embedding coefficients can be selected as possible, in the binary bits of the first auxiliary information, "the number of Γ is less than the number of "0", and "0" can be selected. The coefficient in the position is used as the watermark embedding coefficient; or in step 702, the "0" and the "number" in the encrypted binary information are directly determined, and if the number of "1" is less than the number of "0", then Turn "Γ into "0" and "0" into "1".

[98] When the number of alternative watermark embedding coefficients in the watermark embedding domain and the number of bits b of the first auxiliary information do not match, the preferred processing method is:

[99] a>b吋, the first auxiliary information is cyclically mapped, for example, if a=16, b=8吋, the first auxiliary information is mapped to the first 8 bits of the watermark embedding domain, and the first auxiliary is used again. Information is mapped to the last 8 bits of the watermark embedding field

[100] a<b吋, directly delete the extra bits of the first auxiliary information.

[101] After embedding the digital watermark information in the multimedia content according to the above method, the multimedia content can be detected as follows:

[102] receiving a multimedia frame embedded with the digital watermark and frame number information of the multimedia frame embedded with the digital watermark; determining second auxiliary information according to frame number information of the multimedia frame embedded with the digital watermark; and according to the second auxiliary information The digital watermark information in the multimedia frame embedded in the digital watermark is detected.

[103] The specific inspection process is shown in Figure 9.

[104] Step 901: Determine a reference watermark generation domain and a watermark extraction domain in the multimedia frame embedded in the digital watermark, and determine reference watermark information according to the reference watermark generation domain;

[105] The multimedia frame embedded in the digital watermark is detected, corresponding to the embedding, and the inter prediction residual obtained by decoding the multimedia frame embedded in the digital watermark is determined as the extraction domain of the watermark, used to extract the watermark information; The intra prediction residual obtained by decoding the digital watermarked multimedia frame is determined as a generation domain of the reference watermark, and is used for determining the reference watermark information. As with the embedded 吋, the determination of the reference watermark information is also arbitrary, as long as it is the same as the method of detecting 数字 determining the digital watermark.

[106] Step 902: Determine second auxiliary information according to frame serial number information and security information of the multimedia frame embedded in the digital watermark; [107] The determining process of the specific second auxiliary information is the same as the step 702 in the watermark embedding process, and is not described here. Similarly, the second auxiliary information may be directly determined according to the frame serial number information of the multimedia frame embedded in the digital watermark. Or directly using the frame number information of the multimedia frame embedded in the digital watermark as the second auxiliary information.

[108] Step 903: Extract digital watermark information from the watermark extraction domain according to the second auxiliary information.

[109] extracting the watermark information is to extract the embedded watermark information from the watermark extraction coefficient determined according to the second auxiliary information, and the process of determining the watermark extraction coefficient according to the second auxiliary information is the same as step 703 in the watermark embedding process, and is no longer Praise.

[110] Step 904: Compare the reference watermark information with the extracted digital watermark information to obtain a detection result.

[111] if the comparison result of the reference watermark information and the extracted digital watermark information is different, obtaining a detection result that the embedded digital watermarked multimedia frame is tampered; if the reference watermark information and the extracted digital watermark information If the comparison result is the same, the detection result that the embedded digital watermarked multimedia frame has not been tampered with is obtained. According to the detection result, information such as the frame number and macroblock position where tampering occurs can be given.

[112] For the digital watermark detection process, the specific examples are as follows: For example, a water-printed video has a total of 100 frames, and if the transmission process, the sixth frame and the 90th frame are exchanged. In the watermark embedding, the calculation of the auxiliary information of the sixth frame is performed using PicNum = 6, and in the watermark extraction, the PicNum = 90 is calculated, and the auxiliary information obtained by the method of the embodiment of the present invention is definitely different. . In this case, it will happen that the watermark embedding position and the extraction position are misaligned, so the extracted digital watermark information is definitely different from the embedded 吋.

. The determination of the reference watermark is the same as the method of determining the original watermark information embedded in 吋, so the reference watermark and the embedded digital watermark are the same. The watermark information extracted from the watermark extraction domain is compared with the reference watermark information determined by the reference watermark generation domain, and the result of the comparison is that the two watermark information are different, indicating that the video content has been tampered with. Similarly, the same is true when the 90th frame is detected.

[113] As another example, if a frame deletion occurs during transmission, if the 50th frame is deleted, the original 51st frame will become 50 frames, and the original 52 frames will become 51 frames. Then, The frame number of the watermark embedded frame and the frame number of the extracted frame will be different, and the watermark embedding position and the extraction position will be misaligned, so that tampering can also be detected; in addition, if the last frame in the video content, that is, the 100th frame is deleted The video obtained at the decoder becomes 99 frames, and the 99th frame becomes the last frame. Here, the 99th frame is embedded, the auxiliary information is calculated using PicNum = 99 _; and in the watermark extraction, since the 99th frame has become the last one Therefore, according to the requirements of the embodiments of the present invention, PicNum is processed to obtain PicNu m', and the calculated PicNum' is not the original 99. Therefore, the watermark embedding position and the extraction position are misaligned, and the result is also Can detect tampering.

[114] The above embodiment is an example of the video content. In fact, the embodiment of the present invention can be applied to any multimedia content, such as audio, video content, etc., and the auxiliary information processing module according to the embodiment of the present invention can also be present. Any watermarking system can be used in combination. In the processing of auxiliary information, any encryption algorithm can be combined. Of course, there are many specific processing methods for auxiliary information. One embodiment of this method is to use a frame. The serial number is used as a parameter for determining the auxiliary information, and the tampering of the relationship between the frames can be detected by embedding and detecting the watermark by the auxiliary information including the frame number information. The specific processing method for the auxiliary information may be an embodiment of the present invention according to any method that can be thought of by those skilled in the art.

As can be seen from the foregoing embodiments, the embodiment of the present invention determines first auxiliary information according to frame number information of the original multimedia frame, and embeds digital watermark information in the original multimedia frame according to the first auxiliary information, to obtain A multimedia frame embedded with a digital watermark. Determining second auxiliary information according to frame number information of the embedded digital watermarked multimedia frame; and detecting digital watermark information in the digital watermark embedded multimedia frame according to the second auxiliary information. Therefore, the digital watermark information embedded in the original multimedia frame is associated with the frame number thereof. If the inter-frame relationship of the multimedia content is tampered with, the watermark information embedded in the original multimedia frame is changed, and after the detection, the reference watermark information and The extracted digital watermark information is compared, and tampering of the relationship between the frames can be detected.

[116] It will be understood by those skilled in the art that all or part of the above embodiments may be completed by a program instructing corresponding hardware, and the program may be stored in a computer readable storage medium, and executed in the program. In addition, some or all of the steps of the digital watermark embedding method and the digital watermark detecting method provided by the embodiments of the present invention may be included. Among them, a readable storage medium such as a read only memory (ROM), a random access memory (RAM), a magnetic disk, a compact disk, or the like can be read.

It is to be understood that the foregoing is only a preferred embodiment of the present invention, and is not intended to limit the scope of the invention, any modifications, equivalents, Improvements and the like should be included in the scope of the present invention.

Claims

Claim

[1] A digital watermark processing system, characterized in that the system comprises:

a digital watermark embedding apparatus, configured to receive frame number information of the original multimedia frame and the original multimedia frame, determine first auxiliary information according to frame number information of the original multimedia frame, and use the first auxiliary information in the original multimedia Embedding digital watermark information in the frame to obtain a multimedia frame embedded with the digital watermark;

a digital watermark detecting apparatus, configured to receive a multimedia frame embedded in the digital watermark and frame number information of the multimedia frame embedded in the digital watermark, and determine second auxiliary information according to frame number information of the multimedia frame embedded in the digital watermark; The second auxiliary information detects the digital watermark information in the digital watermark embedded multimedia frame.

[2] A digital watermark embedding device, characterized in that the device comprises:

An auxiliary information processing module, configured to receive frame sequence number information of the original multimedia frame, and determine first auxiliary information according to frame number information of the original multimedia frame;

And a watermark embedding module, configured to receive the original multimedia frame and the first auxiliary information, and embed the digital watermark information in the original multimedia frame according to the first auxiliary information.

[3] The digital watermark embedding apparatus according to claim 2, wherein the watermark embedding module is configured to determine a watermark embedding coefficient in the original multimedia frame according to the first auxiliary information, and the number is Watermark information is embedded in the watermark embedding coefficients.

[4] The digital watermark embedding device according to claim 2 or 3, wherein the watermark embedding module

Determining an intra prediction residual obtained by encoding the original multimedia frame as a watermark generation domain

And obtaining the digital watermark information from the watermark generation domain, or using the first auxiliary information as the digital watermark information.

[5] The digital watermark embedding apparatus according to claim 2, wherein the auxiliary information processing module

And further configured to receive the security information, and determine the first auxiliary information according to the security information and frame number information of the original multimedia frame.

[6] The digital watermark embedding apparatus according to claim 2, wherein the auxiliary information processing module comprises:

a frame number receiving unit, configured to receive frame sequence number information of the original multimedia frame; An auxiliary information determining unit, configured to acquire frame number information of the original multimedia frame from the frame number receiving unit, determine the first auxiliary information according to frame number information of the original multimedia frame, and send the first auxiliary information to the watermark Embed the module.

[7] The digital watermark embedding apparatus according to claim 6, wherein the auxiliary information processing module further comprises:

a security information receiving unit, configured to receive the security information, and send the auxiliary information determining unit to the auxiliary information determining unit, to further receive the security information sent by the security information receiving unit, according to the security information and the original multimedia frame The frame number information determines the first auxiliary information.

[8] The digital watermark embedding apparatus according to claim 7, wherein the auxiliary information processing module further comprises:

a frame number processing unit, configured to receive the security information; and, after the original multimedia frame is the last frame, obtain frame number information of the original frame of the last frame from the frame number receiving unit, according to the Determining, by the security information, the frame number information of the original frame of the last frame, the verification frame number of the original frame of the last frame, and transmitting the verification frame number as the frame number information of the last frame to the Auxiliary information determining unit;

The security information receiving unit is further configured to send the security information to the frame serial number processing unit;

The auxiliary information determining unit further receives the frame number information sent by the frame number processing unit.

[9] The digital watermark embedding apparatus according to claim 8, wherein the frame number processing unit is configured to convert the security information into decimal and correspond to a frame number of the original frame of the last frame. If the result of the subtraction is taken as an absolute value, the verification frame number is obtained.

[10] The digital watermark embedding apparatus according to claim 7, wherein the auxiliary information determining unit comprises:

a parameter receiving subunit, configured to acquire frame number information of the original multimedia frame from the frame serial number processing unit or the frame serial number receiving unit; and receive the security information; An encryption subunit, configured to acquire frame number information of the original multimedia frame and the security information from the parameter receiving subunit; encrypting, by using the security information, frame number information of the original multimedia frame to obtain Describe the first auxiliary information;

And an auxiliary information sending subunit, configured to acquire the first auxiliary information from the encryption subunit, and send the first auxiliary information to the watermark embedding module.

[11] The digital watermark embedding apparatus according to claim 7, wherein the auxiliary information determining unit comprises:

a parameter receiving subunit, configured to acquire frame number information of the original multimedia frame from the frame number processing unit or the frame number receiving unit; and receive the security information; and an operation subunit, configured to receive the parameter Receiving frame number information of the original multimedia frame and the security information sent by the subunit; converting the security information and the frame serial number information of the original multimedia frame into a binary number, and the security information and the original One of the frame number information of the multimedia frame with less binary digits is complemented, so that the security information and the frame number information of the original multimedia frame have the same binary digit; the security information with the same binary digits and The frame serial number information of the original multimedia frame is subjected to a modulo two addition operation, or a logical OR operation is performed to obtain the first auxiliary information;

And an auxiliary information sending subunit, configured to acquire the first auxiliary information from the operation subunit, and send the first auxiliary information to the watermark embedding module.

[12] A digital watermark detecting apparatus, characterized in that the apparatus comprises:

An auxiliary information processing module, configured to receive frame number information of a multimedia frame embedded with a digital watermark, determine second auxiliary information according to frame number information of the multimedia frame embedded with the digital watermark; and a watermark detection module, configured to process from the auxiliary information And acquiring, by the module, the second auxiliary information, and detecting the digital watermark information in the multimedia frame embedded in the digital watermark according to the second auxiliary information.

[13] The digital watermark detection apparatus according to claim 12, wherein the auxiliary information processing module is further configured to receive security information according to the security information and a frame number of the multimedia frame embedded in the digital watermark. The information determines the second auxiliary information.

[14] The digital watermark detecting apparatus according to claim 12, wherein the watermark detecting module, And configured to determine, according to the second auxiliary information, a watermark extraction coefficient from the embedded digital watermarked multimedia frame, and extract digital watermark information from the watermark extraction coefficient.

[15] The digital watermark detection apparatus according to claim 14, wherein the watermark detection module is configured to determine an intra prediction residual obtained by decoding the embedded digital watermarked multimedia frame as a reference watermark generation And obtaining reference watermark information from the reference watermark generation domain, or using the second auxiliary information as reference watermark information.

[16] The digital watermark detection apparatus according to claim 15, wherein the watermark detection module is configured to compare the extracted digital watermark information with the reference watermark information; if the reference watermark information and extraction If the comparison result of the digital watermark information is different, the detection result that the embedded digital watermarked multimedia frame is falsified is obtained; if the comparison result of the reference watermark information and the extracted digital watermark information is the same, the embedded digital is obtained The detection result of the watermarked multimedia frame has not been tampered with.

[17] A digital watermark embedding method, the method comprising:

Receiving original frame of the multimedia frame and frame number information of the original multimedia frame;

Determining first auxiliary information according to frame number information of the original multimedia frame;

And embedding digital watermark information in the original multimedia frame according to the first auxiliary information.

[18] The digital watermark embedding method of claim 17, wherein the embedding the digital watermark information in the original multimedia frame according to the first auxiliary information comprises:

Determining a watermark generation domain and a watermark embedding domain in the original multimedia frame, and determining the digital watermark information according to the watermark generation domain;

Embedding the digital watermark information in the watermark embedding domain according to the first auxiliary information.

[19] The digital watermark embedding method of claim 18, wherein the embedding the digital watermark information in the watermark embedding domain according to the first auxiliary information comprises:

Determining a watermark embedding coefficient in the watermark embedding domain according to the first auxiliary information, embedding the digital watermark information in the watermark embedding coefficient.

[20] The digital watermark embedding method according to claim 19, wherein the determining the watermark embedding coefficient in the watermark embedding domain according to the first auxiliary information comprises:

Mapping the binary bits of the first auxiliary information one by one to each of the watermark embedding domains Positionally, the watermark is embedded in a field in which the corresponding bit in the field is determined to be a coefficient of the watermark embedding coefficient, or the watermark is embedded in a position where the corresponding bit in the domain is "0". The coefficient is determined as the watermark embedding coefficient.

[21] The digital watermark embedding method according to claim 18, wherein the determining the watermark generation domain and the watermark embedding domain in the original multimedia frame comprises:

The intra prediction residual obtained by encoding the original multimedia frame is determined as the watermark generation domain, and the inter prediction residual obtained by encoding the original multimedia frame is determined as the watermark embedding domain.

[22] The digital watermark embedding method according to claim 17, wherein the digital watermark information is the first auxiliary information.

The digital watermark embedding method according to any one of claims 17 to 22, wherein determining the first auxiliary information according to the frame serial number information of the original multimedia frame comprises:

Obtain security information;

The first auxiliary information is determined based on the security information and frame number information of the original multimedia frame.

[24] The digital watermark embedding method according to claim 23, wherein the determining the first auxiliary information according to the security information and frame number information of the original multimedia frame comprises: if the original multimedia The frame is the last frame of the multimedia content, and the security information is converted into decimal and subtracted from the frame number of the original multimedia frame, and the subtracted result is taken as an absolute value to obtain a verification frame number;

Determining the first auxiliary information according to the security information and the verification frame sequence number.

[25] The digital watermark embedding method according to claim 23, wherein the determining the first auxiliary information according to the security information and the frame serial number information of the original multimedia frame comprises: using the security The information encrypts a frame number of the original multimedia frame, and determines an encryption result as the first auxiliary information.

[26] The digital watermark embedding method according to claim 23, wherein the determining the first auxiliary information according to the security information and the frame serial number information of the original multimedia frame comprises: Information and frame number information of the original multimedia frame are converted into binary numbers, and one of the security information and the frame number information of the original multimedia frame has a smaller number of bits Complementing, the security information and the frame number information of the original multimedia frame are the same as the binary digits; and the security information having the same binary digit and the frame serial number information of the original multimedia frame are modulo two The operation, or a logical OR operation, determines the result of the operation as the first auxiliary information.

[27] The digital watermark embedding method according to claim 23, wherein the security information comprises: a user password.

[28] A digital watermark detection method, characterized in that the method comprises:

Receiving a frame number information of the multimedia frame embedded with the digital watermark and the multimedia frame embedded with the digital watermark;

Determining second auxiliary information according to frame number information of the multimedia frame embedded with the digital watermark; and detecting digital watermark information in the multimedia frame embedded in the digital watermark according to the second auxiliary information.

[29] The digital watermark detection method according to claim 28, wherein the detecting the digital watermark information in the embedded digital watermarked multimedia frame according to the second auxiliary information is included in the embedding Determining a reference watermark generation domain and a watermark extraction domain in the multimedia frame of the digital watermark, and determining reference watermark information according to the reference watermark generation domain;

Extracting digital watermark information from the watermark extraction domain according to the second auxiliary information; comparing the reference watermark information with the extracted digital watermark information to obtain a detection result.

[30] The digital watermark detection method according to claim 29, wherein the extracting the digital watermark information from the watermark extraction domain according to the second auxiliary information comprises:

And determining watermark extraction coefficients in the watermark extraction domain according to the second auxiliary information, and extracting digital watermark information from the watermark extraction coefficients.

[31] The digital watermark detection method according to claim 29, wherein the determining the reference watermark generation domain and the watermark extraction domain in the embedded digital watermarked multimedia frame comprises: embedding the digital watermark embedded multimedia The intra prediction residual obtained after the frame decoding is determined as the reference watermark generation domain, and the inter prediction residual obtained by decoding the embedded digital watermarked multimedia frame is determined as the watermark extraction domain.

[32] The digital watermark embedding method according to claim 29, wherein the comparing the reference watermark information with the extracted digital watermark information to obtain a detection result comprises: if the reference watermark information and extraction If the comparison result of the digital watermark information is different, the detection result that the embedded digital watermarked multimedia frame is falsified is obtained; if the comparison result of the reference watermark information and the extracted digital watermark information is the same, the embedded digital is obtained The detection result of the watermarked multimedia frame has not been tampered with.

The digital watermark detection method according to any one of claims 28 to 32, wherein the determining the second auxiliary information according to the frame serial number information of the embedded digital watermarked multimedia frame comprises: obtaining security Information

And determining the second auxiliary information according to the security information and frame number information of the multimedia frame embedded with the digital watermark.

[34] The digital watermark detection method according to claim 33, wherein the determining the second auxiliary information according to the security information and the frame number information of the embedded digital watermarked multimedia frame comprises:

The frame number of the digital watermark embedded multimedia frame is encrypted by using the security information, and the encryption result is determined as the second auxiliary information.

[35] The digital watermark detection method according to claim 33, wherein the determining the second auxiliary information according to the security information and the frame number information of the embedded digital watermarked multimedia frame comprises:

Converting the security information and frame number information of the watermark embedded multimedia frame into a binary number, and supplementing the security information and the frame number information of the watermark embedded multimedia frame with less binary digits Bits, the security information and the frame number information of the watermark embedded multimedia frame are the same as the binary digits; and the security information having the same binary digit and the frame serial number information of the watermark embedded multimedia frame are modulo 2 The addition operation, or a logical OR operation, determines the operation result as the second auxiliary information.