CN111105337B

CN111105337B - Watermark processing method, information display method and related device

Info

Publication number: CN111105337B
Application number: CN201911324091.3A
Authority: CN
Inventors: 常炎隆
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-12-19
Filing date: 2019-12-19
Publication date: 2022-05-17
Anticipated expiration: 2039-12-19
Also published as: CN111105337A

Abstract

The application discloses a method for processing a watermark, which enables a digital carrier to have no distortion condition and a loss condition and to be difficult to crack the digital watermark. The method comprises the following steps: acquiring a watermark airspace image; acquiring watermark position information corresponding to the watermark airspace image; acquiring a first frequency domain image corresponding to a first original airspace image; covering the watermark space domain image in a high-frequency region in the first frequency domain image based on the watermark position information to obtain a second frequency domain image; and performing inverse Fourier transform processing on the second frequency domain image to obtain a target airspace image. According to the method and the device, the watermark airspace image can be added to the high-frequency region in the frequency domain image, and the image is hardly influenced by covering the high-frequency region, so that the digital carrier can be better in fidelity. In addition, the watermark space domain image is added in the frequency domain image, and a user cannot visually observe the position of the watermark space domain image in the digital carrier, so that the digital watermark is difficult to crack.

Description

Watermark processing method, information display method and related device

Technical Field

The present application relates to the field of multimedia processing, and in particular, to a method for watermarking, a method for displaying information, and a related apparatus.

Background

Digital watermarking (Digital Watermark) is a content-based, non-cryptographic computer information hiding technique. It is to embed some identification information (i.e. digital watermark) directly into digital carrier (such as multimedia, document and software, etc.) or indirectly (such as modifying the structure of specific area), which does not affect the use value of the original carrier, and is not easy to be ascertained and modified again, but can be recognized by the producer.

At present, digital watermarks are added to digital carriers by encrypting the digital watermarks with Least Significant Bits (LSBs). Referring to fig. 1, fig. 1 is a schematic diagram illustrating a modification of the lowest bit of a pixel value in an image based on the lowest significant bit, and as shown in the figure, a shaded "1" is the lowest significant bit, and the lowest significant bit is used for storing a digital watermark.

However, storing the digital watermark by using the least significant bits is only suitable for spatial domain information, and the spatial domain information represents a spatial domain where a two-dimensional plane of an image is located, so that a user can visually see the digital watermark of the digital carrier. This results in, on the one hand, easy cracking of the digital watermark and, on the other hand, a significant degree of damage to the digital carrier.

Disclosure of Invention

The embodiment of the application provides a watermark processing method, an information display method and a related device, which can achieve better fidelity for a digital carrier, and in addition, a user cannot visually observe the position of a watermark airspace image in the digital carrier, so that the digital watermark is difficult to crack.

In view of the above, one aspect of the present application provides a method for watermarking, including:

acquiring a watermark airspace image;

acquiring watermark position information corresponding to the watermark airspace image;

acquiring a first frequency domain image corresponding to a first original spatial domain image, wherein the first frequency domain image is obtained by performing Fourier transform on the first original spatial domain image and comprises a high-frequency region;

covering the watermark space domain image in a high-frequency region in the first frequency domain image based on the watermark position information to obtain a second frequency domain image;

and performing inverse Fourier transform processing on the second frequency domain image to obtain a target airspace image.

Another aspect of the present application provides a method for media information processing, including:

acquiring a target airspace image, wherein the target airspace image is obtained after performing inverse Fourier transform processing on a second frequency domain image, the second frequency domain image is obtained after covering a watermark airspace image in a high-frequency region in a first frequency domain image based on watermark position information, the first frequency domain image is obtained after performing Fourier transform on an original airspace image, and the first frequency domain image comprises the high-frequency region;

acquiring watermark position information corresponding to the watermark airspace image according to the target airspace image;

performing Fourier transform processing on the target airspace image to obtain a second frequency domain image;

and acquiring a watermark space domain image from the second frequency domain image based on the watermark position information.

Another aspect of the present application provides a watermark processing apparatus, including:

the acquisition module is used for acquiring a watermark airspace image;

the acquisition module is also used for acquiring watermark position information corresponding to the watermark airspace image;

the acquisition module is further used for acquiring a first frequency domain image corresponding to the first original spatial domain image, wherein the first frequency domain image is obtained by performing Fourier transform on the first original spatial domain image and comprises a high-frequency region;

the covering module is used for covering the watermark space domain image in a high-frequency area in the first frequency domain image based on the watermark position information to obtain a second frequency domain image;

and the transformation module is used for carrying out inverse Fourier transform processing on the second frequency domain image to obtain a target airspace image.

In a possible design, in a first implementation manner of another aspect of the embodiment of the present application, the watermark processing apparatus further includes a scaling module and a generating module,

the acquisition module is specifically used for acquiring a first watermark image, copyright information and watermark size information;

the scaling module is used for scaling the first watermark image based on the watermark size information to obtain a second watermark image;

the transformation module is specifically used for carrying out Fourier transformation processing on the second watermark image to obtain a first watermark frequency domain image;

the generating module is used for generating a second watermark frequency domain image according to the first watermark frequency domain image and the copyright information;

and the transformation module is specifically used for performing inverse Fourier transform processing on the second watermark frequency domain image to obtain a watermark spatial domain image.

In one possible design, in a second implementation of another aspect of an embodiment of the present application,

the generating module is specifically used for generating binary information according to the copyright information;

replacing the most significant bit of the watermark frequency domain image with binary information through a bit group BitSet function to obtain a second watermark frequency domain image;

or the like, or, alternatively,

and replacing the least significant bit of the watermark frequency domain image with binary information through a BitSet function to obtain a second watermark frequency domain image.

In one possible design, in a third implementation of another aspect of an embodiment of the present application,

the acquisition module is specifically used for acquiring a first watermark image, copyright information, watermark size information and frame rate information;

the scaling module is specifically used for scaling the first watermark image based on the watermark size information to obtain a second watermark image;

the generating module is specifically used for generating a second watermark frequency domain image according to the watermark frequency domain image, the copyright information and the frame rate information;

In one possible design, in a fourth implementation of another aspect of an embodiment of the present application,

the generating module is specifically used for generating binary information according to the copyright information and the frame rate information;

or the like, or, alternatively,

In one possible design, in a fifth implementation of another aspect of an embodiment of the present application,

the acquisition module is specifically used for acquiring a first original airspace image and basic information corresponding to the first original airspace image;

converting the first original spatial domain image into a second original spatial domain image based on the basic information, wherein the first original spatial domain image and the second original spatial domain image belong to different image formats;

and the transformation module is specifically used for carrying out Fourier transformation processing on the second original spatial domain image to obtain a first frequency domain image.

In one possible design, in a sixth implementation of another aspect of an embodiment of the present application,

the acquisition module is specifically used for acquiring a first original airspace image;

and performing Fourier transform processing on the first original spatial domain image to obtain a first frequency domain image.

In a possible design, in a seventh implementation manner of another aspect of the embodiment of the present application, the watermark processing apparatus further includes a determining module,

a determining module, configured to determine a high-frequency region in the first frequency-domain image based on the watermark location information;

and the covering module is specifically configured to cover the watermark spatial domain image as a first layer on a second layer corresponding to a high-frequency region in the first frequency domain image to obtain a second frequency domain image, where the first layer is on the second layer.

In one possible design, in an eighth implementation of another aspect of an embodiment of the present application,

a determining module, configured to obtain N high-frequency sub-regions from the first frequency domain image based on the watermark location information, where the N high-frequency sub-regions belong to a high-frequency region, the high-frequency region includes M high-frequency sub-regions, M is an integer greater than or equal to 1, and N is an integer greater than or equal to 1 and less than or equal to N;

the generating module is specifically used for generating N watermark airspace images;

and the covering module is specifically configured to cover the N watermark spatial domain images as a first layer on a second layer corresponding to the N high-frequency subregions in the first frequency domain image to obtain a second frequency domain image, where the high-frequency subregions and the watermark spatial domain images have a one-to-one correspondence relationship.

In a ninth implementation form of another aspect of the embodiment of the present application, the watermark processing apparatus further includes an adding module,

the acquisition module is also used for acquiring a binary file corresponding to the first frequency domain image;

the generating module is further used for generating data to be added according to the watermark position information and the watermark size information;

and the adding module is used for adding the data to be added into the binary file to obtain the target binary file.

Another aspect of the present application provides a media information processing apparatus, including:

the acquisition module is used for acquiring a target airspace image, wherein the target airspace image is obtained after performing inverse Fourier transform processing on a second frequency domain image, the second frequency domain image is obtained after covering a watermark airspace image in a high-frequency region in a first frequency domain image based on watermark position information, the first frequency domain image is obtained after Fourier transform of an original airspace image, and the first frequency domain image comprises the high-frequency region;

the acquisition module is also used for acquiring watermark position information corresponding to the watermark airspace image according to the target airspace image;

the transformation module is used for carrying out Fourier transformation processing on the target airspace image to obtain a second frequency domain image;

and the obtaining module is further used for obtaining the watermark space domain image from the second frequency domain image based on the watermark position information.

In a possible design, in a first implementation manner of another aspect of the embodiment of the present application, the watermark processing apparatus further includes a presentation module,

the transformation module is also used for carrying out Fourier transformation processing on the watermark spatial domain image to obtain a watermark frequency domain image;

the acquisition module is also used for acquiring copyright information according to the watermark frequency domain image;

and the display module is used for displaying the watermark airspace image and copyright information.

In a possible design, in a second implementation manner of another aspect of the embodiment of the present application, the watermark processing apparatus further includes a playing module,

the acquisition module is also used for acquiring copyright information and frame rate information according to the watermark frequency domain image;

the display module is also used for displaying the watermark airspace image and copyright information;

and the playing module is used for playing the video corresponding to the target airspace image based on the frame rate information.

Another aspect of the present application provides an electronic device, including: a memory, a transceiver, a processor, and a bus system;

wherein the memory is used for storing programs;

the processor is configured to execute the program in the memory, including performing the method of any of the above first aspects, or performing the method of any of the above second aspects;

the bus system is used for connecting the memory and the processor so as to enable the memory and the processor to communicate.

A sixth aspect of the present application provides a computer-readable storage medium having stored therein instructions, which when run on a computer, cause the computer to perform the method of the above-described aspects.

According to the technical scheme, the embodiment of the application has the following advantages:

in the embodiment of the application, a watermark spatial domain image is obtained, watermark position information corresponding to the watermark spatial domain image is obtained along with the watermark spatial domain image, a first frequency domain image is obtained after the obtained first original spatial domain image is subjected to Fourier transform, the first frequency domain image comprises a high-frequency region, the watermark spatial domain image is covered in the high-frequency region of the first frequency domain image based on the obtained watermark position information, a second frequency domain image is obtained, and finally inverse Fourier transform processing is performed on the second frequency domain image, so that a target spatial domain image is obtained. By the method, the watermark spatial domain image can be added to the high-frequency region in the frequency domain image, the high-frequency region is mainly represented by a region with steep image outline and color change in the image, so that the image is hardly influenced by covering the high-frequency region, and the digital carrier can be better in fidelity. In addition, the watermark space domain image is added in the frequency domain image, and a user cannot visually observe the position of the watermark space domain image in the digital carrier, so that the digital watermark is difficult to crack.

Drawings

FIG. 1 is a diagram illustrating modification of the least significant bit of a pixel value in an image based on the least significant bit;

fig. 2 is a schematic diagram of an architecture of a watermarking system according to an embodiment of the present application;

fig. 3 is a schematic flowchart of a watermarking method according to an embodiment of the present application;

FIG. 4 is a diagram illustrating an embodiment of a method of watermarking in an embodiment of the present application;

fig. 5 is a schematic diagram of an embodiment of watermark location information in an embodiment of the present application;

FIG. 6 is a schematic diagram of an embodiment of generating a watermark spatial domain image in an embodiment of the present application;

FIG. 7 is a schematic diagram of an embodiment of changing a pixel value in an image according to an embodiment of the present application;

FIG. 8 is a schematic diagram of another embodiment of generating a watermark spatial domain image in an embodiment of the present application;

FIG. 9 is a schematic diagram of an embodiment of first frequency domain image acquisition in an embodiment of the present application;

FIG. 10 is a schematic diagram of another embodiment of obtaining a first frequency domain image according to an embodiment of the present application;

FIG. 11 is a schematic diagram of an embodiment of a second frequency-domain image in an embodiment of the present application;

fig. 12 is a schematic diagram of another embodiment of a method for watermarking in an embodiment of the present application;

FIG. 13 is a diagram of an embodiment of a method for media information processing in an embodiment of the present application;

fig. 14 is a schematic diagram of another embodiment of watermark location information in the embodiment of the present application;

FIG. 15 is a diagram of another embodiment of a method for media information processing according to an embodiment of the present application;

FIG. 16 is a diagram of another embodiment of a method for media information processing according to an embodiment of the present application;

fig. 17 is a schematic diagram of an embodiment of a watermark processing apparatus in the embodiment of the present application;

FIG. 18 is a diagram showing an embodiment of a media information processing apparatus according to the embodiment of the present application;

FIG. 19 is a schematic diagram of a server according to an embodiment of the present application;

fig. 20 is a schematic structural diagram of a terminal device in the embodiment of the present application.

Detailed Description

The embodiment of the application provides a watermarking method, an information display method and a related device, which are used for adding a watermark spatial domain image to a high-frequency region in a frequency domain image, wherein the high-frequency region is mainly represented by a region with steeper image outline and color change in the image, so that the image is hardly influenced by covering the high-frequency region, and therefore, the digital carrier can be better in fidelity. In addition, the watermark space domain image is added in the frequency domain image, and a user cannot visually observe the position of the watermark space domain image in the digital carrier, so that the digital watermark is difficult to crack.

The terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present application and in the drawings described above, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "corresponding" and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

It should be understood that the embodiments of the present application may be applied to a scenario in which a digital watermark technology processes an image or a video, because the digital watermark technology may directly embed the digital watermark into a digital carrier (e.g., multimedia, document, and software), the use value of the original carrier may not be affected, and the digital watermark may not be easily ascertained and modified again, but may be identified by a producer, and the digital watermark may be, but is not limited to, a number, a serial number, a text, an image mark, and other copyright information, so that the digital watermark may effectively protect information security, implement anti-counterfeiting tracing, and protect copyright. Specifically, the digital watermarking technology can be applied to ticket anti-counterfeiting, hidden identification and tampering prompt of sound image data, digital work intellectual property protection and hidden communication.

Specifically, taking the application to ticket anti-counterfeiting water as an example, the ticket anti-counterfeiting watermark is a relatively special watermark, and tickets, electronic tickets and various certificates need high anti-counterfeiting degree, so that unique and invisible digital watermarks can be added into output tickets, electronic tickets and various certificates, whether the watermarks exist or not can be judged from scanned tickets, electronic tickets and various certificates in real time when needed, and the authenticity distinguishing accuracy can be improved by the digital watermarks.

In another example, for application to intellectual property rights of digital works, since copying and modifying of digital works (such as computer arts, scanned images, digital music, videos, or three-dimensional animations) are easy and can be completely similar to the original digital works, and the digital works are not only intellectual property works but also commodities, watermarks need to be added on the digital works for intellectual property protection, but obviously visible watermarks are easy to modify, so that the intellectual property watermarks of the digital works need to be concealed and robust, and have small influence on the original digital works, and the amount of watermark data needs to be relatively small.

In another example, taking hidden identification and tamper-evidence applied to image data as an example, the identification information of the data tends to be more confidential than the data itself, such as the date, longitude, and latitude of the remote sensing image. Image data without identifying information sometimes cannot even be used, but such important information is marked directly higher on the original image file that was stolen. Therefore, the digital watermarking technology can make the identification information invisible on the original image file and can only read through a special reading program, and the safety of the image data is improved. In addition, after the image data is tampered and attacked, whether the image data is tampered or not can be judged through the hidden digital watermark state, and the safety of the image data is improved.

In another example, for the application of covert communication, network information warfare is an important component of information warfare, and network information warfare can utilize public networks for confidential data transmission, however, encrypted files are often chaotic and disordered, and therefore important labels of confidential data need to be hidden, and the use of confidential data by illegal users is limited. The digital concealed digital pajamas can conceal information of various time domains and transformation domains, thereby realizing concealed communication and improving the safety and reliability of confidential data.

It will be appreciated that digital watermarking technology has many other applications and its field of application is expanding and therefore the embodiments of the present application are not intended to be exhaustive. The way of adding a digital watermark to a digital carrier may be to encrypt the digital watermark with least significant bits, which may be used to detect the parity of the number, and conversely referred to as most significant bits, in which the digital watermark may be stored. In the automatic playing method of the YUV file, the parameters can be written in the head of the YUV file to play the YUV file, so that the byte number of the preset length is read from the tail of the YUV file during playing. However, the digital watermark is only suitable for spatial domain information by adopting the least significant bit to store the digital watermark, and the spatial domain information represents a spatial domain where a two-dimensional plane of an image is located, so that a user can visually see the digital watermark of the digital carrier, and therefore, on one hand, the digital watermark is easy to crack, and on the other hand, the digital carrier is obviously damaged. In addition, because the YUV file playing preparation conditions are complicated, and when the information corresponding to the YUV file cannot be accurately known or the information corresponding to the YUV file is input incorrectly, the YUV file cannot be played correctly, and the displayed addition parameters also reduce the encryption of the YUV file.

Based on the foregoing various scenarios, the present application provides a method for watermarking, where the method is applied to a watermarking system shown in fig. 2, for easy understanding, please refer to fig. 2, and fig. 2 is a schematic structural diagram of the watermarking system in an embodiment of the present application, where as shown in the drawing, the watermarking system includes a server and a terminal device.

Specifically, the server may obtain a watermark spatial domain image, then obtain watermark position information corresponding to the watermark spatial domain image along with the watermark spatial domain image, then obtain a first frequency domain image after performing fourier transform on the obtained first original spatial domain image, where the first frequency domain image includes a high-frequency region, cover the watermark spatial domain image in the high-frequency region of the first frequency domain image based on the obtained watermark position information, obtain a second frequency domain image, and finally perform inverse fourier transform on the second frequency domain image, so as to obtain a target spatial domain image.

After the target airspace image is obtained, when the terminal equipment initiates a playing request, the server can analyze the target airspace image to obtain watermark position information corresponding to the watermark airspace image, then perform Fourier transform processing on the target airspace image to obtain a second frequency domain image, and finally obtain the watermark airspace image from the second frequency domain image based on the watermark position information.

It is understood that the server in fig. 2 is a server cluster or a cloud computing center that may be one server or a plurality of servers, and the details are not limited herein. The terminal device may be a tablet computer, a notebook computer, a palm computer, a mobile phone, a Personal Computer (PC) and a voice interaction device shown in fig. 2, and may also be a monitoring device, a face recognition device, and the like, which is not limited herein. The voice interaction device includes, but is not limited to, an intelligent sound and an intelligent household appliance.

The terminal device and the server can communicate with each other through a wireless network, a wired network or a removable storage medium. Wherein the wireless network described above uses standard communication techniques and/or protocols. The wireless Network is typically the internet, but can be any Network including, but not limited to, bluetooth, Local Area Network (LAN), Metropolitan Area Network (MAN), Wide Area Network (WAN), mobile, private, or any combination of virtual private networks. In some embodiments, custom or dedicated data communication techniques may be used in place of or in addition to the data communication techniques described above. The removable storage medium may be a Universal Serial Bus (USB) flash drive, a removable hard drive or other removable storage medium, and the like.

Although only five terminal devices and one server are shown in fig. 2, it should be understood that the example in fig. 2 is only used for understanding the present solution, and the number of the specific terminal devices and the number of the servers should be flexibly determined according to actual situations.

For convenience of description, please refer to fig. 3, where fig. 3 is a schematic flowchart of a watermark processing method in an embodiment of the present application, and the method for object control provided by the present application may be divided into the flows shown in the figure, and each flow is described below, specifically:

and the high-frequency watermark generating module is used for converting the acquired watermark image into a high-frequency watermark space domain image. In the high-frequency watermark generating module, step S1 may obtain a first watermark image, copyright information, and watermark size information from the loading input module, step S2 may perform scaling processing on the first watermark image based on the watermark size information obtained in step S1 to obtain a second watermark image, step S3 may perform fourier transform processing on the second watermark image obtained in step S2 to obtain a first watermark frequency domain image, step S4 may further generate a second watermark frequency domain image according to the watermark frequency domain image and the copyright information obtained in the foregoing step, and step S5 may perform inverse fourier transform processing on the second watermark frequency domain image generated in step S4 to obtain a watermark spatial domain image.

The image decoding and reading module is used for converting the original spatial domain image into a frequency domain image. In the image decoding and reading module, if the image format is YUV format, the first original spatial domain image and the basic information corresponding to the first original spatial domain image are obtained in step S6, where the first original spatial domain image is YUV format, then step S7 may convert the first original spatial domain image into a second original spatial domain image based on the basic information obtained in step S6, where the second original spatial domain image is Red Green Blue (RGB) format, and step S8 performs fourier transform processing on the second original spatial domain image obtained in step S7 to obtain the first frequency domain image including the high frequency region as shown in fig. 3 (B). When the image format is the RGB format, the first original spatial domain image shown in (a) of fig. 3 is obtained through step S9, and then the fourier transform process may be performed on the first original spatial domain image obtained in step S9 in step S10, so as to obtain the first frequency domain image including the high frequency region shown in (B) of fig. 3.

The watermark processing module is used for covering the watermark space domain image on the frequency domain image so as to obtain a target space domain image. After the watermark spatial domain image is obtained in step S5 and the first frequency domain image is obtained in step S8 or S10, the watermark position information corresponding to the watermark spatial domain image may be obtained in step S11, step S12 may cover the watermark spatial domain image in the high frequency region of the first frequency domain image based on the watermark position information obtained in step S11 to obtain the second frequency domain image shown in (C) in fig. 3, and finally step S13 performs inverse fourier transform processing on the second frequency domain image obtained in step S12 to obtain the target spatial domain image shown in (D) in fig. 3, thereby completing the watermark processing.

With reference to the above description, the following description will describe a method of watermarking in the present application, please refer to fig. 4, where fig. 4 is a schematic diagram of an embodiment of a method of watermarking in an embodiment of the present application, and as shown in the drawing, an embodiment of the method of watermarking in an embodiment of the present application includes:

101. acquiring a watermark airspace image;

in this embodiment, the watermark processing apparatus may obtain a watermark airspace image, where the watermark airspace image may be a trademark (logo) of a company, or may be a mark, and this is not limited here. Specifically, the spatial domain refers to a spatial domain where a two-dimensional plane of an image is located, and the spatial domain may also be referred to as an image space (image space), which is a space formed by image elements. The direct processing of pixel values in image space with length or distance as an argument is called spatial domain processing. The spatial domain may also be referred to as a pixel domain, and the processing in the spatial domain is processing at a pixel level, such as image superposition at a pixel level, and after fourier transformation of the spatial domain image, a frequency spectrum of the image, i.e., a frequency domain image, may be obtained, which may represent an energy gradient of the image. In this embodiment, the watermark spatial domain image is a pair of images that are usually seen in visualization.

It should be noted that the watermarking apparatus may be deployed in a server or a terminal device, and this application is described by taking the deployment in the server as an example, but this should not be construed as a limitation to this application.

102. Acquiring watermark position information corresponding to the watermark airspace image;

in this embodiment, after acquiring the watermark spatial domain image in step 101, the watermark processing apparatus may acquire watermark position information corresponding to the watermark spatial domain image. The watermark position information is used to indicate the position of the watermark airspace image, for example, the watermark position information is used to indicate that the watermark airspace image is located at the lower left, upper right, or lower right of the image to be watermarked, which may be specifically represented as coordinate information, and the watermark position is determined by the abscissa and the ordinate. It should be understood that in practical applications, the watermark location information may also indicate other locations, which is not exhaustive here.

For the convenience of understanding, please refer to fig. 5, where fig. 5 is a schematic diagram of an embodiment of watermark location information in an embodiment of the present application, and as shown in the figure, if the watermark location information indicates "upper left", it indicates that the watermark spatial domain image is located at the upper left of the image to be watermarked (i.e. the location shown in a 1). If the watermark position information indicates "upper right", it indicates that the watermark spatial domain image is located at the upper right of the image to be watermarked (i.e., the position indicated by a 2). If the watermark location information indicates "lower left", it indicates that the watermark spatial domain image is located at the upper left of the image to be watermarked (i.e., the location indicated by a 3). If the watermark location information indicates "lower right", it indicates that the watermark spatial domain image is located at the lower right of the image to be watermarked (i.e., the location indicated by a 4). In practical application, the image can also be any area of the edge of the image.

103. Acquiring a first frequency domain image corresponding to a first original spatial domain image, wherein the first frequency domain image is obtained by performing Fourier transform on the first original spatial domain image and comprises a high-frequency region;

in this embodiment, the watermark processing apparatus may further acquire a first original spatial domain image, where the first original spatial domain image may be an image received by the watermark processing apparatus through a wired network, or may be an image stored by the watermark processing apparatus itself. The first original spatial domain image is the image to be added with the watermark, and may be a picture, for example. The watermark processing device may further perform fourier transform on the first original spatial domain image to obtain a first frequency domain image including high frequency regions. The frequency domain may also be referred to as a frequency domain (frequency domain), that is, any waveform may be decomposed into a sum of a plurality of sine waves, each sine wave having its own frequency and amplitude, so that any waveform signal has its own set of frequency and amplitude, and the frequency domain is a signal obtained by fourier transform in a spatial domain.

For ease of understanding, the high frequency region and the low frequency region will be described below. After the first original spatial domain image is converted into the first frequency domain image, the center point of the first frequency domain image may be the coordinate (0, 0), where (x, y) represents the frequency intensity of the first frequency domain image. The color in the image changes slowly, that is, the gray scale changes slowly, the frequency intensity is low, that is, it means that it is a continuously changing area, and this part of the area is the low frequency area. For the same image, the opposite region is a high frequency region, and the high frequency is a frequency region, that is, the gray scale in the image changes rapidly, which means that the gray scale difference between adjacent regions in the image is large, and therefore, the region with large gray scale difference between adjacent regions in the image can be called as a high frequency region. For example, for the same image, the gray value of the image edge changes greatly, the corresponding frequency is high, and the gray value of the image middle part changes slightly, that is, the high frequency area is located at the image edge, and the low frequency area is located at the image middle part. And after the first original spatial domain image is subjected to Fourier transform, the information of the first original spatial domain image is concentrated in a low-frequency region, and the coefficient of a high-frequency region is small and can be almost ignored.

The frequency of the image is an index indicating how strongly the gradation changes in the image, and is the gradient of the gradation in the plane space. For example: the large area desert is a region with slow gray scale change in the image, the corresponding frequency value is very low, and the edge region with violent surface attribute change is a region with violent gray scale change in the image, and the corresponding frequency value is high. And the fourier transform may be to convert the image from a spatial domain to a frequency domain, and the inverse transform thereof may be to convert the image from the frequency domain to the spatial domain, that is, the fourier transform may transform a gray distribution function of the image into a frequency distribution function of the image, and the inverse fourier transform may transform the frequency distribution function of the image into a gray distribution function.

It should be noted that there is no chronological order between step 102 and step 103, that is, the watermark processing apparatus may execute step 102 and step 103 at the same time, or execute step 102 and then step 103, or execute step 103 and then step 102, and the specific details are not limited herein.

104. Covering the watermark space domain image in a high-frequency region in the first frequency domain image based on the watermark position information to obtain a second frequency domain image;

in this embodiment, after the watermark processing apparatus acquires the first frequency domain image in step 103, it may determine, according to the watermark position information, a specific position where the watermark airspace image should be covered on the first frequency domain image, and then cover the watermark airspace image acquired in step 101 on a high-frequency region in the first frequency domain image to obtain the second frequency domain image. Because the gray scale of the watermark spatial domain image is not similar to and changes with the first frequency domain image, the gray scale change of the high-frequency region in the first frequency domain image is large, the part corresponding to the spatial domain region has steeper image outline and color change, and because the information of the first frequency domain image in the high-frequency region is less, the influence of covering the watermark spatial domain image in the high-frequency region on the first frequency domain image is small. If the watermark airspace image is covered in the low-frequency area of the first frequency domain image, because the gray scale change of the low-frequency area in the first frequency domain image is small, the part corresponding to the airspace area is a part with slow color change, and the information of the first frequency domain image in the low-frequency area is more, the influence of the watermark airspace image covered in the low-frequency area on the first frequency domain image is larger, the authenticity of the second frequency domain image is reduced, and the distortion of the subsequent image is caused. Therefore, the embodiment selects to overlay the watermark space domain image in the high frequency region of the first frequency domain image.

105. And performing inverse Fourier transform processing on the second frequency domain image to obtain a target airspace image.

In this embodiment, after the watermark processing apparatus acquires the second frequency domain image in step 104, the inverse fourier transform processing may be performed on the second frequency domain image to obtain the target spatial domain image. Specifically, the inverse transform may convert the image from the frequency domain to the spatial domain, that is, the inverse fourier transform may transform a frequency distribution function of the image into a gray distribution function. The high-frequency area in the second frequency domain image is a darker area, the low-frequency area is a brighter area, the brightness can also show the energy distribution in the second frequency domain image, and if the number of dark points in the second frequency domain image is more, the obtained target airspace image is softer (because the gray level difference is small). On the contrary, if the bright points in the spectrogram are many, the obtained target airspace image is sharp, the boundary is clear, and the difference between the pixels on the two sides of the boundary is large. It should be understood that the target spatial domain image is an RGB image, and in practical applications, the target spatial domain image can be converted into an image in YUV format under different requirements.

Optionally, on the basis of the foregoing embodiments corresponding to fig. 4, in an optional embodiment of the watermarking method provided in the embodiment of the present application, the obtaining a watermark spatial domain image may include:

acquiring a first watermark image, copyright information and watermark size information;

based on the watermark size information, carrying out scaling processing on the first watermark image to obtain a second watermark image;

performing Fourier transform processing on the second watermark image to obtain a first watermark frequency domain image;

generating a second watermark frequency domain image according to the first watermark frequency domain image and copyright information;

and performing inverse Fourier transform processing on the second watermark frequency domain image to obtain a watermark spatial domain image.

In this embodiment, after obtaining the first watermark image, the copyright information, and the watermark size information, the watermark processing apparatus may perform scaling processing on the first watermark image based on the watermark size information to obtain a second watermark image, then perform fourier transform processing on the second watermark image to obtain a first watermark frequency domain image, further generate a second watermark frequency domain image according to the first watermark frequency domain image and the copyright information, and finally perform inverse fourier transform processing on the second watermark frequency domain image to obtain a watermark spatial domain image.

For easy understanding, please refer to fig. 6, where fig. 6 is a schematic view of an embodiment of generating a watermark spatial domain image in the embodiment of the present application, as shown in the figure, the watermark processing apparatus may first obtain a first watermark image, copyright information, and watermark size information from the loading input module through step W1, where the first watermark image is a spatial domain image, and the first watermark image may be an image received by the watermark processing apparatus through a wired network or an image stored by the watermark processing apparatus itself. The loading input module is used for loading first original airspace image attribute information, a first original airspace image, a first watermark image, copyright information and watermark size information. The copyright information may be information related to copyright protection, such as artist information, photographer information, and image copyright holder information, which may be presented in the form of text information or pictures. Copyright information needs to be stored in the image in byte form. The watermark size information may be a length and width size of the first watermark image.

The watermark processing apparatus may perform scaling processing on the first watermark image based on the obtained watermark size information to obtain a second watermark image by step W2. The scaling process may include, but is not limited to, scaling down, enlarging, and cropping the first watermark image. Then, the second watermark image is subjected to Fourier transform processing in the step W3 to obtain a first watermark frequency domain image, copyright information is converted into computer byte information in the step W4 and stored in the first watermark frequency domain image to generate a second watermark frequency domain image, and finally, inverse Fourier transform processing is performed on the second watermark frequency domain image in the step W5 to obtain a watermark space domain image.

In the embodiment of the application, a method for acquiring a watermark airspace image is provided, which includes performing scaling processing on a first watermark image based on acquired watermark size information to obtain a second watermark image, performing fourier transform processing on the second watermark image to obtain a first watermark frequency domain image, generating a second watermark frequency domain image according to the acquired first watermark frequency domain image and copyright information, and finally performing inverse fourier transform processing on the second watermark frequency domain image to obtain the watermark airspace image. By the mode, the non-airspace watermark can prevent pirate washing of the watermark, so that the confidentiality and copyright protection of the watermark airspace image can be improved, and the safety and copyright protection of watermark processing are improved.

Optionally, on the basis of the foregoing embodiments corresponding to fig. 4, in an optional embodiment of the method for watermarking provided in the embodiment of the present application, the generating a second watermark frequency domain image according to the watermark frequency domain image and the copyright information may include:

generating binary information according to the copyright information;

or, generating the second watermark frequency domain image according to the watermark frequency domain image and the copyright information may include:

generating binary information according to the copyright information;

In this embodiment, the watermark processing apparatus may generate binary information according to the copyright information, and then replace the most significant bit of the watermark frequency domain image with the binary information through the BitSet function to obtain a second watermark frequency domain image, and may further replace the watermark with the binary information through the BitSet functionAnd replacing the least significant bit of the frequency domain image with binary information to obtain a second watermark frequency domain image. Specifically, the Most Significant Bit (MSB) represents the most significant bit in the binary system, which may indicate the (n-1) th bit in an n-bit binary digit, and has the highest weight of 2ⁿ1, i.e. in a 16-bit digital image, the most significant bit has the greatest effect on the 16-bit value. The most significant bit is the high leading bit and the least significant bit is the low leading bit.

The BitSet function operates on a binary digit number, and each digit is used to store only 0 or 1, and one bit is used to indicate whether a datum is present, 0 is not present, and 1 is present. When used, the BitSet function can be used to mark data according to whether a bit is 0 or not.

For easy understanding, please refer to fig. 7, fig. 7 is a schematic diagram of an embodiment of changing a pixel value in an image according to an embodiment of the present application, and as shown in the figure, for an 8-bit 2-ary number "10010101," 1 "corresponding to B1 in fig. 7 represents a most significant bit, and" 1 "corresponding to B2 in fig. 7 represents a least significant bit. Binary information is generated from the copyright information, the most significant bits are replaced with the binary information by a BitSet function, for example, the most significant bits in a binary number "10010101" are replaced, and a second watermark frequency domain image is generated based on the most significant bits. Alternatively, the least significant bits are replaced by binary information through the BitSet function, for example, the least significant bits in the binary number "10010101" are replaced, and the second watermark frequency domain image is generated based on the least significant bits.

In the embodiment of the present application, a method for obtaining a second watermark frequency domain image is provided, which may generate binary information according to copyright information, and then replace the most significant bit of the watermark frequency domain image with the binary information through a BitSet function to obtain the second watermark frequency domain image, or replace the least significant bit of the watermark frequency domain image with the binary information through the BitSet function to obtain the second watermark frequency domain image. By adopting the mode, the MSB is adopted to insert information into the watermark image for the second time, the situation that the LSB is frequently used in the prior art market can be avoided, the LSB is not easy to crack, the playing information is finally stored, and if a pirate party carries out forced lossy transformation on the watermark image, the watermark image can not be played finally, so that the safety of the watermark image is improved.

acquiring a first watermark image, copyright information, watermark size information and frame rate information;

generating a second watermark frequency domain image according to the watermark frequency domain image, the copyright information and the frame rate information;

In this embodiment, when the first watermark image is an image obtained from a video stream, the watermark processing apparatus may obtain the first watermark image, copyright information, watermark size information, and frame rate information. The video stream formats include, but are not limited to, Motion Picture Experts Group (MPEG) format, Audio Video Interleaved (AVI) format, Advanced Streaming Format (ASF) format, Windows Media Video (WMV) format, and video container variable bit rate file format (RMVB). The copyright information may be, but is not limited to, copyright protection related information of the video, such as video sponsor information and video copyright attribution. The frame rate information is a Frame Per Second (FPS) representing the number of frames per second transmitted in the picture of the first watermark image. The frame rate information is information quantity measured for storing and displaying dynamic video. For example, if the video from which the first watermark image is extracted plays 24 frames of images in one second, the corresponding frame rate information is 24 frames per second. The watermark size information may be the length and width size of the first watermark image and xy coordinate information.

For easy understanding, referring to fig. 8, fig. 8 is a schematic diagram of another embodiment of generating a watermark spatial domain image in the embodiment of the present application, as shown in the drawing, in step X1, the watermark processing apparatus obtains a first watermark image, copyright information, watermark size information, and frame rate information, where the first watermark image is a spatial domain image, and the first watermark image may be an image received by the watermark processing apparatus through a wired network or an image stored by the watermark processing apparatus itself. The loading input module is used for loading first original airspace image attribute information, a first original airspace image, a first watermark image, copyright information, watermark size information and frame rate information. Specifically, the copyright information may be information related to copyright protection, such as artist information, photographer information, and image copyright holder information, which may be presented in the form of text information or pictures. Copyright information needs to be stored in the image in byte form. The watermark size information may be a length and width size of the first watermark image.

The watermark processing apparatus may perform scaling processing on the first watermark image based on the acquired watermark size information to obtain a second watermark image in step X2. The scaling process may include, but is not limited to, scaling down, enlarging, and cropping the first watermark image. Performing fourier transform processing on the second watermark image in step X3 to obtain a first watermark frequency domain image, converting copyright information and frame rate information into computer byte information through step X4, storing the computer byte information in the first watermark frequency domain image to generate a second watermark frequency domain image, and finally performing inverse fourier transform processing on the second watermark frequency domain image in step X5 to obtain a watermark spatial domain image.

In the embodiment of the application, another method for acquiring a watermark spatial domain image is provided, in which a first watermark image is scaled based on acquired watermark size information to obtain a second watermark image, the second watermark image is subjected to fourier transform to obtain a first watermark frequency domain image, a second watermark frequency domain image is generated according to the acquired first watermark frequency domain image, copyright information and frame rate information, and finally, the second watermark frequency domain image is subjected to inverse fourier transform to obtain the watermark spatial domain image. By the mode, the non-airspace watermark can prevent pirate washing of the watermark, so that the confidentiality and copyright protection of the watermark airspace image can be improved, and the safety and copyright protection of watermark processing are improved. Secondly, as the frame rate information is written into the first watermark frequency domain image, the consistency of the subsequent images in the video stream playing is improved, thereby improving the practicability of the watermark processing.

Optionally, on the basis of the foregoing embodiments corresponding to fig. 4, in an optional embodiment of the method for watermarking provided in the embodiment of the present application, the generating a second watermark frequency domain image according to the watermark frequency domain image, the copyright information, and the frame rate information may include:

generating binary information according to the copyright information and the frame rate information;

or, generating the second watermark frequency domain image according to the watermark frequency domain image, the copyright information, and the frame rate information may include:

In this embodiment, the watermark processing apparatus may generate binary information according to the copyright information and the frame rate information, and then replace the most significant bit of the watermark frequency domain image with the binary information through the BitSet function to obtain the second watermark frequency domain image, and may also replace the least significant bit of the watermark frequency domain image with the binary information through the BitSet function to obtain the second watermark frequency domain image.

For easy understanding, please refer to fig. 7 again, fig. 7 is a schematic diagram of an embodiment of changing a pixel value in an image according to an embodiment of the present application, and as shown in the figure, for an 8-bit 2-ary number "10010101," 1 "corresponding to B1 in fig. 7 represents a most significant bit, and" 1 "corresponding to B2 in fig. 7 represents a least significant bit. Replacing the most significant bits of the watermark frequency domain image based on the binary information by replacing the most significant bits of the binary information with the binary information, e.g., replacing the most significant bits of the binary number "10010101", and generating a second watermark frequency domain image based on the most significant bits, according to the binary information generated by the copyright information and the frame rate information. Alternatively, the least significant bits are replaced by binary information through the BitSet function, for example, the least significant bits in the binary number "10010101" are replaced, and the second watermark frequency domain image is generated based on the least significant bits.

In the embodiment of the present application, a method for obtaining a second watermark frequency domain image is provided, which may generate binary information according to copyright information and frame rate information, and then replace a most significant bit of the watermark frequency domain image with the binary information through a bit group BitSet function to obtain the second watermark frequency domain image, or replace a least significant bit of the watermark frequency domain image with the binary information through the BitSet function to obtain the second watermark frequency domain image. By adopting the mode, the MSB is adopted to insert information into the watermark image for the second time, so that the condition that the LSB is frequently used in the prior art market can be avoided, the LSB is not easy to crack and the playing information is finally stored, and secondly, as the frame rate information is written into the first watermark frequency domain image, if pirates perform forced lossy transformation on the watermark image, the watermark image can not be played or normally played finally, and thus the security of the watermark image is improved. Secondly, as the frame rate information is written into the first watermark frequency domain image, the subsequent complete playing can be continued when a certain frame in the video stream is lost, thereby improving the practicability of the watermark processing.

Optionally, on the basis of the various embodiments corresponding to fig. 4, in an optional embodiment of the watermarking method provided in the embodiment of the present application, the obtaining of the first frequency domain image corresponding to the first original spatial domain image may include:

acquiring a first original airspace image and basic information corresponding to the first original airspace image;

and performing Fourier transform processing on the second original spatial domain image to obtain a first frequency domain image.

In this embodiment, assuming that the first original spatial domain image is in a YUV format, the watermarking device first obtains the first original spatial domain image and basic information corresponding to the first original spatial domain image, converts the first original spatial domain image into a second original spatial domain image based on the basic information, and then performs fourier transform processing on the second original spatial domain image to obtain the first frequency domain image. The basic information includes a type of the first original spatial domain image (i.e., a sampling manner of the first original spatial domain image) and size information of the first original spatial domain image. The image formats stored in the image file include, but are not limited to, Bitmap (BMP) format, personal computer exchange (PCX) format, graphics exchange format (GIF), Joint Photographic Experts Group (JPEG), and Portable Network Graphics (PNG). The present embodiment performs classification based on color classification of the image file, and can be classified into YUV format or RGB format.

Assuming that the first frequency domain image is in an RGB format, if the acquired first original spatial domain image is in a YUV format, the YUV format needs to be converted. Specifically, YUV is divided into three components, "Y" represents brightness (i.e., gray scale value), and "U" and "V" represent chroma (i.e., chroma) that can be used to describe image color and saturation to specify pixel color. YUV is a color coding method, mainly used in the field of television systems and analog videos, it separates the brightness information "Y" from the color information "U" and "V", it can display the complete image without the "U" and "V" information, it is only black and white, and YUV does not require the simultaneous transmission of three independent video signals, so it has low bandwidth occupancy rate to transmit the image by YUV way.

Specifically, the YUV format can be divided into two types, the first type is to store "Y" of all pixel points continuously, then store "U" of all pixel points, then store "V" of all pixel points, and the second type is to store "Y", U ", and" V "of each pixel point in a continuous and staggered manner. The storage format of the YUV code stream is closely related to the sampling mode thereof, the YUV sampling mode may include, but is not limited to YUV444, YUV422 and YUV420, and only if the YUV value of each pixel point is restored from the code stream correctly according to the sampling format thereof, the RGB value of each pixel point can be extracted through the conversion formula of YUV and RGB, that is, the first original airspace image is converted into the second original airspace image. The present application is described by taking YUV444 format as an example.

The conversion formula of YUV and RGB can be converted according to the following formula, and it should be understood that, in practical application, the corresponding formula can also be used according to different sampling modes and different quantization results:

R＝Y+1.402(V-128)；

G＝Y+0.34414(U-128)-0.71414(V-128)；

B＝Y+1.772(U-128)；

where Y "represents brightness," U "and" V "represent chromaticity, R represents red (red), G represents green (green), and B represents blue (blue).

For the YUV444 sampling mode, each Y corresponds to a group of UV components, and the image and RGB occupy the same pixel size, which is pixel size × 3, where pixel size represents the pixel size. For the YUV422 sampling mode, every two Ys share a set of UV components, and the image occupies pixels with size of pixel size + pixel size/2+ pixel size/2. For the YUV420 sampling mode, every four Ys share a set of UV components, and the image occupies pixels of size pixel + pixel size/4+ pixel size/4. It can be understood that, because the YUV422 and YUV420 sampling manners cannot completely restore the YUV value of each pixel point from the code stream, the RGB value extracted by the YUV-to-RGB conversion formula is lost, which may cause data loss and cannot be restored, and therefore, the YUV sampling manner in this embodiment is YUV444, and the YUV444 may restore the YUV value of each pixel point from the code stream, and therefore, the loss of the RGB value extracted by the YUV-to-RGB conversion formula is low, which improves the retention rate of data, and thus improves the authenticity of the first frequency domain image.

For easy understanding, referring to fig. 9, fig. 9 is a schematic diagram of an embodiment of obtaining a first frequency domain image in the embodiment of the present application, as shown in the figure, the watermarking apparatus may obtain, in step Y1, the first original spatial domain image shown in fig. 9(a) and the basic information corresponding to the first original spatial domain image, where the first original spatial domain image is an image in YUV format, and the first original spatial domain image may be an image received by the watermarking apparatus through a wired network or an image stored by the watermarking apparatus itself. The loading input module is used for loading a first original spatial domain image and basic information of the first original spatial domain image. Since the first original spatial domain image is in YUV format and the second original spatial domain image is in RGB format, which belong to different image formats, the watermarking apparatus may convert the first original spatial domain image into the second original spatial domain image shown in fig. 9(B) based on the basic information in step Y2, and then perform fourier transform processing on the second original spatial domain image in step Y3 to obtain the first frequency domain image shown in fig. 9 (C).

In the embodiment of the application, when the first original spatial domain image and the second original spatial domain image belong to different image formats, a method for acquiring the first frequency domain image is provided, and the acquired first original spatial domain image can be converted into the second original spatial domain image based on basic information corresponding to the acquired first original spatial domain image, and then the second original spatial domain image is subjected to fourier transform processing to obtain the first frequency domain image. Through the mode, the YUV format has the characteristic of separating the brightness information and the color information, but the general image processing operation is based on the RGB format, and the compatibility of the RGB format is higher, so that the first frequency domain image is obtained by performing Fourier transform processing after the YUV format is converted into the RGB format, the compatibility of the first frequency domain image can be improved, and the feasibility of the embodiment of the application is realized.

acquiring a first original airspace image;

In this embodiment, assuming that the first original spatial domain image is in an RGB format, the watermarking apparatus may first obtain the first original spatial domain image, and then directly perform fourier transform processing on the first original spatial domain image to obtain the first frequency domain image.

To facilitate understanding, referring to fig. 10, fig. 10 is a schematic diagram of another embodiment of obtaining a first frequency domain image in the embodiment of the present application, as shown in the figure, the watermark processing apparatus obtains a first original spatial domain image as shown in fig. 10(a) in step Z1, where the first original spatial domain image may be an image received by the watermark processing apparatus through a wired network, or may be an image stored by the watermark processing apparatus itself. The loading input module is used for loading the first original airspace image and the size information corresponding to the first original image. Since the first original spatial domain image is in RGB format, the watermarking apparatus may directly perform fourier transform processing on the first original spatial domain image in step Z2 to obtain the first frequency domain image shown in fig. 10 (B).

In the embodiment of the present application, another method for acquiring a first frequency domain image is provided, which may be used to directly perform fourier transform processing on an acquired first original spatial domain image to obtain a first frequency domain image. By the method, the RGB format has good compatibility, the image in the RGB format is subjected to Fourier transform processing, the compatibility of the first frequency domain image can be improved, and the generation efficiency of the first frequency domain image is improved, so that the feasibility of the embodiment of the application is realized.

Optionally, on the basis of each embodiment corresponding to fig. 4, in an optional embodiment of the method for watermarking provided in the embodiment of the present application, based on the watermark position information, the covering the watermark spatial domain image in the high-frequency region of the first frequency domain image to obtain the second frequency domain image may include:

determining a high-frequency region in the first frequency domain image based on the watermark location information;

and covering the watermark space domain image on a second image layer corresponding to a high-frequency region in the first frequency domain image to obtain a second frequency domain image, wherein the first image layer is arranged on the second image layer.

In this embodiment, the watermark processing apparatus may determine a high-frequency region in the first frequency domain image based on the watermark location information, then use the watermark spatial domain image as a first layer, and cover the first layer on a second layer corresponding to the high-frequency region in the first frequency domain image, to obtain a second frequency domain image, that is, the first layer is on the second layer, and the watermark spatial domain image is on the high-frequency region in the first frequency domain image. For easy understanding, referring to fig. 11, fig. 11 is a schematic diagram of an embodiment of the second frequency-domain image in the embodiment of the present application, as shown in the figure, the watermark spatial-domain image indicated by C1 is located in the first image layer, and the first frequency-domain image indicated by C2 is located in the second image, this embodiment is described by taking an example that the watermark location information indicates the watermark spatial-domain image at the upper left, a high-frequency region in the first frequency-domain image is determined to be a region indicated by C21 based on the watermark location information, and then the first image layer C1 is overlaid on a high-frequency region in the first frequency-domain image C2 to be C21, so that the second frequency-domain image C3 can be obtained.

In the embodiment of the application, a method for acquiring a second frequency domain image is provided, in which a high-frequency region in a first frequency domain image is determined based on watermark position information, and a watermark spatial domain image is covered on a second image layer corresponding to the high-frequency region in the first frequency domain image as a first image layer, so as to obtain the second frequency domain image. By the method, the second frequency domain image can be obtained based on the high-frequency region determined by the watermark position information, and the watermark coverage accuracy is improved, so that the accuracy of the embodiment of the application is improved.

Optionally, on the basis of the foregoing embodiments corresponding to fig. 4, in an optional embodiment of the method for watermarking provided in this embodiment of the present application, the determining a high-frequency region in the first frequency-domain image based on the watermark position information includes:

acquiring N high-frequency sub-regions from the first frequency domain image based on the watermark position information, wherein the N high-frequency sub-regions belong to a high-frequency region, the high-frequency region comprises M high-frequency sub-regions, M is an integer greater than or equal to 1, and N is an integer greater than or equal to 1 and less than or equal to N;

taking the watermark spatial domain image as a first layer, and covering the first layer on a second layer corresponding to a high-frequency region in the first frequency domain image to obtain a second frequency domain image, which may include:

generating N watermark space domain images;

and covering N watermark space domain images on a second image layer corresponding to N high-frequency subregions in the first frequency domain image to obtain a second frequency domain image, wherein the high-frequency subregions and the watermark space domain images have one-to-one correspondence.

In this embodiment, the watermark processing apparatus may first acquire, based on the watermark position information, N high-frequency sub-regions belonging to a high-frequency region from the first frequency domain image, where the high-frequency region includes M high-frequency sub-regions. The watermark processing apparatus may further generate N watermark spatial domain images, for example, directly copy one watermark spatial domain image into N same watermark spatial domain images, and may further perform processing such as mirror image flipping or scale adjustment on the N watermark spatial domain images, which is not limited herein. And covering N watermark space domain images on second image layers corresponding to N high-frequency subregions in the first frequency domain image to obtain second frequency domain images, wherein the high-frequency subregions and the watermark space domain images have one-to-one correspondence, M is an integer larger than or equal to 1, and N is an integer larger than or equal to 1 and smaller than or equal to N.

For convenience of understanding, please refer to fig. 12, where fig. 12 is a schematic diagram of another embodiment of the method for watermarking in the embodiment of the present application, as shown in the drawing, the first frequency domain image D1 includes four high frequency sub-regions D11, D12, D13, and D14, and the embodiment takes the example that the watermark position information indicates that the watermark spatial domain image is the upper left side and the lower right side of the first frequency domain image as an example, based on the watermark position information, 2 high frequency sub-regions belonging to the high frequency region may be obtained from the first frequency domain image D1, which are respectively the high frequency sub-region D11 and the high frequency sub-region D14, and then 2 watermark spatial domain images may be generated, two of which may be the watermark spatial domain image D21 or may be obtained after the watermark spatial domain image D21 is rotated. For example, the watermark spatial domain image D22 is an image obtained by flipping the watermark spatial domain image D21 by 180 °, the watermark spatial domain image D23 is an image obtained by left-rotating the watermark spatial domain image D21 by 90 °, the watermark spatial domain image D21 is covered on the second image layer D11 corresponding to the corresponding high-frequency region, the watermark spatial domain image D23 is covered on the second image layer D14 corresponding to the corresponding high-frequency region, and then the second frequency domain image D3 including the watermark spatial domain image D22 and the watermark spatial domain image D23 is obtained.

In the embodiment of the present application, another second frequency domain image obtaining method is provided, in which a plurality of watermark spatial domain images may be added to a high frequency region in a frequency domain image in the above manner, and the plurality of watermark spatial domain images may be images with the same attribute information and similar directions. In addition, a plurality of watermark space domain images are added in the frequency domain image, so that the cracking and copying difficulty can be improved, and the safety of the embodiment of the application is improved.

Optionally, on the basis of the foregoing embodiments corresponding to fig. 4, in an optional embodiment of the watermarking method provided in this embodiment of the present application, the watermarking method may further include:

acquiring a binary file corresponding to the first frequency domain image;

generating data to be added according to the watermark position information and the watermark size information;

and adding the data to be added into the binary file to obtain a target binary file.

In this embodiment, the watermark processing apparatus may first obtain a binary file corresponding to the first frequency domain image, and the binary file may be analyzed to obtain a first original spatial domain image. And generating data to be added according to the watermark position information and the watermark size information, wherein the data to be added is binary information converted from the watermark position information and the watermark size information, and then adding the data to be added to the binary file to obtain a target binary file. Data to be added can be generated according to the watermark position information and the watermark size information, and then the data to be added is added to the binary file according to the data to be added, so that the target binary file is obtained. And generating data to be added only according to the watermark position information, and adding the data to be added to the binary file according to the data to be added, so as to obtain the target binary file.

In practical applications, data to be added is usually inserted into the beginning of the binary file, and the data at the beginning of the binary file may be overwritten. The purpose of generating the target binary file is that when the image or the video is analyzed, the data head of the target binary file can be read first, and the watermark size information and the watermark position information of the watermark space domain image are obtained. Therefore, the watermark size information and the watermark position information can be obtained, and the watermark airspace image can be accurately obtained.

In the embodiment of the application, a method for acquiring a target binary file is provided, and through the above manner, binary data to be added is generated through position information, so that the accuracy of a watermark position can be improved, and secondly, the target binary file is obtained by inserting the data to be added, so that the generation efficiency of the target binary file can be improved.

With reference to the above description, the following describes a method for processing media information in the present application, please refer to fig. 13, where fig. 13 is a schematic diagram of an embodiment of the method for processing media information in the embodiment of the present application, and as shown in the diagram, an embodiment of the method for processing media information in the embodiment of the present application includes:

201. acquiring a target airspace image, wherein the target airspace image is obtained after performing inverse Fourier transform processing on a second frequency domain image, the second frequency domain image is obtained after covering a watermark airspace image in a high-frequency region in a first frequency domain image based on watermark position information, the first frequency domain image is obtained after performing Fourier transform on an original airspace image, and the first frequency domain image comprises the high-frequency region;

in this embodiment, the media information processing device may acquire the target airspace image. Specifically, the spatial domain refers to a spatial domain where a two-dimensional plane of an image is located, and the spatial domain may also be referred to as an image space and is a space formed by image elements. The direct processing of pixel values in image space with length or distance as an argument is called spatial domain processing. The spatial domain may also be referred to as a pixel domain, and the processing in the spatial domain is processing at a pixel level, such as image superposition at a pixel level, and after fourier transformation of the spatial domain image, a frequency spectrum of the image, i.e., a frequency domain image, may be obtained, which may represent an energy gradient of the image. In this embodiment, the target airspace image is an image that is usually seen in visualization.

It should be noted that the media information processing apparatus may be disposed in a server or a terminal device, and this application is described by taking the case of being disposed in a server as an example, however, this should not be construed as limiting the application. The target airspace image may be an image received by the media information processing device through a wired network, or may be an image stored in the media information processing device itself.

202. Acquiring watermark position information corresponding to the watermark airspace image according to the target airspace image;

in this embodiment, after acquiring the target spatial domain image in step 201, the media information processing device may further acquire a watermark spatial domain image corresponding to the target spatial domain image, and thus may further acquire watermark position information corresponding to the watermark spatial domain image. The watermark position information is used to indicate the position of the watermark airspace image, for example, the watermark position information is used to indicate that the watermark airspace image is located at the lower left, upper right, or lower right of the target airspace image, which may be specifically represented as coordinate information, and the watermark position is determined by the abscissa and the ordinate. It should be understood that, in practical applications, the watermark location information may also be located in other areas in the target spatial domain image, and this application takes the watermark location information as the lower left of the target spatial domain image as an example, which should not be construed as a limitation to this application.

For convenience of understanding, referring to fig. 14, fig. 14 is a schematic diagram of another embodiment of the watermark location information in the embodiment of the present application, and as shown in the figure, the watermark location information may be located at the upper left of the target spatial domain image as indicated by F1, may also be located at the upper right of the target spatial domain image as indicated by F2, may also be located at the lower left of the target spatial domain image as indicated by F3, and may also be located at the lower right of the target spatial domain image as indicated by F4. In practical application, the target airspace image may be an arbitrary region at the edge.

203. Performing Fourier transform processing on the target airspace image to obtain a second frequency domain image;

in this embodiment, the media information processing apparatus may perform fourier transform processing on the target spatial domain image acquired in step 203 to obtain a second frequency domain image. In particular, the frequency domain may also be referred to as the frequency domain, i.e. any waveform may be decomposed into a sum of a plurality of sine waves, each sine wave having its own frequency and amplitude, so that any waveform signal has its own set of frequencies and amplitudes, and the frequency domain is a fourier transformed signal in the spatial domain.

204. And acquiring a watermark space domain image from the second frequency domain image based on the watermark position information.

In this embodiment, the media information processing apparatus may obtain a watermark spatial domain image from the second frequency domain image obtained in step 203 based on the watermark position information obtained in step 202. Specifically, the watermark position information indicates the region corresponding to the watermark spatial domain image, and the watermark information corresponds to the watermark spatial domain image one to one, and after the spatial domain image is converted into the frequency domain image, the corresponding region is not changed, so that the corresponding watermark spatial domain image can be directly determined by the watermark information.

In the embodiment of the present application, a method for processing media information is provided, and through the above manner, a watermark spatial domain image may be added to a high-frequency region in a frequency domain image, where the high-frequency region mainly represents a region with a steep image contour and color change in the image, so that covering the high-frequency region hardly affects the image, and thus, the digital carrier can be better in fidelity. Secondly, after the frequency domain image comprising the watermark space domain image is subjected to Fourier transform, the watermark space domain image can be directly obtained based on the watermark position information in the watermark space domain image, and the information of the watermark space domain image is complete, so that the authenticity and the reliability of media information processing are improved.

Optionally, on the basis of the embodiment corresponding to fig. 13, in a first optional embodiment of the method for processing media information provided in the embodiment of the present application, after acquiring the watermark spatial domain image from the second frequency domain image based on the watermark position information, the method for processing media information may further include:

performing Fourier transform processing on the watermark spatial domain image to obtain a watermark frequency domain image;

acquiring copyright information according to the watermark frequency domain image;

the method can also comprise the following steps:

and displaying the watermark space domain image and copyright information.

In this embodiment, the media information processing device may perform fourier transform processing on the watermark spatial domain image to obtain a watermark frequency domain image, and then obtain copyright information according to the watermark frequency domain image, and may also display the watermark spatial domain image and the copyright information.

For convenience of understanding, referring to fig. 15, fig. 15 is a schematic diagram of another embodiment of the method for processing media information according to the embodiment of the present application, as shown in the drawing, the media information processing device may obtain a target spatial domain image in step U1, and then obtain a watermark spatial domain image corresponding to the target spatial domain image in step U2, so that watermark position information corresponding to the watermark spatial domain image may also be obtained, perform fourier transform processing on the target spatial domain image obtained in step U2 in step U3 to obtain a second frequency domain image, and obtain the watermark spatial domain image from the second frequency domain image obtained in step U3 based on the watermark position information obtained in step U2 in step U4. Performing fourier transform processing on the watermark spatial domain image obtained in the step U2 in a step U5 to obtain a watermark frequency domain image, obtaining copyright information according to the watermark frequency domain image obtained in the step U5 in a step U6, and finally displaying the watermark spatial domain image and the copyright information obtained in the step U6 in a step U7.

In the embodiment of the application, a method for displaying watermark spatial domain images and copyright information is provided, and by the mode, since the non-spatial domain watermarks can prevent pirating and washing the watermarks, the watermark frequency domain images can completely reserve the copyright information of the images, so that the safety and the copyright protection of media information processing are improved.

Optionally, on the basis of the embodiment corresponding to fig. 13, in a first optional embodiment of the method for processing media information provided in the embodiment of the present application, after acquiring a watermark spatial domain image from a second frequency domain image based on watermark position information, a spatial domain of the media information processing further includes:

acquiring copyright information and frame rate information according to the watermark frequency domain image;

the method can also comprise the following steps:

displaying watermark space domain images and copyright information;

and playing the video corresponding to the target airspace image based on the frame rate information.

In this embodiment, when the watermark spatial domain image is an image obtained from a media video stream, the information processing apparatus may perform fourier transform processing on the watermark spatial domain image to obtain a watermark frequency domain image, then obtain copyright information and frame rate information according to the watermark frequency domain image, further display the watermark spatial domain image and the copyright information, and play a video corresponding to the target spatial domain image based on the frame rate information.

For easy understanding, referring to fig. 16, fig. 16 is a schematic diagram of another embodiment of the method for processing media information in the embodiment of the present application, and as shown in the figure, steps V1 to V4 of the media information processing apparatus may obtain the watermark spatial domain image by a method similar to the aforementioned steps U1 to U4. Further, in step V5, fourier transform processing is performed on the watermark spatial domain image obtained in step V2 to obtain a watermark frequency domain image, in step V6, copyright information and frame rate information are obtained according to the watermark frequency domain image obtained in step V5, then in step V7, the watermark spatial domain image and copyright information obtained in step V6 are displayed, and finally in step V8, a video corresponding to the target spatial domain image is played based on the frame rate information.

It should be noted that there is no chronological order between step V7 and step V5.

In the embodiment of the application, a method for playing a video is provided, and by the above manner, since the non-spatial domain watermark can prevent pirate watermark cleaning, the watermark frequency domain graph can completely retain the copyright information of the image, thereby improving the security of media information processing and the copyright protection. And secondly, the video corresponding to the target airspace image can be played based on the acquired frame rate information, and because the integrity of the frame rate information stored in the frequency domain is high, the playing consistency of the target airspace image in the video stream can be improved, one or two frames of the target airspace image can be played continuously, and the feasibility of media information processing is improved.

Referring to fig. 17, fig. 17 is a schematic diagram of an embodiment of a watermark processing apparatus in an embodiment of the present application, and as shown in the drawing, the watermark processing apparatus 300 includes:

an obtaining module 301, configured to obtain a watermark airspace image;

the obtaining module 301 is further configured to obtain watermark position information corresponding to the watermark airspace image;

the obtaining module 301 is further configured to obtain a first frequency domain image corresponding to the first original spatial domain image, where the first frequency domain image is obtained by performing fourier transform on the first original spatial domain image, and the first frequency domain image includes a high-frequency region;

a covering module 302, configured to cover the watermark spatial domain image in a high-frequency region in the first frequency domain image based on the watermark position information, to obtain a second frequency domain image;

and the transformation module 303 is configured to perform inverse fourier transform processing on the second frequency domain image to obtain a target airspace image.

Optionally, on the basis of the embodiment corresponding to fig. 17, in another embodiment of the watermark processing apparatus 300 provided in the embodiment of the present application, the watermark processing apparatus 300 further includes a scaling module 304 and a generating module 305,

an obtaining module 301, configured to obtain a first watermark image, copyright information, and watermark size information;

a scaling module 304, configured to perform scaling processing on the first watermark image based on the watermark size information to obtain a second watermark image;

a transform module 303, specifically configured to perform fourier transform processing on the second watermark image to obtain a first watermark frequency domain image;

a generating module 305, configured to generate a second watermark frequency domain image according to the first watermark frequency domain image and the copyright information;

the transform module 303 is specifically configured to perform inverse fourier transform processing on the second watermark frequency domain image to obtain a watermark spatial domain image.

Optionally, on the basis of the embodiment corresponding to fig. 17, in another embodiment of the watermark processing apparatus 300 provided in this embodiment of the present application,

a generating module 305, configured to generate binary information according to the copyright information;

or the like, or, alternatively,

an obtaining module 301, configured to obtain a first watermark image, copyright information, watermark size information, and frame rate information;

a scaling module 304, specifically configured to scale the first watermark image based on the watermark size information to obtain a second watermark image;

a generating module 305, configured to generate a second watermark frequency domain image according to the watermark frequency domain image, the copyright information, and the frame rate information;

a generating module 305, configured to generate binary information according to the copyright information and the frame rate information;

or the like, or, alternatively,

an obtaining module 301, specifically configured to obtain a first original airspace image and basic information corresponding to the first original airspace image;

the transform module 303 is specifically configured to perform fourier transform processing on the second original spatial domain image to obtain a first frequency domain image.

an obtaining module 301, specifically configured to obtain a first original airspace image;

Optionally, on the basis of the embodiment corresponding to fig. 17, in another embodiment of the watermark processing apparatus 300 provided in this embodiment, the watermark processing apparatus 300 further includes a determining module 306,

a determining module 306, configured to determine a high-frequency region in the first frequency-domain image based on the watermark location information;

the covering module 302 is specifically configured to cover the watermark spatial domain image as a first layer on a second layer corresponding to a high-frequency region in the first frequency domain image to obtain a second frequency domain image, where the first layer is on the second layer.

a determining module 306, configured to obtain N high-frequency sub-regions from the first frequency-domain image based on the watermark position information, where the N high-frequency sub-regions belong to a high-frequency region, the high-frequency region includes M high-frequency sub-regions, M is an integer greater than or equal to 1, and N is an integer greater than or equal to 1 and less than or equal to N;

a generating module 305, specifically configured to generate N watermark spatial domain images;

the covering module 302 is specifically configured to cover the N watermark spatial domain images as a first layer on a second layer corresponding to N high-frequency sub-regions in the first frequency domain image to obtain a second frequency domain image, where the high-frequency sub-regions and the watermark spatial domain images have a one-to-one correspondence relationship.

Optionally, on the basis of the embodiment corresponding to fig. 17, in another embodiment of the watermark processing apparatus 300 provided in the embodiment of the present application, the watermark processing apparatus 300 further includes an adding module 307,

the obtaining module 301 is further configured to obtain a binary file corresponding to the first frequency domain image;

the generating module 305 is further configured to generate data to be added according to the watermark position information and the watermark size information;

and an adding module 307, configured to add data to be added to the binary file to obtain a target binary file.

Referring to fig. 18, fig. 18 is a schematic diagram of an embodiment of a media information processing apparatus according to an embodiment of the present application, and as shown in the diagram, the media information processing apparatus 400 includes:

an obtaining module 401, configured to obtain a target spatial domain image, where the target spatial domain image is obtained by performing inverse fourier transform processing on a second frequency domain image, the second frequency domain image is obtained by covering a watermark spatial domain image in a high-frequency region in a first frequency domain image based on watermark position information, the first frequency domain image is obtained by performing fourier transform on an original spatial domain image, and the first frequency domain image includes the high-frequency region;

the obtaining module 401 is further configured to obtain watermark position information corresponding to the watermark airspace image according to the target airspace image;

a transform module 402, configured to perform fourier transform processing on the target spatial domain image to obtain a second frequency domain image;

the obtaining module 401 is further configured to obtain a watermark spatial domain image from the second frequency domain image based on the watermark position information.

Optionally, on the basis of the embodiment corresponding to fig. 18, in another embodiment of the watermark processing apparatus 400 provided in the embodiment of the present application, the watermark processing apparatus 300 further includes a presentation module 403,

the transformation 402 module is further configured to perform fourier transform processing on the watermark spatial domain image to obtain a watermark frequency domain image;

the obtaining module 401 is further configured to obtain copyright information according to the watermark frequency domain image;

and a display module 403, configured to display the watermark spatial domain image and the copyright information.

Optionally, on the basis of the embodiment corresponding to fig. 18, in another embodiment of the watermark processing apparatus 400 provided in this embodiment, the watermark processing apparatus 300 further includes a playing module 404,

the transform module 402 is further configured to perform fourier transform processing on the watermark spatial domain image to obtain a watermark frequency domain image;

the obtaining module 401 is further configured to obtain copyright information and frame rate information according to the watermark frequency domain image;

the display module 403 is further configured to display the watermark airspace image and copyright information;

the playing module 404 is configured to play a video corresponding to the target airspace image based on the frame rate information.

Take the example that the watermark processing device is disposed in the electronic device, and take the example that the media information processing device is disposed in the electronic device. The electronic device may be a server, please refer to fig. 19, fig. 19 is a schematic structural diagram of a server according to an embodiment of the present invention, and the server 500 may generate a relatively large difference due to different configurations or performances, and may include one or more Central Processing Units (CPUs) 522 (e.g., one or more processors) and a memory 532, and one or more storage media 530 (e.g., one or more mass storage devices) storing an application 542 or data 544. Memory 532 and storage media 530 may be, among other things, transient storage or persistent storage. The program stored on the storage medium 530 may include one or more modules (not shown), each of which may include a series of instruction operations for the server. Still further, the central processor 522 may be configured to communicate with the storage medium 530, and execute a series of instruction operations in the storage medium 530 on the server 500.

The Server 500 may also include one or more power supplies 526, one or more wired or wireless network interfaces 550, one or more input-output interfaces 558, and/or one or more operating systems 541, such as a Windows Server^TM，Mac OS X^TM，Unix^TM,Linux^TM，FreeBSD^TMAnd so on.

The steps performed by the server in the above embodiment may be based on the server configuration shown in fig. 19.

In the embodiment of the present application, the CPU 522 included in the server also has the following functions:

acquiring a watermark airspace image;

covering the watermark airspace image in the high-frequency area in the first frequency domain image based on the watermark position information to obtain a second frequency domain image;

and carrying out inverse Fourier transform processing on the second frequency domain image to obtain a target airspace image.

acquiring a target airspace image, wherein the target airspace image is obtained by performing inverse Fourier transform processing on a second frequency domain image, the second frequency domain image is obtained by covering a watermark airspace image in a high-frequency region in a first frequency domain image based on watermark position information, the first frequency domain image is obtained by performing Fourier transform on an original airspace image, and the first frequency domain image comprises the high-frequency region;

and acquiring the watermark space domain image from the second frequency domain image based on the watermark position information.

Take the example that the watermark processing device is disposed in the electronic device, and take the example that the media information processing device is disposed in the electronic device. The electronic device may be a terminal device, as shown in fig. 20, for convenience of description, only a portion related to the embodiment of the present application is shown, and details of the method are not disclosed, please refer to the method portion of the embodiment of the present application. The terminal device may be any terminal device including a mobile phone, a tablet computer, a Personal Digital Assistant (PDA), a Point of Sales (POS), a vehicle-mounted computer, and the like, taking the terminal device as the mobile phone as an example:

fig. 20 is a block diagram illustrating a partial structure of a mobile phone related to a terminal device provided in an embodiment of the present application. Referring to fig. 20, the handset includes: radio Frequency (RF) circuit 610, memory 620, input unit 630, display unit 640, sensor 650, audio circuit 660, wireless fidelity (WiFi) module 670, processor 680, and power supply 690. Those skilled in the art will appreciate that the handset configuration shown in fig. 20 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The following describes the components of the mobile phone in detail with reference to fig. 20:

the RF circuit 610 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, receives downlink information of a base station and then processes the received downlink information to the processor 680; in addition, the data for designing uplink is transmitted to the base station. In general, RF circuit 610 includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuitry 610 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), and the like.

The memory 620 may be used to store software programs and modules, and the processor 680 may execute various functional applications and data processing of the mobile phone by operating the software programs and modules stored in the memory 620. The memory 620 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, etc. Further, the memory 620 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 630 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone. Specifically, the input unit 630 may include a touch panel 631 and other input devices 632. The touch panel 631, also referred to as a touch screen, may collect touch operations of a user (e.g., operations of the user on the touch panel 631 or near the touch panel 631 by using any suitable object or accessory such as a finger or a stylus) thereon or nearby, and drive the corresponding connection device according to a preset program. Alternatively, the touch panel 631 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 680, and can receive and execute commands sent by the processor 680. In addition, the touch panel 631 may be implemented using various types, such as resistive, capacitive, infrared, and surface acoustic wave. The input unit 630 may include other input devices 632 in addition to the touch panel 631. In particular, other input devices 632 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 640 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 640 may include a display panel 641, and optionally, the display panel 641 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch panel 631 can cover the display panel 641, and when the touch panel 631 detects a touch operation thereon or nearby, the touch panel is transmitted to the processor 680 to determine the type of the touch event, and then the processor 680 provides a corresponding visual output on the display panel 641 according to the type of the touch event. Although the touch panel 631 and the display panel 641 are shown as two separate components in fig. 20 to implement the input and output functions of the mobile phone, in some embodiments, the touch panel 631 and the display panel 641 may be integrated to implement the input and output functions of the mobile phone.

The handset may also include at least one sensor 650, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display panel 641 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 641 and/or the backlight when the mobile phone is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.

Audio circuit 660, speaker 661, and microphone 662 can provide an audio interface between a user and a cell phone. The audio circuit 660 may transmit the electrical signal converted from the received audio data to the speaker 661, and convert the electrical signal into an audio signal through the speaker 661 for output; on the other hand, the microphone 662 converts the collected sound signals into electrical signals, which are received by the audio circuit 660 and converted into audio data, which are processed by the audio data output processor 680 and then transmitted via the RF circuit 610 to, for example, another cellular phone, or output to the memory 620 for further processing.

WiFi belongs to short-distance wireless transmission technology, and the mobile phone can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 670, and provides wireless broadband Internet access for the user. Although fig. 20 shows the WiFi module 670, it is understood that it does not belong to the essential constitution of the handset, and can be omitted entirely as needed within the scope not changing the essence of the invention.

The processor 680 is a control center of the mobile phone, and connects various parts of the entire mobile phone by using various interfaces and lines, and performs various functions of the mobile phone and processes data by operating or executing software programs and/or modules stored in the memory 620 and calling data stored in the memory 620, thereby performing overall monitoring of the mobile phone. Optionally, processor 680 may include one or more processing units; optionally, the processor 680 may integrate an application processor and a modem processor, wherein the application processor mainly handles operating systems, user interfaces, application programs, and the like, and the modem processor mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 680.

The handset also includes a power supply 690 (e.g., a battery) for powering the various components, optionally, the power supply may be logically connected to the processor 680 via a power management system, so that the power management system may be used to manage charging, discharging, and power consumption.

Although not shown, the mobile phone may further include a camera, a bluetooth module, etc., which are not described herein.

In this embodiment, the processor 680 included in the terminal device further has the following functions:

acquiring a watermark airspace image;

covering the watermark space domain image in the high-frequency region in the first frequency domain image based on the watermark position information to obtain a second frequency domain image;

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. A method of watermarking, comprising:

acquiring a watermark airspace image;

acquiring watermark position information corresponding to the watermark airspace image, wherein the watermark position information is used for indicating that the watermark airspace image is positioned at a position to be added with a watermark image;

performing inverse Fourier transform processing on the second frequency domain image to obtain a target airspace image;

based on the watermark position information, covering the watermark space domain image in the high-frequency region in the first frequency domain image to obtain a second frequency domain image, including:

acquiring N high-frequency sub-regions corresponding to watermark position information from a high-frequency region of the first frequency domain image based on the watermark position information, wherein the N high-frequency sub-regions belong to the high-frequency region, the high-frequency region comprises M high-frequency sub-regions, M is an integer greater than or equal to 1, and N is an integer greater than or equal to 1 and less than or equal to M;

generating N watermark space domain images;

and taking the N watermark space domain images as a first image layer to cover a second image layer corresponding to the N high-frequency subregions in the first frequency domain image to obtain a second frequency domain image, wherein the high-frequency subregions and the watermark space domain images have one-to-one correspondence relationship.

2. The method according to claim 1, wherein the obtaining the watermark spatial domain image comprises:

generating a second watermark frequency domain image according to the first watermark frequency domain image and the copyright information;

and performing inverse Fourier transform processing on the second watermark frequency domain image to obtain the watermark spatial domain image.

3. The method of claim 2, wherein generating a second watermark frequency domain image based on the watermark frequency domain image and the copyright information comprises:

generating binary information according to the copyright information;

replacing the most significant bit of the watermark frequency domain image with the binary information through a bit group BitSet function to obtain a second watermark frequency domain image;

or, the generating a second watermark frequency domain image according to the watermark frequency domain image and the copyright information includes:

generating binary information according to the copyright information;

and replacing the least significant bit of the watermark frequency domain image with the binary information through a BitSet function to obtain the second watermark frequency domain image.

4. The method according to claim 1, wherein the obtaining the watermark spatial domain image comprises:

5. The method of claim 4, wherein generating a second watermark frequency domain image based on the watermark frequency domain image, the copyright information, and the frame rate information comprises:

or, the generating a second watermark frequency domain image according to the watermark frequency domain image, the copyright information, and the frame rate information includes:

6. The method according to claim 1, wherein the obtaining the first frequency domain image corresponding to the first original spatial domain image comprises:

acquiring the first original airspace image and basic information corresponding to the first original airspace image;

and performing Fourier transform processing on the second original spatial domain image to obtain the first frequency domain image.

7. The method according to claim 1, wherein the obtaining the first frequency domain image corresponding to the first original spatial domain image comprises:

acquiring the first original airspace image;

and carrying out Fourier transform processing on the first original spatial domain image to obtain the first frequency domain image.

8. A method of media information processing, comprising:

acquiring a target airspace image, wherein the target airspace image is obtained after a second frequency domain image is subjected to inverse Fourier transform processing, the second frequency domain image is obtained after the watermark airspace image is covered in a high-frequency region in a first frequency domain image based on watermark position information, the first frequency domain image is obtained after an original airspace image is subjected to Fourier transform, the first frequency domain image comprises the high-frequency region, and the second frequency domain image obtaining process is as follows: acquiring N high-frequency sub-regions corresponding to watermark position information from a high-frequency region of the first frequency domain image based on the watermark position information, wherein the N high-frequency sub-regions belong to the high-frequency region, the high-frequency region comprises M high-frequency sub-regions, M is an integer greater than or equal to 1, and N is an integer greater than or equal to 1 and less than or equal to M; generating N watermark space domain images; covering the N watermark space domain images as a first image layer on a second image layer corresponding to the N high-frequency subregions in the first frequency domain image to obtain a second frequency domain image, wherein the high-frequency subregions and the watermark space domain images have one-to-one correspondence;

acquiring watermark position information corresponding to the watermark airspace image according to the target airspace image, wherein the watermark position information is used for indicating that the watermark airspace image is positioned at a position to be added with the watermark image;

and acquiring the watermark spatial domain image from the second frequency domain image based on the watermark position information.

9. The method according to claim 8, wherein after obtaining the watermark spatial domain image from the second frequency domain image based on the watermark location information, the method further comprises:

performing Fourier transform processing on the watermark space domain image to obtain a watermark frequency domain image;

the method further comprises the following steps:

and displaying the watermark airspace image and the copyright information.

10. The method according to claim 8, wherein after obtaining the watermark spatial domain image from the second frequency domain image based on the watermark location information, the method further comprises:

the method further comprises the following steps:

displaying the watermark airspace image and the copyright information;

11. A watermark processing apparatus, comprising:

the acquisition module is used for acquiring a watermark airspace image;

the acquisition module is further configured to acquire watermark position information corresponding to the watermark airspace image, where the watermark position information is used to indicate that the watermark airspace image is located at a position where a watermark image is to be added;

the acquisition module is further configured to acquire a first frequency domain image corresponding to a first original spatial domain image, where the first frequency domain image is obtained by performing fourier transform on the first original spatial domain image, and the first frequency domain image includes a high-frequency region;

the covering module is used for covering the watermark airspace image in the high-frequency area in the first frequency domain image based on the watermark position information to obtain a second frequency domain image;

the transformation module is used for carrying out inverse Fourier transform processing on the second frequency domain image to obtain a target airspace image;

wherein the overlay module is specifically configured to:

generating N watermark space domain images;

12. An electronic device, comprising: a memory, a transceiver, a processor, and a bus system;

wherein the memory is used for storing programs;

the processor is configured to execute the program in the memory, including performing the method of any of claims 1 to 7 above, or performing the method of any of claims 8 to 10 above;

13. A computer-readable storage medium comprising instructions which, when executed on a computer, cause the computer to perform the method of any one of claims 1 to 7 or the method of any one of claims 8 to 10.