KR100613981B1 - Method for Water-marking Multi-media data in Mobile Communication System - Google Patents

Abstract

The present invention relates to a method for watermarking multimedia data in a mobile communication system, wherein a user can select whether to insert a watermark into a multimedia data file received from a personal computer or generated by various peripheral devices in a mobile communication terminal. Process; Selecting a type of watermark according to the multimedia data size of the file when the user selects to insert a watermark; Replacing the ESN of the mobile communication terminal with a watermark character table according to the selected watermark type and converting the character table into binary image data to generate a watermark; And inserting the generated watermark into the multimedia data file through an encoder to perform watermarking, so that the author and distributor of the information can be tracked and verified without the intervention of an accredited certification authority. Not only can the copyright protection, misuse and abuse be solved, the time and economic losses are minimized, and the watermarking is selectively performed by the mobile communication terminal, thereby preventing the processing speed of the mobile communication terminal from being lowered.

Description

Method for watermarking multimedia data in mobile communication system {Method for Water-marking Multi-media data in Mobile Communication System}             

1 is a block diagram of a water-marking system for multimedia data according to an embodiment of the present invention.

2 and 3 illustrate exemplary binary image data formats to be used as watermarks in FIG. 1;

4 and 5 are exemplary diagrams of a character table form for format conversion of an ESN (Electronic Serial Number) in FIG. 1;

6 is a flowchart illustrating a multimedia data watermarking procedure in a mobile communication terminal according to an embodiment of the present invention.

7 is a flowchart illustrating a multimedia data watermarking procedure in a base station according to an embodiment of the present invention.

Explanation of symbols on the main parts of the drawings

100: Network 200: Personal Computer

201: Client

202: Water-making Tool Block

300: mobile communication terminal 301: USB (Universal Serial Bus) block

302: Moving Picture Experts Group (MPEG) Processor

303: watermark block 304: signal processing block

305: multimedia data block 306: microprocessor

307: camera / camcorder 308: LCD (Liquid Crystal Display)

309: Speaker 310: Memory

311: Mike 400: the base station

402: Watermarking Tool Block

The present invention relates to a method of watermarking multimedia data in a mobile communication system, and more particularly, to multimedia watermarking in a mobile communication system in which a mobile communication terminal or a base station selectively watermarks multimedia data using a binary image data as a watermark. It is about a method.

Generally, in order to distribute copyrighted multimedia data (e.g. music, video and video files, etc.), the client transmits user information, multimedia information, and watermark information directly to the certification authority, and then authorizes authorization from the certification authority. Watermarking the multimedia data using a watermarking tool provided by the certification authority, and provides the multimedia data with the watermark to the consumer using a network or a mobile communication terminal.

In addition, a general mobile communication terminal can increase the utilization of multimedia information by using peripheral devices (eg, cameras, camcorders, microphones, speakers, etc.), microprocessors, DSP processors, and MPEG chips that have improved performance and performance. Is being developed.

However, there is a disadvantage in that illegal copying of multimedia data is made using these improved functions and distributed in the market. In addition, using the above-mentioned peripheral devices, the invasive multimedia of others has been produced and has been used commercially.

As described above, the conventional mobile communication terminal can only claim the user's ownership through the certification authority, and it is pointed out as a problem of the information society because illegal copying of information and production of invasive information of others can be easily performed.

delete

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and an object thereof is to selectively watermark multimedia data using binary image data as a watermark in a mobile communication terminal or a base station of a mobile communication network.

Furthermore, another object of the present invention is not to insert a watermark when storing the file only in the mobile communication terminal itself, and when uploading the file to the outside, the unique ESN of the mobile communication terminal is converted into binary image data and converted into a watermark. Watermarking, but optionally the watermarking at the base station or personal PC to which the file is uploaded, so that the author or provider of the information can be tracked and verified, as well as time, The economic loss can be minimized and the processing speed of the mobile communication terminal is prevented from being lowered.

According to an embodiment of the present invention, a method for watermarking multimedia data in a mobile communication system includes a watermark on a multimedia data file received from a personal computer or generated by various peripheral devices in a mobile communication terminal. Allowing a user to select whether to insert a; Selecting a type of watermark according to the multimedia data size of the file when the user selects to insert a watermark; Replacing the ESN of the mobile communication terminal with a watermark character table according to the selected watermark type and converting the character table into binary image data to generate a watermark; And inserting the generated watermark into the multimedia data file through an encoder to perform watermarking.

In the method for watermarking multimedia data in a mobile communication system according to an embodiment of the present invention, after checking whether a watermark is inserted into a multimedia data file uploaded from the mobile communication terminal by a base station, Confirming whether to insert; When the user presets to apply watermark embedding, selecting a type of watermark according to the multimedia data size of the file; Replacing the ESN of the mobile communication terminal with a watermark character table according to the selected watermark type and converting the character table into binary image data to generate a watermark; The method may further include inserting the generated watermark into the multimedia data file through an encoder to perform watermarking.

delete

delete

Furthermore, the method for watermarking multimedia data in a mobile communication system according to an embodiment of the present invention includes: receiving a download request from a personal computer in the mobile communication terminal and transmitting its ESN to the personal computer; Confirming whether to insert a watermark into the multimedia data file generated by the personal computer; When the user presets to apply watermark embedding, selecting, by the personal computer, the type of watermark according to the multimedia data size of the file; Replacing the ESN received from the mobile communication terminal with a watermark character table according to the selected watermark type and converting the character table into binary image data to generate a watermark; The method may further include inserting the generated watermark into the multimedia data file through an encoder to perform watermarking.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a water-marking system for multimedia data according to an embodiment of the present invention.

Referring to FIG. 1, the watermarking system of the present embodiment includes a network 100, a personal computer 200, a mobile communication terminal 300, and a base station 400.

In this case, the mobile communication terminal 300 is connected to the personal computer 200 and the base station 400 in order to transmit and receive data in a wired or wireless manner, and the personal computer 200 transmits data through the network 100. It is made to share.

The personal computer 200 transmits all the multimedia data received through the network 100 to the mobile communication terminal 300, and downloads an ESN from the mobile communication terminal 300 to obtain binary image data (ie, Watermarking by converting the image data into a watermark.

In addition, the personal computer 200 includes a client 201 for performing communication with the network 100 and the mobile communication terminal 300 and an ESN downloaded through the client 201 as binary image data. And a watermarking tool block 202 for converting and watermarking the multimedia data using the watermark.

The mobile communication terminal 300 receives the multimedia data from the personal computer 200 or the base station 400, or after producing the multimedia data using a variety of peripheral devices within the water, the received or produced multimedia data Insert and store a mark, insert a watermark when uploading (ie, transmitting) multimedia data, and transmit its ESN to the personal computer 200 when the personal computer 200 requests a download. Do this.

The mobile communication terminal 300 includes a USB block 301 for performing serial communication with the personal computer 200, an MPEG processor 302 for encoding, decoding, and watermarking data; A watermark block 303 for generating a watermark, a signal processing block 304 for digital signal processing, a multimedia data block 305 for communicating with the base station 400 and retrieving data to be used; A microprocessor 306 for baseband operation and control, a camera / camcorder 307 as a peripheral device, an LCD 308 and speakers 309, and a memory 310 for storing data. It is done by

Here, the MPEG processor 302 receives the multimedia data through the USB block 301 or receives the multimedia data generated by the peripheral device and generates the watermark block 303 in the frequency domain while performing the DCT. It selectively inserts a watermark and plays a role of unconditionally inserting a watermark when uploading (ie, transmitting) multimedia data to the outside. The watermark block 303 converts the hexadecimal ESN into binary image data (ie, image data), which defines the character position of the ESN as shown in FIGS. 2 and 3 and defines the character positions of the ESN. It is defined as a character table as shown in the form.

The watermark used for watermarking is inserted into binary image data in a form as shown in FIG. 2 or 3. In addition, the hexadecimal characters of the ESN as the corresponding watermark are transformed into binary image data of the form shown in FIG. 4 or 5 during watermarking. Here, the size of the binary image data is as shown in FIG. 2 or 3.

The base station 400 includes a watermarking tool block 402, and receives a file uploaded from the mobile communication terminal 300 and transmits the file to a mobile communication network. Check whether the watermark is inserted in the watermark, and if the watermark is not inserted, perform watermarking through the watermarking tool block 402 using the ESN of the mobile communication terminal 300 which transmitted the file. do.

The watermarking tool block 402 converts the ESN of the mobile communication terminal 300 into binary image data and uses it as a watermark to watermark multimedia data.

In the method of watermarking multimedia data using a mobile communication terminal according to an embodiment of the present invention, watermarking multimedia data (eg, an image file, a video file, a sound file, etc.) using the mobile communication terminal 300. There are five ways to apply it.

First, all multimedia data originally downloaded from the personal computer 200 connected to the network 100 or the base station 400 at the request of the client 201 (ie, the network 100 or the base station 400). Watermark is inserted while all the multimedia data received through the) to be stored in the memory 310 of the mobile communication terminal (300).

Second, a watermark is inserted while uploading (ie, transmitting) multimedia data using the mobile communication terminal 300.

Third, multimedia data is produced using various peripheral devices (ie, camera / camcorder 307, LCD 308, and speaker 309) of the mobile communication terminal 300, and the corresponding multimedia data is produced. The watermark is inserted during the storage in the memory 310.

Fourth, the mobile communication terminal 300 transmits (ie, downloads) the ESN to the personal computer 200, and the mobile communication is performed in the watermarking tool block 202 provided in the personal computer 200. It receives a ESN of the terminal 300 and converts it into binary image data to insert a watermark.

Fifth, the mobile communication terminal 300 which transmits the multimedia data identified through the general call processing process in the base station 400, more specifically, the base station controller (not shown) constituting the base station 400; The ESN is converted into binary image data to insert a watermark.

6 is a flowchart illustrating a multimedia data watermarking procedure in a mobile communication terminal 300 according to an embodiment of the present invention.

Referring to FIG. 6, first, a user of the mobile communication terminal 300 inputs a password using a keypad provided in the corresponding mobile communication terminal 300 to perform a user authentication request to the corresponding mobile communication terminal 300. After receiving the user authentication approval response from the corresponding mobile communication terminal 300, the user is logged in (S601). When the multimedia function is selected in the login state, the multimedia function selection is detected ( S602) to perform the watermarking operation.

At this time, it is checked whether the data download using the personal computer 200 or the base station 400 is selected in step S602 (S603). If the data download is selected, the act of illegally copying the multimedia information to prevent unauthorized distribution For this purpose, watermarking is selectively performed using the user's ESN.

Accordingly, it is determined whether to output the downloaded data (S604), wherein the downloaded data is data encoded in MPEG format.

Then, in case of outputting the data, after decoding the data in the MPEG processor 302 (S605), the decoded data is output through the LCD 308 and the speaker 309 (S606).

When the multimedia function of S602 is selected, it is checked whether multimedia data generation using various peripheral devices (ie, camera / camcorder 307 and microphone 311) of the mobile communication terminal 300 is selected (S607). .

Thus, when the multimedia data generation is selected, watermarking is selectively performed using the ESN of the user in order to solve the problem of copyright protection of the author or misuse and abuse of information on the infringing work of others.

Accordingly, the signal processing block 304 performs digital signal processing (for example, data format conversion, etc.) on the generated multimedia data (S608), and then displays the digital signal processed data on the LCD 308 and the speaker. The output is through 309 (S609).

At the same time, it is determined whether to store the data decoded in S605 or the digital signal processed data in S608 (S610). At this time, if it is desired to store the data, it is checked whether to insert a watermark (S611).

That is, the MPEG processor 302 can selectively perform the watermark embedding, and by allowing the user to set whether to insert the watermark in advance, the watermarking operation is omitted in the case of data that does not require watermark embedding. Try to minimize unnecessary operations.

Then, if it is set in advance in S611 that the user applies the watermark embedding, the watermark type is selected according to the size of the multimedia data to apply the watermarking (S612).

The ESN of the mobile communication terminal 300 is replaced with a watermark character table as shown in FIG. 4 or 5 according to the type of the selected watermark to generate a watermark for tracking illegal users of multimedia. (S613).

Here, the watermark is generated in the watermark block 303, which uses the only ESN of the mobile terminal 300.

The watermark block 303 converts the hexadecimal ESN into a binary value (that is, binary image data) to be used as a watermark. In this case, the watermark-embedded data (hereinafter referred to as 'embedded data') The watermark is partially destroyed when performing various digital signal processing operations (ie, filtering, size conversion, compression ratio conversion, etc.) in the signal processing block 304, so that accurate user information cannot be extracted. The watermark block 303 converts the hexadecimal ESN into binary image data.

In this case, the binary image data is defined in two forms, a form of 15 * 20 pixels 321 as shown in FIG. 2 and a form of 30 * 40 pixels 322 as shown in FIG. 3. This is for selectively applying a watermark according to the size of multimedia data for applying watermarking.

When the size of the multimedia data to be applied to the watermarking is large, even if the watermark is inserted, the distorted portion cannot be visually distinguished from the original data, thereby satisfying the invisibility of watermarking. .

However, when the size of the multimedia data is small, that is, when a relatively large watermark is inserted in the small multimedia data, the embedded data may not be meaningful as multimedia data due to a lot of distortion. Since the invisibility of the watermark may not be satisfied and the watermark may be artificially deleted by the illegal user, it is important to select the watermark type according to the size of the multimedia data to apply the watermarking.

For example, if the original data is larger than or equal to the VGA size (e.g., 640 * 480 pixels), use a file size as shown in Figure 3, whereas if it is smaller than the VGA size, the file size is Use the file size as shown.

When the digital signal processing in the signal processing block 304 is applied to the embedded data, a slight data loss occurs in the extracted watermark, thereby reducing the identification of the ESN, and thus the correction power of the extracted watermark. In order to improve identification and identification, the text positions of the ESN are defined as shown in FIGS. 2 and 3. In addition, the hexadecimal ESN is defined as a character table as shown in FIGS. 4 and 5, wherein the number of pixels of each character is 5 * 3 pixels 321 and 7 * 5 pixels 322, and the file of the original data is defined. Make sure to choose according to the size.

Thereafter, the watermark generated in S613 is inserted through the encoder of the MPEG processor 302, that is, the MPEG processor 302 inserts a watermark in the frequency domain while performing the DCT (S614).

In this case, it is set in advance that the user does not apply the watermark embedding in S611, or after the watermark is inserted in S614, the file information is stored. In this case, the name of the file and the presence or absence of watermark embedding are recorded. The memory 310 is stored in the memory 310 (S615). Here, the information of the file is used to distinguish the presence or absence of a watermark when checking the file information when uploading the data.

On the other hand, to check whether the data upload was selected when the multimedia function of the S602 is selected (S616), when the data upload is selected, the problem of misuse and abuse of information on copyright protection of copyright or infringing works of others To do this, watermarking is selectively performed using the user's ESN.

Accordingly, when a user selects a file for uploading data from the memory 310, the user checks information of the selected file (S617) and checks whether a watermark is inserted (S618).

As a result of the inspection, if the watermark is inserted, the file is directly transmitted (S620). If the watermark is not inserted, it is checked whether or not the watermark is inserted (S619).

As a result of the check, if the user has previously set not to apply the watermark embedding, the file is directly transmitted (S620), and if the corresponding watermark embedding is set in advance, the size of the multimedia data to apply the watermarking. In step S621, a watermark type is selected.

According to the selected watermark type, the ESN of the mobile communication terminal 300 is replaced with a watermark character table as shown in FIG. 4 or 5 to convert the character table into binary image data to illegally use the multimedia. A watermark for tracing is generated (S622).

Thereafter, the generated watermark is inserted through the encoder of the MPEG processor 302, that is, after the MPEG processor 302 inserts the watermark in the frequency domain while performing the DCT (S623). The watermarked file is transmitted (S624).

7 is a flowchart illustrating a multimedia data watermarking procedure in a base station 400 according to an embodiment of the present invention.

Referring to FIG. 7, when a file uploaded from an arbitrary mobile communication terminal 300 is received (S701), the base station 400 checks file information of the received file and checks whether a watermark is inserted into the corresponding file. (S702).

As a result of the check, if the watermark is inserted into the file, the file is transmitted to the mobile communication network as it is (S706).

However, if the watermark is not embedded in the file, the watermarking process is unconditionally performed using the user's ESN to solve the problem of copyright protection or misuse and misuse of information on the infringing work of others. Proceed.

Accordingly, the watermarking tool block 402 selects a watermark type according to the size of the multimedia data in order to apply watermarking (S703).

Then, the watermark is generated by replacing the ESN of the mobile communication terminal 300 with the watermark character table as shown in FIG. 4 or 5 according to the type of the selected watermark (S704).

Thereafter, the generated watermark is inserted into the multimedia data (S705) and the corresponding watermarked file is transmitted to the mobile communication network (S706).

Meanwhile, the watermarking algorithm of the present invention is not limited to the above-described embodiment, and various general algorithms may be used.

In the method for watermarking multimedia data in a mobile communication terminal according to an embodiment of the present invention, in order to protect copyright of multimedia data created without using the mobile communication terminal 300, the personal computer 200 is provided in the personal computer 200. In the watermarking tool block 202, the ESN of the mobile communication terminal 300 is downloaded, converted into binary image data, and used as a watermark.

On the other hand, in order to extract the watermark after the watermark is used as watermarking as described above, the reverse process is performed on the algorithm used for the watermarking after selecting suspicious multimedia data. A marking algorithm is performed to extract the watermark.

After the watermark is extracted through the inverse watermarking algorithm as described above, it is possible to confirm whether normal watermarking is performed by comparing the extracted watermark with the ESN.

As described above, according to the present invention, watermarking is selectively applied to a mobile communication terminal or a base station in a mobile communication network. There is an effect to minimize the economic loss, and to prevent the processing speed of the mobile communication terminal.

Claims (5)

Allowing a user to select whether to insert a watermark in a multimedia data file received from a personal computer or generated by various peripheral devices in a mobile communication terminal; Selecting a type of watermark according to the multimedia data size of the file when the user selects to insert a watermark; Replacing the ESN of the mobile communication terminal with a watermark character table according to the selected watermark type and converting the character table into binary image data to generate a watermark; And inserting the generated watermark into the multimedia data through an encoder to perform watermarking. The method of claim 1, Confirming whether a watermark is inserted in the multimedia data file uploaded from the mobile communication terminal by the base station, and if not, inserting a watermark; When the user presets to apply watermark embedding, selecting a type of watermark according to the multimedia data size of the file; Replacing the ESN of the mobile communication terminal with a watermark character table according to the selected watermark type and converting the character table into binary image data to generate a watermark; And inserting the generated watermark into the multimedia data file through an encoder to perform watermarking. delete delete The method of claim 1, Receiving a download request from a personal computer at the mobile communication terminal and transmitting its ESN to the personal computer; Confirming whether to insert a watermark into the multimedia data file generated by the personal computer; When the user presets to apply watermark embedding, selecting, by the personal computer, the type of watermark according to the multimedia data size of the file; Replacing the ESN received from the mobile communication terminal with a watermark character table according to the selected watermark type and converting the character table into binary image data to generate a watermark; And inserting the generated watermark into a multimedia data file through an encoder to perform watermarking.

Images