KR100541500B1 - a Water-marking System of the Mobile Communication Network - Google Patents

Abstract

The present invention relates to a watermarking system in a mobile communication network which protects information by applying a watermarking system to a mobile communication terminal in a mobile communication network. The present invention relates to a personal computer for transmitting multimedia data received through a base station or a network in a mobile communication network; ; A watermarking system in a mobile communication network including a mobile communication terminal receiving multimedia data from the personal computer or the base station or producing multimedia data using various peripheral devices therein, wherein the mobile communication terminal is connected to the personal computer. A universal serial bus (USB) block for performing serial communication; A multimedia data block communicating with the base station and transmitting and receiving multimedia data; A watermark block for generating a watermark by converting an electronic serial number (ESN) of the mobile communication terminal into an image file; A moving picture expert group (MPEG) processor for watermarking the watermark generated from the watermark block by inserting the watermark into the multimedia data received through the USB block or the multimedia data block; And a memory for storing the multimedia data and the watermarked data, so that the author and distributor of the information can be tracked and verified without the intervention of an accredited certification authority, thereby preventing the problem of copyright protection, misuse, and abuse of information. I can solve it.

Description

Watermarking System in Mobile Communication Networks {a Water-marking System of the Mobile Communication Network}             

1 is a block diagram illustrating a water-marking system in a mobile communication network according to an exemplary embodiment of the present invention.

FIG. 2 illustrates an example of a format of a binary image file to be used as a watermark in FIG. 1; FIG.

FIG. 3 illustrates in this example the format of a binary image file to be used as a watermark in FIG.

FIG. 4 is a diagram illustrating an example of a character table for format conversion of an ESN (Electronic Serial Number) in FIG. 1; FIG.

FIG. 5 is a diagram showing the form of a character table for format conversion of an ESN in FIG. 1; FIG.

6 is a flowchart illustrating an operation of a watermarking system in a mobile communication network according to an exemplary embodiment of the present invention.

Explanation of symbols on the main parts of the drawings

100: Network 200: Personal Computer

201: Client

202: Water-making Tool Block

300: mobile communication terminal 400: base station

301: Universal Serial Bus Block

302: Moving Picture Experts Group (MPEG) Processor

303: watermark block 304: signal processing block

305: multimedia data block 306: microprocessor

307: camera / camcorder 308: LCD (Liquid Crystal Display)

309: Speaker 310: Memory

311 Mike

The present invention relates to a watermarking system in a mobile communication network, and more particularly, to a watermarking system in a mobile communication network in which a watermarking system is applied to a mobile communication terminal to protect information.

In general, in order to distribute copyrighted multimedia data (e.g., music, video and video files), the client transmits user information, multimedia information, and watermark information directly to the certification authority, and then obtains approval from the certification authority. In response to this, the watermarking multimedia data is watermarked using a watermarking tool provided by the certification authority, and the watermarked multimedia data is provided to the consumer using a network or a mobile communication terminal.

In addition, a general mobile communication terminal can increase the utilization of multimedia information by using peripheral devices (eg, cameras, camcorders, microphones, speakers, etc.), microprocessors, DSP processors, MPEG chips, etc., which have improved operation speed and performance. Is being developed.

However, there is a disadvantage in that illegal copying of multimedia data is made using these improved functions and distributed in the market. In addition, using the above-mentioned peripheral devices, the invasive multimedia of others has been produced and has been used commercially.

As described above, the conventional mobile communication terminal can only claim the user's ownership through the certification authority, and it is pointed out as a problem of the information society because illegal copying of information and production of invasive information of others can be easily performed.

SUMMARY OF THE INVENTION The present invention provides a watermarking system in a mobile communication network to protect information by applying a watermarking system to a mobile communication terminal in a mobile communication network.

In addition, the present invention is to perform the watermarking using a mobile communication terminal for information protection in the mobile communication network, to solve the problem of copyright protection and misuse and abuse of information, and to ensure that watermarking without intervention of the certification authority , Its purpose is.

In addition, the present invention applies watermarking to the codec of the mobile communication terminal in the mobile communication network, and by using the unique ESN of the mobile communication terminal as a watermark in the application, it is possible to identify the author and distributor of the information It aims to address copyright protection, misuse and abuse of information.

In addition, an object of the present invention is to insert the ESN of the mobile communication terminal as a watermark to track the person who took the picture when taking and storing the picture using the camera of the mobile communication terminal in the mobile communication network.

In addition, the present invention applies watermarking to the mobile communication terminal to solve the problem of misuse and abuse of information and copyright protection that may occur when using the mobile communication terminal in the mobile communication network, the mobile communication terminal when applying the watermarking By using its unique ESN as a watermark, it is possible to track and verify the author or provider of the information without the involvement of an accredited certification body.

delete

Watermarking system in a mobile communication network according to an embodiment of the present invention for achieving the above object is a personal computer for transmitting the multimedia data received through the base station or network in the mobile communication network; A watermarking system in a mobile communication network including a mobile communication terminal receiving multimedia data from the personal computer or the base station or producing multimedia data using various peripheral devices therein, wherein the mobile communication terminal is connected to the personal computer. A USB block for performing serial communication; A multimedia data block communicating with the base station and transmitting and receiving multimedia data; A watermark block for generating a watermark by converting the ESN of the mobile communication terminal into an image file; An MPEG processor for performing watermarking by inserting the watermark generated in the watermark block into multimedia data received through the USB block or the multimedia data block; And a memory for storing the multimedia data and the watermarked data.

Preferably, the watermark block selects a type of watermark according to the size of the multimedia data, and generates a watermark by replacing the ESN of the mobile communication terminal with a watermark character table according to the selected watermark type. It features.

Further preferably, the watermark block is characterized by defining a character position for the hexadecimal ESN and defining a character table to convert the hexadecimal ESN into a binary image file to use as a watermark.

delete

The present invention relates to the implementation of a watermarking system that does not require a certification authority, implements a watermarking system using a mobile communication terminal without the intervention of the certification authority, and binary the unique ESN of the mobile communication terminal at the time of watermarking By converting an image file (ie, a video file) into a watermark, it is possible to identify and track illegal users of multimedia information using a mobile communication terminal with watermarking. Accordingly, copyright protection and misuse and abuse of information Try to solve the problem. Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Watermarking system in a mobile communication network according to an embodiment of the present invention is implemented so that watermarking is applied to protect the multimedia data transmitted or received through the mobile communication terminal, the configuration is shown in Figure 1, It comprises a network 100, a personal computer 200, a mobile communication terminal 300, and a base station 400.

Here, the mobile communication terminal 300 is connected to the personal computer 200 and the base station 400 in order to transmit and receive data in a wired or wireless manner, and the personal computer 200 transmits data through the network 100. It is made to share.

The personal computer 200 transmits all the multimedia data received through the network 100 to the mobile communication terminal 300, and downloads an ESN from the mobile communication terminal 300 to obtain a binary image file (ie, It converts the image file into a watermark and performs watermarking.

In addition, the personal computer 200 includes a client 201 for performing communication with the network 100 and the mobile communication terminal 300 and an ESN downloaded through the client 201 as a binary image file. And a watermarking tool block 202 for converting and watermarking the multimedia data using the watermark.

The mobile communication terminal 300 receives the multimedia data from the personal computer 200 or the base station 400, or after producing the multimedia data using a variety of peripheral devices within the water, the received or produced multimedia data It inserts and stores the mark, and transmits its own ESN to the personal computer 200 when the personal computer 200 downloads the request.

The mobile communication terminal 300 includes a USB block 301 for performing serial communication with the personal computer 200, an MPEG processor 302 for encoding, decoding, and watermarking data; Watermark block 303 for generating a watermark, signal processing block 304 for digital signal processing, multimedia data block 305 for importing data to be used, and baseband operation and control A microprocessor 306, a camera / camcorder 307 as a peripheral device, an LCD 308 and a speaker 309, and a memory 310 for storing data.

Here, the MPEG processor 302 receives the multimedia data through the USB block 301 or receives the multimedia data generated by the peripheral device and generates the watermark block 303 in the frequency domain while performing the DCT. It inserts a watermark. The watermark block 303 converts the hexadecimal ESN into a binary image file (ie, an image file), which defines the character position of the ESN as shown in FIGS. 2 and 3 and defines the character positions of the ESN. It is defined as a character table as shown in the form.

The watermark used for watermarking is inserted into a binary image file in the form as shown in FIG. 2 or 3. In addition, the hexadecimal characters of the ESN as the corresponding watermark are transformed into a binary image file of the form shown in FIG. 4 or 5 during watermarking. Here, the size of the binary image file is as shown in FIG. 2 or 3.

In the watermarking system in a mobile communication network according to an embodiment of the present invention having the above-described configuration, the multimedia data (for example, an image file, a video file, a sound file, etc.) using the mobile communication terminal 300 There are three ways to apply watermarking.

First, all multimedia data originally downloaded from the personal computer 200 connected to the network 100 or the base station 400 at the request of the client 201 (ie, the network 100 or the base station 400). A method of inserting a watermark while storing all the multimedia data received through the memory in the memory 310 of the mobile communication terminal 300.

Secondly, multimedia data is produced using various peripheral devices (ie, camera / camcorder 307, LCD 308, and speaker 309) of the mobile communication terminal 300, and the corresponding multimedia data is produced. A method of inserting a watermark while storing the memory 310 is performed.

Thirdly, the mobile communication terminal 300 transmits (ie downloads) the ESN to the personal computer 200, and the mobile communication is performed in the watermarking tool block 202 provided in the personal computer 200. Receiving an ESN of the terminal 300 is converted to a binary image file to use as a watermark.

Then, the process of performing watermarking in the mobile communication terminal 300 will be described with reference to the flowchart of FIG. 6.

First, a user of the mobile communication terminal 300 inputs a password using a keypad provided in the mobile communication terminal 300 to perform a user authentication request to the corresponding mobile communication terminal 300, and then the corresponding mobile communication. Receiving a user authentication approval response from the terminal 300, the user is logged in (step S1), and if the multimedia function is selected in the corresponding login state, the multimedia function selection is detected (step S2). Allows you to perform an action.

At this time, when the multimedia function of the second step S2 is selected, data stored in the memory 310 is selected (step S3), or data download is performed using the personal computer 200 or the base station 400. Check whether it is selected (step S4).

Therefore, when the data stored in the third step S3 or the data download is selected in the fourth step S4, the user's ESN is used to prevent illegal copying and distribution of multimedia information. To proceed with the watermarking process.

Accordingly, it is determined whether to output the stored data or the downloaded data (step S5), wherein the downloaded data is data encoded in MPEG format.

Thus, in the case of outputting the data, after decoding the data in the MPEG processor 302 (step S6), the decoded data is output through the LCD 308 and the speaker 309 (step S7). .

When the multimedia function is selected in the second step S2, whether multimedia data generation using various peripheral devices (ie, the camera / camcorder 307 and the microphone 311) of the mobile communication terminal 300 is selected is selected. Check (step S8).

Therefore, in the case where multimedia data generation is selected in the eighth step S8, watermarking is performed using the user's ESN in order to solve the problem of copyright protection or misuse and misuse of information on copyright infringing works of others. Allow the process to proceed.

Accordingly, the signal processing block 304 performs digital signal processing (for example, data format conversion, etc.) on the generated multimedia data (step S9), and then displays the digital signal processed data on the LCD 308 and the like. It outputs through the speaker 309 (step S10).

At the same time, it is determined whether to store the data decoded in the sixth step S6 or the digital signal processed data in the ninth step S9 (step S11). The watermark type is selected according to the size of the multimedia data to be applied (step S12).

Then, the ESN of the mobile communication terminal 300 is replaced with the watermark character table as shown in FIG. 4 or 5 according to the type of the selected watermark to generate a watermark for tracking illegal users of the multimedia. (Step S13).

Here, the watermark is generated in the watermark block 303, which uses the only ESN of the mobile communication terminal 300.

The watermark block 303 converts the hexadecimal ESN into a binary value to use as a watermark. In this case, the watermarked data (hereinafter referred to as 'embedded data') is the signal processing block. When performing various digital signal processing operations (ie, filtering, size conversion, compression rate conversion, etc.) at 304, the corresponding watermark is partially destroyed, so that accurate user information cannot be extracted, so that the watermark block 303 Convert a hexadecimal ESN to a binary image file.

In this case, the binary image file is defined in two forms, a form of 15 * 20 pixels 321 as shown in FIG. 2 and a form of 30 * 40 pixels 322 as shown in FIG. 3. This is for selectively applying a watermark according to the size of multimedia data for applying watermarking.

When the size of the multimedia data to be applied to the watermarking is large, even if the watermark is inserted, the distorted portion cannot be visually distinguished from the original data, thereby satisfying the invisibility of watermarking. .

However, when the size of the multimedia data is small, that is, when a relatively large watermark is inserted into the small size of the multimedia data, the embedded data may cause a lot of distortion and become meaningless as the multimedia data. Since the invisibility of the mark may not be satisfied and the watermark may be artificially deleted by the illegal user, it is important to select the watermark type according to the size of the multimedia data to apply the watermarking.

For example, if the original data is larger than or equal to the VGA size (e.g., 640 * 480 pixels), use a file size as shown in Figure 3, whereas if it is smaller than the VGA size, the file size is Use the file size as shown.

When the digital signal processing in the signal processing block 304 is applied to the embedded data, a slight data loss occurs in the extracted watermark, thereby reducing the identification of the ESN, and thus the correction power of the extracted watermark. In order to improve identification and identification, the text positions of the ESN are defined as shown in FIGS. 2 and 3. In addition, the hexadecimal ESN is defined as a character table as shown in FIGS. 4 and 5, wherein the number of pixels of each character is 5 * 3 pixels 321 and 7 * 5 pixels 322, and the file of the original data is defined. Make sure to choose according to the size.

Then, the watermark generated in the thirteenth step S13 is inserted through the encoder of the MPEG processor 302, that is, the MPEG processor 302 inserts a watermark in the frequency domain while performing the DCT. (Step S14).

Meanwhile, it should be understood that the watermarking algorithm used in the watermarking system in the mobile communication network according to the above-described embodiments of the present invention is not limited to the above-described embodiment, and various general algorithms may be used.

In the watermarking system in a mobile communication network according to an embodiment of the present invention, in order to protect copyright of multimedia data created without using the mobile communication terminal 300, the water provided in the personal computer 200 is provided. In the marking tool block 202, the ESN of the mobile communication terminal 300 is downloaded, converted into a binary image file, and used as a watermark.

On the other hand, in order to extract the watermark after the watermark is used as watermarking as described above, the reverse process is performed on the algorithm used for the watermarking after selecting suspicious multimedia data. The marking algorithm is extracted to extract the watermark.

As described above, watermarking is applied to the codec of the mobile communication terminal in the mobile communication network according to the present invention, and by using the unique ESN of the mobile communication terminal as the watermark at the time of application, the author of the information and By tracking and verifying distributors, you can address the issue of copyright protection, misuse, and abuse of information.

Claims (5)

delete delete A personal computer for transmitting multimedia data received through a base station or a network in a mobile communication network; In the watermarking system in a mobile communication network comprising a mobile communication terminal for receiving multimedia data from the personal computer or the base station, or to produce the multimedia data using a variety of peripheral devices in itself, The mobile communication terminal includes a universal serial bus (USB) block for performing serial communication with the personal computer; A multimedia data block communicating with the base station and transmitting and receiving multimedia data; A watermark block for generating a watermark by converting an electronic serial number (ESN) of the mobile communication terminal into an image file; A moving picture expert group (MPEG) processor for watermarking the watermark generated from the watermark block by inserting the watermark into the multimedia data received through the USB block or the multimedia data block; And a memory for storing the multimedia data and the watermarked data. The method of claim 3, The watermark block selects a watermark type according to the size of the multimedia data, and generates a watermark by replacing the ESN of the mobile communication terminal with a watermark character table according to the selected watermark type. Watermarking system in communication network. The method of claim 4, wherein The watermark block is a watermarking system in a mobile communication network, characterized in that for defining the character position for the ESN of the hexadecimal number and the character table to convert the hexadecimal ESN to a binary image file to use as a watermark.

Images